Web Tool Resources
Latest Update, February 16, 2004
Jump down to:
Link Checkers | Web Crawlers
| Site Mapping | Change Detection
| HTML Validators |
Site Monitors | Site Management
| Other
General list of tools
- Web Site Test Tools and Site Management Tools
www.softwareqatest.com/qatweb1.html
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of a multitude of software tools loosely grouped into 12 web testing and web site management categories. Tool descriptions were taken from the tools' vendors web sites. - How can World
Wide Web sites be tested?
www.softwareqatest.com/qatfaq2.html#FAQ2_18
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower This section of the FAQ bullets several factors to consider when performing web testing. - "Beyond Broken Links,"
By Rick Hower, Internet Systems, July 1997.
www.dbmsmag.com/9707I03.html
This article addresses several facets of testing database-driven web sites including: risk analysis, performance testing, communication variations, and security. An overview of testing tools available (at least at the time that the article was written) is provided. Links to several online informational resources are also provided. - Keynote
Resource Library
www.keynote.com/resources/resource_library.html
This page is the resource page for a vendor of "enterprise monitoring solutions for large e-commerce sites." The library includes white papers, articles, and reports, as well as documents promoting the vendor's services. - Google Site Management Directory
directory.google.com/Top/Computers/Software/Internet/Site_Management/
Google, a popular Web search engine, organizes the Web by topic into categories. The "Site Management" category presents links to software vendors and other Web resources in many subcategories such as link management, site monitoring, and HTML validators. - World Wide Web and HTML Tools
www.w3.org/Tools/
This archived page (apparently last updated 2/2002) lists mostly HTML generating, authoring and editing tools, but also includes some HTML validators and link checkers. - Evaluation, Repair, and Transformation Tools for Web Content Accessibility
www.w3.org/WAI/ER/existingtools.html
This page lists links to and brief descriptions of a number of tools useful for "Web content developers and Web users who wish to make the Web more accessible."
Link Checker
- LinkScan
www.elsop.com/wrc/comp_ls.htm
This page of the commercial site for LinkScan, a link validation product, provides a list of links to other link checking products for comparison shopping purposes. - Google
Link Management Directory
directory.google.com/Top/Computers/Software/Internet/Site_Management/Link_Management/
Google, a popular Web search engine, organizes the Web by topic into categories. The "Link Management" category presents links to software vendors and other Web resources in subcategories such as bookmark managers, link popularity, and online tools. - Link Checking Tools
www.softwareqatest.com/qatweb1.html#LINK
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of several web tools for link checking. - Free On-the-Web HTML Validators and Link Checkers
www.softwareqatest.com/qatweb1.html#FREE
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of a several web tools for link checking.
Web Crawler
- The Web Robots Database
www.robotstxt.org/wc/active/html/
This site provides an out-of-date database of robots, with descriptions and contact details. - Robot Source Code
www.searchtools.com/robots/robot-code.html
This page lists links to articles and tutorials about creating web robots, as well as links to open-source code in a variety of programming languages. - Crawlers, Robots, and Spiders
dir.yahoo.com/Computers_and_Internet/Internet/World_Wide_Web/Searching_the_Web/Crawlers__Robots__and_Spiders/
Yahoo's directory of Web sites dedicated to web robots and related utilities. - Web Capture Tools
www-personal.si.umich.edu/~calz/ermlinks/cap_web.htm
This page provides links to web capture tools and is a part of a larger topical directory of resources related to electronic record keeping maintained by Cal Lee at the University of Michigan, School of Information Science. - "Distributed High-performance Web Crawlers"
www.cs.ucsd.edu/~dboswell/PastWork/WebCrawlingSurvey.pdf
"Distributed high-performance web crawlers: A survey of the state of the art," by Dustin Boswell, December 10, 2003. This article presents an overview of web crawler design and compares several major distributed web crawling systems.
Site Mapping and Visualization Programs
- Information
Architects Wiki: SiteMaps
iawiki.net/action=browse&id=SiteMap&oldid=SiteMaps
This page, located on the Information Architects Wiki, provides a forum for discussion of site mapping, as well as links to tools, articles and other site mapping resources. - An Atlas
of Cyberspace
www.cybergeography.org/atlas/web_sites.html
Part of a collection "of maps and graphic representations of the geographies of the new electronic territories of the Internet, the World-Wide Web and other emerging Cyberspaces." - Map of the Month
mappa.mundi.net/maps/
“A look at the geography of cyberspace and how researchers help define our perception of virtual spaces.” - "Visualizing Web
Site Comparisons"
www2002.org/CDROM/refereed/571/
Liu, Bing, Kaidi Zhao and Lan Yi, "Visualizing Web Site Comparisons," WWW 2002, May 7-11, 2002, Honolulu, Hawaii, USA. This paper, presented in the Eleventh International World Wide Web Conference proceedings, discusses a visualization technique designed to find similarities and differences between different Web sites. - "Three
Dimensional Visualization of the World Wide Web"
www.cs.nott.ac.uk/~dfb/Publications/Download/1999/Benford99.pdf
Benford, Steve, Ian Taylor, David Brailsford, Boriana Koleva, Mike Craven, Mike Fraser, Gail Reynard, and Chris Greenhalgh, "Three Dimensional Visualization of the World Wide Web," ACM Computing Surveys, Vol. 31, Number 4es, December 1999, pp.1-16. This paper presents and discusses numerous examples of 3-D visualizations of the World Wide Web.
Change Detection
- "Do I Detect A Change?"
www.libraryjournal.com/index.asp?layout=article&articleid=CA251668
Bell, Steven J., "Do I detect a change?" Library Journal Net Connect, Oct. 15, 2002. This article presents a brief overview of the utility of change detection applications from a library science perspective. - Web Detection Services
staff.philau.edu/bells/keepup/detectit.htm
Steven Bell's "Keeping Up" Web Site, this page discusses the utility of Web Page Change Detection Services and reviews several available services. - "Tracking The Net"
www.freepint.com/issues/131201.htm#tips
Garside, John, "Tracking The Net," Free Pint, Number 102, Dec. 13, 2001. This article discusses several types of Web site tracking applications including change detection, monitoring, and clipping software and services. - Change
Detection Bibliography
www.cc.gatech.edu/~buttler/bib/auto/webcq.html
A bibliography of articles related to change detection and monitoring maintained by David Buttler, Georgia Institute of Technology. - "ChangeDetector™:
A Site-Level Monitoring Tool for the WWW."
www2002.org/CDROM/refereed/458/
Boyapati, Vijay, Kristie Chevrier, Avi Finkel, Natalie Glance, Tom Pierce, Robert Stockton, Chip Whitmer, "ChangeDetector™: A Site-Level Monitoring Tool for the WWW."
This paper, presented in the Eleventh International World Wide Web Conference proceedings, discusses a prototype software system for monitoring entire Web sites with selective change detection features.
HTML Validator
- Google
HTML Validator Directory
directory.google.com/Top/Computers/Software/Internet/Authoring/HTML/Validators_and_Lints
Google, a popular Web search engine, organizes the Web by topic into categories. The "HTML Validator" category presents links to software vendors and other Web resources for HTML validators and lint software. - HTML Validators
www.softwareqatest.com/qatweb1.html#VALIDATE
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions several web tools for HTML validation. - Free On-the-Web
HTML Validators and Link Checkers
www.softwareqatest.com/qatweb1.html#FREE
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of several web tools for link checking. - PERL and C
Programs for Validating and Checking
www.softwareqatest.com/qatweb1.html#PERL
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of source code, scripts and programs written in PERL and C languages. - HTML & LINK VALIDATORS
www.extremetech.com/resource_center/0,1598,s=1871,00.asp
This resource page describes and links to various HTML validating and link checking software.
Web Site Monitor
- Google
Web Site Monitor Directory
directory.google.com/Top/Computers/Software/Internet/Site_Management/Monitoring/
Google, a popular Web search engine, organizes the Web by topic into categories. The "Monitoring" category presents links to software vendors and other Web resources for Web site monitoring. - "Early
Warning"
www.pcmag.com/article2/0,1759,119219,00.asp
Sarrel, Matthew D., "Early Warning," PC Magazine, v.20 no. 21 (December 11, 2001) p. 159+.
This article includes reviews of AlertSite, FarSight, Global SiteSeer Plus, SiteAngel, and Web Site Perspective.
Site Management
- External Site Monitoring Services
www.softwareqatest.com/qatweb1.html#MONITORING
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of several web tools for Web site monitoring services. - Google Site Management Directory
directory.google.com/Top/Computers/Software/Internet/Site_Management/
Google, a popular Web search engine, organizes the Web by topic into categories. The "Site Management" category presents links to software vendors and other Web resources in many subcategories such as link management, site monitoring, and HTML validators.
Others
- Log Analysis
and Other Web Test Tools
www.softwareqatest.com/qatweb1.html#LOG
This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of software for log analysis tools. Descriptions of "other" web tools follow the log analysis category. - Google
Log Analysis Directory
directory.google.com/Top/Computers/Software/Internet/Site_Management/Log_Analysis/
Google, a popular Web search engine, organizes the Web by topic into categories. The "Log Analysis" category presents links to software vendors and other Web resources for log analysis tasks such as generating hit counts, page statistics, and user patterns. - "Analyze This!"
www.pcmag.com/article2/0,1759,89963,00.asp
Bannan, Karen J., "Analyze This!" PC Magazine, v.20, no.20 (November 27, 2001) p. 133+.
This article includes reviews of Funnel Web Analyzer 4.0, Nettracker 5.0 Enterprise, 123LogAnalyzer, Sawmill 6, and Webtrends Log Analyzer 7.0.
