• Search Cornell

VRC Home
Approach
Tool Box
About

Web Tool Resources

Latest Update, February 16, 2004

Jump down to:
Link Checkers | Web Crawlers | Site Mapping | Change Detection | HTML Validators |
Site Monitors | Site Management | Other

General list of tools

• Web Site Test Tools and Site Management Tools
  www.softwareqatest.com/qatweb1.html
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of a multitude of software tools loosely grouped into 12 web testing and web site management categories. Tool descriptions were taken from the tools' vendors web sites.
• How can World Wide Web sites be tested?
  www.softwareqatest.com/qatfaq2.html#FAQ2_18
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower This section of the FAQ bullets several factors to consider when performing web testing.
• "Beyond Broken Links," By Rick Hower, Internet Systems, July 1997.
  www.dbmsmag.com/9707I03.html
  This article addresses several facets of testing database-driven web sites including: risk analysis, performance testing, communication variations, and security. An overview of testing tools available (at least at the time that the article was written) is provided. Links to several online informational resources are also provided.
• Keynote Resource Library
  www.keynote.com/resources/resource_library.html
  This page is the resource page for a vendor of "enterprise monitoring solutions for large e-commerce sites." The library includes white papers, articles, and reports, as well as documents promoting the vendor's services.
• Google Site Management Directory
  directory.google.com/Top/Computers/Software/Internet/Site_Management/
  Google, a popular Web search engine, organizes the Web by topic into categories. The "Site Management" category presents links to software vendors and other Web resources in many subcategories such as link management, site monitoring, and HTML validators.
• World Wide Web and HTML Tools
  www.w3.org/Tools/
  This archived page (apparently last updated 2/2002) lists mostly HTML generating, authoring and editing tools, but also includes some HTML validators and link checkers.
• Evaluation, Repair, and Transformation Tools for Web Content Accessibility
  www.w3.org/WAI/ER/existingtools.html
  This page lists links to and brief descriptions of a number of tools useful for "Web content developers and Web users who wish to make the Web more accessible."

Link Checker

• LinkScan
  www.elsop.com/wrc/comp_ls.htm
  This page of the commercial site for LinkScan, a link validation product, provides a list of links to other link checking products for comparison shopping purposes.
• Google Link Management Directory
  directory.google.com/Top/Computers/Software/Internet/Site_Management/Link_Management/
  Google, a popular Web search engine, organizes the Web by topic into categories. The "Link Management" category presents links to software vendors and other Web resources in subcategories such as bookmark managers, link popularity, and online tools.
• Link Checking Tools
  www.softwareqatest.com/qatweb1.html#LINK
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of several web tools for link checking.
• Free On-the-Web HTML Validators and Link Checkers
  www.softwareqatest.com/qatweb1.html#FREE
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of a several web tools for link checking.

Web Crawler

• The Web Robots Database
  www.robotstxt.org/wc/active/html/
  This site provides an out-of-date database of robots, with descriptions and contact details.
  
• Robot Source Code
  www.searchtools.com/robots/robot-code.html
  This page lists links to articles and tutorials about creating web robots, as well as links to open-source code in a variety of programming languages.
• Crawlers, Robots, and Spiders
  dir.yahoo.com/Computers_and_Internet/Internet/World_Wide_Web/Searching_the_Web/Crawlers__Robots__and_Spiders/
  Yahoo's directory of Web sites dedicated to web robots and related utilities.
• Web Capture Tools
  www-personal.si.umich.edu/~calz/ermlinks/cap_web.htm
  This page provides links to web capture tools and is a part of a larger topical directory of resources related to electronic record keeping maintained by Cal Lee at the University of Michigan, School of Information Science.
• "Distributed High-performance Web Crawlers"
  www.cs.ucsd.edu/~dboswell/PastWork/WebCrawlingSurvey.pdf
  "Distributed high-performance web crawlers: A survey of the state of the art," by Dustin Boswell, December 10, 2003. This article presents an overview of web crawler design and compares several major distributed web crawling systems.

Site Mapping and Visualization Programs

• Information Architects Wiki: SiteMaps
  iawiki.net/action=browse&id=SiteMap&oldid=SiteMaps
  This page, located on the Information Architects Wiki, provides a forum for discussion of site mapping, as well as links to tools, articles and other site mapping resources.
• An Atlas of Cyberspace
  www.cybergeography.org/atlas/web_sites.html
  Part of a collection "of maps and graphic representations of the geographies of the new electronic territories of the Internet, the World-Wide Web and other emerging Cyberspaces."
• Map of the Month
  mappa.mundi.net/maps/
  “A look at the geography of cyberspace and how researchers help define our perception of virtual spaces.”
• "Visualizing Web Site Comparisons"
  www2002.org/CDROM/refereed/571/
  Liu, Bing, Kaidi Zhao and Lan Yi, "Visualizing Web Site Comparisons," WWW 2002, May 7-11, 2002, Honolulu, Hawaii, USA. This paper, presented in the Eleventh International World Wide Web Conference proceedings, discusses a visualization technique designed to find similarities and differences between different Web sites.
• "Three Dimensional Visualization of the World Wide Web"
  www.cs.nott.ac.uk/~dfb/Publications/Download/1999/Benford99.pdf
  Benford, Steve, Ian Taylor, David Brailsford, Boriana Koleva, Mike Craven, Mike Fraser, Gail Reynard, and Chris Greenhalgh, "Three Dimensional Visualization of the World Wide Web," ACM Computing Surveys, Vol. 31, Number 4es, December 1999, pp.1-16. This paper presents and discusses numerous examples of 3-D visualizations of the World Wide Web.

Change Detection

• "Do I Detect A Change?"
  www.libraryjournal.com/index.asp?layout=article&articleid=CA251668
  Bell, Steven J., "Do I detect a change?" Library Journal Net Connect, Oct. 15, 2002. This article presents a brief overview of the utility of change detection applications from a library science perspective.
• Web Detection Services
  staff.philau.edu/bells/keepup/detectit.htm
  Steven Bell's "Keeping Up" Web Site, this page discusses the utility of Web Page Change Detection Services and reviews several available services.
• "Tracking The Net"
  www.freepint.com/issues/131201.htm#tips
  Garside, John, "Tracking The Net," Free Pint, Number 102, Dec. 13, 2001. This article discusses several types of Web site tracking applications including change detection, monitoring, and clipping software and services.
• Change Detection Bibliography
  www.cc.gatech.edu/~buttler/bib/auto/webcq.html
  A bibliography of articles related to change detection and monitoring maintained by David Buttler, Georgia Institute of Technology.
• "ChangeDetector™: A Site-Level Monitoring Tool for the WWW."
  www2002.org/CDROM/refereed/458/
  Boyapati, Vijay, Kristie Chevrier, Avi Finkel, Natalie Glance, Tom Pierce, Robert Stockton, Chip Whitmer, "ChangeDetector™: A Site-Level Monitoring Tool for the WWW."
  This paper, presented in the Eleventh International World Wide Web Conference proceedings, discusses a prototype software system for monitoring entire Web sites with selective change detection features.

HTML Validator

• Google HTML Validator Directory
  directory.google.com/Top/Computers/Software/Internet/Authoring/HTML/Validators_and_Lints
  Google, a popular Web search engine, organizes the Web by topic into categories. The "HTML Validator" category presents links to software vendors and other Web resources for HTML validators and lint software.
• HTML Validators
  www.softwareqatest.com/qatweb1.html#VALIDATE
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions several web tools for HTML validation.
• Free On-the-Web HTML Validators and Link Checkers
  www.softwareqatest.com/qatweb1.html#FREE
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of several web tools for link checking.
• PERL and C Programs for Validating and Checking
  www.softwareqatest.com/qatweb1.html#PERL
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of source code, scripts and programs written in PERL and C languages.
• HTML & LINK VALIDATORS
  www.extremetech.com/resource_center/0,1598,s=1871,00.asp
  This resource page describes and links to various HTML validating and link checking software.

Web Site Monitor

• Google Web Site Monitor Directory
  directory.google.com/Top/Computers/Software/Internet/Site_Management/Monitoring/
  Google, a popular Web search engine, organizes the Web by topic into categories. The "Monitoring" category presents links to software vendors and other Web resources for Web site monitoring.
• "Early Warning"
  www.pcmag.com/article2/0,1759,119219,00.asp
  Sarrel, Matthew D., "Early Warning," PC Magazine, v.20 no. 21 (December 11, 2001) p. 159+.
  This article includes reviews of AlertSite, FarSight, Global SiteSeer Plus, SiteAngel, and Web Site Perspective.

Site Management

• External Site Monitoring Services
  www.softwareqatest.com/qatweb1.html#MONITORING
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of several web tools for Web site monitoring services.
• Google Site Management Directory
  directory.google.com/Top/Computers/Software/Internet/Site_Management/
  Google, a popular Web search engine, organizes the Web by topic into categories. The "Site Management" category presents links to software vendors and other Web resources in many subcategories such as link management, site monitoring, and HTML validators.

Others

• Log Analysis and Other Web Test Tools
  www.softwareqatest.com/qatweb1.html#LOG
  This link will take you to part of an extensive software testing FAQ, "Software QA and Testing Resource Center," written and maintained by Rick Hower. This section of the FAQ provides links to and very brief descriptions of software for log analysis tools. Descriptions of "other" web tools follow the log analysis category.
• Google Log Analysis Directory
  directory.google.com/Top/Computers/Software/Internet/Site_Management/Log_Analysis/
  Google, a popular Web search engine, organizes the Web by topic into categories. The "Log Analysis" category presents links to software vendors and other Web resources for log analysis tasks such as generating hit counts, page statistics, and user patterns.
• "Analyze This!"
  www.pcmag.com/article2/0,1759,89963,00.asp
  Bannan, Karen J., "Analyze This!" PC Magazine, v.20, no.20 (November 27, 2001) p. 133+.
  This article includes reviews of Funnel Web Analyzer 4.0, Nettracker 5.0 Enterprise, 123LogAnalyzer, Sawmill 6, and Webtrends Log Analyzer 7.0.