Software Map

Delicious Link Checker downloads your del.icio.us bookmarks, checks each
one to ensure it's still valid, and prints a report showing all broken
or expired links.

WebVal is a system that will scan documents for
fully-qualified HTTP URLs, keeping its database
fresh with newly-seen URLs. It can then be
requested to validate the URLs, whereby it will
attempt to access each URL via an HTTP request and
record the response code; it maintains a list of
the most recent codes that have been retrieved.
Response codes are classified as "good" (URL is
correct and a valid page is there) and "bad" (URL
is invalid or outdated). By default any code
other than a 2xx code is considered bad, but this
can be changed (e.g. to ignore 3xx redirection
codes). WebVal can then be used in report mode
where it will scan documents for URLs as before,
but will report invalid URLs (that is, URLs in
the database which have a number of "bad" codes
exceeding a certain threshold). These are then
printed to stderr in a format that shows the file
and line number the URLs were seen in so that
they can be corrected.

HTML-Tree is a Perl program that recursively decends directories, and creates a web-page based graphical map of HTML pages on a webserver. A configuration file provides control over the "root" directory for the map, map page title and header, directories to be excluded, link substitution strings, and map page background image. This mapper may be run as a cron task to provide an up-to-date roadmap of a webserver. It is primarily useful as a web site development and administration tool, since it shows all pages available to web browsers, and can identify where links are needed.

Flinch is a powerful and flexible Web link checker that will make your life as a Web designer or Web server admin easier. It can be used to check all the external links on your Web pages periodically and produce HTML reports of its findings. If a Web resource at the end of a link has not been reachable for a few days, Flinch can send you an email.

GippleDee is a DMOZ-style Web-based link directory
application. GippleDee is the continuation of the
PHP Link Directory v2.1.2 GPL codebase (which is
now developed under a proprietary license for the
3.x family).

RLC is a tool that performs reciprocal link
checking automatically. Simply tell it where the
remote Web pages you wish to monitor are, and the
URLs of your links. It will then crawl the remote
Web pages and give you feedback on the latest
status (found, link not found, or page not
found/network error). You may activate the
checking as needed, or set up cron to carry out
the checking once a week or so.

CCTE is a small utility to provide a way to run automated tests on Web applications. It acts like a Web browser GETing form data to different URLs, and logging output. It has two ways to understand if a CGI did OK: HTTP status, and user-definable strings for both (success and error).

Furies is a Java-based Web site testing tool which relies on many Jakarta components. Its goal is to ensure a Web page is "correct" by running one or more conditions on it. The Furies distribution supplies some conditions and it is very easy to program your own. For accessing Web sites, Furies relies on HttpClient and configuration may be done programmatically or via Digester.

Khttrack is a easy-to-use offline browser utility with a KDE Wizard Interface. It is a frontend to Httrack, used as a library, for KDE. It allows you to download a WWW site from the Internet to a local directory, recursively building all directories, getting HTML, images, and other files from the server to your computer. It arranges the original site's relative link-structure. It can also update an existing mirrored site, and resume interrupted downloads. It is fully configurable, and has an integrated help system.

Search Engine Rankings is a tool that lets you check your
search engine rankings in Google up to the limits
imposed by the Google API. It checks search engine
rankings 100 results deep for each keyword.

XmlTestSuite is an XML-based tool based on HttpUnit for testing complex Web applications using XML. It supports test driven development, database checking, XPath and JavaScript expressions, and can separate test data from test steps. The tests are also written in XML.

QAA is a XUL Mozilla Firefox extension that
performs a user supplied test list on a Web
application. Test sessions can be defined by
example. A report is generated when sessions are
replayed.

LogiTest is a Java application for functional and regression testing of Web sites. It currently supports GET and POST methods, HTTPS, cookies, browser history, XML formatted tests, simple Testlet API for writing new tests, user-defined HTTP headers and parameters, and regular expressions. Tests are recorded and played back through a easy-to-use GUI and can be stored and loaded from XML files.

HTML::TagReader is a Perl module which allows you to read HTML/XML
files by tag. Its package contains some application programs which
are very useful for Webmasters. They all start with the prefix "tr_"
to make it easy to remember their names. tr_blck is a utility to
check for broken links in Web pages. tr_llnk is a utility to build
tar archives. tr_xlnk can process HTML files and expand links on
directories. tr_mvlnk modifies links in HTML files with Perl
commands. tr_staticssi expands the SSI directives #include virtual
and #exec cmd. tr_tagcontentgrep greps for a tag (e.g., "img src").
tr_imgaddsize adds "width" and "height" to "img src=...".