With LinkChecker, you can check HTML documents and Web sites for broken links. It features recursion, robots.txt exclusion protocol support, HTTP proxy support, i18n support, multithreading, regular expression filtering rules for links, and user/password checking for authorized pages. Output can be colored or normal text, HTML, SQL, CSV, or a sitemap graph in DOT, GML, or XML format. Supported link types are HTTP/1.1 and 1.0, HTTPS, FTP, mailto:, news:, nntp:, Telnet, and local files.
Related ProjectsMeCab, osCommerce 日本語版, WordPress Plugins/JSeries, GLOBALBASE PROJECT, Portal Application Laboratory
GNU Wget is a utility for noninteractive download of files from the Web. It supports HTTP and FTP protocols, as well as retrieval through HTTP proxies. It can follow HTML links, download many pages, and convert the links for local viewing. It can also mirror FTP hierarchies or only those files that have changed. Wget has been designed for robustness over slow network connections; if a download fails due to a network problem, it will keep retrying until the whole file has been retrieved.
Related Projectsbbs2chreader, FFFTP, Win32 Disk Imager, Dumpper v.60.3, Open Jane
HTTrack is an easy-to-use offline browser utility. It allows you to download a Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the mirrored Web site in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. WebHTTrack is a Web-based GUI for HTTrack.
Related ProjectsDarik's Boot and Nuke, Shiira, BathyScaphe, iReport-Designer for JasperReports, bbs2chreader
gurlchecker is a graphical Web link checker. It can work on a whole site, a single local page, or a browser bookmarks file.
Related ProjectsosCommerce 日本語版, linuxBean, SmillaEnlarger, WordPress Plugins/JSeries, X/Qt Server
RabbIt is a mutating, caching Web proxy used to
speed up surfing over slow links like modems. It
does this by removing advertising and background
images and scaling down images to low quality
JPEGs. RabbIT is written in Java and should be
able to run on any platform. It does depend upon
an image converter if image scaling is on. The
recommended image converter is "convert" from the
Related ProjectsGLOBALBASE PROJECT, Dumpper v.60.3, MPC-BE, PeaZip, MeCab
ht://Check is a link checker derived from
ht://Dig. It can retrieve information through
HTTP/1.1 and store it in a MySQL database so that
after a "crawl", ht://Check can return broken
links, anchors not found, content-types, and HTTP
status codes summaries. ht://Check also performs
accessibility checks in accordance with the
principles of the University of Toronto's Open
Accessibility Checks (OAC) project, allowing users
to discover site-wide barriers like images without
proper alternatives, missing titles, etc. A PHP
interface lets the user query and view the results
directly via the Web.
Related ProjectsMedia Player Classic - Home Cinema, Dumpper v.60.3, MPC-BE, Win32 Disk Imager, Joomla!じゃぱん
Smart Cache Loader is a very configurable Web grabber with special Smart Cache support.
Related ProjectsGLOBALBASE PROJECT, Portal Application Laboratory, osCommerce 日本語版, MeCab, WordPress Plugins/JSeries
AWbot is a bot that connects to your Web site and makes URL requests
like human visitor. It's not a Web indexing robot, but a Web client
tool that emulates visitors browsing your Web site to test its
stability after a development change, its reliability, and its
response to heavy loads.
Related ProjectsTuxGuitar, iReport-Designer for JasperReports, WordPress Plugins/JSeries, Darik's Boot and Nuke, SmillaEnlarger
SPyRO is a multilingual Object Request Broker
(ORB). SPyRO uses the most efficient available
connection between peers to minimize the costs of
transport and parsing in the communication. SPyRO
provides transparent and translucent remote object
Related ProjectsAmateras, MeCab, MPC-BE, GLOBALBASE PROJECT, Properties Editor
KorWeblog is highly customizable PHP/SQL Weblog/Content Management System initially based on phpweblog. Many features have been added, such as a FAQ, download, threaded comments, user-selectable site theme, user preferences, multi-login user support, story program, HTTP referer, browser/OS, and access counter in the stats page, anti-spam function, an IP blocking function, and more.
Related ProjectsDarik's Boot and Nuke, SmillaEnlarger, PukiWiki, osCommerce 日本語版, GLOBALBASE PROJECT
WebTst is a Web development test infrastructure.
It aims to simplify testing by implementing an
HTTP and HTTPS capture engine: a Web proxy which
records a tester's actions using any Web browser
and then replays them during testing. It comes
with support for cookie handling, HTTP
authentication, concurrency testing, digital
certificates, and a number of simple tests, such
as cookie setting, pattern matching, response
status, and many others. It also provides the
concept of result analyzer components and
capabilities for maintaining smoke and regression
Related ProjectsMeCab, GLOBALBASE PROJECT, Properties Editor, Dumpper v.60.3, Amateras
Load is a utility for Web application and SOAP-based Web services performance and scalability testing. It features a scripting language and a library of test objects for the creation of intelligent agents that drive the Web application or SOAP-based Web service. Running hundreds of agents concurrently shows how your software performs in production environments. Load is a Java application that runs on Linux, Solaris, NT, Win2000, and Macintosh. While Load continues to be maintained, the next generation is the TestMaker program.
Related Projectsギコナビ, Media Player Classic - Home Cinema, Dumpper v.60.3, Amateras, MPC-BE
Checkbot is a tool to verify links on a set of HTML pages. Checkbot can check a single document, or a set of documents on one or more servers. Checkbot creates a report which summarizes all links which caused some kind of warning or error.
Web Secretary is Webpage change notification (monitoring) software. It
goes beyond the normal functions offered by such software by detecting
changes based on content analysis, making sure that it's not just HTML
that changed, but actual content. You can tell it what to ignore in the
page (hit counters and such), and it can mail you the document with the
changes highlighted or load the highlighted page in a browser.
Related ProjectsosCommerce 日本語版, Darik's Boot and Nuke, WordPress Plugins/JSeries, Hinemos, iReport-Designer for JasperReports
Magellan Metasearch is a modular meta search engine, enabling users
to monitor as many search engines as they want. It provides a complex
query language with standard boolean operators, meta-operators (to
search through pages' metadata), and proximity operators. This language
enables users to perform far more complex queries than what common
search engines currently support. It can be fed any custom sources,
since its abstraction layer manages the search results and their meta
tags in a uniform way. In conjunction with the local process scheduler
(such as "cron"), Magellan enables you to save your requests and replay
them later automatically; new results are sent through email and RSS
in realtime. Magellan also provides full anonymity through smart
Related ProjectsDarik's Boot and Nuke, DeSmuME, SmillaEnlarger, nkf Network Kanji Filter, XOOPS