Download List

Projeto Descrição

HITCrawler is a lightweight, easy to use cralwer. The user can get the more important websites first from the starting Url.

HITCrawler is our annual project when I was a freshman.It has the following advantage: 1. The user can get the more important websites first.
2. The user can set the memory the software will use based on the task and computer configuration information.
3. Easy to use, fast running speed.

However, it has the following disadvantage:
1. It is based on single thread. The crawling speed is much slower than the multithreading cralwer.
2. We don't have a configuration file which can set the seed of the website, the connection time, etc. You have to change them in code.

System Requirements

System requirement is not defined

Download Package list

Últimos 5 Arquivos
Nome Tamanho Data Download count
Readme.txt 0.4 KB 2012-07-29 17:56 23
WS2_32.LIB 24.4 KB 2012-07-29 17:51 14327
Url.h 0.6 KB 2012-07-29 17:50 84
Url.cpp 1.5 KB 2012-07-29 17:50 76
Page.h 2.4 KB 2012-07-29 17:50 27
Todos os Arquivos
Readme.txt0.4 KB2012-07-29 17:5623
lib
WS2_32.LIB24.4 KB2012-07-29 17:5114327
Url.h0.6 KB2012-07-29 17:5084
Page.h2.4 KB2012-07-29 17:5027
Url.cpp1.5 KB2012-07-29 17:5076
Page.cpp17.2 KB2012-07-29 17:5013
Maxheap.h2.6 KB2012-07-29 17:5016
main.cpp2.1 KB2012-07-29 17:5012
Connect.h0.9 KB2012-07-29 17:5022
Connect.cpp5.1 KB2012-07-29 17:5018