Simple and extensible Java crawler.
Download
You can browse all Crawler releases and sources at https://oss.sonatype.org/content/groups/public/net/vidageek/crawler/ or http://github.com/vidageek/crawler/downloads . If you use maven to build your project, you can just add the following lines to your pom.xml:<dependencies>
...
<dependency>
<groupId>net.vidageek</groupId>
<artifactId>crawler</artifactId>
<version>1.0</version>
</dependency>
...
</dependencies>