Simple and extensible Java crawler.

Project

Versioning

Crawler uses a simple versioning system:

crawler-A.B.C.jar

Download

We deploy our jars to Maven Central Repository, so you can easily add it as dependency:

Gradle

dependencies {
    'net.vidageek:crawler:1.0'
}

SBT

libraryDependencies += "net.vidageek" % "crawler" % "1.0"

Ivy

<dependency org="net.vidageek" name="crawler" rev="1.0"/>

Maven

<dependency>
    <groupId>net.vidageek</groupId>
    <artifactId>crawler</artifactId>
    <version>1.0</version>
</dependency>

Source

Browse and checkout our sources at Github.

Email Lists

Bugtracker

Just go to Github and don't be ashamed of creating a new ticket!

Project Contributors

Get Involved

You can get involved to Crawler in a lot of ways. If you are just using it, you are already really helping us.

Patches of any kind (source, documentation, etc) are always welcome. You can send your patches through our bugtracking system. Another way you can help is by answering new user's questions on our mailing lists and also by giving us your feedback.

You can even translate Crawler documentation to your native language and help us spreading the project around the world.