10

8

6

4

2


9.1

8.6

8.7

5.8

8.1

8.9

4.9

8.3

3.4

8.2

5 Web Crawling libraries and projects

  • JSoup

    9.1 8.6 L2 Java
    Scrapes, parses, manipulates and cleans HTML.
  • Crawler4j

    8.7 5.8 L2 Java
    Simple and lightweight web crawler.
  • Apache Nutch

    8.1 8.9 L2 Java
    Highly extensible, highly scalable web crawler for production environment.
  • storm-crawler

    4.9 8.3 Java
    Web crawler SDK based on Apache Storm
  • Sparkler

    3.4 8.2 Java
    Spark-Crawler : Evolving Apache Nutch to run on Spark.

Add another 'Web Crawling' Library