10

8

6

4

2


9.1

8.7

8.7
0.0

8.1

7.3

5.7

8.5

4.7

7.6

5 Web Crawling libraries and projects

  • jsoup

    9.1 8.7 L2 Java
    jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
  • Crawler4j

    8.7 0.0 L2 Java
    Open Source Web Crawler for Java
  • Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and ´╗┐external services monitoring, Scout is a developer's best friend when it comes to application development.
    Promo
  • Apache Nutch

    8.1 7.3 L2 Java
    Apache Nutch is an extensible and scalable web crawler
  • storm-crawler

    5.7 8.5 Java
    A scalable, mature and versatile web crawler based on Apache Storm
  • Sparkler

    4.7 7.6 Java
    Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

Add another 'Web Crawling' Library