10

8

6

4

2


9.1

7.8

8.8
0.4

8.1

7.1

5.7

6.7

4.7

8.6

5 Web Crawling libraries and projects

  • jsoup

    9.1 7.8 L2 Java
    jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
  • Crawler4j

    8.8 0.4 L2 Java
    Open Source Web Crawler for Java
  • Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
    Sponsored scoutapm.com
  • Apache Nutch

    8.1 7.1 L2 Java
    Apache Nutch is an extensible and scalable web crawler
  • storm-crawler

    5.7 6.7 Java
    A scalable, mature and versatile web crawler based on Apache Storm
  • Sparkler

    4.7 8.6 Java
    Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

Add another 'Web Crawling' Library