10

8

6

4

2


9.1

7.5

8.8
0.3

8.1

6.7

5.7

7.5

4.7

8.4

5 Web Crawling libraries and projects

  • jsoup

    9.1 7.5 L2 Java
    jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
  • Crawler4j

    8.8 0.3 L2 Java
    Open Source Web Crawler for Java
  • Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
    Sponsored scoutapm.com
  • Apache Nutch

    8.1 6.7 L2 Java
    Apache Nutch is an extensible and scalable web crawler
  • storm-crawler

    5.7 7.5 Java
    A scalable, mature and versatile web crawler based on Apache Storm
  • Sparkler

    4.7 8.4 Java
    Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

Add another 'Web Crawling' Library