10

8

6

4

2


4.7

7.3

8.1

7.5

5.7

8.7

9.1

8.6

8.7
0.0

5 Web Crawling libraries and projects

  • Sparkler

    4.7 7.3 Java
    Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
  • Apache Nutch

    8.1 7.5 L2 Java
    Apache Nutch is an extensible and scalable web crawler
  • Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
  • storm-crawler

    5.7 8.7 Java
    A scalable, mature and versatile web crawler based on Apache Storm
  • jsoup

    9.1 8.6 L2 Java
    jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
  • Crawler4j

    8.7 0.0 L2 Java
    Open Source Web Crawler for Java

Add another 'Web Crawling' Library