10

8

6

4

2


9.1

8.3

8.7
0.0

8.1

6.5

5.7

8.2

4.8

6.6

5 Web Crawling libraries and projects

  • jsoup

    9.1 8.3 L2 Java
    jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
  • Crawler4j

    8.7 0.0 L2 Java
    Open Source Web Crawler for Java
  • Zigi monitors Jira and GitHub updates, pings you when PRs need approval and lets you take fast actions - all directly from Slack! Plus it reduces cycle time by up to 75%.
    Promo
  • Apache Nutch

    8.1 6.5 L2 Java
    Apache Nutch is an extensible and scalable web crawler
  • storm-crawler

    5.7 8.2 Java
    A scalable, mature and versatile web crawler based on Apache Storm
  • Sparkler

    4.8 6.6 Java
    Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

Add another 'Web Crawling' Library