Java Web Crawling

5 Web Crawling libraries and projects

• Sparkler

  4.7 7.3 Java

  Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
  

• Apache Nutch

  8.1 7.5 L2 Java

  Apache Nutch is an extensible and scalable web crawler
  

Static code analysis for 29 languages.

Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

Promo www.sonarqube.org



• storm-crawler

  5.7 8.7 Java

  A scalable, mature and versatile web crawler based on Apache Storm
  

• jsoup

  9.1 8.6 L2 Java

  jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

• Crawler4j

  8.7 0.0 L2 Java

  Open Source Web Crawler for Java

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.

Less time debugging, more time building sponsored scoutapm.com

Popular Comparisons

• Apache Nutch
  vs
  jsoup
• Apache Nutch
  vs
  Crawler4j
• Crawler4j
  vs
  jsoup
• storm-crawler
  vs
  Apache Nutch
• storm-crawler
  vs
  jsoup

SaaSHub - Software Alternatives and Reviews sponsored www.saashub.com