Selected Tags

Click on a tag to remove it

More Tags

Click on a tag to add it and filter down

Web Crawling libraries

Showing projects tagged as Web Crawling

  • webmagic

    9.4 0.0 Java
    A scalable web crawler framework for Java.
  • jsoup

    9.2 9.4 L2 Java
    jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
  • Crawler4j

    8.7 0.0 L2 Java
    Open Source Web Crawler for Java
  • Apache Nutch

    8.0 4.6 L2 Java
    Apache Nutch is an extensible and scalable web crawler
  • storm-crawler

    5.7 6.3 HTML
    A scalable, mature and versatile web crawler based on Apache Storm
  • Sparkler

    4.7 0.0 Java
    Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
  • Google Search Results in Java

    2.4 0.0 Java
    Google Search Results JAVA API via SerpApi