Selected Tags

Click on a tag to remove it

More Tags

Click on a tag to add it and filter down

Web Crawling libraries

Showing projects tagged as Web Crawling

  • webmagic

    9.5 7.0 Java
    A scalable web crawler framework for Java.

  • jsoup

    9.2 9.1 L2 Java
    jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

  • Crawler4j

    8.7 0.0 L2 Java
    Open Source Web Crawler for Java

  • Apache Nutch

    8.1 8.0 L2 Java
    Apache Nutch is an extensible and scalable web crawler

  • storm-crawler

    5.9 8.7 HTML
    A scalable, mature and versatile web crawler based on Apache Storm

  • Sparkler

    4.8 3.0 Java
    Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

  • Google Search Results in Java

    2.4 2.9 Java
    Google Search Results JAVA API via SerpApi