Popularity
3.0
Stable
Activity
8.1
Declining
122
28
56

Description

A web crawler is a bot program that fetches resources from the web for the sake of building applications like search engines, knowledge bases, etc. Sparkler (contraction of Spark-Crawler) is a new web crawler that makes use of recent advancements in distributed computing and information retrieval domains by conglomerating various Apache projects like Spark, Kafka, Lucene/Solr, Tika, and Felix. Sparkler is an extensible, highly scalable, and high-performance web crawler that is an evolution of Apache Nutch and runs on Apache Spark Cluster.

Programming language: Java
Tags: Web Crawling     Java     Spark    

Recently added Sparkler resources

Do you know of a usefull tutorial, book or news relevant to Sparkler?
Be the first to add one!

Sparkler Recommendations

There are no recommendations yet. Be the first to promote Sparkler!

Have you used Sparkler? Share your experience. Write a short recommendation and Sparkler, you and your project will be promoted on Awesome Java.
Recommend Sparkler

Sparkler alternatives and related libraries

Based on the "Web Crawling" category

Do you think we are missing an alternative of Sparkler or a related project?

Add another 'Web Crawling' Library

Popular Comparisons