Contributions

Library
Spark-Crawler : Evolving Apache Nutch to run on Spark.
Library
Web crawler SDK based on Apache Storm