skalmadka / web-crawlerLinks
Distributed Web Crawler, Parser and Search Engine.
☆10Updated 8 years ago
Alternatives and similar repositories for web-crawler
Users that are interested in web-crawler are comparing it to the libraries listed below
Sorting:
- word2vec-java☆7Updated 8 months ago
- Focused Crawler for VT's CTRNet☆10Updated 12 years ago
- scalding powered machine learning☆109Updated 10 years ago
- Collects multimedia content shared through social networks.☆19Updated 10 years ago
- This project contains the code to translate between Apache Spark and SFrame.☆20Updated 8 years ago
- Code for the CIKM 2013 paper "Discovering Coherent Topics Using General Knowledge"☆11Updated 10 years ago
- A subproject of Predictiveworks that provides common access to Cassandra, Elasticsearch, HBase, MongoDB, Parquet, JDBC database and other…☆13Updated 10 years ago
- Tweet Analysis with Spark☆15Updated 7 years ago
- Templates for projects based on top of H2O.☆38Updated 2 months ago
- ☆20Updated 2 years ago
- PredictionIO word2vec engine template (Scala-based parallelized engine)☆12Updated 10 years ago
- A collection of efficient utilities for a data scientist.☆41Updated 10 years ago
- Code for KDD 2014 paper "Mining Topics in Documents: Standing on the Shoulders of Big Data"☆21Updated 9 years ago
- Distributed optimization framework with parameter server☆23Updated 9 years ago
- NLP Utilities in Java☆43Updated 2 years ago
- Antelope Realtime Events framework for feature engineering in agile machine learning environments.☆26Updated 9 years ago
- A chef cookbook for deploying spark☆30Updated 12 years ago
- Notes from Stanford NLP class☆24Updated 12 years ago
- Named Entity Extraction on Twitter Stream using Apache Spark Streaming and Stanford CoreNLP☆15Updated 8 years ago
- Exploration Library in Java☆12Updated last year
- Storm / Solr Integration☆19Updated last year
- Examples for Fast Data Processing with Spark☆59Updated 11 years ago
- ☆24Updated 10 years ago
- A system and a Java API for large-scale graph processing based on Google's Pregel☆64Updated 12 years ago
- ReactiveLDA is a fast, lightweight implementation of the Latent Dirichlet Allocation (LDA) algorithm, using a parallel vanilla Gibbs samp…☆61Updated 9 years ago
- Example project to show how to use Spark to read and write Avro/Parquet files☆50Updated 11 years ago
- VoltDB Click Stream Processing Example.☆16Updated 7 years ago
- A PredictionIO engine template using Latent Dirichlet Allocation to learn a topic model from raw text☆12Updated 9 years ago
- Sparse feature extraction with Spark☆30Updated 6 years ago
- Algorithms that build k-nearest neighbors graph (k-nn graph): Brute-force, NN-Descent,...☆34Updated 6 years ago