b-cube / nutch-crawlerLinks
Apache Nutch fork tunned for web services and data discovery.
☆10Updated 10 years ago
Alternatives and similar repositories for nutch-crawler
Users that are interested in nutch-crawler are comparing it to the libraries listed below
Sorting:
- ☆25Updated 10 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆148Updated 4 years ago
- A platform for real-time streaming search☆102Updated 9 years ago
- Uses Apache Lucene, OpenNLP and geonames and extracts locations from text and geocodes them.☆38Updated last year
- Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.☆58Updated 4 years ago
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Updated 8 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 7 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 7 years ago
- Parse wikipedia dumps and index (some) page data to elasticsearch☆49Updated 10 years ago
- A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.☆52Updated 8 years ago
- Ductile DB is a graph database based on Hadoop/HBase which provides a vast set of features.☆15Updated 7 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- ☆92Updated 10 years ago
- Search a single field with different query time analyzers in Solr☆25Updated 5 years ago
- a set of services that provide NLP facilities☆25Updated 4 years ago
- A Topic Modeling toolbox☆92Updated 9 years ago
- Natural language parsers and conceptual memory☆15Updated 13 years ago
- Implementation of "A Parallel Spatial Co-location Mining Algorithm Based on MapReduce" paper☆49Updated 8 years ago
- ElasticSearch Prediction Generator and Plugin☆22Updated 10 years ago
- An HTTP proxy for Elasticsearch, Solr (etc.) to prevent a 100% full disk situation.☆11Updated 7 years ago
- Elasticsearch Latent Semantic Indexing experimentation☆33Updated 6 years ago
- A prototype of Hive UDFs/UDTFs that execute nested SQL queries within rows.☆54Updated 10 years ago
- Reduce your data. A unix filter for algebird-powered aggregation.☆141Updated 8 years ago
- Bixo is an open source web mining toolkit that runs as a series of Cascading pipes on top of Hadoop. By building a customized Cascading p…☆142Updated 3 years ago
- Collects multimedia content shared through social networks.☆19Updated 10 years ago
- Elasticsearch entity resolution plugin based on Duke☆209Updated 5 years ago
- Data science repo to help others☆12Updated 9 years ago
- Machine Learning for Cascading☆83Updated 10 years ago
- Human-Powered Data Analysis with Mechanical Turk☆300Updated 13 years ago