b-cube / nutch-crawlerLinks
Apache Nutch fork tunned for web services and data discovery.
☆10Updated 10 years ago
Alternatives and similar repositories for nutch-crawler
Users that are interested in nutch-crawler are comparing it to the libraries listed below
Sorting:
- A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.☆52Updated 8 years ago
- ☆25Updated 10 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆148Updated 4 years ago
- ☆92Updated 10 years ago
- Uses Apache Lucene, OpenNLP and geonames and extracts locations from text and geocodes them.☆38Updated last year
- Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.☆58Updated 4 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 7 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- Bixo is an open source web mining toolkit that runs as a series of Cascading pipes on top of Hadoop. By building a customized Cascading p…☆142Updated 3 years ago
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Updated 8 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 9 years ago
- A platform for real-time streaming search☆102Updated 9 years ago
- A Topic Modeling toolbox☆92Updated 9 years ago
- Topic modeling web application☆40Updated 10 years ago
- iSAX Indexing persisted in HBase☆39Updated 14 years ago
- Solr for Astrophysics Data System☆54Updated last month
- Topic Modeling the Sarah Palin emails.☆34Updated 14 years ago
- Distributed Streaming Quantiles (for PySpark)☆38Updated 11 years ago
- Implementation of "A Parallel Spatial Co-location Mining Algorithm Based on MapReduce" paper☆49Updated 8 years ago
- Where 2.0 Workshop Code: Spatial Analysis of Tweets using Hadoop, Pig, Python & Mechanical Turk. Slides here: http://www.slideshare.net/…☆134Updated 15 years ago
- Docker image for an IPython 3/Jupyter Notebook and Terminal with full Anaconda Install☆86Updated 6 years ago
- Modularly extensible semantic metadata validator☆84Updated 9 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 6 years ago
- Data science repo to help others☆12Updated 9 years ago
- cascading schemes and taps for JDBC☆27Updated 9 years ago
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…☆41Updated 9 years ago
- JSON -> Relational DB Column Types☆63Updated 2 years ago
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 9 years ago
- My personal clojure library geared towards NLP applications☆40Updated 14 years ago
- Start a cluster in EC2 for dask.distributed☆106Updated 5 years ago