b-cube / nutch-crawler
Apache Nutch fork tunned for web services and data discovery.
☆10Updated 9 years ago
Alternatives and similar repositories for nutch-crawler:
Users that are interested in nutch-crawler are comparing it to the libraries listed below
- Reduce your data. A unix filter for algebird-powered aggregation.☆138Updated 8 years ago
- Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.☆58Updated 4 years ago
- Topic modeling web application☆40Updated 9 years ago
- ☆25Updated 10 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆148Updated 3 years ago
- Proposals for new Jupyter subprojects to enter into incubation☆18Updated 4 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 9 years ago
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Updated 8 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 6 years ago
- Task Orchestration Tool Based on SWF and boto3☆38Updated 6 years ago
- An example project for doing grid search in MLlib☆13Updated 10 years ago
- a set of services that provide NLP facilities☆25Updated 4 years ago
- Ductile DB is a graph database based on Hadoop/HBase which provides a vast set of features.☆13Updated 7 years ago
- A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.☆51Updated 7 years ago
- Python binding for gumbo-parser using Cython☆14Updated 8 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- Big GeoSpatial Data Points Visualization Tool☆19Updated 9 years ago
- Modularly extensible semantic metadata validator☆84Updated 9 years ago
- Uses Apache Lucene, OpenNLP and geonames and extracts locations from text and geocodes them.☆37Updated last year
- Library for building reproducible data pipelines to support experimentation☆20Updated 9 years ago
- Fetch and plot AWS spot pricing history☆23Updated 8 years ago
- High Level Kafka Scanner☆19Updated 7 years ago
- A Topic Modeling toolbox☆92Updated 9 years ago
- Traptor -- A distributed Twitter feed☆26Updated 2 years ago
- Repo for experiments on pyspark and sklearn☆79Updated 11 years ago
- Python bindings for the sparkey key value store☆37Updated 5 months ago
- Docker images for data science from Wise.io☆50Updated 9 years ago
- common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text☆35Updated 8 years ago
- Convert URL's to a normalized unicode format☆67Updated 7 years ago
- iSAX Indexing persisted in HBase☆39Updated 13 years ago