rossf7 / elasticrawlLinks
Launch AWS Elastic MapReduce jobs that process Common Crawl data.
☆49Updated 8 years ago
Alternatives and similar repositories for elasticrawl
Users that are interested in elasticrawl are comparing it to the libraries listed below
Sorting:
- Human-Powered Data Analysis with Mechanical Turk☆300Updated 12 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 6 years ago
- Index URLs in Common Crawl☆194Updated 7 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆149Updated 3 years ago
- Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.☆58Updated 4 years ago
- Elasticsearch Latent Semantic Indexing experimentation☆33Updated 5 years ago
- The Summarizer from the Web IR / NLP Group (WING), hence SWING, is a modular, state-of-the-art automatic extractive text summarization sy…☆39Updated 10 years ago
- Raw Wikipedia counts for entity linking☆19Updated 8 years ago
- Simple search results with Solr and EmberJS☆58Updated 6 years ago
- Semanticizest: dump parser and client☆20Updated 9 years ago
- Demonstration of using Python to process the Common Crawl dataset with the mrjob framework☆165Updated 3 years ago
- A collection and conversion of WARN notices from California☆12Updated 9 years ago
- ☆43Updated 9 years ago
- Apache Nutch fork tunned for web services and data discovery.☆10Updated 10 years ago
- Wikipedia Live Monitor☆21Updated 5 months ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- Stanford CoreNLP NER addon for Apache Tika's NamerEntityParser☆13Updated 3 years ago
- Parser and standardizer for politician, individual and organization names.☆129Updated 8 years ago
- FacetView is a pure javascript frontend for ElasticSearch.☆291Updated 10 years ago
- Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts☆59Updated 12 years ago
- ☆21Updated 7 years ago
- Algorithmic summarizer for RSS/Atom Feeds, Web Urls and arbitrary text. Codebase for the application deployed at http://tldrzr.herokuapp.…☆53Updated 8 years ago
- Traptor -- A distributed Twitter feed☆26Updated 2 years ago
- For extracting measurements and related entities from text☆58Updated 5 years ago
- SKOS analysis for Elasticsearch☆54Updated 8 years ago
- Topic modeling web application☆40Updated 9 years ago
- Extract postal addresses from the DOM☆66Updated 12 years ago
- GraphAware Timer-Driven Runtime Module that executes PageRank-like algorithm on the graph☆26Updated 7 years ago
- Named-Entity Recognition extension for Google Refine / OpenRefine☆72Updated 7 years ago
- Model Training tool for MITIE☆79Updated 9 years ago