commoncrawl / cc-warc-examples
CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆37Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for cc-warc-examples
- Fusion demo app searching open-source project data from the Apache Software Foundation☆42Updated 6 years ago
- A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata☆28Updated 6 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 6 years ago
- A PL/Java Wrapper on Ark-Tweet-NLP (http://www.ark.cs.cmu.edu/TweetNLP/) - Twitter Parts-of-speech tagger in Postgres/Greenplum☆17Updated 10 years ago
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆56Updated 3 years ago
- Graph Processing Algorithms on top of Neo4j☆39Updated 7 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆32Updated last year
- Parse wikipedia dumps and index (some) page data to elasticsearch☆49Updated 9 years ago
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 3 years ago
- ☆47Updated 7 years ago
- Angular JS Solr and Elasticsearch and OpenSearch Diagnostic Search Services☆25Updated 5 months ago
- A single docker image that combines Neo4j Mazerunner and Apache Spark GraphX into a powerful all-in-one graph processing engine☆46Updated 5 years ago
- An efficient and flexible token-based regular expression language and engine.☆75Updated 10 years ago
- WARC (Web Archive) Input and Output Formats for Hadoop☆35Updated 9 years ago
- Search a single field with different query time analyzers in Solr☆25Updated 4 years ago
- Apache OpenNLP Sandbox☆42Updated last week
- Kafka connector for Solr Sink☆16Updated 8 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆70Updated 4 years ago
- GraphAware Module for Expiring (Deleting) Nodes and Relationships☆29Updated 3 years ago
- ☆28Updated 8 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆148Updated 3 years ago
- An HTTP proxy for Elasticsearch, Solr (etc.) to prevent a 100% full disk situation.☆11Updated 6 years ago
- My fork of MAchine Learning for LanguagE Toolkit☆11Updated 12 years ago
- The first Open Source document analysis platform☆65Updated 3 years ago
- System for mining Wikipedia Usage data to read our collective mind☆21Updated 10 years ago
- Tutorial on parsing Enron email to Avro and then explore the email set using Spark.☆50Updated 4 months ago
- Interactive, embeddable Neo4j-Console☆79Updated last year
- Text Mining Library with a focus on Latent Semantic Analysis☆12Updated 11 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆212Updated last year