commoncrawl / cc-warc-examples
CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆38Updated 3 months ago
Alternatives and similar repositories for cc-warc-examples:
Users that are interested in cc-warc-examples are comparing it to the libraries listed below
- WARC (Web Archive) Input and Output Formats for Hadoop☆35Updated 10 years ago
- Fusion demo app searching open-source project data from the Apache Software Foundation☆42Updated 6 years ago
- Angular JS Solr and Elasticsearch and OpenSearch Diagnostic Search Services☆26Updated 3 weeks ago
- ☆49Updated 8 years ago
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 4 years ago
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆56Updated 3 years ago
- ☆28Updated 8 years ago
- Educational Examle of a custom Lucene Query & Scorer☆48Updated 5 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆243Updated this week
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆213Updated 2 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆33Updated last year
- Search a single field with different query time analyzers in Solr☆25Updated 5 years ago
- A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata☆28Updated 6 years ago
- An HTTP proxy for Elasticsearch, Solr (etc.) to prevent a 100% full disk situation.☆11Updated 6 years ago
- Sentiment analysis framework developed by CERTH.☆22Updated 9 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 6 years ago
- Mirror of Apache Stanbol (incubating)☆112Updated last year
- Parse wikipedia dumps and index (some) page data to elasticsearch☆49Updated 9 years ago
- Extensions for and tools to work with CoreNlp☆24Updated 3 years ago
- Code examples on how to use the Datumbox Machine Learning Framework.☆43Updated last year
- Dice.com tutorial on using black box optimization algorithms to do relevancy tuning on your Solr Search Engine Configuration from Simon H…☆28Updated 6 years ago
- A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)☆65Updated 8 years ago
- A text tagger based on Lucene / Solr, using FST technology☆176Updated last year
- Launch AWS Elastic MapReduce jobs that process Common Crawl data.☆49Updated 8 years ago
- Apache OpenNLP Sandbox☆42Updated this week
- RDF store on a cloud-based architecture (previously on https://code.google.com/p/cumulusrdf)☆31Updated 8 years ago
- Text Mining Library with a focus on Latent Semantic Analysis☆12Updated 11 years ago
- Examples for my book "Power Java"☆21Updated 2 years ago
- Spring integration with Stardog RDF database☆17Updated last month
- Uses Apache Lucene, OpenNLP and geonames and extracts locations from text and geocodes them.☆37Updated 11 months ago