Smerity / cc-warc-examples
CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆56Updated 3 years ago
Alternatives and similar repositories for cc-warc-examples:
Users that are interested in cc-warc-examples are comparing it to the libraries listed below
- Mirror of Apache Stanbol (incubating)☆112Updated last year
- Elasticsearch Latent Semantic Indexing experimentation☆33Updated 5 years ago
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 8 years ago
- Stanford CoreNLP NER addon for Apache Tika's NamerEntityParser☆13Updated 3 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- NLP tools developed by Emory University.☆60Updated 8 years ago
- A Text Classification API in Java originally developed by DigitalPebble Ltd. The API is independent from the ML implementations used and …☆48Updated 3 years ago
- Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts☆59Updated 12 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆33Updated last year
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆281Updated 6 years ago
- Common web archive utility code.☆54Updated 2 months ago
- Analytic UIMA pipelines using Spark☆23Updated 9 years ago
- A toolkit that wraps various natural language processing implementations behind a common interface.☆101Updated 7 years ago
- English Dependency Relationship Extractor☆85Updated 2 months ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆51Updated 4 years ago
- Automatic tagging and analysis of documents in an Apache Solr index for faceted search by RDF(S) Ontologies & SKOS thesauri☆47Updated 3 years ago
- A text tagger based on Lucene / Solr, using FST technology☆176Updated last year
- ☆43Updated 9 years ago
- Apache OpenNLP Sandbox☆43Updated this week
- Examples of Solr configuration entries for Solr plugins and Conceptual Search\Semantic Search from Simon Hughes Dice.com☆26Updated 8 years ago
- SKOS Support for Apache Lucene and Solr☆56Updated 3 years ago
- Solr Query Segmenter for structuring unstructured queries☆21Updated 3 years ago
- `Slib` is a JAVA library dedicated to semantic data mining based on texts and/or ontology processing. The library is composed of various …☆81Updated last year
- Simple search results with Solr and EmberJS☆58Updated 5 years ago
- WARC (Web Archive) Input and Output Formats for Hadoop☆35Updated 10 years ago
- RDF-Centric Map/Reduce Framework and Freebase data conversion tool☆148Updated 3 years ago
- An efficient and flexible token-based regular expression language and engine.☆75Updated 10 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 6 years ago
- Approve or reject statements from third-party datasets☆145Updated 6 years ago
- Software and resources for natural language processing.☆131Updated 8 years ago