commoncrawl / language-detection-cld2
Natural language detection, Java bindings for CLD2
☆14Updated last week
Related projects ⓘ
Alternatives and complementary repositories for language-detection-cld2
- Lightning Fast Language Prediction 🚀☆165Updated 5 years ago
- Lightning fast spell correction / fuzzy search library based on SymSpell by Commerce-Experts☆80Updated 6 years ago
- 🌸 fastText + Bloom embeddings for compact, full-coverage vectors with spaCy☆287Updated last year
- Java port of SymSpell: 1 million times faster through Symmetric Delete spelling correction algorithm☆65Updated 3 years ago
- Named Entity Recognition data for Europeana Newspapers☆173Updated last year
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆50Updated 4 years ago
- Search relevance evaluation toolkit☆73Updated 2 years ago
- Set of Jupyter notebooks demonstrating Learning to Rank integrated with Solr and Elasticsearch☆165Updated 2 months ago
- Indra is a Web Service which allows easy access to different distributional semantics models in several languages.☆47Updated 3 years ago
- Json Wikipedia, contains code to convert the Wikipedia xml dump into a json dump. Questions? https://gitter.im/idio-opensource/Lobby☆17Updated 2 years ago
- Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…☆85Updated 3 years ago
- Index Common Crawl archives in tabular format☆106Updated this week
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆42Updated 6 years ago
- CuVS integration for Lucene☆29Updated 5 months ago
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 3 years ago
- Performance evaluation of nearest neighbor search using Vespa, Elasticsearch and Open Distro for Elasticsearch K-NN☆116Updated 3 years ago
- Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipg…☆124Updated this week
- Source code for the split annotations project.☆53Updated last year
- GSDMM: Short text clustering (Rust implementation)☆23Updated last year
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆159Updated last month
- A fast and simple JavaScript library specifically targeted at collecting search and search related browser events.☆41Updated 3 months ago
- Solr Dictionary Annotator (Microservice for Spark)☆70Updated 4 years ago
- Program used to split text into segments☆25Updated 3 weeks ago
- Open-Source Information Retrieval Reproducibility Challenge☆50Updated 8 years ago
- Search relevance evaluation toolkit☆30Updated 2 years ago
- ☆16Updated 3 years ago
- FoLiA: Format for Linguistic Annotation - FoLiA is a rich XML-based annotation format for the representation of language resources (inclu…☆61Updated 6 months ago
- An unsupervised compound splitter☆40Updated 5 years ago
- Faster, modernized fork of the language identification tool langid.py☆48Updated this week
- A machine learning tool for fishing entities☆249Updated last week