zafercavdar / fasttext-langdetectLinks
80x faster and 95% accurate language identification with Fasttext
☆163Updated last year
Alternatives and similar repositories for fasttext-langdetect
Users that are interested in fasttext-langdetect are comparing it to the libraries listed below
Sorting:
- Simply, faster, sentence-transformers☆143Updated last year
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆212Updated 3 months ago
- ⚡️ 80x faster Fasttext language detection out of the box | Split text by language☆274Updated 3 months ago
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆181Updated last month
- A Python Search Engine for Humans 🥸☆243Updated last week
- Efficient few-shot learning with cross-encoders.☆60Updated last year
- Python API for https://vespa.ai, the open big data serving engine☆154Updated last week
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆134Updated last year
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆111Updated last year
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆155Updated 2 years ago
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆337Updated 2 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆256Updated 3 years ago
- multimodal document analysis☆166Updated last month
- ☆176Updated 9 months ago
- Generalist and Lightweight Model for Text Classification☆167Updated 3 weeks ago
- Few-shot Named Entity Recognition☆122Updated 3 years ago
- PyTorch-IE: State-of-the-art Information Extraction in PyTorch☆77Updated 3 months ago
- 🔢 Work with static vector models☆35Updated 8 months ago
- ☆372Updated 2 years ago
- The pipeline for the OSCAR corpus☆174Updated last month
- Completion After Prompt Probability. Make your LLM make a choice☆82Updated last year
- A language detection software☆65Updated 8 years ago
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆64Updated last year
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆80Updated 2 years ago
- KeyPhraseTransformer lets you quickly extract key phrases, topics, themes from your text data with T5 transformer | Keyphrase extraction…☆106Updated last year
- Guideline following Large Language Model for Information Extraction☆421Updated last year
- Repository for the paper "MultiNERD: A Multilingual, Multi-Genre and Fine-Grained Dataset for Named Entity Recognition (and Disambiguatio…☆45Updated last year
- This repository contains an easy and intuitive approach to few-shot classification using sentence-transformers or spaCy models, or zero-s…☆220Updated 11 months ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆180Updated 6 months ago
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆132Updated last year