zafercavdar / fasttext-langdetectLinks
80x faster and 95% accurate language identification with Fasttext
☆161Updated last year
Alternatives and similar repositories for fasttext-langdetect
Users that are interested in fasttext-langdetect are comparing it to the libraries listed below
Sorting:
- Simply, faster, sentence-transformers☆143Updated last year
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆213Updated 2 months ago
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆171Updated 5 months ago
- ⚡️ 80x faster Fasttext language detection out of the box | Split text by language☆255Updated 2 months ago
- Efficient few-shot learning with cross-encoders.☆59Updated last year
- Python API for https://vespa.ai, the open big data serving engine☆147Updated this week
- A Python Search Engine for Humans 🥸☆238Updated last year
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆110Updated last year
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆255Updated 3 years ago
- ☆369Updated last year
- ☆175Updated 7 months ago
- PyTorch-IE: State-of-the-art Information Extraction in PyTorch☆77Updated last month
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)☆132Updated last year
- Generalist and Lightweight Model for Text Classification☆164Updated 5 months ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆179Updated 5 months ago
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆80Updated 2 years ago
- Notebooks for training universal 0-shot classifiers on many different tasks☆136Updated 10 months ago
- Completion After Prompt Probability. Make your LLM make a choice☆81Updated last year
- Few-shot Named Entity Recognition☆123Updated 3 years ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆190Updated last year
- Guideline following Large Language Model for Information Extraction☆409Updated last year
- A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.☆62Updated last year
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆52Updated last month
- Label data using HuggingFace's transformers and automatically get a prediction service☆193Updated 2 years ago
- Augmenty is an augmentation library based on spaCy for augmenting texts.☆156Updated last year
- Targetted language identifier, based on FastText and Hunspell.☆37Updated 2 months ago
- A language detection software☆59Updated 8 years ago
- Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)☆86Updated last year
- BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages☆228Updated last year