LlmKira / fast-langdetectLinks
⚡️ 80x faster Fasttext language detection out of the box | Split text by language
☆245Updated 3 weeks ago
Alternatives and similar repositories for fast-langdetect
Users that are interested in fast-langdetect are comparing it to the libraries listed below
Sorting:
- 80x faster and 95% accurate language identification with Fasttext☆162Updated last year
- ✨ Split text by languages (e.g. 你喜欢看アニメ吗 -> 你喜欢看 | アニメ | 吗) for NLP tasks (e.g. parse, TTS). Powered by fasttext and budoux☆64Updated 3 weeks ago
- [ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".☆229Updated last year
- A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.☆107Updated last year
- Open Source Text Embedding Models with OpenAI Compatible API☆160Updated last year
- Speech Diarization for scrum automation☆111Updated 2 years ago
- Unattended Lightweight Text Classifiers with LLM Embeddings☆184Updated last year
- Whisper realtime streaming for long speech-to-text transcription and translation☆121Updated last year
- Extract structured text from pdfs quickly☆607Updated 4 months ago
- A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.☆280Updated last month
- A very simple news crawler with a funny name☆406Updated last week
- 🔧 Repair JSON!Solution for JSON Anomalies from LLMs.☆282Updated last month
- TF-ID: Table/Figure IDentifier for academic papers☆240Updated last year
- Open source inference code for Rev's model☆429Updated 5 months ago
- Evaluation for AI apps and agent☆43Updated last year
- FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)☆243Updated last year
- Deep Reasoning Translation (DRT) Project☆233Updated last month
- This code sets up a simple yet robust server using FastAPI for handling asynchronous requests for embedding generation and reranking task…☆70Updated last year
- Sentence Transformers API: An OpenAI compatible embedding API server☆67Updated last year
- ☆237Updated 4 months ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆377Updated last month
- Lightweight, performant, deep table extraction☆513Updated 2 months ago
- LLM steganography with minimum-entropy coupling - Hiding encrypted messages in natural language.☆90Updated last year
- ☆143Updated last month
- A lightweight end-to-end text-to-speech model☆120Updated 7 months ago
- Enhancing Translation with RAG-Powered Large Language Models☆83Updated 2 weeks ago
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆225Updated 4 months ago
- BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages☆228Updated last year
- ☆193Updated this week
- A simple tool that let's you explore different possible paths that an LLM might sample.☆190Updated 5 months ago