LlmKira / fast-langdetectLinks
⚡️ 80x faster Fasttext language detection out of the box | Split text by language
☆271Updated 3 months ago
Alternatives and similar repositories for fast-langdetect
Users that are interested in fast-langdetect are comparing it to the libraries listed below
Sorting:
- 80x faster and 95% accurate language identification with Fasttext☆163Updated last year
- ✨ Split text by languages (e.g. 你喜欢看アニメ吗 -> 你喜欢看 | アニメ | 吗) for NLP tasks (e.g. parse, TTS). Powered by fasttext and budoux☆66Updated 2 months ago
- [ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".☆230Updated last year
- Open Source Text Embedding Models with OpenAI Compatible API☆164Updated last year
- A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.☆288Updated 4 months ago
- Speech Diarization for scrum automation☆111Updated 2 years ago
- A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.☆110Updated last year
- Whisper realtime streaming for long speech-to-text transcription and translation☆121Updated last year
- ☆51Updated last year
- Unattended Lightweight Text Classifiers with LLM Embeddings☆186Updated last year
- TF-ID: Table/Figure IDentifier for academic papers☆241Updated last year
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆506Updated last month
- ☆199Updated last week
- ☆241Updated 6 months ago
- Python API for https://vespa.ai, the open big data serving engine☆151Updated this week
- Open source inference code for Rev's model☆434Updated 7 months ago
- Sentence Transformers API: An OpenAI compatible embedding API server☆68Updated last year
- Gemma 2 optimized for your local machine.