LlmKira / fast-langdetectLinks
⚡️ 80x faster Fasttext language detection out of the box | Split text by language
☆211Updated 2 months ago
Alternatives and similar repositories for fast-langdetect
Users that are interested in fast-langdetect are comparing it to the libraries listed below
Sorting:
- 80x faster and 95% accurate language identification with Fasttext☆157Updated last year
- A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.☆252Updated 2 weeks ago
- ✨ Split text by languages (e.g. 你喜欢看アニメ吗 -> 你喜欢看 | アニメ | 吗) for NLP tasks (e.g. parse, TTS). Powered by fasttext and budoux☆61Updated 4 months ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆328Updated 2 weeks ago
- Extract structured text from pdfs quickly☆497Updated 2 weeks ago
- This code sets up a simple yet robust server using FastAPI for handling asynchronous requests for embedding generation and reranking task…☆69Updated last year
- [ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".☆226Updated 9 months ago
- A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.☆102Updated 9 months ago
- Open Source Text Embedding Models with OpenAI Compatible API☆153Updated 11 months ago
- ☆187Updated last week
- Whisper realtime streaming for long speech-to-text transcription and translation☆119Updated last year
- ☆225Updated 2 weeks ago
- A lightweight end-to-end text-to-speech model☆114Updated 4 months ago
- Unattended Lightweight Text Classifiers with LLM Embeddings☆185Updated 9 months ago
- 🔧 Repair JSON!Solution for JSON Anomalies from LLMs.☆260Updated 2 weeks ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆181Updated 9 months ago
- Fast Semantic Text Deduplication & Filtering☆738Updated 3 weeks ago
- Evaluation for AI apps and agent☆42Updated last year
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆206Updated 2 weeks ago
- Enhancing Translation with RAG-Powered Large Language Models☆80Updated 3 months ago
- Lightweight, performant, deep table extraction☆478Updated this week
- TF-ID: Table/Figure IDentifier for academic papers☆236Updated 11 months ago
- Open source inference code for Rev's model☆407Updated 2 months ago
- BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages☆227Updated last year
- Sentence Transformers API: An OpenAI compatible embedding API server☆60Updated 9 months ago
- ☆471Updated 3 months ago
- A High-efficiency Open-source Toolkit for Table-to-Latex Task☆246Updated 6 months ago
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆207Updated last month
- Speech Diarization for scrum automation☆107Updated last year
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆103Updated 7 months ago