LlmKira / fast-langdetectLinks
⚡️ 80x faster Fasttext language detection out of the box | Split text by language
☆283Updated 4 months ago
Alternatives and similar repositories for fast-langdetect
Users that are interested in fast-langdetect are comparing it to the libraries listed below
Sorting:
- ✨ Split text by languages (e.g. 你喜欢看アニメ吗 -> 你喜欢看 | アニメ | 吗) for NLP tasks (e.g. parse, TTS). Powered by fasttext and budoux☆67Updated 4 months ago
- 80x faster and 95% accurate language identification with Fasttext☆164Updated last year
- [ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".☆231Updated last year
- Open Source Text Embedding Models with OpenAI Compatible API☆165Updated last year
- A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.☆114Updated last year
- Unattended Lightweight Text Classifiers with LLM Embeddings☆187Updated last year
- A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.☆292Updated 5 months ago
- Speech Diarization for scrum automation☆111Updated 2 years ago
- Benchmarking PDF libraries☆320Updated 6 months ago
- Evaluation for AI apps and agent☆44Updated 2 years ago
- ☆246Updated 7 months ago
- Whisper realtime streaming for long speech-to-text transcription and translation☆121Updated last year
- Extract structured text from pdfs quickly☆651Updated 7 months ago
- Deep Reasoning Translation (DRT) Project☆240Updated 4 months ago
- Open source inference code for Rev's model☆434Updated 8 months ago
- TF-ID: Table/Figure IDentifier for academic papers☆245Updated last year
- This code sets up a simple yet robust server using FastAPI for handling asynchronous requests for embedding generation and reranking task…☆72Updated last year
- Sentence Transformers API: An OpenAI compatible embedding API server☆70Updated last year
- Turn any OCR models into online inference API endpoint 🚀 🌖☆57Updated 2 months ago
- Enhancing Translation with RAG-Powered Large Language Models☆88Updated 3 weeks ago
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆232Updated 7 months ago
- An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.☆292Updated 6 months ago
- ASR + diarization model server with speculative decoding☆63Updated last year
- ☆200Updated this week
- A very simple news crawler with a funny name☆430Updated this week
- Effort to open-source NLLB checkpoints.☆473Updated last year
- 🔧 Repair JSON!Solution for JSON Anomalies from LLMs.☆338Updated 4 months ago
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆212Updated 4 months ago
- A lightweight script for processing HTML page to markdown format with support for code blocks☆82Updated last year
- Python API for https://vespa.ai, the open big data serving engine☆154Updated this week