Alternatives and similar repositories for fast-langdetect

Users that are interested in fast-langdetect are comparing it to the libraries listed below

• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆162Updated last year
• DoodleBears / split-lang
  ✨ Split text by languages (e.g. 你喜欢看アニメ吗 -> 你喜欢看 | アニメ | 吗) for NLP tasks (e.g. parse, TTS). Powered by fasttext and budoux
  ☆63Updated 6 months ago
• karminski / streaming-json-py
  A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.
  ☆107Updated 11 months ago
• OpenMatch / NeuScraper
  [ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".
  ☆228Updated last year
• EveripediaNetwork / fastc
  Unattended Lightweight Text Classifiers with LLM Embeddings
  ☆183Updated last year
• ninehills / langeval
  Evaluation for AI apps and agent
  ☆43Updated last year
• ppaanngggg / layoutreader
  A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.
  ☆278Updated last month
• datalab-to / pdftext
  Extract structured text from pdfs quickly
  ☆597Updated 3 months ago
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆160Updated last year
• krystalan / DRT
  Deep Reasoning Translation (DRT) Project
  ☆231Updated 2 weeks ago
• ai8hyf / TF-ID
  TF-ID: Table/Figure IDentifier for academic papers
  ☆240Updated last year
• luweigen / whisper_streaming
  Whisper realtime streaming for long speech-to-text transcription and translation
  ☆121Updated last year
• SivilTaram / code-html-to-markdown
  A lightweight script for processing HTML page to markdown format with support for code blocks
  ☆80Updated last year
• riteshhere / Speaker_diarization
  Speech Diarization for scrum automation
  ☆111Updated 2 years ago
• Unstructured-IO / unstructured-inference
  ☆192Updated last week
• conjuncts / gmft
  Lightweight, performant, deep table extraction
  ☆506Updated last month
• sparticleinc / ASEED
  Conversational Retrieval Evaluation Dataset
  ☆101Updated last month
• huridocs / pdf_paragraphs_extraction
  ☆50Updated last year
• isaacus-dev / semchunk
  A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.
  ☆368Updated last month
• RealAlexandreAI / json-repair
  🔧 Repair JSON！Solution for JSON Anomalies from LLMs.
  ☆275Updated 3 weeks ago
• jina-ai / llm-query-expansion
  Query Expension for Better Query Embedding using LLMs
  ☆57Updated 7 months ago
• puppetm4st3r / baai_m3_simple_server
  This code sets up a simple yet robust server using FastAPI for handling asynchronous requests for embedding generation and reranking task…
  ☆69Updated last year
• bentoml / BentoOCR
  Turn any OCR models into online inference API endpoint 🚀 🌖
  ☆56Updated 5 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆57Updated this week
• py-pdf / benchmarks
  Benchmarking PDF libraries
  ☆310Updated 2 months ago
• winstxnhdw / nllb-api
  A performant high-throughput CPU-based API for Meta's No Language Left Behind (NLLB) using CTranslate2, hosted on Hugging Face Spaces.
  ☆125Updated this week
• aurelio-labs / semantic-chunkers
  ☆235Updated 3 months ago
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆223Updated 3 months ago
• pypdfium2-team / pypdfium2
  Python bindings to PDFium, reasonably cross-platform.
  ☆638Updated this week
• joaodsmarques / LumberChunker
  This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…
  ☆75Updated 11 months ago