Alternatives and similar repositories for langdetect

Users that are interested in langdetect are comparing it to the libraries listed below

• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆164Updated 2 years ago
• mungg / FABLES
  ☆59Updated last year
• yuxiaw / OpenFactCheck
  ☆55Updated last year
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆64Updated last year
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆61Updated last year
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆186Updated 2 months ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated 2 years ago
• DunZhang / Stella
  ☆61Updated last year
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆75Updated last year
• vipulraheja / coedit
  Official implementation of the paper "CoEdIT: Text Editing by Task-Specific Instruction Tuning" (EMNLP 2023)
  ☆136Updated last year
• EleanorJiang / BlonDe
  Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …
  ☆79Updated 2 years ago
• allenai / mmda
  multimodal document analysis
  ☆166Updated 2 months ago
• Knowledgator / unlimited_classifier
  Universal text classifier for generative models
  ☆24Updated last year
• EleutherAI / stackexchange-dataset
  Python tools for processing the stackexchange data dumps into a text dataset for Language Models
  ☆86Updated 2 years ago
• malteos / legal-document-similarity
  Legal document similarity - Code, data, and models for the ICAIL 2021 paper "Evaluating Document Representations for Content-based Legal …
  ☆32Updated 4 years ago
• chatnoir-eu / chatnoir-resiliparse
  A robust web archive analytics toolkit
  ☆127Updated 3 months ago
• AmenRa / retriv
  A Python Search Engine for Humans 🥸
  ☆243Updated last month
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆26Updated last year
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆179Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated 2 years ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆191Updated 6 months ago
• illuin-tech / contextual-embeddings
  Model implementation for the contextual embeddings project
  ☆40Updated 7 months ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆256Updated 3 years ago
• hyintell / RetrievalQA
  Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…
  ☆68Updated last year
• Snowflake-Labs / arctic-embed
  ☆83Updated 2 months ago
• vespa-engine / pyvespa
  Python API for https://vespa.ai, the open big data serving engine
  ☆157Updated last week
• openlanguagedata / seed
  Seed Machine Translation Data
  ☆33Updated last year
• mingdachen / SummScreen
  SummScreen: A Dataset for Abstractive Screenplay Summarization (ACL 2022)
  ☆41Updated 3 years ago
• allenai / open-mds
  The corresponding code for our paper: "Exploring the Challenges of Open Domain Multi-Document Summarization". Do not hesitate to open an …
  ☆33Updated 2 years ago