Alternatives and similar repositories for wtpsplit

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆863Updated 10 months ago
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆696Updated last year
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,242Updated last month
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆707Updated last month
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,146Updated last week
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆437Updated 6 months ago
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,279Updated 6 months ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,442Updated 2 weeks ago
• stanfordnlp / string2string
  String-to-String Algorithms for Natural Language Processing
  ☆550Updated 11 months ago
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆158Updated last year
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆367Updated 4 months ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆581Updated 2 years ago
• fe1ixxu / ALMA
  State-of-the-art LLM-based translation models.
  ☆542Updated 3 months ago
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆481Updated last week
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆868Updated last year
• naver / splade
  SPLADE: sparse neural search (SIGIR21, SIGIR22)
  ☆871Updated last year
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,420Updated last month
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,872Updated last month
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,499Updated last month
• jitsi / jiwer
  Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
  ☆757Updated 5 months ago
• dorianbrown / rank_bm25
  A Collection of BM25 Algorithms in Python
  ☆1,208Updated 9 months ago
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,523Updated 3 months ago
• flairNLP / fundus
  A very simple news crawler with a funny name
  ☆390Updated this week
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆556Updated last year
• MinishLab / semhash
  Fast Semantic Text Deduplication & Filtering
  ☆762Updated last month
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆144Updated last month
• Vaibhavs10 / fast-whisper-finetuning
  ☆527Updated last year
• nlp-uoregon / trankit
  Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
  ☆757Updated 9 months ago
• AmenRa / ranx
  ⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
  ☆575Updated 2 weeks ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆248Updated 2 years ago