Alternatives and similar repositories for wtpsplit

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆875Updated last year
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,319Updated last week
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆694Updated 2 years ago
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,342Updated 3 weeks ago
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆729Updated 3 months ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,521Updated 2 months ago
• dorianbrown / rank_bm25
  A Collection of BM25 Algorithms in Python
  ☆1,241Updated 11 months ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆451Updated 8 months ago
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,497Updated 3 months ago
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,313Updated 8 months ago
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆584Updated this week
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆873Updated last year
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,956Updated 3 months ago
• naver / splade
  SPLADE: sparse neural search (SIGIR21, SIGIR22)
  ☆908Updated last year
• SeanLee97 / AnglE
  Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
  ☆554Updated 6 months ago
• isaacus-dev / semchunk
  A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.
  ☆368Updated last month
• fe1ixxu / ALMA
  State-of-the-art LLM-based translation models.
  ☆553Updated 5 months ago
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,535Updated 3 months ago
• PrithivirajDamodaran / FlashRank
  Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…
  ☆858Updated this week
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,565Updated last month
• MinishLab / semhash
  Fast Semantic Text Deduplication & Filtering
  ☆808Updated 2 weeks ago
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆377Updated 6 months ago
• Unbabel / COMET
  A Neural Framework for MT Evaluation
  ☆659Updated 2 weeks ago
• eole-nlp / eole
  Open language modeling toolkit based on PyTorch
  ☆145Updated 2 weeks ago
• AmenRa / ranx
  ⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
  ☆591Updated last month
• Vaibhavs10 / fast-whisper-finetuning
  ☆539Updated last year
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆573Updated last year
• R1j1t / contextualSpellCheck
  ✔️Contextual word checker for better suggestions (not actively maintained)
  ☆417Updated 7 months ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆587Updated 2 years ago
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆212Updated this week