Alternatives and similar repositories for wtpsplit

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆901Updated last year
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,473Updated this week
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,625Updated 2 months ago
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆704Updated 2 years ago
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,737Updated this week
• dorianbrown / rank_bm25
  A Collection of BM25 Algorithms in Python
  ☆1,299Updated last year
• naver / splade
  SPLADE: sparse neural search (SIGIR21, SIGIR22)
  ☆976Updated last year
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,676Updated last month
• AmenRa / ranx
  ⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍
  ☆642Updated 5 months ago
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆393Updated 2 weeks ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆589Updated 2 years ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,625Updated 7 months ago
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆2,061Updated 3 months ago
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,362Updated last year
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆164Updated 2 years ago
• PrithivirajDamodaran / FlashRank
  Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…
  ☆933Updated last month
• fe1ixxu / ALMA
  State-of-the-art LLM-based translation models.
  ☆576Updated 9 months ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆465Updated last year
• SeanLee97 / AnglE
  Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
  ☆566Updated 3 months ago
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,592Updated last month
• MinishLab / semhash
  Fast Multimodal Semantic Deduplication & Filtering
  ☆879Updated last week
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆693Updated 3 weeks ago
• nlp-uoregon / trankit
  Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
  ☆787Updated 6 months ago
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆767Updated 2 weeks ago
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆872Updated last year
• Unbabel / COMET
  A Neural Framework for MT Evaluation
  ☆711Updated 5 months ago
• jitsi / jiwer
  Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
  ☆848Updated 11 months ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆256Updated 3 years ago
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆214Updated 4 months ago
• benbrandt / text-splitter
  Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from R…
  ☆549Updated this week