Alternatives and similar repositories for wtpsplit

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆851Updated 9 months ago
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,193Updated this week
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,254Updated 4 months ago
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,486Updated last month
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,385Updated 3 weeks ago
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,436Updated last week
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆695Updated last year
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,053Updated last week
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆696Updated 5 months ago
• raphaelsty / neural-cherche
  Neural Search
  ☆357Updated 2 months ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆431Updated 4 months ago
• OpenNMT / CTranslate2
  Fast inference engine for Transformer models
  ☆3,831Updated last month
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆542Updated last year
• SeanLee97 / AnglE
  Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
  ☆543Updated 2 months ago
• MinishLab / semhash
  Fast Semantic Text Deduplication & Filtering
  ☆697Updated last week
• jitsi / jiwer
  Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
  ☆729Updated 3 months ago
• PrithivirajDamodaran / FlashRank
  Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…
  ☆809Updated 6 months ago
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆868Updated last year
• fe1ixxu / ALMA
  State-of-the-art LLM-based translation models.
  ☆530Updated last month
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,824Updated this week
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆361Updated last year
• Vaibhavs10 / fast-whisper-finetuning
  ☆521Updated 10 months ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆578Updated 2 years ago
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆395Updated last week
• xhluca / dl-translate
  Library for translating between 200 languages. Built on 🤗 transformers.
  ☆480Updated 9 months ago
• explosion / spacy-layout
  📚 Process PDFs, Word documents and more with spaCy
  ☆615Updated 2 months ago
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,443Updated 2 months ago
• isaacus-dev / semchunk
  A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.
  ☆315Updated 2 months ago
• universal-ner / universal-ner
  ☆363Updated last year
• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆733Updated last year