Alternatives and similar repositories for wtpsplit

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆894Updated last year
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,447Updated 3 weeks ago
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,361Updated last year
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆760Updated last month
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆702Updated 2 years ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆462Updated last year
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,680Updated this week
• fe1ixxu / ALMA
  State-of-the-art LLM-based translation models.
  ☆577Updated 9 months ago
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,664Updated last month
• dorianbrown / rank_bm25
  A Collection of BM25 Algorithms in Python
  ☆1,291Updated last year
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,607Updated 6 months ago
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆872Updated last year
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆163Updated last year
• MinishLab / semhash
  Fast Semantic Text Deduplication & Filtering
  ☆863Updated last week
• naver / splade
  SPLADE: sparse neural search (SIGIR21, SIGIR22)
  ☆965Updated last year
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆679Updated this week
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆391Updated 9 months ago
• R1j1t / contextualSpellCheck
  ✔️Contextual word checker for better suggestions (not actively maintained)
  ☆417Updated 11 months ago
• nlp-uoregon / trankit
  Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
  ☆784Updated 5 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆589Updated last year
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆185Updated last month
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆211Updated 3 months ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆256Updated 3 years ago
• SeanLee97 / AnglE
  Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
  ☆569Updated 2 months ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆589Updated 2 years ago
• google-research / deduplicate-text-datasets
  ☆1,253Updated last year
• stanfordnlp / string2string
  String-to-String Algorithms for Natural Language Processing
  ☆563Updated last year
• flairNLP / fundus
  A very simple news crawler with a funny name
  ☆427Updated 3 weeks ago
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,587Updated 3 weeks ago
• LIAAD / yake
  Single-document unsupervised keyword extraction
  ☆1,809Updated last month