Alternatives and similar repositories for wtpsplit

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆856Updated 10 months ago
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,213Updated 3 weeks ago
• Vaibhavs10 / fast-whisper-finetuning
  ☆522Updated 11 months ago
• SeanLee97 / AnglE
  Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
  ☆547Updated 3 months ago
• naver / splade
  SPLADE: sparse neural search (SIGIR21, SIGIR22)
  ☆860Updated last year
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆701Updated last week
• fe1ixxu / ALMA
  State-of-the-art LLM-based translation models.
  ☆534Updated 2 months ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆434Updated 5 months ago
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,850Updated 3 weeks ago
• huggingface / speechbox
  ☆359Updated last year
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,016Updated 2 years ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,419Updated last week
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,267Updated 5 months ago
• McGill-NLP / llm2vec
  Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
  ☆1,545Updated 5 months ago
• dorianbrown / rank_bm25
  A Collection of BM25 Algorithms in Python
  ☆1,196Updated 8 months ago
• shon-otmazgin / fastcoref
  ☆164Updated last year
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆157Updated last year
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆579Updated 2 years ago
• castorini / pyserini
  Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
  ☆1,878Updated this week
• hitz-zentroa / GoLLIE
  Guideline following Large Language Model for Information Extraction
  ☆380Updated 8 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆552Updated last year
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆207Updated last month
• ChenghaoMou / text-dedup
  All-in-one text de-duplication
  ☆690Updated last month
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆367Updated 3 months ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆363Updated last year
• raphaelsty / neural-cherche
  Neural Search
  ☆358Updated 3 months ago
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,509Updated 2 months ago
• stanfordnlp / string2string
  String-to-String Algorithms for Natural Language Processing
  ☆549Updated 11 months ago
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆868Updated last year
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆452Updated 2 weeks ago