Alternatives and similar repositories for wtpsplit:

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆831Updated 6 months ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆572Updated last year
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,019Updated last month
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,193Updated last month
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆655Updated 2 months ago
• McGill-NLP / llm2vec
  Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
  ☆1,420Updated 3 weeks ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,208Updated this week
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆417Updated last month
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆357Updated last year
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆338Updated 2 years ago
• fe1ixxu / ALMA
  State-of-the-art LLM-based translation models.
  ☆486Updated 3 weeks ago
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆861Updated last year
• notAI-tech / deepsegment
  A sentence segmenter that actually works!
  ☆304Updated 4 years ago
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,709Updated 2 weeks ago
• universal-ner / universal-ner
  ☆349Updated last year
• Unbabel / COMET
  A Neural Framework for MT Evaluation
  ☆542Updated last month
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆684Updated last year
• MinishLab / semhash
  Fast Semantic Text Deduplication
  ☆532Updated last week
• SeanLee97 / AnglE
  Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
  ☆514Updated last week
• dorianbrown / rank_bm25
  A Collection of BM25 Algorithms in Python
  ☆1,107Updated 4 months ago
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,241Updated last week
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆146Updated last year
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆166Updated last year
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆267Updated last month
• davidberenstein1957 / fast-sentence-transformers
  Simply, faster, sentence-transformers
  ☆141Updated 5 months ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆983Updated last year
• jitsi / jiwer
  Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
  ☆688Updated last week
• cisnlp / GlotLID
  Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆116Updated 2 months ago
• ZNLP / BigTranslate
  BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
  ☆221Updated last year
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆108Updated 3 months ago