Alternatives and similar repositories for wtpsplit:

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆846Updated 8 months ago
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,120Updated last week
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆578Updated 2 years ago
• Vaibhavs10 / fast-whisper-finetuning
  ☆510Updated 9 months ago
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆692Updated last year
• jitsi / jiwer
  Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
  ☆716Updated 2 months ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆425Updated 3 months ago
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆1,955Updated 3 weeks ago
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆681Updated 4 months ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,329Updated last month
• MinishLab / semhash
  Fast Semantic Text Deduplication
  ☆638Updated this week
• huggingface / speechbox
  ☆354Updated last year
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,437Updated 3 weeks ago
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,452Updated 2 weeks ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆127Updated 4 months ago
• OpenNMT / CTranslate2
  Fast inference engine for Transformer models
  ☆3,759Updated 2 weeks ago
• akashmjn / tinydiarize
  Minimal extension of OpenAI's Whisper adding speaker diarization with special tokens
  ☆493Updated last year
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆865Updated last year
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆526Updated last year
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,780Updated 2 months ago
• universal-ner / universal-ner
  ☆360Updated last year
• castorini / pyserini
  Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
  ☆1,809Updated 2 weeks ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,001Updated 2 years ago
• raphaelsty / neural-cherche
  Neural Search
  ☆354Updated last month
• MinishLab / model2vec
  Fast State-of-the-Art Static Embeddings
  ☆1,359Updated this week
• dorianbrown / rank_bm25
  A Collection of BM25 Algorithms in Python
  ☆1,146Updated 6 months ago
• naver / splade
  SPLADE: sparse neural search (SIGIR21, SIGIR22)
  ☆837Updated 11 months ago
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,228Updated 3 months ago
• google-research / deduplicate-text-datasets
  ☆1,206Updated 8 months ago
• xashru / punctuation-restoration
  Punctuation Restoration using Transformer Models for High-and Low-Resource Languages
  ☆212Updated 8 months ago