Alternatives and similar repositories for wtpsplit

Users that are interested in wtpsplit are comparing it to the libraries listed below

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆850Updated 8 months ago
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,153Updated 3 weeks ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆429Updated 4 months ago
• AnswerDotAI / ModernBERT
  Bringing BERT into modernity via both architecture changes and scaling
  ☆1,358Updated this week
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,479Updated last month
• dorianbrown / rank_bm25
  A Collection of BM25 Algorithms in Python
  ☆1,164Updated 7 months ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆578Updated 2 years ago
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆694Updated last year
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,345Updated last month
• raphaelsty / neural-cherche
  Neural Search
  ☆355Updated 2 months ago
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,800Updated 2 months ago
• Vaibhavs10 / fast-whisper-finetuning
  ☆516Updated 10 months ago
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆866Updated last year
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆360Updated last year
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,001Updated last week
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,007Updated 2 years ago
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆153Updated last year
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,245Updated 4 months ago
• OpenNMT / CTranslate2
  Fast inference engine for Transformer models
  ☆3,797Updated last month
• naver / splade
  SPLADE: sparse neural search (SIGIR21, SIGIR22)
  ☆842Updated last year
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,411Updated last week
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆534Updated last year
• asahi417 / tner
  Language model fine-tuning on NER with an easy interface and cross-domain evaluation. "T-NER: An All-Round Python Library for Transformer…
  ☆388Updated 2 years ago
• goodmami / wn
  A modern, interlingual wordnet interface for Python
  ☆243Updated last week
• McGill-NLP / llm2vec
  Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
  ☆1,510Updated 3 months ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆246Updated 2 years ago
• aiola-lab / whisper-medusa
  Whisper with Medusa heads
  ☆833Updated 2 weeks ago
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,044Updated this week
• nlp-uoregon / trankit
  Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
  ☆753Updated 7 months ago
• explosion / spacy-layout
  📚 Process PDFs, Word documents and more with spaCy
  ☆589Updated 2 months ago