segment-any-text / wtpsplit

Related projects ⓘ

Alternatives and complementary repositories for wtpsplit

• nipunsadvilkar / pySBD
  🐍💯pySBD (Python Sentence Boundary Disambiguation) is a rule-based sentence boundary detection that works out-of-the-box.
  ☆808Updated 3 months ago
• notAI-tech / fastPunct
  Punctuation restoration and spell correction experiments.
  ☆248Updated 3 years ago
• notAI-tech / deepsegment
  A sentence segmenter that actually works!
  ☆302Updated 4 years ago
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆671Updated last year
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆565Updated last year
• R1j1t / contextualSpellCheck
  ✔️Contextual word checker for better suggestions (not actively maintained)
  ☆409Updated last month
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,136Updated 3 months ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆401Updated 3 months ago
• huggingface / speechbox
  ☆347Updated 8 months ago
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆908Updated last week
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,239Updated 2 months ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆971Updated last year
• bjascob / LemmInflect
  A python module for English lemmatization and inflection.
  ☆261Updated last year
• beir-cellar / beir
  A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
  ☆1,622Updated 3 months ago
• xashru / punctuation-restoration
  Punctuation Restoration using Transformer Models for High-and Low-Resource Languages
  ☆204Updated 3 months ago
• jitsi / jiwer
  Evaluate your speech-to-text system with similarity measures such as word error rate (WER)
  ☆639Updated 2 weeks ago
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,160Updated 3 weeks ago
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆203Updated 2 years ago
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆328Updated 2 years ago
• ad-freiburg / large-qa-datasets
  A collection of large question answering datasets
  ☆337Updated 4 months ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆230Updated 2 years ago
• Muennighoff / sgpt
  SGPT: GPT Sentence Embeddings for Semantic Search
  ☆852Updated 9 months ago
• google-research / deduplicate-text-datasets
  ☆1,124Updated 3 months ago
• google-research / byt5
  ☆487Updated 9 months ago
• HLasse / TextDescriptives
  A Python library for calculating a large variety of metrics from text
  ☆315Updated last month
• shon-otmazgin / fastcoref
  ☆147Updated 5 months ago
• facebookresearch / GENRE
  Autoregressive Entity Retrieval
  ☆765Updated last year
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆183Updated last month
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆101Updated 2 weeks ago
• Vaibhavs10 / fast-whisper-finetuning
  ☆461Updated 4 months ago