superlinear-ai / wtpsplit-liteLinks
✂️ Sentence segmentation with wtpsplit's state-of-the-art Segment any Text (SaT) models
☆29Updated 3 months ago
Alternatives and similar repositories for wtpsplit-lite
Users that are interested in wtpsplit-lite are comparing it to the libraries listed below
Sorting:
- NLP with Rust for Python 🦀🐍☆70Updated 8 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆67Updated 3 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆27Updated last year
- ☆90Updated 6 months ago
- Efficient few-shot learning with cross-encoders.☆61Updated last year
- Model implementation for the contextual embeddings project☆40Updated 7 months ago
- My NER Experiments with ModernBERT and Ettin☆26Updated 6 months ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated 2 months ago
- Pre-train Static Word Embeddings☆94Updated 4 months ago
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆68Updated last month
- Generalist and Lightweight Model for Text Classification☆167Updated last week
- Python library to use Pleias-RAG models☆68Updated 8 months ago
- Datamodels for hugging face tokenizers☆86Updated this week
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆22Updated 6 months ago
- Crispy reranking models by Mixedbread☆43Updated 4 months ago
- Library for fast text representation and classification.☆31Updated 2 years ago
- Small python package to measure OCR quality and other related metrics.☆25Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆154Updated 6 months ago
- State-of-the-art paired encoder and decoder models (17M-1B params)☆56Updated 5 months ago
- INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.☆24Updated 2 years ago
- ☆53Updated 11 months ago
- Source code and data for Like a Good Nearest Neighbor☆30Updated last year
- 🔢 Work with static vector models☆36Updated 9 months ago
- ☆83Updated 2 months ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆61Updated 2 years ago
- ☆26Updated 10 months ago
- Efficiently find the best-suited language model (LM) for your NLP task☆133Updated 5 months ago
- High-Performance Engine for Multi-Vector Search☆201Updated last week
- Next-generation Punkt sentence boundary detection with zero dependencies☆27Updated 2 months ago
- Notebooks for training universal 0-shot classifiers on many different tasks☆137Updated last year