superlinear-ai / wtpsplit-liteLinks
✂️ Sentence segmentation with wtpsplit's state-of-the-art Segment any Text (SaT) models
☆34Updated 4 months ago
Alternatives and similar repositories for wtpsplit-lite
Users that are interested in wtpsplit-lite are comparing it to the libraries listed below
Sorting:
- NLP with Rust for Python 🦀🐍☆71Updated 8 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆76Updated 2 weeks ago
- Pre-train Static Word Embeddings☆94Updated 5 months ago
- Datamodels for hugging face tokenizers☆99Updated this week
- ☆91Updated 7 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆27Updated last year
- Python library to use Pleias-RAG models☆68Updated 9 months ago
- My NER Experiments with ModernBERT and Ettin☆26Updated 6 months ago
- Small python package to measure OCR quality and other related metrics.☆26Updated last year
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated 3 months ago
- Source code and data for Like a Good Nearest Neighbor☆30Updated last year
- PyLate efficient inference engine☆71Updated last month
- Efficient few-shot learning with cross-encoders.☆62Updated last year
- Library for fast text representation and classification.☆31Updated 2 years ago
- Generalist and Lightweight Model for Text Classification☆169Updated 2 weeks ago
- ☆57Updated last month
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆68Updated 2 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆156Updated 6 months ago
- Notebooks for training universal 0-shot classifiers on many different tasks☆140Updated last year
- Model implementation for the contextual embeddings project☆40Updated 8 months ago
- Crispy reranking models by Mixedbread☆45Updated 4 months ago
- Nearly Inference Free Embeddings: make your RAG queries 500x faster☆70Updated this week
- ☆53Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆22Updated 7 months ago
- A massively multilingual modern encoder language model☆126Updated 3 weeks ago
- ☆59Updated 2 months ago
- Next-generation Punkt sentence boundary detection with zero dependencies☆27Updated 2 months ago
- State-of-the-art paired encoder and decoder models (17M-1B params)☆58Updated 6 months ago
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆82Updated last year
- ☆83Updated 3 months ago