stephantul / skeletokenLinks
Datamodels for hugging face tokenizers
☆85Updated 3 weeks ago
Alternatives and similar repositories for skeletoken
Users that are interested in skeletoken are comparing it to the libraries listed below
Sorting:
- Python library to use Pleias-RAG models☆63Updated 5 months ago
- Pre-train Static Word Embeddings☆87Updated last month
- ☆79Updated 3 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆66Updated 3 weeks ago
- NLP with Rust for Python 🦀🐍☆65Updated 5 months ago
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆67Updated 3 months ago
- ☆49Updated 8 months ago
- Generalist and Lightweight Model for Text Classification☆163Updated 4 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆87Updated last month
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last month
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆151Updated 3 months ago
- Simple UI for debugging correlations of text embeddings☆296Updated 4 months ago
- PyLate efficient inference engine☆66Updated last month
- ☆31Updated 11 months ago
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆51Updated last month
- 🤝 Trade any tensors over the network☆30Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆68Updated last year
- ☆136Updated 2 months ago
- An introduction to LLM Sampling☆79Updated 10 months ago
- ☆52Updated 8 months ago
- ☆86Updated 4 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆33Updated last year
- ☆20Updated last year
- ☆124Updated 11 months ago
- ☆159Updated 10 months ago
- Small python package to measure OCR quality and other related metrics.☆25Updated last year
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆79Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 11 months ago
- Crispy reranking models by Mixedbread☆37Updated last month