stephantul / skeletokenLinks
Datamodels for hugging face tokenizers
☆86Updated last week
Alternatives and similar repositories for skeletoken
Users that are interested in skeletoken are comparing it to the libraries listed below
Sorting:
- Pre-train Static Word Embeddings☆90Updated 2 months ago
- ☆86Updated 4 months ago
- Python library to use Pleias-RAG models☆66Updated 6 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆66Updated last month
- ☆51Updated 9 months ago
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆67Updated 4 months ago
- NLP with Rust for Python 🦀🐍☆66Updated 6 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆68Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆151Updated 4 months ago
- Generalist and Lightweight Model for Text Classification☆164Updated 5 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆88Updated last month
- PyLate efficient inference engine☆66Updated 2 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last month
- Hugging Face Jobs☆19Updated 4 months ago
- ☆31Updated last year
- ☆53Updated 9 months ago
- An introduction to LLM Sampling☆79Updated 10 months ago
- Simple UI for debugging correlations of text embeddings☆299Updated 5 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆69Updated last year
- ☆138Updated 2 months ago
- ☆89Updated 5 months ago
- 🤝 Trade any tensors over the network☆30Updated 2 years ago
- Crispy reranking models by Mixedbread☆38Updated last month
- ☆159Updated 11 months ago
- Small python package to measure OCR quality and other related metrics.☆25Updated last year
- Train LLM on Hugging Face infra☆67Updated 2 months ago
- Efficiently find the best-suited language model (LM) for your NLP task☆132Updated 3 months ago
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆79Updated last year
- ☆124Updated last year
- lossily compress representation vectors using product quantization☆59Updated 2 weeks ago