stephantul / skeletokenLinks
Datamodels for hugging face tokenizers
☆86Updated 3 weeks ago
Alternatives and similar repositories for skeletoken
Users that are interested in skeletoken are comparing it to the libraries listed below
Sorting:
- ☆89Updated 5 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆67Updated 2 months ago
- Pre-train Static Word Embeddings☆94Updated 3 months ago
- Python library to use Pleias-RAG models☆67Updated 7 months ago
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆67Updated 3 weeks ago
- ☆53Updated 10 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆154Updated 5 months ago
- PyLate efficient inference engine☆68Updated 3 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆88Updated last month
- NLP with Rust for Python 🦀🐍☆70Updated 7 months ago
- Generalist and Lightweight Model for Text Classification☆167Updated 3 weeks ago
- Simple UI for debugging correlations of text embeddings☆305Updated 6 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆33Updated last year
- Nearly Inference Free Embeddings: make your RAG queries 500x faster☆66Updated last month
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆68Updated last month
- Train LLM on Hugging Face infra☆67Updated last month
- ☆160Updated last year
- 🤝 Trade any tensors over the network☆30Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- Small python package to measure OCR quality and other related metrics.☆25Updated last year
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last month
- An introduction to LLM Sampling☆79Updated last year
- High-Performance Engine for Multi-Vector Search☆195Updated this week
- Hugging Face Jobs☆19Updated 5 months ago
- ☆124Updated last year
- ☆56Updated 10 months ago
- Crispy reranking models by Mixedbread☆42Updated 3 months ago
- ☆101Updated 6 months ago
- ☆31Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 3 months ago