stephantul / skeletokenLinks
Datamodels for hugging face tokenizers
☆77Updated last week
Alternatives and similar repositories for skeletoken
Users that are interested in skeletoken are comparing it to the libraries listed below
Sorting:
- Pre-train Static Word Embeddings☆85Updated 3 weeks ago
- ☆71Updated 3 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆65Updated this week
- Generalist and Lightweight Model for Text Classification☆161Updated 3 months ago
- ☆49Updated 7 months ago
- Python library to use Pleias-RAG models☆62Updated 5 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆149Updated 2 months ago
- NLP with Rust for Python 🦀🐍☆65Updated 4 months ago
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆67Updated 3 months ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 2 weeks ago
- Simple UI for debugging correlations of text embeddings☆292Updated 4 months ago
- PyLate efficient inference engine☆64Updated 3 weeks ago
- 🤝 Trade any tensors over the network☆30Updated 2 years ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆103Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆87Updated 2 weeks ago
- Crispy reranking models by Mixedbread☆36Updated 2 weeks ago
- Chunk your text using gpt4o-mini more accurately☆44Updated last year
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆32Updated last year
- An introduction to LLM Sampling☆79Updated 9 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 11 months ago
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆50Updated 2 weeks ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆66Updated last year
- ☆83Updated 4 months ago
- ☆124Updated 11 months ago
- ☆159Updated 10 months ago
- ☆210Updated 3 months ago
- A library for working with prompt templates locally or on the Hugging Face Hub.☆50Updated 6 months ago
- ☆136Updated last month
- Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training☆67Updated 7 months ago