Knowledgator / FlashDeBERTaLinks
Trully flash implementation of DeBERTa disentangled attention mechanism.
☆67Updated 2 months ago
Alternatives and similar repositories for FlashDeBERTa
Users that are interested in FlashDeBERTa are comparing it to the libraries listed below
Sorting:
- ☆52Updated 9 months ago
- Pre-train Static Word Embeddings☆92Updated 2 months ago
- Versatile framework designed to streamline the integration of your models, as well as those sourced from Hugging Face, into complex progr…☆34Updated 3 months ago
- PyLate efficient inference engine☆67Updated 2 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆69Updated last year
- Python library to use Pleias-RAG models☆67Updated 7 months ago
- Generalist and Lightweight Model for Text Classification☆165Updated this week
- ☆86Updated 4 months ago
- Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba☆31Updated last month
- Datamodels for hugging face tokenizers☆86Updated this week
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last month
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆55Updated 4 months ago
- PyTorch implementation for MRL☆20Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 2 months ago
- Efficient few-shot learning with cross-encoders.☆60Updated last year
- Model implementation for the contextual embeddings project☆36Updated 6 months ago
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆28Updated last year
- ☆48Updated last year
- ☆95Updated 6 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆22Updated 5 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆33Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- QLoRA with Enhanced Multi GPU Support☆37Updated 2 years ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆153Updated 4 months ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆96Updated 2 years ago
- A massively multilingual modern encoder language model☆110Updated last month
- ☆48Updated last month
- Using short models to classify long texts☆21Updated 2 years ago
- State-of-the-art paired encoder and decoder models (17M-1B params)☆53Updated 3 months ago
- QLoRA for Masked Language Modeling☆22Updated 2 years ago