mixedbread-ai / ofenLinks
WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included
☆17Updated last year
Alternatives and similar repositories for ofen
Users that are interested in ofen are comparing it to the libraries listed below
Sorting:
- Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…☆19Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated last year
- DPO, but faster 🚀☆47Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- ☆20Updated 10 months ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Updated last year
- ☆57Updated last month
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆155Updated 6 months ago
- Crispy reranking models by Mixedbread☆45Updated 4 months ago
- ☆48Updated last year
- Utilities for Training Very Large Models☆58Updated last year
- A fast RWKV Tokenizer written in Rust☆54Updated 5 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆76Updated 2 weeks ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆90Updated last month
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆40Updated last year
- KV Cache Steering for Inducing Reasoning in Small Language Models☆46Updated 6 months ago
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆35Updated 11 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated 2 years ago
- ☆41Updated last year
- ☆90Updated 7 months ago
- ☆50Updated last year
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated 3 months ago
- Latent Large Language Models☆19Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- Code for paper: Long cOntext aliGnment via efficient preference Optimization☆24Updated 4 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 3 months ago
- GoldFinch and other hybrid transformer components☆45Updated last year
- ☆53Updated 3 months ago
- ☆29Updated 2 years ago
- ☆82Updated 2 months ago