mixedbread-ai / ofenLinks
WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included
☆15Updated 8 months ago
Alternatives and similar repositories for ofen
Users that are interested in ofen are comparing it to the libraries listed below
Sorting:
- Showcase how mxbai-embed-large-v1 can be used to produce binary embedding. Binary embeddings enabled 32x storage savings and 40x faster r…☆18Updated last year
- Crispy reranking models by Mixedbread☆31Updated last month
- ☆34Updated 11 months ago
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 11 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆136Updated 2 weeks ago
- NLP with Rust for Python 🦀🐍☆62Updated 3 weeks ago
- ☆45Updated 4 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆55Updated 2 weeks ago
- Pre-train Static Word Embeddings☆76Updated this week
- ☆53Updated 3 months ago
- Training hybrid models for dummies.☆21Updated 4 months ago
- One Line To Build Zero-Data Classifiers in Minutes☆55Updated 8 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆24Updated 2 months ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆179Updated 9 months ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆101Updated last year
- PostText is a QA system for querying your text data. When appropriate structured views are in place, PostText is good at answering querie…☆32Updated last year
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆69Updated 2 weeks ago
- Model implementation for the contextual embeddings project☆26Updated this week
- Latent Large Language Models☆18Updated 9 months ago
- ☆43Updated 3 months ago
- ☆49Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- ☆28Updated 4 months ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- DPO, but faster 🚀☆42Updated 6 months ago
- ☆20Updated last month
- mixedbread ai python sdk☆12Updated 11 months ago