mixedbread-ai / batched
The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching of inference workloads.
☆119Updated last month
Alternatives and similar repositories for batched:
Users that are interested in batched are comparing it to the libraries listed below
- Late Interaction Models Training & Retrieval☆228Updated this week
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆170Updated 4 months ago
- Generalist and Lightweight Model for Text Classification☆59Updated last week
- minimal pytorch implementation of bm25 (with sparse tensors)☆97Updated 10 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆44Updated 4 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- NLP with Rust for Python 🦀🐍☆60Updated 7 months ago
- ☆147Updated last month
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆99Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆249Updated 6 months ago
- experiments with inference on llama☆104Updated 7 months ago
- Python API for https://vespa.ai, the open big data serving engine☆113Updated this week
- Using open source LLMs to build synthetic datasets for direct preference optimization☆51Updated 11 months ago
- ☆207Updated 6 months ago
- ☆110Updated 4 months ago
- Structured generation in Rust☆171Updated this week
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆169Updated last week
- ☆25Updated 7 months ago
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆79Updated 10 months ago
- ☆57Updated 2 months ago
- Vector Database with support for late interaction and token level embeddings.☆51Updated 4 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆225Updated 2 months ago
- code for training & evaluating Contextual Document Embedding models☆166Updated 2 weeks ago
- ☆92Updated last year
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆182Updated 3 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆63Updated 2 months ago
- Efficient vector database for hundred millions of embeddings.☆206Updated 8 months ago
- Tools to make language models a bit easier to use☆33Updated last week
- An introduction to LLM Sampling☆75Updated last month
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆91Updated last month