michaelfeil / infinity
Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models, clip, clap and colpali
☆1,430Updated this week
Related projects ⓘ
Alternatives and complementary repositories for infinity
- Fast, Accurate, Lightweight Python library to make State of the Art Embedding☆1,492Updated this week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,042Updated this week
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆645Updated last month
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,036Updated 2 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,612Updated this week
- Enforce the output format (JSON Schema, Regex etc) of a language model☆1,520Updated 3 weeks ago
- A blazing fast inference solution for text embeddings models☆2,813Updated this week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,178Updated this week
- High-performance retrieval engine for unstructured data☆852Updated last week
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,084Updated this week
- Developer APIs to Accelerate LLM Projects☆1,419Updated 3 weeks ago
- Efficient Retrieval Augmentation and Generation Framework☆1,328Updated this week
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆942Updated 2 months ago
- Chat language model that can use tools and interpret the results☆1,416Updated this week
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆874Updated last week
- ☆796Updated 2 weeks ago
- Large-scale LLM inference engine☆1,106Updated this week
- ☆705Updated last month
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆574Updated this week
- Open-source tool to visualise your RAG 🔮☆1,083Updated 7 months ago
- Deploy your agentic worfklows to production☆1,819Updated this week
- Reliable LLM Memory for AI Applications and AI Agents☆874Updated this week
- Empowering RAG with a memory-based data interface for all-purpose applications!☆1,178Updated this week
- Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.☆1,017Updated this week
- Parse files for optimal RAG☆3,033Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,026Updated last week
- Optimizing inference proxy for LLMs☆1,329Updated this week
- A realtime serving engine for Data-Intensive Generative AI Applications☆909Updated this week
- Tools for merging pretrained large language models.☆4,788Updated this week
- Fine-Tuning Embedding for RAG with Synthetic Data☆468Updated last year