leoguillaume / vllm-embeddingLinks
Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
☆44Updated last year
Alternatives and similar repositories for vllm-embedding
Users that are interested in vllm-embedding are comparing it to the libraries listed below
Sorting:
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated 4 months ago
- ☆51Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆69Updated 2 months ago
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆234Updated 7 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆97Updated 8 months ago
- FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)☆246Updated 2 years ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated 2 years ago
- Open Source Text Embedding Models with OpenAI Compatible API☆167Updated last year
- Evaluation of bm42 sparse indexing algorithm☆72Updated last year
- Synthetic Data for LLM Fine-Tuning☆120Updated 2 years ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆138Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆83Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆114Updated 9 months ago
- TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding mode…☆27Updated last year
- Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]☆88Updated last year
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆68Updated 2 years ago
- ☆24Updated last year
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆107Updated 6 months ago
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆152Updated last year
- ☆67Updated 10 months ago
- One Line To Build Zero-Data Classifiers in Minutes☆62Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆92Updated last year
- ☆140Updated 5 months ago
- A framework for evaluating function calls made by LLMs☆40Updated last year
- ☆32Updated last year
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- ☆61Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆47Updated last year
- A memory framework for Large Language Models and Agents.☆181Updated last year