leoguillaume / vllm-embeddingLinks
Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
☆44Updated last year
Alternatives and similar repositories for vllm-embedding
Users that are interested in vllm-embedding are comparing it to the libraries listed below
Sorting:
- Open Source Text Embedding Models with OpenAI Compatible API☆165Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆66Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆69Updated last month
- TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding mode…☆27Updated last year
- ☆51Updated last year
- Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]☆88Updated 11 months ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated 4 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆96Updated 8 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆241Updated last year
- Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24☆151Updated last year
- ☆165Updated 5 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆81Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 9 months ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆139Updated last year
- Function Calling Benchmark & Testing☆92Updated last year
- Evaluation of bm42 sparse indexing algorithm☆72Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Develop, evaluate and monitor LLM applications at scale☆98Updated last year
- Data preparation code for Amber 7B LLM☆94Updated last year
- A framework for evaluating function calls made by LLMs☆39Updated last year
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆68Updated 2 years ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated last year
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆107Updated 5 months ago
- ☆74Updated last year
- Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.☆73Updated last year
- Synthetic Data for LLM Fine-Tuning☆120Updated 2 years ago
- Simple examples using Argilla tools to build AI☆57Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated 2 years ago
- ☆101Updated last year