bentoml / BentoVLLM
Self-host LLMs with vLLM and BentoML
☆74Updated this week
Related projects ⓘ
Alternatives and complementary repositories for BentoVLLM
- Experimental Code for StructuredRAG: Structured Outputs in Retrieval-Augmented Generation☆94Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆165Updated 2 weeks ago
- Simple examples using Argilla tools to build AI☆40Updated this week
- Dynamic Metadata based RAG Framework☆71Updated 3 months ago
- ☆75Updated 5 months ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆57Updated 4 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆74Updated 2 months ago
- ☆46Updated this week
- ☆105Updated last month
- GPT-4 Level Conversational QA Trained In a Few Hours☆55Updated 3 months ago
- DSPY on action with OpenSource LLMs.☆57Updated 7 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆53Updated 3 weeks ago
- ☆94Updated 2 months ago
- ☆64Updated 5 months ago
- ☆78Updated this week
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆36Updated 9 months ago
- ☆18Updated this week
- Open source and AI-powered web search engine: local, private, dockerized and supported by a fluffy llama🦙☆51Updated 3 months ago
- ☆119Updated this week
- RAG example using DSPy, Gradio, FastAPI☆66Updated 7 months ago
- One click templates for inferencing Language Models☆119Updated this week
- A collection of all available inference solutions for the LLMs☆73Updated 2 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 4 months ago
- Tutorial for building LLM router☆163Updated 4 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆61Updated 2 weeks ago
- End-to-End LLM Guide☆97Updated 4 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆57Updated 4 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆81Updated this week
- Official homepage for "Self-Harmonized Chain of Thought"☆83Updated 2 months ago
- Routing on Random Forest (RoRF)☆84Updated last month