ParisNeo / vllm_proxy_serverLinks
A vllm proxy server to add security and multi model management for vllm servers
☆12Updated last year
Alternatives and similar repositories for vllm_proxy_server
Users that are interested in vllm_proxy_server are comparing it to the libraries listed below
Sorting:
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…☆23Updated 9 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- ☆68Updated last year
- Your Python AI Coder!☆36Updated 8 months ago
- A framework that uses multi-agents to enable users to perform a systematic data science pipeline with just two inputs.☆43Updated last year
- ☆119Updated last year
- Simple Chainlit UI for running llms from Groq and LangChain☆17Updated last year
- ☆11Updated 2 years ago
- Complex RAG backend☆29Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month
- run ollama & gguf easily with a single command☆52Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Updated last year
- ☆135Updated last month
- Simple Chainlit UI for running llms locally using Ollama and LangChain☆46Updated last year
- One Repo To Quickly Build One Docker File for HuggingChat Front and BackEnd☆26Updated 2 years ago
- Dynamic Metadata based RAG Framework☆78Updated 2 months ago
- 🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.☆29Updated 2 years ago
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆118Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆38Updated 2 years ago
- ToolAgents is a lightweight and flexible framework for creating function-calling agents with various language models and APIs.☆27Updated last month
- Easily view and modify JSON datasets for large language models☆87Updated 8 months ago
- RAG example using DSPy, Gradio, FastAPI☆90Updated last year
- Embed anything.☆27Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 9 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated 2 years ago
- ☆24Updated last year
- ☆19Updated last year
- Prompt Jinja2 templates for LLMs☆35Updated 6 months ago
- LlamaCards is a web application that provides a dynamic interface for interacting with LLM models in real-time. This app allows users to …☆38Updated last year
- Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…☆24Updated 2 years ago