unifyai / aibench-llm-endpoints
Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
☆17Updated 11 months ago
Alternatives and similar repositories for aibench-llm-endpoints:
Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated 7 months ago
- ☆49Updated 2 weeks ago
- Benchmarking tool for assessing LLM models' performance across different hardwares☆15Updated last year
- Tutorial for building LLM router☆170Updated 5 months ago
- Embed anything.☆28Updated 7 months ago
- Self-host LLMs with vLLM and BentoML☆79Updated this week
- LLM Agents: Landing Page Generation for an E-commerce Platform Using CrewAI, Groq-LangChain and Qdrant☆13Updated 7 months ago
- The backend behind the LLM-Perf Leaderboard☆10Updated 8 months ago
- TLS & API keys for your LLM APIs☆15Updated last month
- Public reports detailing responses to sets of prompts by Large Language Models.☆28Updated 2 weeks ago
- Tutorial to get started with SkyPilot!☆56Updated 8 months ago
- Supervised fine-tuning of Google's open-source Gemma-2B model to optimize writing Python code☆21Updated 10 months ago
- A desktop for AI agents☆36Updated this week
- Quickly and securely turn any Linux box into a build and deployment assistant☆24Updated 3 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆68Updated 4 months ago
- Streamlit app for recommending eval functions using prompt diffs☆26Updated last year
- A better way of testing, inspecting, and analyzing AI Agent traces.☆22Updated this week
- Tailored cloud solutions based on use case, cost, and preferences using natural language with Agentic AI to research, design, price, diag…☆29Updated 2 months ago
- LLM model runway server☆12Updated last year
- A collection of examples demonstrating how to use dstack☆26Updated 7 months ago
- A framework for evaluating function calls made by LLMs☆36Updated 5 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆35Updated 8 months ago
- Routing on Random Forest (RoRF)☆98Updated 3 months ago
- A visual tool to interpret and understand PyTorch machine learning models☆15Updated 11 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆45Updated 4 months ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆31Updated last week
- Tools for LLM agents.☆57Updated 3 weeks ago
- Creating Generative AI Apps which work☆16Updated 6 months ago
- run ollama & gguf easily with a single command☆49Updated 8 months ago