unifyai / aibench-llm-endpointsLinks
Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
☆17Updated last year
Alternatives and similar repositories for aibench-llm-endpoints
Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below
Sorting:
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated last year
- LLM model runway server☆13Updated last year
- Geniusrise: Framework for building geniuses☆60Updated last year
- Deploy and Scale LLM-based applications☆26Updated 2 years ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆147Updated 8 months ago
- Tutorial to get started with SkyPilot!☆58Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.☆30Updated 6 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- ☆37Updated this week
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆115Updated last week
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆106Updated 4 months ago
- Benchmarking tool for assessing LLM models' performance across different hardwares☆17Updated last year
- Large Language Model Hosting Container☆89Updated last week
- LLM-Powered Analyses of your GitHub Community using EvaDB☆24Updated last year
- Serverless runtime environment tailored for code produced by LLMs. Automatic API generation from your code, support for multiple programm…☆25Updated 2 years ago
- Tools for formatting large language model prompts.☆13Updated last year
- GPU Environment Management for Visual Studio Code☆38Updated last year
- GPU prices aggregator for cloud providers☆39Updated last week
- The AI-powered CLI Assistant☆28Updated last year
- Tools for LLM agents.☆63Updated 6 months ago
- ☆228Updated this week
- Knowledge for GPTScript☆29Updated 8 months ago
- Run code-llama with 50k tokens using flash attention and better transformer☆12Updated last year
- Deploy LangChain Tools Anywhere☆42Updated last month
- Finetune LLMs on K8s by using Runbooks☆169Updated 10 months ago
- Embed anything.☆28Updated last year
- Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Hu…☆20Updated last month
- A specification for OpenInference, a semantic mapping of ML inferences☆47Updated last year
- A collection of tools that can be used for LLM function calling☆33Updated last month
- ☆62Updated 3 months ago