unifyai / aibench-llm-endpoints
Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
☆17Updated last year
Alternatives and similar repositories for aibench-llm-endpoints:
Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated 10 months ago
- LLM model runway server☆13Updated last year
- Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.☆63Updated this week
- Tailored cloud solutions based on use case, cost, and preferences using natural language with Agentic AI to research, design, price, diag…☆31Updated 5 months ago
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 6 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆30Updated this week
- Knowledge for GPTScript☆29Updated 4 months ago
- Geniusrise: Framework for building geniuses☆60Updated 10 months ago
- Routing on Random Forest (RoRF)☆136Updated 6 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆89Updated last month
- A collection of tools for your LLMs that run on Modal☆16Updated last month
- ☆12Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated 10 months ago
- Quickly and securely turn any Linux box into a build and deployment assistant☆24Updated 5 months ago
- This repository is a combination of llama workflows and agents together which is a powerful concept.☆17Updated 7 months ago
- Streamlit app for recommending eval functions using prompt diffs☆27Updated last year
- A new benchmark for measuring LLM's capability to detect bugs in large codebase.☆29Updated 9 months ago
- ☆12Updated 8 months ago
- Code interpreter support for o1☆32Updated 6 months ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated last month
- LLM-Powered Analyses of your GitHub Community using EvaDB☆24Updated last year
- A specification for OpenInference, a semantic mapping of ML inferences☆46Updated 11 months ago
- convert natural language into technical diagrams☆12Updated 3 months ago
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 6 months ago
- The Arcee client for executing domain-adpated language model routines https://pypi.org/project/arcee-py/☆27Updated 5 months ago
- ☆38Updated last week
- BigBertha is an architecture design that demonstrates how automated LLMOps (Large Language Models Operations) can be achieved on any Kube…☆27Updated last year
- Self-host LLMs with vLLM and BentoML☆94Updated last week
- Run Structured LLM Inference with Easy Parallelism☆15Updated 2 months ago
- Visualize any repo or codebase into diagram or animation☆17Updated 5 months ago