unifyai / aibench-llm-endpointsLinks
Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
☆17Updated last year
Alternatives and similar repositories for aibench-llm-endpoints
Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below
Sorting:
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated last year
- Quickly and securely turn any Linux box into a build and deployment assistant☆24Updated 8 months ago
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 8 months ago
- Geniusrise: Framework for building geniuses☆60Updated last year
- ☆60Updated 2 months ago
- Knowledge for GPTScript☆29Updated 7 months ago
- convert natural language into technical diagrams☆14Updated 5 months ago
- A new benchmark for measuring LLM's capability to detect bugs in large codebase.☆30Updated 11 months ago
- ☆12Updated 8 months ago
- LLM model runway server☆13Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆36Updated last year
- Open source multi modal chat interface☆16Updated last year
- LLM-Powered Analyses of your GitHub Community using EvaDB☆24Updated last year
- AI aware proxy☆18Updated 8 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆99Updated 3 months ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆30Updated 5 months ago
- This is a landscape of the infrastructure that powers the generative AI ecosystem☆146Updated 7 months ago
- TLS & API keys for your LLM APIs☆16Updated 5 months ago
- A framework for hosting and scaling AI agents.☆35Updated 6 months ago
- Creating Generative AI Apps which work☆17Updated last month
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆81Updated last week
- Run code-llama with 50k tokens using flash attention and better transformer☆12Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆77Updated 3 months ago
- An awesome & curated list of best LLMOps tools for developers☆24Updated last year
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated last month
- The AI-powered CLI Assistant☆26Updated last year
- ☆41Updated 4 months ago
- Git scrapers for scraping the fediverse☆17Updated this week
- Benchmarking tool for assessing LLM models' performance across different hardwares☆16Updated last year
- Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Hu…☆19Updated this week