unifyai / aibench-llm-endpointsLinks
Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
β17Updated last year
Alternatives and similar repositories for aibench-llm-endpoints
Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below
Sorting:
- π‘ Deploy AI models and apps to Kubernetes without developing a herniaβ32Updated last year
- Quickly and securely turn any Linux box into a build and deployment assistantβ24Updated 8 months ago
- A text-to-SQL prototype on the northwind sqlite datasetβ12Updated 8 months ago
- Geniusrise: Framework for building geniusesβ60Updated last year
- β60Updated 2 months ago
- Knowledge for GPTScriptβ29Updated 7 months ago
- convert natural language into technical diagramsβ14Updated 5 months ago
- A new benchmark for measuring LLM's capability to detect bugs in large codebase.β30Updated 11 months ago
- β12Updated 8 months ago
- LLM model runway serverβ13Updated last year
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for youβ¦β36Updated last year
- Open source multi modal chat interfaceβ16Updated last year
- LLM-Powered Analyses of your GitHub Community usingΒ EvaDBβ24Updated last year
- AI aware proxyβ18Updated 8 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-β¦β99Updated 3 months ago
- Public reports detailing responses to sets of prompts by Large Language Models.β30Updated 5 months ago
- This is a landscape of the infrastructure that powers the generative AI ecosystemβ146Updated 7 months ago
- TLS & API keys for your LLM APIsβ16Updated 5 months ago
- A framework for hosting and scaling AI agents.β35Updated 6 months ago
- Creating Generative AI Apps which workβ17Updated last month
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-lβ¦β81Updated last week
- Run code-llama with 50k tokens using flash attention and better transformerβ12Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)β77Updated 3 months ago
- An awesome & curated list of best LLMOps tools for developersβ24Updated last year
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unlβ¦β33Updated last month
- The AI-powered CLI Assistantβ26Updated last year
- β41Updated 4 months ago
- Git scrapers for scraping the fediverseβ17Updated this week
- Benchmarking tool for assessing LLM models' performance across different hardwaresβ16Updated last year
- Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Huβ¦β19Updated this week