unifyai / aibench-llm-endpointsLinks
Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub
☆17Updated last year
Alternatives and similar repositories for aibench-llm-endpoints
Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below
Sorting:
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated last year
- Benchmarking tool for assessing LLM models' performance across different hardwares☆17Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.☆30Updated 5 months ago
- ☆62Updated 2 months ago
- convert natural language into technical diagrams☆14Updated 6 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆105Updated 4 months ago
- Deploy and Scale LLM-based applications☆26Updated 2 years ago
- A text-to-SQL prototype on the northwind sqlite dataset☆12Updated 9 months ago
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆83Updated last week
- Quickly and securely turn any Linux box into a build and deployment assistant☆24Updated 8 months ago
- Geniusrise: Framework for building geniuses☆60Updated last year
- Chunk Dedupe Estimation☆14Updated 7 months ago
- GPU Environment Management for Visual Studio Code☆38Updated last year
- ☆19Updated 8 months ago
- GraphRag vs Embeddings☆14Updated 11 months ago
- Fine-tuning and serving LLMs on any cloud☆90Updated last year
- The AI-powered CLI Assistant☆27Updated last year
- The backend behind the LLM-Perf Leaderboard☆10Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Blueprint by Mozilla.ai for answering questions about structured documents☆34Updated 3 months ago
- FalkorDB-Browser is a visualization UI for FalkorDB.☆32Updated this week
- ☆13Updated last year
- ☆12Updated 9 months ago
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆80Updated 2 weeks ago
- Tailored cloud solutions based on use case, cost, and preferences using natural language with Agentic AI to research, design, price, diag…☆33Updated 3 weeks ago
- Embed anything.☆28Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated 10 months ago
- A simple DAG for executing LLM calls and using tools.☆41Updated last year
- ☆18Updated 5 months ago
- The official repository for the Anything But Wrappers: Llama Edition Hackameetup☆22Updated last year