Alternatives and similar repositories for aibench-llm-endpoints:

Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below

• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated 11 months ago
• premAI-io / Ayup
  Quickly and securely turn any Linux box into a build and deployment assistant
  ☆24Updated 7 months ago
• lancedb / ragged
  ☆19Updated 6 months ago
• arcee-ai / arcee-python
  The Arcee client for executing domain-adpated language model routines https://pypi.org/project/arcee-py/
  ☆27Updated 7 months ago
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆93Updated 2 months ago
• humanlayer / agentcontrolplane
  ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…
  ☆67Updated 2 weeks ago
• NVIDIA-AI-Blueprints / llm-router
  Route LLM requests to the best model for the task at hand.
  ☆43Updated last month
• substratusai / vllm-docker
  ☆59Updated last month
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 11 months ago
• robbyt / llm_proxy
  AI aware proxy
  ☆18Updated 7 months ago
• j4ys0n / llm-proxy
  TLS & API keys for your LLM APIs
  ☆16Updated 5 months ago
• itsPreto / VECTR8
  Embed anything.
  ☆29Updated 11 months ago
• pulumiverse / katwalk
  LLM model runway server
  ☆13Updated last year
• HammingHQ / bug-in-the-code-stack
  A new benchmark for measuring LLM's capability to detect bugs in large codebase.
  ☆30Updated 11 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 4 months ago
• alexminnaar / Diagify
  convert natural language into technical diagrams
  ☆14Updated 4 months ago
• dstackai / gpuhunt
  GPU prices aggregator for cloud providers
  ☆37Updated last week
• lucyknada / detective-needle-llm
  ☆12Updated 7 months ago
• raphaelmansuy / iteration_of_tought
  Example implementation of Iteration of Tought - Gives a star if you like the project
  ☆41Updated 4 months ago
• morgangiraud / text-to-sql-proto
  A text-to-SQL prototype on the northwind sqlite dataset
  ☆12Updated 7 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• FanaHOVA / openai-o1-code-interpreter
  Code interpreter support for o1
  ☆32Updated 7 months ago
• quantalogic / qllm
  QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…
  ☆33Updated last month
• gptscript-ai / function-calling-test-suite
  ☆12Updated 10 months ago
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆144Updated 6 months ago
• docqai / docq
  Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.
  ☆64Updated 6 months ago
• run-llama / llamabot
  ☆160Updated last year
• computer-reinvention / ChainFactory
  Run Structured LLM Inference with Easy Parallelism
  ☆16Updated 3 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆109Updated this week
• PropsAI / agentserve
  A framework for hosting and scaling AI agents.
  ☆34Updated 5 months ago