Alternatives and similar repositories for aibench-llm-endpoints:

Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below

• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated 10 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 3 months ago
• morgangiraud / text-to-sql-proto
  A text-to-SQL prototype on the northwind sqlite dataset
  ☆12Updated 6 months ago
• dstackai / gpuhunt
  GPU prices aggregator for cloud providers
  ☆34Updated this week
• pulumiverse / katwalk
  LLM model runway server
  ☆13Updated last year
• HammingHQ / bug-in-the-code-stack
  A new benchmark for measuring LLM's capability to detect bugs in large codebase.
  ☆30Updated 10 months ago
• alexminnaar / Diagify
  convert natural language into technical diagrams
  ☆12Updated 4 months ago
• mify-io / mify-llm-editor
  LLM code editor for backend services
  ☆14Updated 5 months ago
• robbyt / llm_proxy
  AI aware proxy
  ☆18Updated 7 months ago
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆92Updated 2 months ago
• run-ai / vscode-genv
  GPU Environment Management for Visual Studio Code
  ☆37Updated last year
• substratusai / vllm-docker
  ☆57Updated 3 weeks ago
• aws-samples / evaluating-large-language-models-using-llm-as-a-judge
  ☆16Updated 3 months ago
• run-ai / jupyterlab_genv
  GPU Environment Management for JupyterLab
  ☆23Updated last year
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 11 months ago
• docqai / docq
  Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.
  ☆62Updated 6 months ago
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆33Updated 11 months ago
• anarchy-ai / llm-speed-benchmark
  Benchmarking tool for assessing LLM models' performance across different hardwares
  ☆16Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆29Updated 10 months ago
• russellballestrini / opencompletion
  Chatroom app where messages are sent to GPT, Claude, Mistral, Together, Grok, Groq, Google, vLLM, Ollama & streamed to the frontend.
  ☆39Updated last month
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• opea-project / GenAIStudio
  GenAI Studio is a low code platform to enable users to construct, evaluate, and benchmark GenAI applications. The platform also provide c…
  ☆37Updated this week
• ray-project / llms-in-prod-workshop-2023
  Deploy and Scale LLM-based applications
  ☆26Updated last year
• run-ai / runai-model-streamer
  ☆191Updated 2 weeks ago
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆21Updated 8 months ago
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated this week
• mystic-ai / chat
  Open source multi modal chat interface
  ☆16Updated 11 months ago
• discus-labs / discus
  A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ
  ☆64Updated last year
• simonw / scrape-fediverse
  Git scrapers for scraping the fediverse
  ☆16Updated this week
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆102Updated this week