Alternatives and similar repositories for aibench-llm-endpoints:

Users that are interested in aibench-llm-endpoints are comparing it to the libraries listed below

• premAI-io / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated 8 months ago
• geniusrise / geniusrise
  Geniusrise: Framework for building geniuses
  ☆60Updated 8 months ago
• ray-project / llms-in-prod-workshop-2023
  Deploy and Scale LLM-based applications
  ☆26Updated last year
• lancedb / ragged
  ☆18Updated 4 months ago
• anarchy-ai / llm-speed-benchmark
  Benchmarking tool for assessing LLM models' performance across different hardwares
  ☆15Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆86Updated this week
• pulumiverse / katwalk
  LLM model runway server
  ☆12Updated last year
• HammingHQ / bug-in-the-code-stack
  A new benchmark for measuring LLM's capability to detect bugs in large codebase.
  ☆29Updated 8 months ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 9 months ago
• substratusai / vllm-docker
  ☆52Updated last month
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆29Updated last month
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆16Updated 7 months ago
• zby / LLMEasyTools
  Tools for LLM agents.
  ☆59Updated last month
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• run-ai / runai-model-streamer
  ☆157Updated last week
• j4ys0n / llm-proxy
  TLS & API keys for your LLM APIs
  ☆15Updated 2 months ago
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆29Updated 8 months ago
• The-Swarm-Corporation / swarms-memory
  A collection of pre-build wrappers over common RAG systems like ChromaDB, Weaviate, Pinecone, and othersz!
  ☆29Updated this week
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 3 months ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆28Updated this week
• PrefectHQ / marvin-recipes
  applications of https://github.com/PrefectHQ/marvin
  ☆12Updated last year
• langchain-ai / helm
  Repository hosting Langchain helm charts.
  ☆44Updated this week
• seanchatmangpt / dslmodel
  Structured outputs from DSPy and Jinja2
  ☆21Updated last month
• QAInsights / kel
  Kel - CLI-based AI assistant
  ☆30Updated last year
• arcee-ai / arcee-python
  The Arcee client for executing domain-adpated language model routines https://pypi.org/project/arcee-py/
  ☆27Updated 4 months ago
• dstackai / dstack-examples
  A collection of examples demonstrating how to use dstack
  ☆26Updated 8 months ago
• premAI-io / Ayup
  Quickly and securely turn any Linux box into a build and deployment assistant
  ☆24Updated 4 months ago
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆112Updated 4 months ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆10Updated 9 months ago
• cognitivecomputations / SystemChat
  ☆30Updated 7 months ago