Alternatives and similar repositories for examples:

Users that are interested in examples are comparing it to the libraries listed below

• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆470Updated last year
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆243Updated last year
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆416Updated 9 months ago
• lm-sys / lm-sys.github.io
  ☆57Updated this week
• character-ai / MuKoe
  ☆53Updated last year
• mlc-ai / llm-perf-bench
  ☆118Updated last year
• nateraw / replicate-examples
  ☆74Updated last year
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆265Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆54Updated 8 months ago
• babelcloud / LLM-RGB
  LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
  ☆160Updated last month
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆437Updated this week
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆345Updated 3 months ago
• GPT-Fathom / GPT-Fathom
  GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well a…
  ☆348Updated last year
• NexaAI / octopus-v4
  AI for all: Build the large graph of the language models
  ☆263Updated 11 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆132Updated 10 months ago
• getcursor / eval
  ☆123Updated last year
• ziwang-com / AGI-MAP
  AGI模块库架构图
  ☆75Updated last year
• WarrenWen666 / AI-Software-Startups
  A Survey of AI startups
  ☆399Updated last year
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆85Updated 3 months ago
• allwefantasy / byzer-agent
  ☆32Updated last year
• kwai / KwaiYii
  ☆223Updated last year
• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆276Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆126Updated last week
• shellc / aify
  AI-native application framework and runtime, simply write a YAML file.
  ☆51Updated last year
• ZhihaoAIRobotic / MetaAgent
  The next generation of Multi-Modal Multi-Agent platform.
  ☆96Updated last month
• dashscope / dash-cookbook
  Receipts for creating AI Applications with APIs from DashScope (and friends)!
  ☆51Updated 7 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆245Updated this week
• 01-ai / Descartes
  ☆108Updated last year
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆18Updated last month
• read-agent / read-agent.github.io
  ☆51Updated 9 months ago