Alternatives and similar repositories for examples:

Users that are interested in examples are comparing it to the libraries listed below

• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆469Updated last year
• lm-sys / lm-sys.github.io
  ☆54Updated 2 months ago
• modelscope / modelscope-studio
  A third-party component library based on Gradio.
  ☆92Updated this week
• ziwang-com / AGI-MAP
  AGI模块库架构图
  ☆75Updated last year
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆238Updated last year
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆426Updated last week
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆339Updated 2 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆261Updated last year
• babelcloud / LLM-RGB
  LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
  ☆156Updated this week
• read-agent / read-agent.github.io
  ☆51Updated 8 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆70Updated last month
• shellc / aify
  AI-native application framework and runtime, simply write a YAML file.
  ☆51Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆53Updated 6 months ago
• ericciarla / local-website-chatbot
  Chat with any website on your local machine
  ☆72Updated 9 months ago
• run-llama / automatic-doc-translate
  ☆75Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆122Updated this week
• nateraw / replicate-examples
  ☆74Updated 11 months ago
• GPT-Fathom / GPT-Fathom
  GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well a…
  ☆349Updated 11 months ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆81Updated last month
• eosphoros-ai / DB-GPT-Plugins
  Multi-Agents & Plugins repo for DB-GPT, Can complete various tasks around databases.
  ☆99Updated last year
• ninehills / llm-playground
  Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果
  ☆95Updated last year
• unit-mesh / edge-infer
  EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained de…
  ☆41Updated 11 months ago
• WarrenWen666 / AI-Software-Startups
  A Survey of AI startups
  ☆396Updated last year
• jina-ai / deepsearch-ui
  Jina DeepSearch UI
  ☆83Updated this week
• zkh2016 / LLMFarm
  MiniCPM on iOS.
  ☆66Updated last week
• allwefantasy / byzer-llm
  Easy, fast, and cheap pretrain,finetune, serving for everyone
  ☆291Updated this week
• CogNLP / CogAGENT
  ☆36Updated 2 years ago
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆405Updated 8 months ago
• mlc-ai / llm-perf-bench
  ☆116Updated 11 months ago
• getcursor / eval
  ☆118Updated last year