Alternatives and similar repositories for examples

Users that are interested in examples are comparing it to the libraries listed below

• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆471Updated last year
• babelcloud / LLM-RGB
  LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
  ☆163Updated last month
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆451Updated last week
• ZhihaoAIRobotic / MetaAgent
  The next generation of Multi-Modal Multi-Agent platform.
  ☆98Updated last month
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆129Updated this week
• NexaAI / octopus-v4
  AI for all: Build the large graph of the language models
  ☆270Updated last year
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆87Updated 5 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆243Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆54Updated 10 months ago
• read-agent / read-agent.github.io
  ☆61Updated 11 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆270Updated last year
• lm-sys / lm-sys.github.io
  ☆62Updated this week
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆85Updated last year
• nateraw / replicate-examples
  ☆74Updated last year
• modelscope / modelscope-studio
  A third-party component library based on Gradio.
  ☆108Updated last week
• hwchase17 / auto-openai-prompter
  ☆249Updated last year
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆189Updated 10 months ago
• ziwang-com / AGI-MAP
  AGI模块库架构图
  ☆76Updated last year
• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆275Updated last year
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆351Updated 5 months ago
• M1n9X / llm_agents_devtools
  A curated list of autonomous agents and developer tools powered by LLM.
  ☆40Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆135Updated last year
• poloclub / wordflow
  Social and customizable AI writing assistant! ✍️
  ☆245Updated 2 weeks ago
• ltzheng / agent-studio
  [ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agents
  ☆210Updated 3 weeks ago
• AutoLLM / AutoAgents
  Complex question answering in LLMs with enhanced reasoning and information-seeking capabilities.
  ☆201Updated last year
• zhangzhejian / codeinterpreter-codebox
  Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.
  ☆53Updated last year
• GenseeAI / cognify
  Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…
  ☆242Updated last month
• alextamkin / generative-elicitation
  ☆130Updated last year
• mlc-ai / llm-perf-bench
  ☆120Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆68Updated last year