Alternatives and similar repositories for examples:

Users that are interested in examples are comparing it to the libraries listed below

• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆464Updated last year
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆405Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆110Updated 2 months ago
• 01-ai / Descartes
  ☆105Updated 9 months ago
• modelscope / modelscope-studio
  A third-party component library based on Gradio.
  ☆73Updated this week
• ziwang-com / AGI-MAP
  AGI模块库架构图
  ☆75Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆50Updated 4 months ago
• nateraw / replicate-examples
  ☆75Updated 9 months ago
• babelcloud / LLM-RGB
  LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
  ☆144Updated last week
• mlc-ai / llm-perf-bench
  ☆116Updated 9 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆236Updated 10 months ago
• allwefantasy / byzer-llm
  Easy, fast, and cheap pretrain,finetune, serving for everyone
  ☆276Updated this week
• read-agent / read-agent.github.io
  ☆51Updated 6 months ago
• NexaAI / octopus-v4
  AI for all: Build the large graph of the language models
  ☆252Updated 7 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆248Updated last year
• lm-sys / lm-sys.github.io
  ☆54Updated this week
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆64Updated last month
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆80Updated 2 months ago
• devsapp / agentcraft
  agentcraft 可以帮助您快速构建各类应用场景的ai agent应用
  ☆52Updated last month
• GenseeAI / cognify
  The Multi-Faceted Optimizer for GenAI Workflows
  ☆180Updated this week
• weanalyze / workcell
  ⚡ Instantly turn your python function into web app.
  ☆39Updated last year
• triton-inference-server / vllm_backend
  ☆218Updated this week
• allwefantasy / byzer-agent
  ☆30Updated 10 months ago
• ZhihaoAIRobotic / MetaAgent
  The next generation of Multi-Modal Multi-Agent platform.
  ☆75Updated this week
• gsuuon / ad-llama
  Structured inference with Llama 2 in your browser
  ☆52Updated 2 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆84Updated 8 months ago
• allwefantasy / BYZER-RETRIEVAL
  Byzer-retrieval is a distributed retrieval system which designed as a backend for LLM RAG (Retrieval Augmented Generation). The system su…
  ☆45Updated 2 weeks ago
• WarrenWen666 / AI-Software-Startups
  A Survey of AI startups
  ☆394Updated last year
• OpenBMB / LLMFarm-MiniCPM
  MiniCPM on iOS.
  ☆64Updated 7 months ago
• poloclub / wordflow
  Social and customizable AI writing assistant! ✍️
  ☆210Updated 7 months ago