Alternatives and similar repositories for examples

Users that are interested in examples are comparing it to the libraries listed below

• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆441Updated this week
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆469Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆127Updated last month
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆242Updated last year
• WarrenWen666 / AI-Software-Startups
  A Survey of AI startups
  ☆398Updated last year
• ziwang-com / AGI-MAP
  AGI模块库架构图
  ☆75Updated last year
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆85Updated 3 months ago
• mlc-ai / llm-perf-bench
  ☆119Updated last year
• GPT-Fathom / GPT-Fathom
  GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well a…
  ☆348Updated last year
• hwchase17 / auto-openai-prompter
  ☆248Updated last year
• NexaAI / octopus-v4
  AI for all: Build the large graph of the language models
  ☆266Updated 11 months ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆267Updated last year
• NascentCore / llm-numbers-cn
  中文版 llm-numbers
  ☆123Updated last year
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆253Updated this week
• poloclub / wordflow
  Social and customizable AI writing assistant! ✍️
  ☆238Updated 11 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆67Updated last year
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆172Updated 6 months ago
• babelcloud / LLM-RGB
  LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
  ☆161Updated this week
• nateraw / replicate-examples
  ☆74Updated last year
• 01-ai / Descartes
  ☆108Updated last year
• lm-sys / lm-sys.github.io
  ☆59Updated this week
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆80Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆132Updated 11 months ago
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆518Updated last year
• M1n9X / llm_agents_devtools
  A curated list of autonomous agents and developer tools powered by LLM.
  ☆40Updated last year
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆419Updated 10 months ago
• Ascend / AscendSpeed
  ☆79Updated last year
• SomeoneKong / llm_long_context_bench202405
  ☆29Updated 9 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆118Updated last year
• ZhihaoAIRobotic / MetaAgent
  The next generation of Multi-Modal Multi-Agent platform.
  ☆96Updated 2 weeks ago