Alternatives and similar repositories for examples

Users that are interested in examples are comparing it to the libraries listed below

• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆471Updated last year
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆448Updated this week
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆242Updated last year
• mlc-ai / llm-perf-bench
  ☆118Updated last year
• nateraw / replicate-examples
  ☆74Updated last year
• babelcloud / LLM-RGB
  LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
  ☆162Updated 3 weeks ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆269Updated last year
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆142Updated last week
• lm-sys / lm-sys.github.io
  ☆59Updated last week
• read-agent / read-agent.github.io
  ☆58Updated 11 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆129Updated last month
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆256Updated 3 weeks ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆133Updated last year
• character-ai / MuKoe
  ☆54Updated last year
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆350Updated 4 months ago
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆520Updated last year
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆73Updated 11 months ago
• cursor / eval
  ☆127Updated 2 years ago
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆20Updated last week
• ZhihaoAIRobotic / MetaAgent
  The next generation of Multi-Modal Multi-Agent platform.
  ☆97Updated last month
• shellc / aify
  AI-native application framework and runtime, simply write a YAML file.
  ☆51Updated last year
• intelligent-machine-learning / atorch
  An industrial extension library of pytorch to accelerate large scale model training
  ☆37Updated last month
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆67Updated last year
• ericciarla / local-website-chatbot
  Chat with any website on your local machine
  ☆80Updated 11 months ago
• NexaAI / octopus-v4
  AI for all: Build the large graph of the language models
  ☆267Updated last year
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆589Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 5 months ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆87Updated 4 months ago
• 01-ai / Descartes
  ☆109Updated last year
• hwchase17 / auto-openai-prompter
  ☆250Updated last year