Alternatives and similar repositories for examples

Users that are interested in examples are comparing it to the libraries listed below

• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆479Updated 2 years ago
• ZhihaoAIRobotic / MetaAgent
  The next generation of Multi-Modal Multi-Agent platform.
  ☆111Updated 8 months ago
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆491Updated last month
• babelcloud / LLM-RGB
  LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
  ☆166Updated 8 months ago
• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆275Updated 2 years ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆88Updated last year
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆279Updated 2 years ago
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆364Updated last year
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆251Updated last year
• timedomain-tech / open-creator
  An open-source LLM tool for extracting repeatable tasks from your conversations, and saving them into a customized skill library for retr…
  ☆128Updated 2 years ago
• nateraw / replicate-examples
  ☆74Updated last year
• star-whale / starwhale
  an MLOps/LLMOps platform
  ☆236Updated last year
• zozoheir / tinyllm
  Develop, evaluate and monitor LLM applications at scale
  ☆100Updated last year
• GenseeAI / cognify
  Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…
  ☆269Updated 8 months ago
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆57Updated last year
• ray-project / llmperf-leaderboard
  ☆476Updated 2 years ago
• hwchase17 / auto-openai-prompter
  ☆252Updated 2 years ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆91Updated last year
• read-agent / read-agent.github.io
  ☆67Updated last year
• AutoLLM / AutoAgents
  Complex question answering in LLMs with enhanced reasoning and information-seeking capabilities.
  ☆204Updated 2 years ago
• WarrenWen666 / AI-Software-Startups
  A Survey of AI startups
  ☆402Updated 2 years ago
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆22Updated last month
• camille-vanhoffelen / langchain-huggingGPT
  Langchain implementation of HuggingGPT
  ☆134Updated 2 years ago
• lm-sys / lm-sys.github.io
  The source of LMSYS website and blogs
  ☆77Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆130Updated 4 months ago
• alextamkin / generative-elicitation
  ☆133Updated 2 years ago
• modelscope / modelscope-studio
  A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…
  ☆135Updated 2 months ago
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆371Updated 2 years ago
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆177Updated last year
• zhangzhejian / codeinterpreter-codebox
  Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.
  ☆58Updated last year