Alternatives and similar repositories for examples

Users that are interested in examples are comparing it to the libraries listed below

• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆480Updated 2 years ago
• babelcloud / LLM-RGB
  LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
  ☆166Updated 8 months ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆88Updated 11 months ago
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆362Updated last year
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆491Updated last month
• ZhihaoAIRobotic / MetaAgent
  The next generation of Multi-Modal Multi-Agent platform.
  ☆111Updated 8 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆251Updated last year
• read-agent / read-agent.github.io
  ☆67Updated last year
• AutoLLM / AutoAgents
  Complex question answering in LLMs with enhanced reasoning and information-seeking capabilities.
  ☆204Updated 2 years ago
• star-whale / starwhale
  an MLOps/LLMOps platform
  ☆236Updated last year
• camille-vanhoffelen / langchain-huggingGPT
  Langchain implementation of HuggingGPT
  ☆134Updated 2 years ago
• nateraw / replicate-examples
  ☆74Updated last year
• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆42Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆57Updated last year
• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆275Updated 2 years ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 4 months ago
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆371Updated 2 years ago
• gsuuon / ad-llama
  Structured inference with Llama 2 in your browser
  ☆53Updated last year
• NVIDIA / workbench-llamafactory
  This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
  ☆72Updated last year
• nexusflowai / NexusRaven
  NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…
  ☆318Updated 2 years ago
• modelscope / modelscope-studio
  A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…
  ☆136Updated 2 months ago
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆177Updated last year
• poloclub / wordflow
  Social and customizable AI writing assistant! ✍️
  ☆259Updated 7 months ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆91Updated last year
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆279Updated 2 years ago
• zozoheir / tinyllm
  Develop, evaluate and monitor LLM applications at scale
  ☆99Updated last year
• character-ai / MuKoe
  ☆55Updated last year
• timedomain-tech / open-creator
  An open-source LLM tool for extracting repeatable tasks from your conversations, and saving them into a customized skill library for retr…
  ☆128Updated 2 years ago
• ninehills / llm-playground
  Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果
  ☆96Updated 2 years ago
• SomeoneKong / llm_long_context_bench202405
  ☆29Updated last year