Alternatives and similar repositories for FastChat-release

Users that are interested in FastChat-release are comparing it to the libraries listed below

• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆38Updated 2 years ago
• unslothai / unsloth-studio
  Unsloth Studio
  ☆120Updated 8 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated 2 years ago
• lunamidori5 / Midori-AI
  Midori AI's Mono Repo! Check out our site below!
  ☆124Updated 4 months ago
• AI-ANK / C3-Voice-Assistant-UI
  A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…
  ☆37Updated last year
• Poly186-AI-DAO / PolyGPT-alpha
  🌟PolyGPT: An Overview of Agent-Based System Architecture for Autonomous Business Operations
  ☆84Updated last year
• QuixiAI / OpenChatML
  ☆164Updated 4 months ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆112Updated last year
• OS-Copilot / FRIDAY-front
  ☆20Updated last year
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆308Updated last year
• autogyro / tool_LLM
  An open platform for training, serving, and evaluating large language model for tool learning.
  ☆20Updated 2 years ago
• cedriking / spark
  Spark is an Auto-GPT alternative that uses LocalAI.
  ☆85Updated 2 years ago
• remichu-ai / gallama
  ☆134Updated 7 months ago
• Jirubizu / localai-admin
  ☆56Updated 2 years ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 10 months ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• janhq / model-converter
  ☆23Updated 2 years ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• AstraBert / PrAIvateSearch
  Own your AI, search the web with it🌐😎
  ☆93Updated 11 months ago
• TheBloke / text-generation-webui
  A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.
  ☆71Updated 2 years ago
• jina-ai / jerboa
  LLM finetuning
  ☆42Updated 2 years ago
• AGiXT / hub
  Hub for Open Source AGiXT Extensions, Chains, Prompts, and Agents.
  ☆17Updated 2 years ago
• petals-infra / chat.petals.dev
  💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
  ☆317Updated last year
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• SakanaAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆34Updated last year
• Neuroengine-vulns / neuroengine
  Neuroengine is a service to share LLMs in the form of a webchat and API.
  ☆45Updated last year
• smartcomputer-ai / agent-os
  Build autonomous AI agents! 🌞
  ☆139Updated this week
• mithril-security / blind_chat
  A fully in-browser privacy solution to make Conversational AI privacy-friendly
  ☆233Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆119Updated last year
• PromptEngineer48 / LLM_Selector
  This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query
  ☆103Updated 2 years ago