Alternatives and similar repositories for ggml-server-example

Users that are interested in ggml-server-example are comparing it to the libraries listed below

• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆60Updated last year
• da-z / llamazing
  A simple Web / UI / App / Frontend to Ollama.
  ☆84Updated 8 months ago
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆113Updated last week
• alexanderatallah / openrouter-streamlit
  Example of calling OpenRouter from a Streamit app
  ☆102Updated 2 years ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆118Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• mzbac / LLM_Web
  Host LLM via text-generation-inference
  ☆16Updated 2 years ago
• smallcloudai / refact-vscode
  Refact - Open-Source AI Agent, Code Generator & Chat for JavaScript, Python, TypeScript, Java, PHP, Go, and more.
  ☆168Updated this week
• KillianLucas / ooba
  Run language models on consumer hardware.
  ☆27Updated 2 years ago
• Intellicode / writer
  🤖📝 A markdown editor powered by AI (Ollama)
  ☆64Updated last year
• xNul / codestral-mamba-for-vscode
  Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
  ☆29Updated last year
• vemonet / libre-chat
  🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline capable and easy to setup.
  ☆165Updated last year
• BeastByteAI / agent_dingo
  A microframework for creating simple AI agents.
  ☆94Updated last year
• ortegaalfredo / neurochat
  Native gui to serveral AI services plus llama.cpp local AIs.
  ☆116Updated last year
• gmchad / smol-plugin
  automatically generate @openai plugins by specifying your API in markdown in smol-developer style
  ☆118Updated 2 years ago
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆113Updated 2 years ago
• rapidarchitect / ollama-crew-mesop
  ☆33Updated last year
• intelligentnode / Intelli
  Create chatbot and AI agent workflows with unified access.
  ☆53Updated this week
• loladotdev / smolex
  🔍 Code entity retrieval "GPT action" for ChatGPT!
  ☆112Updated 2 years ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• Not-Diamond / notdiamond-python
  Not Diamond Python SDK
  ☆89Updated 2 weeks ago
• m18coppola / llama.sh
  No-messing-around sh client for llama.cpp's server
  ☆30Updated last year
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 10 months ago
• MikeyBeez / codemapper
  Python module that creates a context map for AI code generation
  ☆27Updated last year
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆149Updated 2 years ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• joelsprunger / hire-me
  ☆50Updated last year
• tsterbak / promptmage
  simplifies the process of creating and managing LLM workflows.
  ☆114Updated last year
• JosefAlbers / Roy
  Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.
  ☆78Updated 2 years ago
• MattFlower / vscode-aider-extension
  ☆109Updated last year