Alternatives and similar repositories for ik_llama.cpp

Users that are interested in ik_llama.cpp are comparing it to the libraries listed below

• theroyallab / YALS
  ☆83Updated this week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆211Updated this week
• atineiatte / deep-research-at-home
  ☆223Updated 4 months ago
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆78Updated this week
• SlerpE / highCompute.py
  ☆28Updated 3 months ago
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆493Updated this week
• savantskie / persistent-ai-memory
  A persistent local memory for AI, LLMs, or Copilot in VS Code.
  ☆142Updated last week
• SingularityMan / vector_companion
  A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…
  ☆232Updated last month
• avarayr / suaveui
  Open source LLM UI, compatible with all local LLM providers.
  ☆174Updated 11 months ago
• TesslateAI / Agent-Builder
  ☆176Updated last week
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆133Updated this week
• akashjss / sesame-csm
  A Conversational Speech Generation Model with Gradio UI and OpenAI compatible API. UI and API support CUDA, MLX and CPU devices.
  ☆201Updated 4 months ago
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆27Updated 4 months ago
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆110Updated 2 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated this week
• iuliaturc / gguf-docs
  Docs for GGUF quantization (unofficial)
  ☆258Updated 2 months ago
• PkmX / orpheus-chat-webui
  Orpheus Chat WebUI
  ☆75Updated 5 months ago
• TesslateAI / TFrameX
  ☆165Updated last month
• masterFoad / NanoSage
  Local LLM Powered Recursive Search & Smart Knowledge Explorer
  ☆252Updated 7 months ago
• mattjamo / OllamaToGGUF
  Convert downloaded Ollama models back into their GGUF equivalent format
  ☆57Updated 8 months ago
• MaxHastings / Kolo
  The Fastest Way to Fine-Tune LLMs Locally
  ☆320Updated 5 months ago
• Deveraux-Parker / Qwen3-Coder-30B-A3B-Monkey-Wrenches
  Efforts toward giving Qwen 3 Coder 30B A3B proper agentic tool calling capabilities at or near 100% reliability.
  ☆60Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆200Updated this week
• matteoserva / GraphLLM
  ☆209Updated last week
• rombodawg / Easy_training
  ☆50Updated 6 months ago
• boneylizard / Eloquent
  A local front-end for open-weight LLMs with memory, RAG, TTS/STT, Elo ratings, and dynamic research tools. Built with React and FastAPI.
  ☆37Updated last month
• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆43Updated this week
• intelligencedev / eternal
  Eternal is an experimental platform for machine learning models and workflows.
  ☆68Updated 6 months ago
• jd-3d / SOLOBench
  ☆133Updated 4 months ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆63Updated last month