Alternatives and similar repositories for ik_llama.cpp

Users that are interested in ik_llama.cpp are comparing it to the libraries listed below

• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆156Updated this week
• Thireus / GGUF-Tool-Suite
  Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input your VRAM and RAM and the toolcha…
  ☆76Updated this week
• Nyarlth / higgs-audio_quantized
  Quantized text-audio foundation model from Boson AI
  ☆43Updated 5 months ago
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆23Updated 10 months ago
• hasaranga / NativeChat
  win32 native frontend for llama-cli
  ☆12Updated last year
• loscrossos / comfy_workflows
  no further adue.. just give me the forkwlows!
  ☆103Updated 5 months ago
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆29Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated last month
• SystemPanic / vllm-windows
  A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
  ☆294Updated 2 months ago
• PasiKoodaa / ACE-Step-RADIO
  ACE-Step: A Step Towards Music Generation Foundation Model
  ☆49Updated 8 months ago
• cocktailpeanut / hallucinator
  ☆51Updated last year
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆30Updated 8 months ago
• kevkid / gguf_gui
  ☆128Updated last year
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆166Updated 9 months ago
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆150Updated last month
• codeprimate / personfromvid
  AI-powered video frame extraction tool that automatically identifies and extracts high-quality frames containing people, with intelligent…
  ☆155Updated 7 months ago
• rombodawg / Easy_training
  ☆51Updated 11 months ago
• theroyallab / YALS
  ☆90Updated last month
• dreamfast / go-civitai-downloader
  Easily download and archive content from Civitai
  ☆93Updated last week
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆81Updated last week
• Kaoru8 / T5XXL-Unchained
  ☆93Updated 9 months ago
• kalomaze / koboldcpp
  My personal fork of koboldcpp where I hack in experimental samplers.
  ☆44Updated last year
• duynt575 / kokoro-voice-composer-backup
  Since the owner of the repo took it down and it used an MIT license, I guess it's okay to upload it here for people to use.
  ☆52Updated 10 months ago
• wkpark / triton
  Development repository for the Triton language and compiler
  ☆34Updated last year
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆58Updated last year
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆68Updated 10 months ago
• komikndr / raylight
  Enable true multi gpu capability in Comfy UI using XDiT XFuser and FSDP managed by Ray
  ☆280Updated this week
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆30Updated 2 weeks ago
• dasjoms / BagelUI
  A rework of the gradio WebUI for the open-source unified multimodal model by ByteDance
  ☆22Updated 8 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆35Updated 3 months ago