Alternatives and similar repositories for optimize_llamacpp_ngl

Users that are interested in optimize_llamacpp_ngl are comparing it to the libraries listed below

• reka-ai / rekaquant
  ☆62Updated 2 months ago
• summersonnn / reddit_analyzer
  Analyze Reddit posts
  ☆25Updated 6 months ago
• josephrocca / rwkv-v4-web
  BlinkDL's RWKV-v4 running in the browser
  ☆47Updated 2 years ago
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆24Updated last month
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 9 months ago
• cahya-wirawan / rwkv-tokenizer
  A fast RWKV Tokenizer written in Rust
  ☆53Updated last month
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆64Updated last week
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated 2 weeks ago
• efogdev / apollo
  Deploy Apollo HF space locally
  ☆40Updated 9 months ago
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated last year
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• tercumantanumut / GameCompanionAI
  Game Companion AI is an advanced application designed to enhance the gaming experience by providing real-time analysis and interpretation…
  ☆53Updated 11 months ago
• TLAMHutto / ollamaChat
  ☆23Updated 11 months ago
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated last year
• wassname / prob_jsonformer
  Generate Structured JSON with probs from Language Models
  ☆17Updated 6 months ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆22Updated last year
• Milimo-Quantum / milimochat
  MilimoChat: Privacy-first, self-hosted AI chat with customizable personas, context-aware memory, and local analytics. Built on Python/Str…
  ☆14Updated 6 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• kyutai-labs / dactory
  ☆42Updated 2 weeks ago
• xhedit / quantkit
  cli tool to quantize gguf, gptq, awq, hqq and exl2 models
  ☆75Updated 9 months ago
• LeonEricsson / llmcontext
  Pressure testing the context window of open LLMs
  ☆25Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 4 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆33Updated last week
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆146Updated 7 months ago
• rodrigobaron / anthill
  ☆24Updated 8 months ago
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆27Updated 6 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆57Updated 9 months ago
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆16Updated last year