Alternatives and similar repositories for quant_clone

Users that are interested in quant_clone are comparing it to the libraries listed below

• AaronFeng753 / Qwen3-Gemini2.5
  Make Qwen3 Think like Gemini 2.5 Pro | Open webui function
  ☆25Updated 8 months ago
• TAR-ALEX / llm-html
  ☆19Updated 7 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆88Updated this week
• rhulha / Speech2Speech
  A web application that converts speech to speech 100% private
  ☆82Updated 8 months ago
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆23Updated 10 months ago
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆29Updated last month
• rodrigobaron / anthill
  ☆24Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• summersonnn / reddit_analyzer
  Analyze Reddit posts
  ☆29Updated 11 months ago
• yyjhao / wrait
  ☆49Updated 10 months ago
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …
  ☆49Updated 5 months ago
• Thrasher-Software / sigil
  A local-first LLM development studio. Build, test, and customize inference workflows with your own models — no cloud, totally local.
  ☆17Updated 8 months ago
• pwilkin / llama-runner
  Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends
  ☆51Updated 5 months ago
• PasiKoodaa / Chat-with-Screen
  ☆20Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆49Updated 3 months ago
• PasiKoodaa / dia
  A TTS model capable of generating ultra-realistic dialogue in one pass.
  ☆31Updated 9 months ago
• monkesearch / monkeSearch
  fully local, temporally aware natural language file search on your pc! even without a GPU. find relevant files using natural language i…
  ☆166Updated last month
• FarFetchd / sleepyllama
  an auto-sleeping and -waking framework around llama.cpp
  ☆12Updated 11 months ago
• hasaranga / NativeChat
  win32 native frontend for llama-cli
  ☆12Updated last year
• RobViren / kokovoicelab
  A cli app for experimenting with kokoro voice creating and mixing using the available voices to interpolate new ones
  ☆36Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 8 months ago
• projektjoe / GPT-OSS
  From-scratch implementation of OpenAI's GPT-OSS model in Python. No Torch, No GPUs.
  ☆108Updated 3 months ago
• Edw590 / VISOR---A-Voice-Assistant
  V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!
  ☆36Updated 2 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆59Updated last year
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆53Updated last year
• gvlassis / gvtop
  🎮 Material You TUI for monitoring NVIDIA GPUs
  ☆58Updated 3 weeks ago
• ikiruneo / millionaire-bench
  German "Who Wants To Be A Millionaire" LLM Benchmarking.
  ☆47Updated last month
• KartDriver / mira_converse
  ☆83Updated 11 months ago
• callbacked / qwen3-semantic-search
  interactive semantic search demo using Qwen3-0.6B-Embedding in your browser
  ☆55Updated 7 months ago
• CalvesGEH / VoiceCraftAPI
  An API for VoiceCraft.
  ☆25Updated last year