Alternatives and similar repositories for bitsandbytes

Users that are interested in bitsandbytes are comparing it to the libraries listed below

• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆40Updated this week
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆81Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆104Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆84Updated 5 months ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆25Updated last year
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆50Updated last year
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆53Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆104Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• xhedit / quantkit
  cli tool to quantize gguf, gptq, awq, hqq and exl2 models
  ☆70Updated 5 months ago
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated last year
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated last year
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆22Updated 10 months ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆46Updated 10 months ago
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆53Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆32Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆47Updated 2 weeks ago
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆49Updated 3 months ago
• PasiKoodaa / dia
  A TTS model capable of generating ultra-realistic dialogue in one pass.
  ☆30Updated last month