Alternatives and similar repositories for bitsandbytes

Users that are interested in bitsandbytes are comparing it to the libraries listed below

• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• xhedit / quantkit
  cli tool to quantize gguf, gptq, awq, hqq and exl2 models
  ☆77Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• j-csc / mlx_bark
  Port of Suno's Bark TTS transformer in Apple's MLX Framework
  ☆86Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆54Updated 2 years ago
• okio-ai / nendo-example-apps
  Examples of apps built with Nendo, the AI Audio Tool Suite
  ☆55Updated last year
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆75Updated 2 years ago
• remyxai / FFMPerative
  Chat to Compose Video
  ☆197Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆127Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆249Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• unixwzrd / oobabooga-macOS
  Information on optimizing python libraries specifically for oobabooga to take advantage of Apple Silicon and Accelerate Framework.
  ☆77Updated 10 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆67Updated last year
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆91Updated 2 years ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆32Updated 2 years ago
• OoriData / Toolio
  GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…
  ☆130Updated 3 weeks ago
• mzbac / mlx-lora
  ☆38Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆82Updated last year
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆178Updated 3 weeks ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• RandomInternetPreson / text_generation_webui_xtt_Alts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆34Updated last year
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆275Updated last month
• priontific / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆122Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆99Updated 6 months ago
• devbrones / llama-prompts
  A collection of prompts for Llama
  ☆101Updated 2 years ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆53Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆28Updated 2 years ago