Alternatives and similar repositories for bitsandbytes

Users that are interested in bitsandbytes are comparing it to the libraries listed below

• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆54Updated 2 years ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• j-csc / mlx_bark
  Port of Suno's Bark TTS transformer in Apple's MLX Framework
  ☆86Updated last year
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆81Updated 2 years ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆53Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆128Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆68Updated last year
• sacha-ichbiah / outlines-mlx
  A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  ☆59Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆110Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• lucataco / cog-whisperspeech
  Cog wrapper for collabora/WhisperSpeech
  ☆25Updated last year
• OoriData / Toolio
  GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…
  ☆132Updated last month
• Maximilian-Winter / llama_cpp_function_calling
  ☆32Updated 2 years ago
• remyxai / FFMPerative
  Chat to Compose Video
  ☆198Updated 2 years ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆43Updated 7 months ago
• priontific / MLX-text-completion-notebook
  A simple Jupyter Notebook for learning MLX text-completion fine-tuning!
  ☆123Updated last year
• abetlen / program-constrained-language-model-sampling
  ☆35Updated 2 years ago
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆75Updated 2 years ago
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated 2 years ago
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• xhedit / quantkit
  cli tool to quantize gguf, gptq, awq, hqq and exl2 models
  ☆78Updated last year
• okio-ai / nendo-example-apps
  Examples of apps built with Nendo, the AI Audio Tool Suite
  ☆55Updated last year
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆28Updated last year
• JosefAlbers / PVM
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆273Updated 2 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆76Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆108Updated last year
• ChuloAI / oasis
  Local LLaMAs/Models in VSCode
  ☆54Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆249Updated 2 years ago