Alternatives and similar repositories for apple-silicon-4bit-quant

Users that are interested in apple-silicon-4bit-quant are comparing it to the libraries listed below

• smpanaro / ModernBERT-AppleNeuralEngine
  ModernBERT model optimized for Apple Neural Engine.
  ☆28Updated 11 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆226Updated last year
• FL33TW00D / coremlprofiler
  Profile your CoreML models directly from Python 🐍
  ☆29Updated 3 months ago
• FL33TW00D / deCoreML
  Find out why your CoreML model isn't running on the Neural Engine!
  ☆27Updated last year
• huggingface / HuggingSnap
  SmolVLM2 Demo
  ☆179Updated 8 months ago
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆61Updated last year
• apple / ml-recurrent-drafter
  ☆219Updated 10 months ago
• riccardomusmeci / mlx-image
  mlx image models for Apple Silicon machines
  ☆87Updated last week
• NolanoOrg / SpectraSuite
  ☆52Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated 2 months ago
• IST-DASLab / Quartet
  ☆111Updated 3 weeks ago
• ml-explore / mlx-c
  C API for MLX
  ☆154Updated last week
• Goekdeniz-Guelmez / mlx-kan
  KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon
  ☆31Updated 5 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆64Updated 5 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆83Updated 10 months ago
• mlc-ai / llm-perf-bench
  ☆120Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆40Updated last month
• FL33TW00D / wattkit
  ☆14Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆100Updated last year
• Cornell-RelaxML / qtip
  ☆158Updated 5 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆75Updated 2 weeks ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆157Updated 2 years ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆194Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆214Updated this week
• nyunAI / PruneGPT
  ☆51Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆150Updated 6 months ago
• ml-explore / mlx-onnx
  MLX support for the Open Neural Network Exchange (ONNX)
  ☆62Updated last year
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated last year