Alternatives and similar repositories for apple-silicon-4bit-quant

Users that are interested in apple-silicon-4bit-quant are comparing it to the libraries listed below

• smpanaro / ModernBERT-AppleNeuralEngine
  ModernBERT model optimized for Apple Neural Engine.
  ☆29Updated 11 months ago
• FL33TW00D / coremlprofiler
  Profile your CoreML models directly from Python 🐍
  ☆29Updated 3 months ago
• FL33TW00D / deCoreML
  Find out why your CoreML model isn't running on the Neural Engine!
  ☆28Updated last year
• huggingface / HuggingSnap
  SmolVLM2 Demo
  ☆180Updated 9 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆233Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆61Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆83Updated 11 months ago
• ml-explore / mlx-c
  C API for MLX
  ☆157Updated last week
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆99Updated last year
• Goekdeniz-Guelmez / mlx-kan
  KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon
  ☆31Updated 6 months ago
• Cornell-RelaxML / yaqa-quantization
  ☆66Updated 6 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆104Updated 7 months ago
• apple / ml-recurrent-drafter
  ☆219Updated 11 months ago
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆84Updated 4 months ago
• riccardomusmeci / mlx-image
  mlx image models for Apple Silicon machines
  ☆88Updated last month
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆83Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆102Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆196Updated last year
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated last year
• NolanoOrg / SpectraSuite
  ☆52Updated last year
• nyunAI / PruneGPT
  ☆51Updated last year
• jbarrow / mlx-playground
  mlx implementations of various transformers, speedups, training
  ☆33Updated 2 years ago
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆54Updated 2 weeks ago
• ToluClassics / mlx-transformers
  MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers an…
  ☆69Updated last year
• QuixiAI / kraken
  ☆68Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated 2 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆95Updated 7 months ago
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆62Updated last year
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆569Updated last year