exo-explore / mlx-bitnet
1.58 Bit LLM on Apple Silicon using MLX
☆96Updated 4 months ago
Related projects: ⓘ
- Fast parallel LLM inference for MLX☆118Updated 2 months ago
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆60Updated 3 weeks ago
- Scripts to create your own moe models using mlx☆86Updated 6 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆117Updated 8 months ago
- run embeddings in MLX☆68Updated last month
- Distributed Inference for mlx LLm☆57Updated last month
- On-device intelligence.☆136Updated last week
- ☆109Updated last month
- ☆101Updated 5 months ago
- ☆64Updated 3 months ago
- ☆36Updated 6 months ago
- Just a bunch of benchmark logs for different LLMs☆112Updated last month
- 1.58-bit LLaMa model☆77Updated 5 months ago
- Start a server from the MLX library.☆157Updated last month
- Implementation of nougat that focuses on processing pdf locally.☆68Updated 4 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆158Updated 2 months ago
- Port of Andrej Karpathy's nanoGPT to Apple MLX framework.☆95Updated 7 months ago
- Low-Rank adapter extraction for fine-tuned transformers model☆154Updated 4 months ago
- For inferring and serving local LLMs using the MLX framework☆77Updated 5 months ago
- GRDN.AI app for garden optimization☆68Updated 7 months ago
- ☆101Updated this week
- Inference of Mamba models in pure C☆175Updated 6 months ago
- Full finetuning of large language models without large memory requirements☆94Updated 8 months ago
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆45Updated 2 months ago
- inference code for mixtral-8x7b-32kseqlen☆97Updated 9 months ago
- FastMLX is a high performance production ready API to host MLX models.☆163Updated last week
- ☆144Updated 2 months ago
- ☆75Updated 3 weeks ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆39Updated 8 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated last week