exo-explore / mlx-bitnet
1.58 Bit LLM on Apple Silicon using MLX
☆192Updated 10 months ago
Alternatives and similar repositories for mlx-bitnet:
Users that are interested in mlx-bitnet are comparing it to the libraries listed below
- Fast parallel LLM inference for MLX☆174Updated 8 months ago
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆264Updated 6 months ago
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆259Updated this week
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆108Updated 5 months ago
- Port of Andrej Karpathy's nanoGPT to Apple MLX framework.☆105Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆75Updated 8 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆63Updated 4 months ago
- Scripts to create your own moe models using mlx☆89Updated last year
- 1.58-bit LLaMa model☆82Updated 11 months ago
- ☆203Updated 2 months ago
- Distributed Inference for mlx LLm☆85Updated 7 months ago
- ☆149Updated this week
- FastMLX is a high performance production ready API to host MLX models.☆274Updated this week
- Inference of Mamba models in pure C☆186Updated last year
- run embeddings in MLX☆84Updated 5 months ago
- Mistral7B playing DOOM☆130Updated 8 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆196Updated 8 months ago
- A collection of optimizers for MLX☆32Updated last week
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.☆162Updated last year
- Start a server from the MLX library.☆182Updated 7 months ago
- PyTorch implementation of models from the Zamba2 series.☆177Updated 2 months ago
- Implementation of nougat that focuses on processing pdf locally.☆80Updated 2 months ago
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆278Updated last week
- ☆111Updated 3 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 5 months ago
- ☆152Updated 8 months ago
- An implementation of bucketMul LLM inference☆215Updated 8 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆137Updated last month