philipturner / metal-flash-attentionLinks
FlashAttention (Metal Port)
☆542Updated last year
Alternatives and similar repositories for metal-flash-attention
Users that are interested in metal-flash-attention are comparing it to the libraries listed below
Sorting:
- Efficient framework-agnostic data loading☆442Updated 3 weeks ago
- Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.☆199Updated 4 months ago
- 1.58 Bit LLM on Apple Silicon using MLX☆224Updated last year
- Run transformers (incl. LLMs) on the Apple Neural Engine.☆63Updated last year
- Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.☆456Updated 8 months ago
- Python bindings for ggml☆146Updated last year
- ☆218Updated 9 months ago
- CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.☆117Updated 9 months ago
- ☆561Updated 11 months ago
- Fast parallel LLM inference for MLX☆223Updated last year
- On-device Image Generation for Apple Silicon☆662Updated 6 months ago
- Official implementation of Half-Quadratic Quantization (HQQ)☆883Updated last month
- C API for MLX☆143Updated 3 weeks ago
- LLM training in simple, raw C/Metal Shading Language☆58Updated last year
- LLM-based code completion engine☆190Updated 9 months ago
- ☆54Updated 2 years ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- Inference of Mamba models in pure C☆192Updated last year
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆278Updated 4 months ago
- FastMLX is a high performance production ready API to host MLX models.☆331Updated 7 months ago
- Convert StableHLO models into Apple Core ML format☆19Updated 2 months ago
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"☆385Updated last year
- ModernBERT model optimized for Apple Neural Engine.☆28Updated 9 months ago
- Apple GPU microarchitecture☆556Updated last year
- GGUF implementation in C as a library and a tools CLI program☆291Updated last month
- An innovative library for efficient LLM inference via low-bit quantization☆349Updated last year
- CLIP inference in plain C/C++ with no extra dependencies☆523Updated 4 months ago
- An implementation of bucketMul LLM inference☆223Updated last year
- scalable and robust tree-based speculative decoding algorithm☆360Updated 8 months ago
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆273Updated last year