regrettable-username / llm.metal
LLM training in simple, raw C/Metal Shading Language
☆37Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for llm.metal
- C API for MLX☆75Updated last month
- Tensors and dynamic Neural Networks in Mojo☆124Updated 3 months ago
- Find out why your CoreML model isn't running on the Neural Engine!☆24Updated 4 months ago
- FlashAttention (Metal Port)☆382Updated last month
- Implementation of Karpathy's micrograd in Mojo☆67Updated 11 months ago
- An implementation of bucketMul LLM inference☆214Updated 4 months ago
- ☆50Updated last year
- 1.58 Bit LLM on Apple Silicon using MLX☆134Updated 6 months ago
- Tensor library with autograd using only Rust's standard library☆62Updated 4 months ago
- Distributed Inference for mlx LLm☆68Updated 3 months ago
- MLX Swift implementation of Andrej Karpathy's Let's build GPT video☆53Updated 6 months ago
- Fast parallel LLM inference for MLX☆146Updated 4 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆36Updated last year
- ☆122Updated 6 months ago
- WebGPU LLM inference tuned by hand☆146Updated last year
- Python bindings for ggml☆132Updated 2 months ago
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆48Updated 3 months ago
- port of Andrjey Karpathy's llm.c to Mojo☆321Updated 3 weeks ago
- Build and train Neural Networks in Mojo☆207Updated last month
- ☆35Updated 11 months ago
- Implementation of mamba with rust☆71Updated 8 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆55Updated this week
- Inference of Mamba models in pure C☆177Updated 8 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆52Updated last week
- ☆40Updated last year
- ☆113Updated 11 months ago
- A Learning Journey: Micrograd in Mojo 🔥☆57Updated 3 weeks ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆31Updated 11 months ago
- Port of Suno's Bark TTS transformer in Apple's MLX Framework☆71Updated 8 months ago
- ☆27Updated 4 months ago