smpanaro / more-ane-transformersLinks
Run transformers (incl. LLMs) on the Apple Neural Engine.
☆63Updated last year
Alternatives and similar repositories for more-ane-transformers
Users that are interested in more-ane-transformers are comparing it to the libraries listed below
Sorting:
- CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.☆116Updated 8 months ago
- FlashAttention (Metal Port)☆534Updated 11 months ago
- ☆55Updated 2 years ago
- Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.☆196Updated 3 months ago
- Tool for exporting Apple Neural Engine-accelerated versions of transformers models on HuggingFace Hub.☆13Updated 2 years ago
- ☆185Updated 6 months ago
- See the device (CPU/GPU/ANE) and estimated cost for every layer in your CoreML model.☆23Updated last year
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆280Updated 3 months ago
- 1.58 Bit LLM on Apple Silicon using MLX☆223Updated last year
- Python tools for WhisperKit: Model conversion, optimization and evaluation☆227Updated last month
- Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.☆454Updated 7 months ago
- ☆23Updated 2 years ago
- Local ML voice chat using high-end models.☆175Updated 3 weeks ago
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆207Updated 2 weeks ago
- run embeddings in MLX☆92Updated 11 months ago
- FastMLX is a high performance production ready API to host MLX models.☆331Updated 6 months ago
- Tool for visual profiling Core ML models, compatible with both package and compiled versions, including reasons for unsupported operation…☆34Updated last year
- A multi-platform SwiftUI frontend for running local LLMs with Apple's MLX framework.☆420Updated 10 months ago
- MLX Swift implementation of Andrej Karpathy's Let's build GPT video☆59Updated last year
- Explore a simple example of utilizing MLX for RAG application running locally on your Apple Silicon device.☆175Updated last year
- A wannabe Ollama equivalent for Apple MlX models☆80Updated 6 months ago
- C API for MLX☆132Updated 2 weeks ago
- Fast parallel LLM inference for MLX☆217Updated last year
- Export Hugging Face models to Core ML and TensorFlow Lite☆675Updated last year
- Swift implementation of Flux.1 using mlx-swift☆106Updated last month
- ☆297Updated 5 months ago
- Mac app to demonstrate swift-transformers☆572Updated last year
- mlx image models for Apple Silicon machines☆84Updated 5 months ago
- Large Language Model (LLM) module for the Spezi Ecosystem☆265Updated this week
- A tool which checks compatibility of CoreML model with Apple Neural Engine☆13Updated 3 years ago