mzbac / mlx_shardingLinks
Distributed Inference for mlx LLm
☆99Updated last year
Alternatives and similar repositories for mlx_sharding
Users that are interested in mlx_sharding are comparing it to the libraries listed below
Sorting:
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆99Updated 5 months ago
- Fast parallel LLM inference for MLX☆238Updated last year
- For inferring and serving local LLMs using the MLX framework☆109Updated last year
- ☆117Updated last year
- Train Large Language Models on MLX.☆236Updated 2 weeks ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Updated 6 months ago
- ☆109Updated 4 months ago
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆129Updated 2 weeks ago
- ☆164Updated 4 months ago
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆275Updated last month
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 11 months ago
- Simple examples using Argilla tools to build AI☆57Updated last year
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆53Updated last year
- ☆68Updated last year
- ☆134Updated 2 weeks ago
- ☆107Updated last month
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆118Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆54Updated 10 months ago
- All the world is a play, we are but actors in it.☆49Updated 5 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆222Updated last month
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Updated last year
- ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)☆120Updated this week
- Scripts to create your own moe models using mlx☆90Updated last year
- ☆15Updated last week
- A simple experiment on letting two local LLM have a conversation about anything!☆112Updated last year
- Something similar to Apple Intelligence?☆59Updated last year
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 11 months ago
- ☆91Updated 11 months ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆84Updated 4 months ago