mzbac / mlx_shardingLinks
Distributed Inference for mlx LLm
☆100Updated last year
Alternatives and similar repositories for mlx_sharding
Users that are interested in mlx_sharding are comparing it to the libraries listed below
Sorting:
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆99Updated 6 months ago
- Train Large Language Models on MLX.☆240Updated this week
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆273Updated 2 months ago
- Fast parallel LLM inference for MLX☆241Updated last year
- ☆134Updated last month
- ☆119Updated last year
- For inferring and serving local LLMs using the MLX framework☆109Updated last year
- ☆165Updated 5 months ago
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆132Updated last month
- ☆107Updated 2 months ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆61Updated last year
- ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)☆122Updated last week
- All the world is a play, we are but actors in it.☆49Updated 5 months ago
- ☆108Updated 4 months ago
- Implementation of nougat that focuses on processing pdf locally.☆84Updated last year
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Updated last year
- 1.58 Bit LLM on Apple Silicon using MLX☆237Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆56Updated 11 months ago
- Embed anything.☆27Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆118Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 11 months ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Updated 6 months ago
- powerful and fast tool calling agents☆79Updated 9 months ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆85Updated 4 months ago
- ☆68Updated last year
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆284Updated 7 months ago
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆44Updated last year
- FastMLX is a high performance production ready API to host MLX models.☆335Updated 9 months ago
- Simple examples using Argilla tools to build AI☆57Updated last year
- ☆210Updated last week