mzbac / mlx_shardingLinks
Distributed Inference for mlx LLm
☆92Updated 10 months ago
Alternatives and similar repositories for mlx_sharding
Users that are interested in mlx_sharding are comparing it to the libraries listed below
Sorting:
- ☆114Updated 5 months ago
- Train Large Language Models on MLX.☆77Updated last week
- Fast parallel LLM inference for MLX☆189Updated 10 months ago
- ☆129Updated last month
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆84Updated 5 months ago
- ☆66Updated last year
- Scripts to create your own moe models using mlx☆89Updated last year
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆76Updated last month
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆64Updated 7 months ago
- ☆59Updated last week
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆72Updated 8 months ago
- ☆157Updated 10 months ago
- ☆75Updated 2 weeks ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆139Updated 3 months ago
- Train your own SOTA deductive reasoning model☆92Updated 2 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated last year
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆40Updated 3 months ago
- ☆28Updated last year
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Updated 8 months ago
- 1.58 Bit LLM on Apple Silicon using MLX☆212Updated last year
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated 9 months ago
- A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.☆68Updated 3 months ago
- Implementation of nougat that focuses on processing pdf locally.☆81Updated 4 months ago
- The DPAB-α Benchmark☆23Updated 4 months ago
- Simple examples using Argilla tools to build AI☆53Updated 6 months ago
- A collection of optimizers for MLX☆36Updated last week
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆39Updated 4 months ago
- look how they massacred my boy☆63Updated 7 months ago
- ☆90Updated 5 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆134Updated this week