Alternatives and similar repositories for mlx:

Users that are interested in mlx are comparing it to the libraries listed below

• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆7,363Updated last week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆79,335Updated this week
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,345Updated 9 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,063Updated 3 weeks ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,445Updated this week
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,203Updated last month
• karpathy / nanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆41,081Updated 4 months ago
• karpathy / micrograd
  A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
  ☆11,783Updated 9 months ago
• karpathy / minGPT
  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
  ☆21,842Updated 8 months ago
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆24,061Updated this week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆20,548Updated last week
• karpathy / llm.c
  LLM training in simple, raw C/CUDA
  ☆26,518Updated last week
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,191Updated 2 months ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,605Updated 8 months ago
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆21,842Updated this week
• meta-llama / codellama
  Inference code for CodeLlama models
  ☆16,293Updated 8 months ago
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,463Updated last year
• Mozilla-Ocho / llamafile
  Distribute and run LLMs with a single file.
  ☆22,335Updated 2 weeks ago
• triton-lang / triton
  Development repository for the Triton language and compiler
  ☆15,447Updated this week
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆9,620Updated 10 months ago
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆46,848Updated this week
• meta-llama / llama
  Inference code for Llama models
  ☆58,197Updated 3 months ago
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,560Updated last week
• unslothai / unsloth
  Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥
  ☆38,242Updated this week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆17,259Updated last week
• microsoft / graphrag
  A modular graph-based Retrieval-Augmented Generation (RAG) system
  ☆24,976Updated last week
• apple / ml-ferret
  ☆8,612Updated 7 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,391Updated 9 months ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,902Updated 9 months ago
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,535Updated 3 weeks ago