vllm-project / vllm-metalLinks
Community maintained hardware plugin for vLLM on Apple Silicon
☆349Updated last week
Alternatives and similar repositories for vllm-metal
Users that are interested in vllm-metal are comparing it to the libraries listed below
Sorting:
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆269Updated 3 weeks ago
- Train Large Language Models on MLX.☆245Updated last week
- A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…☆351Updated this week
- Verify Precision of all Kimi K2 API Vendor☆501Updated last week
- 1.58 Bit LLM on Apple Silicon using MLX☆242Updated last year
- Fast parallel LLM inference for MLX☆245Updated last year
- A command-line interface tool for serving LLM using vLLM.☆468Updated last week
- FastMLX is a high performance production ready API to host MLX models.☆341Updated 10 months ago
- Distributed Inference for mlx LLm☆100Updated last year
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆226Updated 3 months ago
- ☆237Updated 2 months ago
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆93Updated last week
- ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)☆128Updated this week
- This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang☆100Updated this week
- A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI…☆203Updated this week
- Train embedding and reranker models for retrieval tasks on Apple Silicon with MLX☆172Updated 4 months ago
- Self-host LLMs with vLLM and BentoML☆168Updated 2 weeks ago
- Start a server from the MLX library.☆196Updated last year
- The LLM abstraction layer for modern AI agent applications.☆499Updated last week
- Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)☆459Updated 5 months ago
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆132Updated last month
- Routing on Random Forest (RoRF)☆239Updated last year
- frozen-in-time version of our Paper Finder agent for reproducing evaluation results☆224Updated 5 months ago
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆18Updated 10 months ago
- KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon☆31Updated 7 months ago
- Verifiers for LLM Reinforcement Learning☆81Updated 4 months ago
- ☆307Updated 9 months ago
- For inferring and serving local LLMs using the MLX framework☆110Updated last year
- A Tree Search Library with Flexible API for LLM Inference-Time Scaling☆513Updated last month
- A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.☆77Updated 2 months ago