Minimalist repo to do mlx vlm constrained decoding in batch mode
☆18Apr 11, 2026Updated 3 months ago
Alternatives and similar repositories for mlx-vlm-batch-outlines
Users that are interested in mlx-vlm-batch-outlines are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 4 months ago
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆37Jun 12, 2026Updated last month
- ☆36Mar 30, 2026Updated 4 months ago
- Moshi-Finetune-MLX lets you fine-tune Moshi (Native, Real-Time, Speech-to-Speech) models all on Apple Silicon.☆26Apr 21, 2026Updated 3 months ago
- The end of Screenshot 2023-12-20-21.11.59.png☆15Dec 22, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Notebook Terminal UI and Headless Renderer☆29Apr 19, 2026Updated 3 months ago
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers☆30May 19, 2026Updated 2 months ago
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 3 months ago
- A GUI for launchd, similar to launchctl. Or... something.☆15May 7, 2022Updated 4 years ago
- Open source, clear, transparent, real world llm benchmarks☆52Updated this week
- 🐙 HRM-MLX implements the Hierarchical Reasoning Model for Apple Silicon with 27M params, enabling fast multi-timescale reasoning on 1k s…☆24Jul 27, 2026Updated last week
- ☆38May 19, 2026Updated 2 months ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆756Jun 11, 2026Updated last month
- this repo has all official MLX-LM-LoRA example notebooks for training on Apple Silicon☆36Apr 23, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Super fast local inferencing for common NLP tasks on technical text☆51Jun 16, 2026Updated last month
- ☆206Jun 11, 2026Updated last month
- Minimal Claude Code alternative powered by MLX☆47Jan 11, 2026Updated 6 months ago
- A simple library for generating instruction tuning datasets locally☆92Jun 10, 2026Updated last month
- Thoughtful Lightning AI Assistant - Dual-engine system with DeepSeek reasoning and Groq inference, featuring Gradio UI, secure API manage…☆20Jan 22, 2025Updated last year
- Wrangler Compatible Cloudflare Deployment API☆19Mar 27, 2026Updated 4 months ago
- ☆18Jul 16, 2026Updated 2 weeks ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆422Jul 25, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Pipeline parallel training on Apple Silicon!☆33Dec 5, 2025Updated 7 months ago
- Here are some useful Google Apps Script scripts which you can copy and deploy through Google Drive.☆15Oct 12, 2021Updated 4 years ago
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆242Oct 28, 2025Updated 9 months ago
- Flash-MoE iOS — Run massive MoE models on iPhone☆48Mar 23, 2026Updated 4 months ago
- MLX-powered Qwen3 embedding server for Apple Silicon Macs. Features 0.6B/4B/8B models, 44K tokens/sec throughput, REST API, batch proce…☆17Aug 9, 2025Updated 11 months ago
- An intelligent load balancer for LM Studio that distributes requests across multiple loaded language models, optimizing resource utilizat…☆21Oct 13, 2025Updated 9 months ago
- Exact speculative decoding on Apple Silicon, powered by MLX.☆382Apr 20, 2026Updated 3 months ago
- Run LLMs with MLX☆15May 1, 2026Updated 3 months ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Grounded reasoning agent: Falcon Perception + Gemma 4 VLM on Apple Silicon☆28Apr 5, 2026Updated 3 months ago
- A beautiful desktop application for Local-NotebookLM that provides an intuitive UI for converting PDFs to engaging audio content.☆19Apr 1, 2026Updated 4 months ago
- OpenSource deployment made easy☆10Jun 13, 2015Updated 11 years ago
- Links to all the source code and solutions I reference in my O'Reilly Introduction to Docker video tutorial☆11Dec 10, 2014Updated 11 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- ☆10Jul 14, 2025Updated last year
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆33Mar 12, 2026Updated 4 months ago