Minimalist repo to do mlx vlm constrained decoding in batch mode
☆20Apr 11, 2026Updated 6 months ago
Alternatives and similar repositories for mlx-vlm-batch-outlines
Users that are interested in mlx-vlm-batch-outlines are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Super fast local inferencing for common NLP tasks on technical text☆57Jun 16, 2026Updated 4 months ago
- Community-driven benchmark suite for MLX inference engines on Apple Silicon☆25Oct 11, 2026Updated last week
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 4 months ago
- Let Auggie describe your PR for you☆10Oct 9, 2025Updated last year
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A simple library for generating instruction tuning datasets locally☆120Sep 20, 2026Updated last month
- The end of Screenshot 2023-12-20-21.11.59.png☆15Dec 22, 2023Updated 2 years ago
- Moshi-Finetune-MLX lets you fine-tune Moshi (Native, Real-Time, Speech-to-Speech) models all on Apple Silicon.☆26Apr 21, 2026Updated 6 months ago
- We gave AI models telepathy.☆21Sep 25, 2026Updated 3 weeks ago
- Notebook Terminal UI and Headless Renderer☆30Apr 19, 2026Updated 6 months ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Updated this week
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 6 months ago
- A repo of useful MLX skills.☆90Jan 25, 2026Updated 8 months ago
- ☆191Sep 8, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- H3MLX: MiniMax-H3 Metal 4 / Pure C Video Gen Master Suite, Benchmark Matrix & AI Agent Skill for Apple Silicon☆23Sep 6, 2026Updated last month
- Find the hidden meaning of LLMs☆42Nov 13, 2025Updated 11 months ago
- ☆21Aug 7, 2026Updated 2 months ago
- A functional JS framework that values elegance, simplicity and minimalism.☆13Sep 26, 2024Updated 2 years ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆789Aug 20, 2026Updated 2 months ago
- Give DeepSeek V4 Flash eyes. OpenAI-compatible shim + tiny local VLM. Point any harness at one URL and your text-only model accepts image…☆30Aug 9, 2026Updated 2 months ago
- MiniMax H3 (video + audio) on TensorFold 0.6.5 with an H3 family, Mac Studio M5 Ultra: 5 s 864x480 clip in ~50 s, 40 s at 768x448 — the f…☆29Oct 7, 2026Updated 2 weeks ago
- Wrangler Compatible Cloudflare Deployment API☆19Mar 27, 2026Updated 6 months ago
- ☆236Jun 11, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Thoughtful Lightning AI Assistant - Dual-engine system with DeepSeek reasoning and Groq inference, featuring Gradio UI, secure API manage…☆20Jan 22, 2025Updated last year
- Minimal Claude Code alternative powered by MLX☆47Jan 11, 2026Updated 9 months ago
- this repo has all official MLX-LM-LoRA example notebooks for training on Apple Silicon☆42Sep 13, 2026Updated last month
- MLX-powered Qwen3 embedding server for Apple Silicon Macs. Features 0.6B/4B/8B models, 44K tokens/sec throughput, REST API, batch proce…☆17Aug 9, 2025Updated last year
- A fully trainable state space model (SSM)☆16Mar 18, 2025Updated last year
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- A feature rich implementation of Recursive Language Models, with ACP integration, REPL tool support, structured IO, advanced visualizatio…☆480Aug 24, 2026Updated last month
- JOSIE Voice: a real-time, on-device voice assistant for Apple Silicon. Download the macOS app (DMG) from Releases.☆47Updated this week
- Pipeline parallel training on Apple Silicon!☆34Dec 5, 2025Updated 10 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A fully client-side Three.js talking avatar powered by Google GNM, local WebGPU speech models, real-time lip sync, and browser-based voic…☆34Jul 20, 2026Updated 3 months ago
- Reinforcement learning for text generation on MLX (Apple Silicon)☆14Feb 15, 2026Updated 8 months ago
- makeyouravatar-zimage☆11Dec 10, 2025Updated 10 months ago
- Rust-native hybrid training & inference engine for Apple Neural Engine + Metal GPU☆181Apr 3, 2026Updated 6 months ago
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆246Oct 28, 2025Updated 11 months ago
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆481Oct 14, 2026Updated last week
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated last week