Minimalist repo to do mlx vlm constrained decoding in batch mode
☆19Apr 11, 2026Updated 5 months ago
Alternatives and similar repositories for mlx-vlm-batch-outlines
Users that are interested in mlx-vlm-batch-outlines are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 6 months ago
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 3 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 5 months ago
- ☆38Mar 30, 2026Updated 6 months ago
- Moshi-Finetune-MLX lets you fine-tune Moshi (Native, Real-Time, Speech-to-Speech) models all on Apple Silicon.☆26Apr 21, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The end of Screenshot 2023-12-20-21.11.59.png☆15Dec 22, 2023Updated 2 years ago
- Notebook Terminal UI and Headless Renderer☆30Apr 19, 2026Updated 5 months ago
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 5 months ago
- A GUI for launchd, similar to launchctl. Or... something.☆15May 7, 2022Updated 4 years ago
- A repo of useful MLX skills.☆89Jan 25, 2026Updated 8 months ago
- Open source, clear, transparent, real world llm benchmarks☆86Updated this week
- 🐙 HRM-MLX implements the Hierarchical Reasoning Model for Apple Silicon with 27M params, enabling fast multi-timescale reasoning on 1k s…☆24Updated this week
- Find the hidden meaning of LLMs☆42Nov 13, 2025Updated 10 months ago
- Converting text-LMs into Visual Language Models☆72Jan 31, 2026Updated 8 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆787Aug 20, 2026Updated last month
- this repo has all official MLX-LM-LoRA example notebooks for training on Apple Silicon☆42Sep 13, 2026Updated 2 weeks ago
- Super fast local inferencing for common NLP tasks on technical text☆55Jun 16, 2026Updated 3 months ago
- A fully trainable state space model (SSM)☆16Mar 18, 2025Updated last year
- Minimal Claude Code alternative powered by MLX☆47Jan 11, 2026Updated 8 months ago
- Wrangler Compatible Cloudflare Deployment API☆19Mar 27, 2026Updated 6 months ago
- Thoughtful Lightning AI Assistant - Dual-engine system with DeepSeek reasoning and Groq inference, featuring Gradio UI, secure API manage…☆20Jan 22, 2025Updated last year
- ☆28Jul 16, 2026Updated 2 months ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆475Aug 17, 2026Updated last month
- Here are some useful Google Apps Script scripts which you can copy and deploy through Google Drive.☆15Oct 12, 2021Updated 4 years ago
- Pipeline parallel training on Apple Silicon!☆34Dec 5, 2025Updated 9 months ago
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆241Oct 28, 2025Updated 11 months ago
- MLX-powered Qwen3 embedding server for Apple Silicon Macs. Features 0.6B/4B/8B models, 44K tokens/sec throughput, REST API, batch proce…☆17Aug 9, 2025Updated last year
- Rust-native hybrid training & inference engine for Apple Neural Engine + Metal GPU☆182Apr 3, 2026Updated 5 months ago
- Exact speculative decoding on Apple Silicon, powered by MLX.☆391Apr 20, 2026Updated 5 months ago
- Run LLMs with MLX☆14May 1, 2026Updated 5 months ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Grounded reasoning agent: Falcon Perception + Gemma 4 VLM on Apple Silicon☆28Apr 5, 2026Updated 5 months ago
- OpenSource deployment made easy☆10Jun 13, 2015Updated 11 years ago
- An intelligent load balancer for LM Studio that distributes requests across multiple loaded language models, optimizing resource utilizat…☆21Oct 13, 2025Updated 11 months ago
- On-device semantic search over Apple WWDC 2025 docs using MLX embeddings — SwiftUI app (WWDC OMT 2025)☆76Jun 12, 2025Updated last year
- Links to all the source code and solutions I reference in my O'Reilly Introduction to Docker video tutorial☆11Dec 10, 2014Updated 11 years ago
- A beautiful desktop application for Local-NotebookLM that provides an intuitive UI for converting PDFs to engaging audio content.☆29Apr 1, 2026Updated 6 months ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year