Minimalist repo to do mlx vlm constrained decoding in batch mode
☆20Apr 11, 2026Updated 7 months ago
Alternatives and similar repositories for mlx-vlm-batch-outlines
Users that are interested in mlx-vlm-batch-outlines are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Minimal Docker/Compose front end for Apple's container, in Swift☆18Oct 11, 2026Updated last month
- LLM inference in C, compiled per model and per chip. Up to 14x faster.☆28Sep 7, 2026Updated 2 months ago
- Converting text-LMs into Visual Language Models☆76Jan 31, 2026Updated 9 months ago
- Super fast local inferencing for common NLP tasks on technical text☆56Jun 16, 2026Updated 4 months ago
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 5 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Let Auggie describe your PR for you☆10Oct 9, 2025Updated last year
- ☆39May 19, 2026Updated 5 months ago
- ☆37Mar 30, 2026Updated 7 months ago
- The end of Screenshot 2023-12-20-21.11.59.png☆15Dec 22, 2023Updated 2 years ago
- llama.cpp fork for running Qwen3.8-Flash-Next V3 (95.5 GiB) on a 64 GB Apple Silicon Mac by streaming MoE experts from SSD. Setup guide: …☆13Sep 19, 2026Updated last month
- Moshi-Finetune-MLX lets you fine-tune Moshi (Native, Real-Time, Speech-to-Speech) models all on Apple Silicon.☆26Apr 21, 2026Updated 6 months ago
- A simple library for generating instruction tuning datasets locally☆119Sep 20, 2026Updated last month
- Notebook Terminal UI and Headless Renderer☆31Apr 19, 2026Updated 6 months ago
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers☆30May 19, 2026Updated 5 months ago
- A repo of useful MLX skills.☆90Jan 25, 2026Updated 9 months ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Oct 25, 2026Updated 2 weeks ago
- Yahoo's repo using Caffe:cpu as neural network, to recognize Not Safe For work images. Ported to a web interface☆15Dec 5, 2018Updated 7 years ago
- ☆24Jun 12, 2026Updated 5 months ago
- GPU-resident vector database in single exe☆15Sep 26, 2026Updated last month
- We gave AI models telepathy.☆27Sep 25, 2026Updated last month
- ☆192Sep 8, 2026Updated 2 months ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆793Aug 20, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆21Updated this week
- Code for The Truth Lies Somewhere in the Middle (of the Generated Tokens)☆25May 12, 2026Updated 6 months ago
- ☆17Aug 26, 2026Updated 2 months ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- Thoughtful Lightning AI Assistant - Dual-engine system with DeepSeek reasoning and Groq inference, featuring Gradio UI, secure API manage…☆20Jan 22, 2025Updated last year
- ☆240Jun 11, 2026Updated 5 months ago
- A feature rich implementation of Recursive Language Models, with ACP integration, REPL tool support, structured IO, advanced visualizatio…☆485Aug 24, 2026Updated 2 months ago
- Give DeepSeek V4 Flash eyes. OpenAI-compatible shim + tiny local VLM. Point any harness at one URL and your text-only model accepts image…☆30Aug 9, 2026Updated 3 months ago
- Pipeline parallel training on Apple Silicon!☆34Dec 5, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Reinforcement learning for text generation on MLX (Apple Silicon)☆14Feb 15, 2026Updated 8 months ago
- Rust-native hybrid training & inference engine for Apple Neural Engine + Metal GPU☆184Apr 3, 2026Updated 7 months ago
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆248Oct 28, 2025Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- Exact speculative decoding on Apple Silicon, powered by MLX.☆390Apr 20, 2026Updated 6 months ago
- ☆70Sep 8, 2026Updated 2 months ago
- Links to all the source code and solutions I reference in my O'Reilly Introduction to Docker video tutorial☆11Dec 10, 2014Updated 11 years ago
Are these results useful?