Minimalist repo to do mlx vlm constrained decoding in batch mode
☆19Apr 11, 2026Updated 5 months ago
Alternatives and similar repositories for mlx-vlm-batch-outlines
Users that are interested in mlx-vlm-batch-outlines are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 5 months ago
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 3 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 4 months ago
- ☆37Mar 30, 2026Updated 5 months ago
- Notebook Terminal UI and Headless Renderer☆29Apr 19, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers☆30May 19, 2026Updated 3 months ago
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆145Apr 15, 2026Updated 4 months ago
- Open source, clear, transparent, real world llm benchmarks☆83Updated this week
- A repo of useful MLX skills.☆89Jan 25, 2026Updated 7 months ago
- Multi-LoRA inference server for Apple Silicon -- one base model, many adapters, zero reload☆20Apr 13, 2026Updated 5 months ago
- Find the hidden meaning of LLMs☆42Nov 13, 2025Updated 10 months ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆779Aug 20, 2026Updated 3 weeks ago
- this repo has all official MLX-LM-LoRA example notebooks for training on Apple Silicon☆41Apr 23, 2026Updated 4 months ago
- Super fast local inferencing for common NLP tasks on technical text☆54Jun 16, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A fully trainable state space model (SSM)☆16Mar 18, 2025Updated last year
- ☆227Jun 11, 2026Updated 3 months ago
- A simple library for generating instruction tuning datasets locally☆110Aug 21, 2026Updated 3 weeks ago
- Thoughtful Lightning AI Assistant - Dual-engine system with DeepSeek reasoning and Groq inference, featuring Gradio UI, secure API manage…☆20Jan 22, 2025Updated last year
- sigil is a low level tool that runs a linux process in a private and restricted environment similar to docker☆36Apr 16, 2026Updated 4 months ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization☆467Aug 17, 2026Updated 3 weeks ago
- Pipeline parallel training on Apple Silicon!☆34Dec 5, 2025Updated 9 months ago
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆242Oct 28, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Exact speculative decoding on Apple Silicon, powered by MLX.☆388Apr 20, 2026Updated 4 months ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 5 months ago
- OpenSource deployment made easy☆10Jun 13, 2015Updated 11 years ago
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16May 8, 2025Updated last year
- [ACL 2026] G2RPO-A: Guided Group Relative Policy Optimization with Adaptive Guidance☆16May 20, 2026Updated 3 months ago
- ☆18Jan 29, 2026Updated 7 months ago
- ☆15Jun 13, 2025Updated last year
- ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)☆152Updated this week
- Limit is your AI coding companion that refuses to leave the terminal — and that's exactly where it belongs.☆19Mar 27, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A CLI secrets store & dispatch tool built for AI agents. Authy stores encrypted secrets locally and dispatches them to agents with polic…☆24Feb 26, 2026Updated 6 months ago
- A simple NextJS MCP client with sensible keybindings☆38Feb 12, 2026Updated 7 months ago
- Realtime Transcription with Voxtral in MLX☆106Feb 8, 2026Updated 7 months ago
- ☆11Sep 11, 2024Updated 2 years ago
- ☆49Jan 3, 2026Updated 8 months ago
- MLX binary vectors and associated algorithms.☆14Mar 13, 2025Updated last year
- Triton‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon☆53Mar 31, 2026Updated 5 months ago