A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
☆11Oct 13, 2026Updated 3 weeks ago
Alternatives and similar repositories for Model-Optimizer
Users that are interested in Model-Optimizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Claude Code ZeroClaw Pro 2026: AI Multitool & CLI Router for Claude SDK Subagents☆52Updated this week
- ☆41Aug 16, 2026Updated 2 months ago
- ☆17Oct 20, 2026Updated 3 weeks ago
- Fermion Research fork of llama.cpp: FV5/FV5B five-value ternary types for Neutrino GGUF packs (CPU + CUDA)☆14Sep 29, 2026Updated last month
- ☆22Oct 18, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A very-low-resource API-compatible replacement for Ray☆13Nov 1, 2026Updated last week
- AI to AI comms with koboldcpp from Claude/other MCP compatible apps☆13May 6, 2025Updated last year
- realtime local churn monitor for git branch diffs☆10Mar 6, 2026Updated 8 months ago
- Train Embedding Models on MLX.☆17Jun 2, 2026Updated 5 months ago
- LLM inference in C/C++☆24Oct 21, 2026Updated 2 weeks ago
- Custom MEC firmware for 7900XTX☆18Aug 18, 2026Updated 2 months ago
- Pipeline parallel training on Apple Silicon!☆34Dec 5, 2025Updated 11 months ago
- Serve DeepSeek-V4-Flash-Vision EXL3 MixedK (full 256 experts) on one NVIDIA DGX Spark with vLLM — recipe, loader patches, and receipts☆14Sep 7, 2026Updated 2 months ago
- Eight-system DGX Spark engineering: fabric repair, NCCL tuning, rack recabling, custom 3D-printed PSU supports, and thermal validation.☆11Aug 3, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- WikiPBX is an open source PBX web interface for FreeSWITCH. WikiPBX is written in python and uses the Django web application framework. C…☆10May 30, 2014Updated 12 years ago
- ☆21Oct 21, 2026Updated 2 weeks ago
- GLM-5.2 UD-Q2 decode speedup: CPU∥GPU MoE expert-split (harness, specs, de-risk)☆23Aug 9, 2026Updated 3 months ago
- Auto researching harness that burns through everything.☆61Updated this week
- NPU-accelerated speech transcription & speaker diarization on AMD Strix Halo: Whisper-v3-turbo on XDNA 2 + pyannote, OpenAI-compatible AP…☆14Aug 31, 2026Updated 2 months ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆33May 12, 2026Updated 5 months ago
- Type-safe, async Rust SDK for the Agent2Agent (A2A) protocol, built to the final v1.0.1 spec — JSON-RPC, REST, WebSocket & gRPC for build…☆21Updated this week
- A small Node.js script that polls a website and sends a notification when there's a change. Inspired by my attempts to get a close hotel …☆13Nov 10, 2022Updated 4 years ago
- AI-powered news curation engine with personalized source discovery☆12Oct 12, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MoJev: typed, calibrated decisions in one forward pass.☆30Sep 23, 2026Updated last month
- One serving daemon for local LLM inference — across runtimes and machines.☆22Updated this week
- ☆28May 20, 2026Updated 5 months ago
- Breaking the quadratic memory barrier in AI☆60Oct 13, 2026Updated 3 weeks ago
- ☆13Nov 3, 2026Updated last week
- Mechanical design files for Tanmatsu☆14Oct 27, 2026Updated 2 weeks ago
- A plugin for Ghidra for automatic analysis of the binding of individual registers and their layouts.☆17Dec 18, 2025Updated 10 months ago
- SparkHome: a tvOS-style home screen and voice assistant for the NVIDIA DGX Spark. Plugins for controllers, tiles and connectors; MCP for …☆39Nov 2, 2026Updated last week
- ☆14Sep 7, 2026Updated 2 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- GLM 5.3 Flash for 2x RTX 6000, Full Mixed EXL3 Support, Code C1 >220tps☆22Oct 25, 2026Updated 2 weeks ago
- Tiny node module of utilities for working with waveforms in the browser. Depends on pcm.js and ffprobe.js.☆12Apr 22, 2013Updated 13 years ago
- node-can is a NodeJS CAN library supporting multiple transports & protocols, heavily inspired by python-can.☆10Nov 18, 2024Updated last year
- PabloDraw is an Ansi/Ascii text and RIPscrip vector graphic art editor/viewer with multi-user capabilities.☆15Nov 30, 2020Updated 5 years ago
- AWS SAM Lambda and SQS demo☆11Jun 27, 2018Updated 8 years ago
- Telegraf plugin for FreeSWITCH☆12Feb 12, 2016Updated 10 years ago
- ☆16Jul 21, 2026Updated 3 months ago
Are these results useful?