A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
☆12Oct 13, 2026Updated last week
Alternatives and similar repositories for Model-Optimizer
Users that are interested in Model-Optimizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆41Aug 16, 2026Updated 2 months ago
- ☆22May 22, 2026Updated 4 months ago
- GLM-5.2 UD-Q2 decode speedup: CPU∥GPU MoE expert-split (harness, specs, de-risk)☆23Aug 9, 2026Updated 2 months ago
- ☆21Aug 17, 2026Updated 2 months ago
- Working on the fastest vllm path for AMD Radeon AI PRO R9700☆74Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Standalone C11 and Metal inference server for EmbeddingGemma 300M☆28Updated this week
- Train Embedding Models on MLX.☆17Jun 2, 2026Updated 4 months ago
- Pipeline parallel training on Apple Silicon!☆34Dec 5, 2025Updated 10 months ago
- MoJev: typed, calibrated decisions in one forward pass.☆30Sep 23, 2026Updated 3 weeks ago
- Breaking the quadratic memory barrier in AI☆61Oct 13, 2026Updated last week
- Type-safe, async Rust SDK for the Agent2Agent (A2A) protocol, built to the final v1.0.0 spec — JSON-RPC, REST, WebSocket & gRPC for build…☆20Updated this week
- Truthful scheduler-step and streaming visualization for local LLM inference☆35Sep 6, 2026Updated last month
- GLM-5.3 (full) on 3-6 DGX Sparks (GB10): a from-scratch CUDA inference engine☆38Updated this week
- Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.☆80Sep 18, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Serve typed-decision (System 1) models — Laya or your own — on NVIDIA GPUs or Apple Silicon, with a Jev-compatible API and coding-agent i…☆35Sep 24, 2026Updated 3 weeks ago
- ☆57Sep 27, 2026Updated 3 weeks ago
- Memory-safe Rust controller for your own Sonos speakers on your own LAN — reliable SSDP/UPnP-SOAP/GENA interoperability (S1 + S2), a Spot…☆96Updated this week
- ☆13Aug 5, 2026Updated 2 months ago
- C5VRX build companion: ESP32-C5 analog FPV wiring, source firmware and a real-device USB console☆17Oct 3, 2026Updated 2 weeks ago
- Interactive canvas for taking an LLM apart tensor by tensor: measured INT8/INT4/FP8 error, distributions, spectra and outlier channels fo…☆75Sep 2, 2026Updated last month
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆90Oct 4, 2026Updated 2 weeks ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆33May 12, 2026Updated 5 months ago
- ☆58Oct 1, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Open recipes, engine patches, and benchmark harnesses for LLM inference on Intel Arc Pro B60/B70 (Battlemage, Xe2). MoE 35B at 160 t/s de…☆182Updated this week
- A small Node.js script that polls a website and sends a notification when there's a change. Inspired by my attempts to get a close hotel …☆13Nov 10, 2022Updated 3 years ago
- Run oversized sparse MoE GGUF models with bounded NVMe-to-RAM-to-VRAM caching, native multi-GPU planning, and a Linux desktop Studio.☆20Oct 12, 2026Updated last week
- Mechanical design files for Tanmatsu☆14Jul 3, 2026Updated 3 months ago
- StewardOS - agentic autonomous OSS system☆74Oct 7, 2026Updated last week
- PabloDraw is an Ansi/Ascii text and RIPscrip vector graphic art editor/viewer with multi-user capabilities.☆15Nov 30, 2020Updated 5 years ago
- ☆16May 24, 2026Updated 4 months ago
- DiffusionGemma NVFP4 structured decisions on a DGX Spark: container recipe☆220Sep 24, 2026Updated 3 weeks ago
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆41Sep 17, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆16Jul 21, 2026Updated 2 months ago
- A fork of https://github.com/Niko1221/Strata optimized for my 3090+5070 Ti setup, see docs/COMPARISON.md☆46Updated this week
- A plugin for Ghidra for automatic analysis of the binding of individual registers and their layouts.☆17Dec 18, 2025Updated 10 months ago
- ☆13Sep 7, 2026Updated last month
- AWS SAM Lambda and SQS demo☆11Jun 27, 2018Updated 8 years ago
- node-can is a NodeJS CAN library supporting multiple transports & protocols, heavily inspired by python-can.☆10Nov 18, 2024Updated last year
- A tool to unlobotomize your NVIDIA card!☆32Sep 6, 2026Updated last month