My reasearch of losslessly compressing LLM weights.
☆66Jul 23, 2026Updated 3 months ago
Alternatives and similar repositories for weight-compression
Users that are interested in weight-compression are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Dynamic per-token early exit for LLM inference. Skip layers tokens don't need☆34Sep 18, 2026Updated last month
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆22Aug 6, 2026Updated 2 months ago
- ☆15Jan 14, 2026Updated 9 months ago
- Small System One decision models (17M–400M) for Yes/No, Choice, Score, and reranking. Training toolkit, Python inference, and ONNX suppor…☆37Oct 15, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- DGX Spark (GB10/sm_121) port: DeepSeek-V4-Flash 159B on one Spark, GLM-5.2 753B across two. Prepacked 2-bit planes + unified-memory fixes…☆19Jul 20, 2026Updated 3 months ago
- Submodule of evalverse forked from [google-research/instruction_following_eval](https://github.com/google-research/google-research/tree/m…☆15May 4, 2024Updated 2 years ago
- A web interface (and more) for YuE2: cover a recording or write a song from a prompt, edit the score, extract the stems, create your own …☆24Updated this week
- CLI tool using ripgrep and treesitter to produce code skeletons for agentic programming☆14Oct 3, 2026Updated 2 weeks ago
- Run oversized sparse MoE GGUF models with bounded NVMe-to-RAM-to-VRAM caching, native multi-GPU planning, and a Linux desktop Studio.☆20Oct 12, 2026Updated last week
- Cetvel: A Unified Benchmark for Evaluating Language Understanding, Generation and Cultural Capacity of LLMs for Turkish (EACL 2026, Offic…☆31Feb 27, 2026Updated 7 months ago
- CoalaEmbeddings: Extreme embedding compression framework—use 128x less RAM with >94% search quality.☆24Aug 15, 2026Updated 2 months ago
- ☆46Aug 3, 2026Updated 2 months ago
- Int4-quantized FLUX.2-klein inference runtime (GemLite / fused Triton / eager backends)☆21May 24, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆90Updated this week
- Lightweight ternary QAT for ternary Bonsai models by Prism-ML☆17Sep 18, 2026Updated last month
- Demo of knowledge graph creation and Graph RAG with Dspy and Kuzu☆22Jun 30, 2025Updated last year
- An AI assistant to prioritize security vulnerabilities☆14May 29, 2026Updated 4 months ago
- A tiny ~10K-parameter LLM router that learns which open-source model (deepseek-v4-pro / glm-5p2 / kimi-k2p6 via Fireworks) should answer …☆316Jul 6, 2026Updated 3 months ago
- Find abandoned, deprecated and single-maintainer npm dependencies before they become supply-chain incidents. Zero-dep CLI + GitHub Action…☆23Updated this week
- lumen beat gpt-5.6 sol at html/react accessibility repair, with an estimated ~200× lower inference cost.☆24Aug 8, 2026Updated 2 months ago
- Claude Code plugin — AI-powered autopilot for managing open source contributions. Track PRs, respond to maintainers, discover issues, mai…☆21Updated this week
- ☆57Sep 27, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆23Oct 13, 2026Updated last week
- GLM-5.3 (full) on 3-6 DGX Sparks (GB10): a from-scratch CUDA inference engine☆38Updated this week
- Cross-session messaging for opencode — let independent sessions discover and text each other, modeled after Claude Code's cross-session m…☆16Updated this week
- A skill to avoid writing AI-like texts you can install in your best AI tool☆31Sep 26, 2026Updated 3 weeks ago
- GLM-5.2 UD-Q2 decode speedup: CPU∥GPU MoE expert-split (harness, specs, de-risk)☆23Aug 9, 2026Updated 2 months ago
- ☆14Aug 21, 2026Updated 2 months ago
- Immutable Linux distribution based on Gentoo, BtrFS, and Cosmic-Desktop.☆14Sep 13, 2026Updated last month
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆97Updated this week
- SGLang kernel library for Intel XPU☆36Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LLMs take the path of least resistance. Pre-Reasoning hands any model a map of the problem first, so it unlocks the knowledge it already …☆19Sep 21, 2026Updated last month
- ☆34Mar 9, 2025Updated last year
- ☆15Sep 5, 2026Updated last month
- Project code for training LLMs to write better unit tests + code☆22May 19, 2025Updated last year
- Trail is a local-first, prolly tree backed operation database for code and text worktrees. Git records committed snapshots; Trail records…☆29Aug 13, 2026Updated 2 months ago
- A training-free method for extending the maximum context length of language models☆14Oct 6, 2025Updated last year
- Official code for "μ0: A Scalable 3D Interaction-Trace World Model" (CoRL 2026)☆18Oct 7, 2026Updated 2 weeks ago