Statistically-Lossless Quantization of Large Language Models
☆61Oct 8, 2026Updated last month
Alternatives and similar repositories for SLQ
Users that are interested in SLQ are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).☆135Jul 11, 2026Updated 4 months ago
- An in-app browser pane for DeepSeek Harness — real Chrome over CDP, plus rendered previews of local files, markdown and PDFs.☆15Sep 28, 2026Updated last month
- Recursive Self-Aggregation evals on ARC-AGI☆36Jan 26, 2026Updated 9 months ago
- Official Repository for "WUSH: Near-Optimal Adaptive Transforms for LLM Quantization" (ICML 2026)☆18Jun 30, 2026Updated 4 months ago
- TFT (Training from Traces) benchmark: 5 scenarios comparing TFT pipeline vs Direct Training on SGD restaurant traces☆13Sep 7, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- FORTE (Full-cycle Office Real-world Task Evaluation) is a general agent benchmark for evaluating AI agents on daily office productivity a…☆20Jun 30, 2026Updated 4 months ago
- Making 1.58-bit models simple to build and broadly accessible through low-cost, high-accuracy post-training ternary quantization.☆48Aug 18, 2026Updated 2 months ago
- Lossless compression of BF16 models to 12-bits☆28Updated this week
- The chunking benchmark☆15Feb 7, 2026Updated 9 months ago
- RCO: Optimization of Non-Decomposable Objectives under Exact Budget Constraints for LLM Quantization and Pruning☆70Jun 13, 2026Updated 4 months ago
- Qwen3.6-27B (NVFP4) DFlash for DGX Spark☆23Jul 31, 2026Updated 3 months ago
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 5 months ago
- Long-term memory for AI agents with no LLM call: an MCP server and Claude Code plugin, plus local-first context compression for LLM apps.☆25Updated this week
- Air-gapped deployment toolkit for Jina AI models☆23Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Efficient non-uniform quantization with GPTQ for GGUF☆68Sep 17, 2025Updated last year
- Run Escha models on Apple Silicon: 2-bit escha runtime for MLX with bit-exact Metal kernels and OpenAI-compatible serving.☆18Sep 16, 2026Updated last month
- ☆127Feb 26, 2026Updated 8 months ago
- A PyTorch native automated mega-kernel compiler☆33Updated this week
- DialSort implementation in Cpp☆82Jun 15, 2026Updated 4 months ago
- Repo for a ChatBot, with Gradio, Streaming TinyLlama1.1BOpenOrca.gguf on CPU only☆11Dec 13, 2023Updated 2 years ago
- A minimal, self-contained implementation of a Lean 4-style theorem prover kernel in Rust.☆24Updated this week
- ☆98Jun 3, 2026Updated 5 months ago
- Arctic Training and Inference Platform☆65Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A dependency-free C inference engine for Liquid AI's LFM2 / LFM2.5 models. Terminal chat, an OpenAI-compatible server, a web agent and a …☆31Updated this week
- Build generative models in ONNX☆21Updated this week
- Boo, a ghost-faced audio/visual agent you talk to from your phone: speech in and out, camera, hand tracking, memory and a tool-using back…☆14Oct 30, 2026Updated last week
- Collect LLM Quantization related papers, data, repositories☆12Aug 27, 2024Updated 2 years ago
- Nemotron 3.5 Super VL (NVFP4) on one DGX Spark with TensorFold 1.0.12 and 18 lossless engine patches☆11Oct 24, 2026Updated 2 weeks ago
- Light-weight infrastructure for express LLM pre-training☆124Updated this week
- [ICLR 2026] ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference☆344Aug 19, 2026Updated 2 months ago
- Serve Ornith-1.5-35B-A3B (NVFP4 + in-checkpoint MTP, 256k ctx) on one DGX Spark — vLLM b12x recipe plus CUDA-graph fixes.☆33Aug 19, 2026Updated 2 months ago
- A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.☆13Jan 13, 2026Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆35Nov 11, 2025Updated last year
- ☆13May 25, 2026Updated 5 months ago
- ☆16Jun 16, 2026Updated 4 months ago
- MiniMax M2.7 NVFP4 dual-GB10 Blackwell benchmark: vLLM FlashInfer-CUTLASS, public data, HTML canvas report, and Docker runtime.☆13May 24, 2026Updated 5 months ago
- Automatic detection of flaws in iOS sandbox profiles☆14Jun 13, 2022Updated 4 years ago
- Evalution: evolve your LLMs with better evals.☆17Updated this week
- Transformers for decision models: fine-tune, load and serve calibrated decsion-model on any Hugging Face model.☆44Nov 2, 2026Updated last week
Are these results useful?