Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free, 9 architectures validated.
☆24Jul 26, 2026Updated last week
Alternatives and similar repositories for nexusquant
Users that are interested in nexusquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Open-source options gamma exposure (GEX) & positioning dashboard — dealer GEX, max pain, open interest, IV surface. Self-hosted, Docker, …☆44Updated this week
- A comprehensive AI & ML project portfolio from the University of Texas at Austin PG Program, demonstrating real-world data science and ma…☆17Jan 25, 2026Updated 6 months ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆30Jan 22, 2026Updated 6 months ago
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15May 19, 2026Updated 2 months ago
- A demonstrative example of running SGLang Diffusion with DP router☆17Mar 15, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆34Updated this week
- NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.☆24Apr 10, 2026Updated 3 months ago
- ☆25Jul 13, 2026Updated 3 weeks ago
- ☆16Mar 10, 2026Updated 4 months ago
- VibeRL is a Reinforcement Learning framework built essentially through vibe coding with Kimi K2.☆17Jul 27, 2026Updated last week
- Code for Fast Ternary Large Language Model Inference with Addition-Based Sparse GEMM on Edge Devices☆15Apr 17, 2026Updated 3 months ago
- This repositories contains the reference implementation for the Sparse Delta Memory paper.More precisely, it contains the model definitio…☆32Jul 9, 2026Updated 3 weeks ago
- High Performance KV Cache Store for LLM☆59May 20, 2026Updated 2 months ago
- [WIP] Better (FP8) attention for Hopper☆33Feb 24, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- a size profiler for cuda binary☆71Jan 15, 2026Updated 6 months ago
- Code for MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization☆22Feb 18, 2026Updated 5 months ago
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated last month
- (ECCV 2026): Official code for Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models☆18Jul 9, 2026Updated 3 weeks ago
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆61Feb 6, 2026Updated 5 months ago
- 🔥LongCat-Video 1.7x🎉 speedup: cache acceleration and 4/8-bits weight only.☆15Oct 28, 2025Updated 9 months ago
- ☆53May 19, 2025Updated last year
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆16Feb 9, 2026Updated 5 months ago
- HiCache: Hermite Polynomial-based Feature Cache for diffusion inference☆15Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆57Aug 6, 2025Updated 11 months ago
- ☆18Jul 12, 2025Updated last year
- Deep learning-based flower classification system using CNN architectures for image recognition and classification. Trained and evaluated …☆19Jul 18, 2026Updated 2 weeks ago
- BitNet a4.8 Implementation in one file of pytorch☆24Jan 13, 2025Updated last year
- Go version of ruyiPage based on Firefox + WebDriver BiDi☆16Apr 24, 2026Updated 3 months ago
- ☆18May 15, 2023Updated 3 years ago
- Xmixers: A collection of SOTA efficient token/channel mixers☆29Sep 4, 2025Updated 10 months ago
- Type-safe, async Rust SDK for the Agent2Agent (A2A) protocol, built to the final v1.0.0 spec — JSON-RPC, REST, WebSocket & gRPC for build…☆19Updated this week
- 1CatV2 with TileLANG written FA-v100 and many goodies☆17Jul 15, 2026Updated 2 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- fake CUTLASS to get peformance☆26Apr 28, 2026Updated 3 months ago
- FLA but cuTile☆27Apr 17, 2026Updated 3 months ago
- ☆23Aug 20, 2025Updated 11 months ago
- Rust implementation of TurboQuant, PolarQuant, and QJL — zero-overhead vector quantization for semantic search and KV cache compression (…☆26May 31, 2026Updated 2 months ago
- An Optimizer for Nvidia Compilers.☆114Updated this week
- Systematic options trading intelligence for small accounts. Create desks in your portfolio, allocate capital and risk appetite at Desk Le…☆17Updated this week
- ☆32Jul 2, 2025Updated last year