Cuda kernels for leveraging LLM sparsity to improve throughput and decrease the memory requirements during inference and training.
☆264Jun 29, 2026Updated 2 months ago
Alternatives and similar repositories for sparser-faster-llms
Users that are interested in sparser-faster-llms are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation☆317Feb 18, 2026Updated 7 months ago
- Official Codebase: LT2: Linear-Time Looped Transformers.☆63Jul 27, 2026Updated last month
- ☆27May 14, 2026Updated 4 months ago
- ☆34Feb 1, 2026Updated 7 months ago
- Triton kernels and PyTorch ops for Block Attention Residuals (AttnRes)☆89May 29, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Official PyTorch Implementation of Gated DeltaNet-2: Decoupling Erase and Write in Linear Attention☆294Aug 29, 2026Updated 3 weeks ago
- ☆23Jul 10, 2026Updated 2 months ago
- Official code for "How2Everything: Mining the Web for How-To Procedures to Evaluate and Improve LLMs"☆25Feb 10, 2026Updated 7 months ago
- Code with CliqueFlowmer model for Optimal Computational Materials Discovery☆17Sep 6, 2026Updated 2 weeks ago
- An hardware-aware Efficient Implementation for "Mixture-of-Depths Attention".☆277May 6, 2026Updated 4 months ago
- Code for MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization☆23Feb 18, 2026Updated 7 months ago
- ☆16Updated this week
- Population Based Training of Petri Dish Neural Cellular Automata☆18Apr 14, 2026Updated 5 months ago
- Official JAX implementation of End-to-End Test-Time Training for Long Context☆703Feb 15, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A lightweight inference engine supporting speculative speculative decoding (SSD).☆1,004May 10, 2026Updated 4 months ago
- Quartet II Official Code☆82May 1, 2026Updated 4 months ago
- Fast Polar Decomposition for Muon☆183Jul 2, 2026Updated 2 months ago
- ☆17Jun 15, 2026Updated 3 months ago
- The implementation for ThreadWeaver Adaptive Threading for Efficient Parallel Reasoning in Language Models☆67Apr 8, 2026Updated 5 months ago
- [EMNLP 2026] MDM-Prime-v2: Binary Encoding and Index Shuffling Enable Scaling of Diffusion Language Models☆30Sep 11, 2026Updated last week
- ☆803Sep 11, 2026Updated last week
- ConfAgents: A Conformal-Guided Multi-Agent Framework for Cost-Efficient Medical Diagnosis☆15Jul 22, 2026Updated last month
- 📄Small Batch Size Training for Language Models☆87Mar 18, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆638May 24, 2026Updated 3 months ago
- Generative Modeling with Bayesian Sample Inference☆26Aug 14, 2026Updated last month
- We propose Bidirectional Evolutionary Search (BES), a search framework that couples forward candidate evolution with backward goal decomp…☆170May 28, 2026Updated 3 months ago
- ☆22May 5, 2025Updated last year
- Efficient non-uniform quantization with GPTQ for GGUF☆66Sep 17, 2025Updated last year
- AdaSplash: Adaptive Sparse Flash Attention (aka Flash Entmax Attention)☆49May 20, 2026Updated 3 months ago
- Delta Attention Residuals - supplementary code and pretrained models☆43May 20, 2026Updated 3 months ago
- This repositories contains the reference implementation for the Sparse Delta Memory paper.More precisely, it contains the model definitio…☆39Jul 9, 2026Updated 2 months ago
- The training codes of Jasper-Token-Compression-600M☆22Nov 19, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repository contains companion software for the Colfax Research paper "Categorical Foundations for CuTe Layouts".☆145Aug 15, 2026Updated last month
- Training teachers with reinforcement learning able to make LLMs learn how to reason for test time scaling.☆368Jun 23, 2025Updated last year
- ☆38Jul 8, 2026Updated 2 months ago
- ☆138May 29, 2025Updated last year
- Experiment on replacing the Scaled Dot-Product Attention in Transformers for a distance-based metric: the Radial Basis Function (RBF) ker…☆25Apr 19, 2026Updated 5 months ago
- Hypernetworks that update LLMs to remember factual information☆823Jun 15, 2026Updated 3 months ago
- 🖥 Neural Computers' Data Engine☆207May 19, 2026Updated 4 months ago