Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models
☆16May 11, 2026Updated 6 months ago
Alternatives and similar repositories for SparsityAndCoD
Users that are interested in SparsityAndCoD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official codebase for our paper "Do Language Models Use Their Depth Efficiently?"☆30Jun 25, 2025Updated last year
- SQL-based Recommendation System for multi-topic recommendations☆12Jun 1, 2021Updated 5 years ago
- [Technical Report] Multi-Stream Attention Residuals☆43Oct 12, 2026Updated last month
- Official Codebase: LT2: Linear-Time Looped Transformers.☆69Jul 27, 2026Updated 3 months ago
- ☆32May 20, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [NeurIPS 2025] Official Pytorch Implementation of "The Curse of Depth in Large Language Models" by Wenfang Sun, Xinyuan Song, Pengxiang L…☆75Mar 3, 2026Updated 8 months ago
- Invariant Representation learning☆20Jun 26, 2024Updated 2 years ago
- ☆12Jul 17, 2025Updated last year
- Official implementation of the paper "PonderLM-2: Pretraining LLM with Latent Thoughts in Continuous Space"☆18May 6, 2026Updated 6 months ago
- RollPacker: Taming Long-Tail Rollouts for RL Post-Training with Tail Batching☆12Mar 2, 2026Updated 8 months ago
- A Chrome extension to replace Arxiv URL's☆10Feb 26, 2018Updated 8 years ago
- Depth-Attention: Cross-Layer Value Mixing for Language Models☆11Aug 7, 2026Updated 3 months ago
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Jul 24, 2024Updated 2 years ago
- Implementation of “EO-EPTC: End-to-End Original Traffic-Based Encrypted Proxy Traffic Classification Framework”☆12Jan 9, 2026Updated 10 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Network Traffic Classification with Graph Neural Networks☆14Nov 4, 2023Updated 3 years ago
- Code for Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformers (https://arxiv.org/abs/2606.31779)☆55Jul 20, 2026Updated 3 months ago
- Implementation of <Orthogonal Model Merging>☆38Aug 5, 2026Updated 3 months ago
- Code implementation of DuoGPT (NeurIPS 2025, https://arxiv.org/abs/2506.20194)☆10Sep 23, 2025Updated last year
- Type theory + whales and syntax☆11Nov 28, 2019Updated 6 years ago
- 桂林电子科技大学PPT模板(Beamer)☆15Dec 22, 2023Updated 2 years ago
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Updated this week
- [NeurIPS 2026] Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers☆48Jul 1, 2026Updated 4 months ago
- This is a repository dedicated to high quality figures from ICLR 2025 papers.☆11Dec 15, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [JAG 2024] UAD-RS: Universal adversarial defense in remote sensing based on pre-trained denoising diffusion models☆11Nov 8, 2024Updated 2 years ago
- A paper list shared in the group meeting☆13Nov 13, 2025Updated last year
- This is the official implementation of the IndexNet.☆11May 23, 2023Updated 3 years ago
- tensorrt部署教程☆11Aug 1, 2025Updated last year
- ☆11May 14, 2026Updated 6 months ago
- DepthBench: Measuring How Residual Connections Enable More Computational Depth☆20Nov 4, 2026Updated last week
- ⚡ Official code for “Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus”…☆25Aug 13, 2026Updated 3 months ago
- Paper2Demo: Turn any academic PDF into a stunning demo video☆12Mar 20, 2026Updated 7 months ago
- multi-master-paxos with 3 nodes☆14Apr 11, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆12Jun 20, 2024Updated 2 years ago
- In-context Example Selection with Influences☆15May 12, 2023Updated 3 years ago
- Overloaded Record Fields implementation based on GHC prototypes.☆14Mar 6, 2017Updated 9 years ago
- [ECCV 2024] Official Implementation of CoPT: Unsupervised Domain Adaptive Segmentation using Domain-Agnostic Text Embeddings☆10Feb 24, 2025Updated last year
- ☆15Oct 4, 2024Updated 2 years ago
- ☆50Sep 9, 2026Updated 2 months ago
- ☆10Nov 26, 2025Updated 11 months ago
Are these results useful?