Depth-Attention: Cross-Layer Value Mixing for Language Models
☆11Aug 7, 2026Updated 3 months ago
Alternatives and similar repositories for Depth-Attention
Users that are interested in Depth-Attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of the paper "PonderLM-2: Pretraining LLM with Latent Thoughts in Continuous Space"☆18May 6, 2026Updated 6 months ago
- ☆15Oct 31, 2024Updated 2 years ago
- Official implementation of the paper "Pretraining Language Models to Ponder in Continuous Space"☆28Jul 21, 2025Updated last year
- [ACL 2025] NeuSym-RAG: Hybrid Neural Symbolic Retrieval with Multiview Structuring for PDF Question Answering☆32Jul 29, 2025Updated last year
- Official implementation of the paper "AWM: Accurate Weight-Matrix Fingerprint for Large Language Models"☆13Feb 20, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code and paper reproductions for MLPs Are Hebbians☆34Jul 22, 2026Updated 3 months ago
- Implementation of "Scaling Latent Reasoning via Looped Language Models" aka LoopLM☆41Apr 28, 2026Updated 6 months ago
- SQL-based Recommendation System for multi-topic recommendations☆12Jun 1, 2021Updated 5 years ago
- ☆32May 20, 2026Updated 5 months ago
- Code for "On Expressive Power of Looped Transformers: Theoretical Analysis and Enhancement via Timestep Encoding (ICML 2025)"☆10Jun 29, 2025Updated last year
- 🎓Automatically Update circult-eda-mlsys-tinyml Papers Daily using Github Actions (Update Every 8th hours)☆10Updated this week
- ⚡ Official code for “Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus”…☆25Aug 13, 2026Updated 3 months ago
- A Trustworthy Machine Learning Algorithm Library☆12Jul 1, 2024Updated 2 years ago
- official github repository of Subdora python package☆11Nov 13, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Official implementation for "HuRef: HUman-REadable Fingerprint for Large Language Models" (NeurIPS2024)☆15Jun 17, 2025Updated last year
- Official code for Towards Looped Models Done Right based on xLLM☆66Oct 21, 2026Updated 3 weeks ago
- Code for the paper Depth Memory☆17Oct 14, 2026Updated 3 weeks ago
- Bitwise-identical token probabilities between RL rollout (vLLM) and training☆42Updated this week
- A demo repo based on OpenAI API (gpt-3.5-turbo)☆14Mar 4, 2023Updated 3 years ago
- Lev: Thinking Fast and Deep with Looped Decision Models. One checkpoint, multiple depths: System 1.5 decision models that think in loops,…☆27Oct 19, 2026Updated 3 weeks ago
- ☆16Jul 21, 2025Updated last year
- Repo for RLTT Looped LLM RLVR Project☆15May 26, 2026Updated 5 months ago
- Code for "Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation"☆19Sep 1, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models☆16May 11, 2026Updated 6 months ago
- KV cache compression via sparse coding☆18Oct 26, 2025Updated last year
- 235 papers on looped and recursive Transformers, latent reasoning, and test-time compute. Bilingual EN/ZH atlas with official code and su…☆17Oct 27, 2026Updated 2 weeks ago
- MoIIE: Mixture of Intra- and Inter-Modality Experts for Large Vision Language Models☆20Aug 14, 2025Updated last year
- LLM play 20questions with itself☆13Mar 31, 2023Updated 3 years ago
- [RSS 2026] GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization☆103May 14, 2026Updated 5 months ago
- ☆12Jul 17, 2025Updated last year
- Synthetic Alphabet Dataset☆19Mar 27, 2025Updated last year
- UCB-CS61C project3 : RISC-V CPU design☆11Mar 19, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Auxiliary tasks for task-oriented dialogue systems. Published in ICNLSP'22 and indexed in the ACL Anthology.☆17Feb 27, 2023Updated 3 years ago
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆21Jun 25, 2024Updated 2 years ago
- TernGEMM: General Matrix Multiply Library with Ternary Weights for Fast DNN Inference☆14Feb 22, 2022Updated 4 years ago
- The official implementation of the paper "A Dual-Space Framework for General Knowledge Distillation of Large Language Models".☆17Jan 4, 2026Updated 10 months ago
- (Nanochat based) Full-bandwidth transformer, feed LLM's own deep hidden states back to itself☆20Oct 3, 2026Updated last month
- Easily change the background of your Hyper terminal!☆11Nov 29, 2024Updated last year
- ☆13Dec 8, 2022Updated 3 years ago
Are these results useful?