Dynamic Attention Mask (DAM) generate adaptive sparse attention masks per layer and head for Transformer models, enabling long-context inference with lower compute and memory overhead without fine-tuning.
☆14Jun 16, 2025Updated last year
Alternatives and similar repositories for DAM
Users that are interested in DAM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Apr 13, 2024Updated 2 years ago
- A simple audio recorder for Android☆16Mar 17, 2014Updated 12 years ago
- Awesome Visual Tracking☆25Oct 3, 2025Updated last year
- A modified Betaflight firmware for quadrotor autopilot☆10Dec 27, 2025Updated 9 months ago
- PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"☆21Oct 28, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆10May 10, 2025Updated last year
- ☆21Feb 4, 2016Updated 10 years ago
- ☆12Aug 4, 2026Updated 2 months ago
- Learning to Skip the Middle Layers of Transformers☆17Aug 7, 2025Updated last year
- A quad-rotor controller based on CH32V307☆15Jul 25, 2024Updated 2 years ago
- OpenIPC Steam Deck Groundstation☆16Jan 22, 2025Updated last year
- Sparsity as a Variance Regulator for Improved Depth Utilization in Language Models☆16May 11, 2026Updated 5 months ago
- Peer-to-Peer Search Engine System☆13May 31, 2024Updated 2 years ago
- IPFS private network☆10Jul 10, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A base protocol providing streams of messages☆15Aug 22, 2025Updated last year
- [ICLR 2025] Knowing Your Target: Target-Aware Transformer Makes Better Spatio-Temporal Video Grounding☆44Mar 18, 2025Updated last year
- Load and run Llama from safetensors files in C☆16Oct 24, 2024Updated 2 years ago
- Homepage for paper “MeKi : Memory-based Expert Knowledge Injection for Efficient LLM Scaling”☆30Mar 5, 2026Updated 7 months ago
- uTP implementation for Rust + tokio☆14Dec 23, 2019Updated 6 years ago
- Emotion-Aware Dialogue Response Generation by Multi-Task Learning☆13Jan 22, 2022Updated 4 years ago
- RISC-V to x86/64 instruction emulator written in C/C++☆11Jan 10, 2022Updated 4 years ago
- Godot 4.4 had a merge where we can get a android surface from a android plugin. This is a tryout for that☆14Sep 22, 2026Updated last month
- A Neural Network implemented from scratch as per http://neuralnetworksanddeeplearning.com/ in Rust. This is then trained on MNIST. This i…☆10Jul 17, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- GenFlowChart is a framework that implements flowchart parsing using generative AI. Leveraging SAM for segmentation and OCR for text extra…☆35Jun 5, 2024Updated 2 years ago
- ⚡ Official code for “Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus”…☆22Aug 13, 2026Updated 2 months ago
- Fairy Tale is a godot demo game project where a main character with basic player movements and 3 different combat mechanics fights agains…☆11Aug 9, 2021Updated 5 years ago
- Towards Robust Discriminative Projections Learning via Non-greedy $\ell_{2,1}$-Norm MinMax☆10Jul 2, 2020Updated 6 years ago
- This GDextension implements the open-source MPV video player in Godot Engine 4.4. It's capable of playing local and http video stream to …☆15Mar 17, 2026Updated 7 months ago
- tensorrt部署教程☆11Aug 1, 2025Updated last year
- A port of the RWKV v7 language model, implemented with the Burn deep learning framework☆14Jun 9, 2025Updated last year
- ☆19Oct 14, 2018Updated 8 years ago
- A simple, hackable magnet url parser in Rust☆20May 9, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15Aug 26, 2024Updated 2 years ago
- TACS: Taxonomy Adaptive Cross-Domain Semantic Segmentation☆12Jul 14, 2022Updated 4 years ago
- [ICML 2026] Prism: Spectral-Aware Block-Sparse Attention☆27May 22, 2026Updated 5 months ago
- [ECCV 2024] Official Implementation of CoPT: Unsupervised Domain Adaptive Segmentation using Domain-Agnostic Text Embeddings☆10Feb 24, 2025Updated last year
- update number 187: added up to 8 types of horses that can be used as mounts, next update will add horse AI and taming system☆14Nov 28, 2023Updated 2 years ago
- Bittorrent V1 Library and Client Written in Rust☆15Mar 19, 2024Updated 2 years ago
- Multi-Layer Key-Value sharing experiments on Pythia models☆35Jun 14, 2024Updated 2 years ago