A clean, single-file PyTorch implementation of Attention Residuals (Kimi Team, MoonshotAI, 2026), integrated with Grouped Query Attention (GQA), SwiGLU feed-forward networks, and Rotary Position Embeddings (RoPE).
☆43Mar 16, 2026Updated 7 months ago
Alternatives and similar repositories for attn_res
Users that are interested in attn_res are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL'26 Findings] Official code for: "Beyond Black-Box Interventions: Latent Probing for Faithful Retrieval-Augmented Generation“☆15Apr 23, 2026Updated 6 months ago
- [ICLR 2026] Official implementation of the paper "Exploring Cross-Modal Flows for Few-Shot Learning".☆27Mar 1, 2026Updated 8 months ago
- Open implementation of Attention Residuals (Kimi Team, arXiv:2603.15031)☆86Apr 30, 2026Updated 6 months ago
- An open source community implementation of VARC: "ARC Is a Vision Problem!"☆14Nov 19, 2025Updated 11 months ago
- implementations and experimentation on mHC by deepseek - https://arxiv.org/abs/2512.24880☆381Feb 17, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is an ultra-simple, single-file PyTorch implementation of MoonViT, the native-resolution vision encoder from Kimi-VL.☆39Apr 25, 2026Updated 6 months ago
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 7 months ago
- SmolVLM2 on the RK3588 NPU☆13Jul 25, 2026Updated 3 months ago
- [ICLR 2026] Empowering Small VLMs to Think with Dynamic Memorization and Exploration☆20Mar 18, 2026Updated 7 months ago
- ☆15Oct 30, 2026Updated last week
- iSeparate library for the SDX2023 challenge☆15Dec 15, 2023Updated 2 years ago
- ☆14Jul 3, 2025Updated last year
- NeuroSkill™ and NeuroLoop™ markdown files☆13Oct 26, 2026Updated 2 weeks ago
- Leanstral's fork of SafeVerify, which we use for code agent training and as part of our evaluation stack.☆41Jul 3, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MachGen's VC attention (https://arxiv.org/html/2609.15810v1) implementation. 2x faster (compared to 1.47-1.6x in original paper) FP8 atte…☆15Oct 12, 2026Updated 3 weeks ago
- The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"☆34Jun 22, 2026Updated 4 months ago
- ☆13Oct 7, 2025Updated last year
- ☆15Feb 24, 2023Updated 3 years ago
- The implementation of "GradNet: Unsupervised Deep Screened Poisson Reconstruction for Gradient-Domain Rendering"☆13Mar 25, 2020Updated 6 years ago
- Benchmark for agentic spatial data analysis☆11Nov 2, 2026Updated last week
- SciCore-Mol: Augmenting Large Language Models with Pluggable Molecular Cognition Modules☆12May 13, 2026Updated 5 months ago
- This repository is the official implementation of "Jakiro: Boosting Speculative Decoding with Decoupled Multi-Head via MoE" [ACL 2026 Mai…☆39Oct 5, 2025Updated last year
- Unified registry of 85 audio effects across 7 libraries (audiomentations, sox, torchaudio, scipy, librosa, pyloudnorm, numpy), with a cle…☆18Jul 13, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Silicon-proven INT8 systolic NPU (8×8 MAC array) taped out on SkyWater 130nm via LibreLane. Features a custom 32-bit ISA, UART–APB host i…☆20May 24, 2026Updated 5 months ago
- [ICLR 2025] Official code for Combining Text-based and Drag-based Editing for Precise and Flexible Image Editing.☆21May 6, 2025Updated last year
- ☆15Jul 2, 2025Updated last year
- ☆20Jul 15, 2026Updated 3 months ago
- Judge's Verdict: A Comprehensive Analysis of LLM Judge Capability Through Human Agreement☆15Oct 8, 2025Updated last year
- Mamba R1 represents a novel architecture that combines the efficiency of Mamba's state space models with the scalability of Mixture of Ex…☆26Oct 13, 2025Updated last year
- ☆15Aug 6, 2026Updated 3 months ago
- observability for speculative decoding☆15Aug 23, 2026Updated 2 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆32Oct 26, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Quadcopter Neural Adaptive Model Predictive Control☆13Aug 10, 2026Updated 3 months ago
- Official repository of Self-Geometry☆15Sep 3, 2026Updated 2 months ago
- Project for EE609 Convex Optimization☆12May 6, 2021Updated 5 years ago
- Official Implementation of BSMamba2☆16Nov 28, 2025Updated 11 months ago
- ☆14Jul 16, 2020Updated 6 years ago
- LIMA: Language for Integrated Modeling and Analysis☆12Sep 8, 2018Updated 8 years ago
- Agent application/benchmark/workload traces should be placed here.☆20Apr 13, 2026Updated 6 months ago
Are these results useful?