A plug-and-play tool for visualizing attention-score heatmap in generative LLMs. Easy to customize for your own need.
☆52May 16, 2024Updated 2 years ago
Alternatives and similar repositories for Attention-Viewer
Users that are interested in Attention-Viewer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS ENLSP Workshop'24] CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios☆16Oct 18, 2024Updated last year
- Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)☆67Sep 28, 2024Updated last year
- Code for "Retaining Key Information under High Compression Rates: Query-Guided Compressor for LLMs" (ACL 2024)☆19Jun 12, 2024Updated 2 years ago
- ☆29Apr 30, 2024Updated 2 years ago
- Efficient retrieval head analysis with triton flash attention that supports topK probability☆13Jun 15, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A web application tagging and retrieval of arguments in text☆30May 1, 2023Updated 3 years ago
- ACL24☆11Jun 7, 2024Updated 2 years ago
- Code for the paper "Closing the Curious Case of Neural Text Degeneration"☆12Apr 9, 2025Updated last year
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Jul 24, 2024Updated 2 years ago
- This Repository has a project which explains how to generate a face point cloud in Three js using Tensorflow Js☆23Jun 9, 2022Updated 4 years ago
- ☆22Apr 17, 2025Updated last year
- A recipe for constituency parsing, disfluency tagging and obtaining the fluent transcripts of English Fisher dataset☆13May 2, 2021Updated 5 years ago
- fork of karparthy's nanogpt with custom datasets☆11Jul 25, 2023Updated 3 years ago
- ☆10Mar 4, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Source code of “Reinforcement Learning with Token-level Feedback for Controllable Text Generation (NAACL 2024)☆17Dec 8, 2024Updated last year
- Load and visualize different datasets in video question answering☆10May 11, 2021Updated 5 years ago
- code for paper "Discerning and Resolving Knowledge Conflicts through Adaptive Decoding with Contextual Information-Entropy Constraint"☆12Sep 29, 2024Updated last year
- A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.☆11Nov 6, 2021Updated 4 years ago
- ☆15Apr 22, 2024Updated 2 years ago
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- soft entropy estimation☆16May 29, 2026Updated 3 months ago
- Text generation using language models with multiple exit heads☆16Sep 18, 2025Updated 11 months ago
- ☆21Nov 13, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 【ICML2026 Spotlight】 T2PO: Uncertainty-Guided Exploration Control for Stable Multi-Turn Agentic Reinforcement Learning☆54May 27, 2026Updated 3 months ago
- ☆43Mar 24, 2023Updated 3 years ago
- ☆11Jul 28, 2023Updated 3 years ago
- Evaluation utilities based on SymPy.☆25Dec 12, 2024Updated last year
- WarpRNNT loss ported in Numba CPU/CUDA for Pytorch☆17Mar 11, 2022Updated 4 years ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆205Mar 4, 2024Updated 2 years ago
- Some simple codes to format the CSDMC2010 SPAM corpus☆11Sep 18, 2016Updated 9 years ago
- ☆19Oct 12, 2024Updated last year
- ☆20Mar 18, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An N-gram punctuator for Chinese and English.☆20Oct 14, 2025Updated 10 months ago
- ☆14Nov 2, 2025Updated 9 months ago
- ☆13Feb 12, 2024Updated 2 years ago
- LONGAGENT: Scaling Language Models to 128k Context through Multi-Agent Collaboration☆11Mar 11, 2024Updated 2 years ago
- PASTA: Post-hoc Attention Steering for LLMs☆142Nov 24, 2024Updated last year
- The official implement of paper S2-VER: Semi-Supervised Visual Emotion Recognition☆11Apr 28, 2024Updated 2 years ago
- ☆12Sep 23, 2024Updated last year