A plug-and-play tool for visualizing attention-score heatmap in generative LLMs. Easy to customize for your own need.
☆52May 16, 2024Updated 2 years ago
Alternatives and similar repositories for Attention-Viewer
Users that are interested in Attention-Viewer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS ENLSP Workshop'24] CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios☆16Oct 18, 2024Updated last year
- Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)☆67Sep 28, 2024Updated last year
- Efficient retrieval head analysis with triton flash attention that supports topK probability☆13Jun 15, 2024Updated 2 years ago
- ACL24☆11Jun 7, 2024Updated 2 years ago
- Code for the paper "Closing the Curious Case of Neural Text Degeneration"☆12Apr 9, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Jul 24, 2024Updated 2 years ago
- ☆14Jun 11, 2024Updated 2 years ago
- simple implementation of Expected Gradients and Integrated Gradients by pytorch☆12May 11, 2022Updated 4 years ago
- ☆22Apr 17, 2025Updated last year
- A recipe for constituency parsing, disfluency tagging and obtaining the fluent transcripts of English Fisher dataset☆13May 2, 2021Updated 5 years ago
- fork of karparthy's nanogpt with custom datasets☆11Jul 25, 2023Updated 3 years ago
- ☆10Mar 4, 2024Updated 2 years ago
- [TMLR 2025] Official implementation of AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulation☆27Jun 17, 2025Updated last year
- 使用fastrtc框架调用qwen-2.5-omni-realtime实现实时语音、视频等☆14Jun 27, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A simple implementation of ReasonGenRM.☆19Apr 21, 2025Updated last year
- Math24o: 高中奥林匹克数学竞赛测评集 High School Olympiad Mathematics Chinese Benchmark☆14Mar 27, 2025Updated last year
- The complete codes of the paper "Multimodal Graph Contrastive Learning for Recommendation"☆10Mar 20, 2023Updated 3 years ago
- Source code of “Reinforcement Learning with Token-level Feedback for Controllable Text Generation (NAACL 2024)☆17Dec 8, 2024Updated last year
- Load and visualize different datasets in video question answering☆10May 11, 2021Updated 5 years ago
- A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.☆11Nov 6, 2021Updated 4 years ago
- ☆15Apr 22, 2024Updated 2 years ago
- soft entropy estimation☆16May 29, 2026Updated 2 months ago
- Text generation using language models with multiple exit heads☆16Sep 18, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆21Nov 13, 2023Updated 2 years ago
- 【ICML2026 Spotlight】 T2PO: Uncertainty-Guided Exploration Control for Stable Multi-Turn Agentic Reinforcement Learning☆54May 27, 2026Updated 2 months ago
- KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation, NAACL 2024☆16Jul 29, 2024Updated 2 years ago
- Repo for preprint 2025 "MedHEval: Benchmarking Hallucinations and Mitigation Strategies in Medical Large Vision-Language Models"☆16Apr 23, 2025Updated last year
- ☆11Jul 28, 2023Updated 3 years ago
- Evaluation utilities based on SymPy.☆25Dec 12, 2024Updated last year
- WarpRNNT loss ported in Numba CPU/CUDA for Pytorch☆17Mar 11, 2022Updated 4 years ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆205Mar 4, 2024Updated 2 years ago
- ☆53May 13, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 使用django对情感分析功能进行封装，里面包含使用情感词典和Bert模型进行情感分类，最后可以使用tensorFlow serving将模型部署在docker中运行。☆13Sep 23, 2019Updated 6 years ago
- ☆19Oct 12, 2024Updated last year
- An N-gram punctuator for Chinese and English.☆20Oct 14, 2025Updated 9 months ago
- ☆14Nov 2, 2025Updated 9 months ago
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Oct 11, 2021Updated 4 years ago
- ☆13Feb 12, 2024Updated 2 years ago
- Official repository for the ACL 2025 Findings paper "Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal M…☆25May 12, 2026Updated 2 months ago