Using PyTorch autograd to compute Hessian of Perplexity for Large Language Models
☆29Apr 17, 2025Updated last year
Alternatives and similar repositories for llm-hessian
Users that are interested in llm-hessian are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official code for "Algorithmic Capabilities of Random Transformers" (NeurIPS 2024)☆15Sep 28, 2024Updated last year
- Code for ICLR 2022 Paper (HyperDQN: A Randomized Exploration Method for Deep Reinforcement Learning)☆12Nov 28, 2023Updated 2 years ago
- Minimalistic port of NanoGUI claim works with SDL API w/o external dependencies.☆12Sep 4, 2019Updated 6 years ago
- Irene is a python package that aims to be a toolkit for global optimization problems that can be realized algebraically. It generalizes L…☆15Jun 13, 2026Updated 3 weeks ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆65Mar 11, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆16Oct 14, 2020Updated 5 years ago
- Website for release of TellMeWhy dataset for why question answering☆14Nov 11, 2022Updated 3 years ago
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆12Nov 8, 2024Updated last year
- This repo explores how AMR to address tasks difficult for LLMs☆13Jan 15, 2024Updated 2 years ago
- Code for EMNLP 2021 paper "Measuring Association Between Labels and Free-Text Rationales"☆12Sep 12, 2023Updated 2 years ago
- Federated Conformal Prediction with Quantile-of-Quantiles (FedCP-QQ)☆11May 6, 2026Updated 2 months ago
- Official code for Guiding Language Model Math Reasoning with Planning Tokens☆19Feb 29, 2024Updated 2 years ago
- Understand what physics/algorithms do transformers learn internally when trained on planetary motion☆44Feb 9, 2026Updated 5 months ago
- [ICLR'25 Spotlight] Rethinking and improving autoformalization: towards a faithful metric and a Dependency Retrieval-based approach☆30May 20, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Wenzhou-Kean University AI-LAB☆10Jun 6, 2022Updated 4 years ago
- Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"☆16Aug 11, 2023Updated 2 years ago
- ☆68Apr 8, 2026Updated 3 months ago
- A package containing utils for the PyTorch version of the Tapas algorithm.☆11Apr 29, 2021Updated 5 years ago
- A pytorch module to implement Bayesian neural networks with variational inference☆11Mar 3, 2021Updated 5 years ago
- PeRL: Parameter-Efficient Reinforcement Learning☆81May 20, 2026Updated last month
- Efficient Conformal Prediction via Cascaded Inference with Expanded Admission☆20Sep 15, 2021Updated 4 years ago
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆55Aug 6, 2025Updated 11 months ago
- [ICLR2025] IV-Mixed Sampler: Leveraging Image Diffusion Models for Enhanced Video Synthesis☆39Feb 17, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Perform bayesian distribution regression☆13Mar 19, 2018Updated 8 years ago
- Using CNN to classify RF modulation data.☆15Jun 25, 2020Updated 6 years ago
- [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs☆129Jul 4, 2025Updated last year
- Models and code for the ICLR 2020 workshop paper "Towards Understanding Normalization in Neural ODEs"☆16Apr 27, 2020Updated 6 years ago
- ☆25Apr 3, 2025Updated last year
- A benchmark of real-world DL kernel problems☆247May 28, 2026Updated last month
- Apply data augmentation techniques on YOLO v7 format dataset.☆18Nov 20, 2023Updated 2 years ago
- Implementation of EWC introduced by "Overcoming catastrophic forgetting in neural networks"☆17Jun 9, 2017Updated 9 years ago
- ☆22Jun 4, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆29Dec 19, 2023Updated 2 years ago
- ☆30Jul 22, 2024Updated last year
- Code for paper "Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language?"☆21Oct 13, 2020Updated 5 years ago
- Neural theorem proving evaluation via the Lean REPL☆24Jul 12, 2025Updated 11 months ago
- Arbitrary Distribution Modeling with Censorship in Real Time Bidding Advertising for KDD'22☆16Mar 9, 2022Updated 4 years ago
- ☆32Aug 21, 2025Updated 10 months ago
- Sirius, an efficient correction mechanism, which significantly boosts Contextual Sparsity models on reasoning tasks while maintaining its…☆21Sep 10, 2024Updated last year