Unofficial Implementation of Selective Attention Transformer
☆20Oct 31, 2024Updated last year
Alternatives and similar repositories for selective-attention-transformer
Users that are interested in selective-attention-transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- A Qwen .5B reasoning model trained on OpenR1-Math-220k☆14Updated this week
- ☆19Jun 3, 2024Updated 2 years ago
- ☆17Sep 11, 2026Updated last month
- Code for "What really matters in matrix-whitening optimizers?"☆25Oct 31, 2025Updated 11 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting☆35Mar 19, 2024Updated 2 years ago
- Example code of Sparse Gaussian Process Attention (ICLR 2023)☆26Sep 15, 2025Updated last year
- Code for Augment & Reduce, a scalable stochastic algorithm for large categorical distributions☆10May 16, 2018Updated 8 years ago
- pytorch☆10Apr 13, 2022Updated 4 years ago
- ☆26Jun 29, 2025Updated last year
- Mixture of Lora Experts☆11Apr 7, 2024Updated 2 years ago
- ☆10Aug 26, 2022Updated 4 years ago
- Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision☆11Jul 22, 2024Updated 2 years ago
- Jupyter notebooks from our weekly (or so) hackathons☆11Dec 3, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for "Exponential Family Estimation via Adversarial Dynamics Embedding" (NeurIPS 2019)☆14Nov 26, 2019Updated 6 years ago
- ☆19Mar 25, 2025Updated last year
- Easy training for Sparse Linear Autoencoders (https://arxiv.org/abs/2309.08600) with data from TransformerLens models.☆12Nov 1, 2023Updated 2 years ago
- The Compositionality article class.☆14Mar 16, 2026Updated 7 months ago
- ☆13Jun 15, 2021Updated 5 years ago
- ☆13Feb 2, 2023Updated 3 years ago
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- Evals meant to evaluate language models' ability to reason over long contexts.☆10Sep 12, 2024Updated 2 years ago
- Self-Teaching Notes on Gradient Leakage Attacks against GPT-2 models.☆14Mar 18, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Apr 26, 2023Updated 3 years ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Nov 11, 2024Updated last year
- Code for Semi-crowdsourced Clustering with Deep Generative Models☆12Dec 9, 2022Updated 3 years ago
- Code accompanying VarGrad: A Low-Variance Gradient Estimator for Variational Inference☆12Oct 12, 2020Updated 6 years ago
- ☆18Feb 6, 2025Updated last year
- personal info☆11Mar 23, 2024Updated 2 years ago
- Bayesian Low-Rank Adaptation of LLMs: BLoB [NeurIPS 2024] and TFB [NeurIPS 2025]☆42Feb 4, 2026Updated 8 months ago
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated 2 years ago
- [NeurIPS 2021] "Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models" by Boxin Wang*, Chejian Xu*, Shuoh…☆13Apr 3, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Oct 21, 2017Updated 8 years ago
- ☆11Jul 25, 2021Updated 5 years ago
- Code for the paper "Automated Generation of Hospital Discharge Summaries Using Clinical Guidelines and Large Language Models"☆12May 3, 2024Updated 2 years ago
- ☆13Mar 10, 2026Updated 7 months ago
- Demonstration of how to run multiple chains in Langchain Assyncronously☆12Jul 6, 2023Updated 3 years ago
- Fine-tune copilot based on your codebase☆12Mar 26, 2024Updated 2 years ago
- Code for paper 'Zero-Shot Scene Graph Generation via Triplet Calibration and Reduction' （TOMM 2023）☆10Sep 6, 2025Updated last year