zhqwqwq / Learning-Parity-with-CoTLinks
[ICLR 2025] This repository contains the code to reproduce the results from our paper From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency.
☆12Updated 10 months ago
Alternatives and similar repositories for Learning-Parity-with-CoT
Users that are interested in Learning-Parity-with-CoT are comparing it to the libraries listed below
Sorting:
- ☆24Updated last year
- Implementation of PatchSAE as presented in "Sparse autoencoders reveal selective remapping of visual concepts during adaptation"☆28Updated 3 months ago
- ☆27Updated 2 months ago
- Official implementation for "Pruning Large Language Models with Semi-Structural Adaptive Sparse Training" (AAAI 2025)☆18Updated 6 months ago
- The repo for paper: Exploiting the Index Gradients for Optimization-Based Jailbreaking on Large Language Models.☆13Updated last year
- [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…☆16Updated last month
- KV cache compression via sparse coding☆17Updated 3 months ago
- ☆18Updated last year
- ☆72Updated last year
- Welcome to the 'In Context Learning Theory' Reading Group☆30Updated last year
- A collection of papers and libraries for performing multi-agent optimization☆16Updated 6 months ago
- A brief and partial summary of RLHF algorithms.☆143Updated 10 months ago
- AdaRFT: Efficient Reinforcement Finetuning via Adaptive Curriculum Learning☆53Updated 7 months ago
- ☆63Updated 6 months ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆34Updated 10 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆124Updated 10 months ago
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆52Updated 9 months ago
- ☆57Updated 2 years ago
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆19Updated last year
- Machine Learning from Human Preferences☆24Updated last week
- ☆27Updated 6 months ago
- Official repo of dataset-decomposition paper [NeurIPS 2024]☆20Updated last year
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆36Updated 9 months ago
- ☆35Updated 2 weeks ago
- Repo of paper "Free Process Rewards without Process Labels"☆168Updated 10 months ago
- Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation☆25Updated 11 months ago
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆34Updated last year
- ☆46Updated 4 months ago
- The implementation for FREE-Merging: Fourier Transform for Model Merging with Lightweight Experts (ICCV25)☆14Updated 7 months ago
- ☆205Updated 3 months ago