zhqwqwq / Learning-Parity-with-CoTLinks
[ICLR 2025] This repository contains the code to reproduce the results from our paper From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency.
☆11Updated 10 months ago
Alternatives and similar repositories for Learning-Parity-with-CoT
Users that are interested in Learning-Parity-with-CoT are comparing it to the libraries listed below
Sorting:
- ☆24Updated 11 months ago
- ☆27Updated last month
- Implementation of PatchSAE as presented in "Sparse autoencoders reveal selective remapping of visual concepts during adaptation"☆29Updated 2 months ago
- Official implementation for "Pruning Large Language Models with Semi-Structural Adaptive Sparse Training" (AAAI 2025)☆18Updated 6 months ago
- ☆55Updated 2 years ago
- The repo for paper: Exploiting the Index Gradients for Optimization-Based Jailbreaking on Large Language Models.☆13Updated last year
- ☆18Updated last year
- Welcome to the 'In Context Learning Theory' Reading Group☆30Updated last year
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆50Updated 9 months ago
- ☆23Updated 3 months ago
- [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…☆16Updated 3 weeks ago
- Implementation of CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation☆25Updated 10 months ago
- KV cache compression via sparse coding☆17Updated 2 months ago
- An Open-source Factuality Evaluation Demo for LLMs☆19Updated 5 months ago
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆19Updated last year
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆19Updated 5 months ago
- A collection of papers and libraries for performing multi-agent optimization☆16Updated 6 months ago
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆34Updated 11 months ago
- [ICLR 2025] "Rethinking LLM Unlearning Objectives: A Gradient Perspective and Go Beyond"☆15Updated 10 months ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆36Updated 9 months ago
- Code for the ICML 2024 paper "Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustment"☆78Updated 7 months ago
- ☆26Updated 5 months ago
- ☆70Updated last year
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆108Updated 2 years ago
- Code to replicate the Representation Noising paper and tools for evaluating defences against harmful fine-tuning☆23Updated last year
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆122Updated 6 months ago
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆79Updated last year
- Official code for "Decoding-Time Language Model Alignment with Multiple Objectives".☆29Updated last year
- Official repo of dataset-decomposition paper [NeurIPS 2024]☆20Updated last year
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆151Updated 6 months ago