MingLiiii / Layer_Gradient
What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
☆63Updated 3 weeks ago
Alternatives and similar repositories for Layer_Gradient:
Users that are interested in Layer_Gradient are comparing it to the libraries listed below
- [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.☆101Updated this week
- [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction☆61Updated 3 weeks ago
- ☆83Updated last week
- ☆59Updated 6 months ago
- ☆102Updated 2 months ago
- Large Language Models Can Self-Improve in Long-context Reasoning☆66Updated 3 months ago
- ☆95Updated 8 months ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆53Updated 11 months ago
- Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering☆57Updated 3 months ago
- [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?☆70Updated 2 months ago
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆110Updated 10 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆107Updated 11 months ago
- A brief and partial summary of RLHF algorithms.☆124Updated 2 weeks ago
- [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy☆54Updated 3 months ago
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆108Updated 8 months ago
- [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆73Updated 2 months ago
- [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales☆78Updated last month
- Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".☆51Updated 3 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆52Updated 5 months ago
- HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models☆38Updated 3 months ago
- Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting☆28Updated last year