FranxYao / Retrieval-Head-with-Flash-Attention
Efficient retrieval head analysis with triton flash attention that supports topK probability
☆12Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for Retrieval-Head-with-Flash-Attention
- ☆10Updated 4 months ago
- ☆25Updated last month
- ☆37Updated 7 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆46Updated 4 months ago
- Towards Systematic Measurement for Long Text Quality☆28Updated 2 months ago
- Long Context Extension and Generalization in LLMs☆39Updated last month
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆36Updated 8 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models☆48Updated 2 months ago
- Methods and evaluation for aligning language models temporally☆24Updated 8 months ago
- Complexity Based Prompting for Multi-Step Reasoning☆14Updated last year
- The code and data for the paper JiuZhang3.0☆35Updated 5 months ago
- ☆31Updated 7 months ago
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆35Updated last year
- ☆40Updated 11 months ago
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆24Updated 11 months ago
- The official repository for the paper "From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning".☆61Updated last year
- ☆16Updated 8 months ago
- Evaluating Mathematical Reasoning Beyond Accuracy☆37Updated 7 months ago
- [EMNLP 2023] Knowledge Rumination for Pre-trained Language Models☆17Updated last year
- Codebase for Instruction Following without Instruction Tuning☆30Updated last month
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆28Updated 7 months ago
- Evaluate the Quality of Critique☆35Updated 5 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆37Updated 4 months ago
- ☆26Updated last year
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆20Updated 8 months ago
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆24Updated 2 months ago
- The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism☆25Updated 3 months ago
- Personality Alignment of Language Models☆18Updated 2 months ago
- Conic10K: A large-scale dataset for closed-vocabulary math problem understanding. Accepted to EMNLP2023 Findings.☆23Updated 11 months ago
- BeHonest: Benchmarking Honesty in Large Language Models☆29Updated 2 months ago