FranxYao / Retrieval-Head-with-Flash-Attention
Efficient retrieval head analysis with triton flash attention that supports topK probability
☆12Updated 9 months ago
Alternatives and similar repositories for Retrieval-Head-with-Flash-Attention:
Users that are interested in Retrieval-Head-with-Flash-Attention are comparing it to the libraries listed below
- ☆11Updated 8 months ago
- Towards Systematic Measurement for Long Text Quality☆33Updated 6 months ago
- Complexity Based Prompting for Multi-Step Reasoning☆17Updated 2 years ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆54Updated 8 months ago
- ☆29Updated 2 months ago
- ☆34Updated 11 months ago
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆36Updated last year
- This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…☆26Updated 5 months ago
- ☆31Updated last year
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆19Updated 7 months ago
- BeHonest: Benchmarking Honesty in Large Language Models☆31Updated 7 months ago
- Evaluate the Quality of Critique☆35Updated 9 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆46Updated 8 months ago
- ☆48Updated 11 months ago
- ☆17Updated 5 months ago
- Codebase for Instruction Following without Instruction Tuning☆33Updated 5 months ago
- ☆17Updated 3 months ago
- Official implementation of AAAI 2025 paper "Augmenting Math Word Problems via Iterative Question Composing"(https://arxiv.org/abs/2401.09…☆19Updated 3 months ago
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆29Updated 11 months ago
- Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models☆22Updated 7 months ago
- ☆16Updated 2 weeks ago
- ☆41Updated last year
- ☆14Updated last year
- [EMNLP 2023] Knowledge Rumination for Pre-trained Language Models☆17Updated last year
- ☆12Updated last year
- AbstainQA, ACL 2024☆25Updated 5 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆61Updated 4 months ago