FranxYao / Retrieval-Head-with-Flash-AttentionLinks
Efficient retrieval head analysis with triton flash attention that supports topK probability
☆12Updated last year
Alternatives and similar repositories for Retrieval-Head-with-Flash-Attention
Users that are interested in Retrieval-Head-with-Flash-Attention are comparing it to the libraries listed below
Sorting:
- Towards Systematic Measurement for Long Text Quality☆35Updated 9 months ago
- ☆12Updated 11 months ago
- ☆30Updated 5 months ago
- Complexity Based Prompting for Multi-Step Reasoning☆17Updated 2 years ago
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆36Updated last year
- ☆14Updated last year
- Revisiting Mid-training in the Era of RL Scaling☆62Updated 2 months ago
- ☆51Updated last year
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆62Updated 11 months ago
- ☆17Updated 3 months ago
- ☆14Updated last year
- [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language M…☆26Updated last year
- ☆31Updated last year
- AbstainQA, ACL 2024☆26Updated 8 months ago
- "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)☆14Updated last year
- Methods and evaluation for aligning language models temporally☆29Updated last year
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆29Updated last year
- ☆35Updated last year
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆24Updated last year
- This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.☆14Updated last year
- Official implementation of AAAI 2025 paper "Augmenting Math Word Problems via Iterative Question Composing"(https://arxiv.org/abs/2401.09…☆20Updated 6 months ago
- ☆33Updated 9 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆22Updated 10 months ago
- [SIGIR 2025] The official repo for "Scaling Sparse and Dense Retrieval in Decoder-Only LLMs"☆15Updated 2 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆50Updated last year
- Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"☆40Updated 9 months ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 9 months ago
- ☆46Updated this week
- The rule-based evaluation subset and code implementation of Omni-MATH☆22Updated 6 months ago