FranxYao / Retrieval-Head-with-Flash-AttentionLinks
Efficient retrieval head analysis with triton flash attention that supports topK probability
☆12Updated 11 months ago
Alternatives and similar repositories for Retrieval-Head-with-Flash-Attention
Users that are interested in Retrieval-Head-with-Flash-Attention are comparing it to the libraries listed below
Sorting:
- ☆12Updated 11 months ago
- Towards Systematic Measurement for Long Text Quality☆35Updated 9 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆62Updated 10 months ago
- Complexity Based Prompting for Multi-Step Reasoning☆17Updated 2 years ago
- Revisiting Mid-training in the Era of RL Scaling☆48Updated last month
- ☆29Updated 5 months ago
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆24Updated last year
- Official Code Repository for [AutoScale–Automatic Prediction of Compute-optimal Data Compositions for Training LLMs]☆12Updated 4 months ago
- ☆50Updated last year
- ☆14Updated last year
- The code and data for the paper JiuZhang3.0☆45Updated last year
- ☆17Updated last year
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆48Updated 11 months ago
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆36Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆50Updated 5 months ago
- ☆41Updated last year
- ☆31Updated last year
- ☆14Updated last year
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆21Updated 9 months ago
- ☆33Updated 8 months ago
- Reproducing R1 for Code with Reliable Rewards☆10Updated last month
- [AAAI 2024] MELO: Enhancing Model Editing with Neuron-indexed Dynamic LoRA☆25Updated last year
- SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433☆25Updated 6 months ago
- The rule-based evaluation subset and code implementation of Omni-MATH☆22Updated 5 months ago
- Official implementation of AAAI 2025 paper "Augmenting Math Word Problems via Iterative Question Composing"(https://arxiv.org/abs/2401.09…☆20Updated 5 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆70Updated 6 months ago
- Methods and evaluation for aligning language models temporally☆29Updated last year
- AbstainQA, ACL 2024☆25Updated 7 months ago
- [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language M…☆26Updated last year
- Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"☆40Updated 8 months ago