FranxYao / Retrieval-Head-with-Flash-Attention
Efficient retrieval head analysis with triton flash attention that supports topK probability
☆12Updated 10 months ago
Alternatives and similar repositories for Retrieval-Head-with-Flash-Attention:
Users that are interested in Retrieval-Head-with-Flash-Attention are comparing it to the libraries listed below
- ☆11Updated 9 months ago
- ☆48Updated last year
- The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agen…☆26Updated last year
- Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning☆36Updated last year
- Evaluate the Quality of Critique☆34Updated 10 months ago
- Complexity Based Prompting for Multi-Step Reasoning☆17Updated 2 years ago
- Towards Systematic Measurement for Long Text Quality☆34Updated 7 months ago
- ☆16Updated last month
- ☆14Updated 11 months ago
- ☆31Updated last year
- ☆34Updated last year
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆47Updated 3 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆59Updated 9 months ago
- ☆14Updated last year
- ☆29Updated 3 months ago
- The official repository for the paper "From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning".☆64Updated last year
- AbstainQA, ACL 2024☆25Updated 6 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆63Updated 5 months ago
- [EMNLP 2023] Knowledge Rumination for Pre-trained Language Models☆17Updated last year
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆29Updated last year
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆46Updated 9 months ago
- The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism☆28Updated 9 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆20Updated 7 months ago
- This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.☆14Updated 11 months ago
- BeHonest: Benchmarking Honesty in Large Language Models☆31Updated 8 months ago
- ☆16Updated 10 months ago
- Official Implementation for the paper "Integrative Decoding: Improving Factuality via Implicit Self-consistency"☆23Updated this week
- ☆30Updated 11 months ago
- Code and models for EMNLP 2024 paper "WPO: Enhancing RLHF with Weighted Preference Optimization"☆38Updated 6 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year