WowCZ / LongMIT
LongMIT: Essential Factors in Crafting Effective Long Context Multi-Hop Instruction Datasets
β36Updated 7 months ago
Alternatives and similar repositories for LongMIT:
Users that are interested in LongMIT are comparing it to the libraries listed below
- This is the official code for our paper "Simple and Scalable Nearest Neighbor Machine Translation" (ICLR 2023).β14Updated last year
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Modelsβ76Updated last year
- [ICLR 2025] 𧬠RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)β131Updated 2 months ago
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generationβ23Updated 2 weeks ago
- The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202β¦β46Updated 2 years ago
- [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Modelsβ55Updated 9 months ago
- πΌ Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Expertsβ38Updated 7 months ago
- Code for the ICLR'22 paper "Improving Non-Autoregressive Translation Models Without Distillation"β18Updated 3 years ago
- Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)β41Updated last year
- β98Updated 7 months ago
- β53Updated 8 months ago
- A retrieval augmented sequence modeling toolkit implemented based on Fairseqβ29Updated 2 years ago
- code for Teaching LM to Translate with Comparisonβ39Updated last year
- Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Modelsβ23Updated 9 months ago
- Code for paper "Nearest Neighbor Knowledge Distillation for Neural Machine Translation" by Zhixian Yang, Renliang Sun, and Xiaojun Wan. Tβ¦β30Updated 2 years ago
- Deeply Supervised, Layer-wise Prediction-aware (DSLP) Transformer for Non-autoregressive Neural Machine Translationβ43Updated last year
- Official Implementation for the ICML2022 paper "Directed Acyclic Transformer for Non-Autoregressive Machine Translation"β125Updated last year
- β173Updated 9 months ago
- Official Implementation for the ICLR2023 paper "Fuzzy Alignments in Directed Acyclic Graph for Non-autoregressive Machine Translation"β13Updated 2 years ago
- β49Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"β74Updated 11 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"β179Updated 2 months ago
- Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Processβ27Updated 9 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Modelsβ170Updated 10 months ago
- β31Updated last year
- [ACL 2024] Long-Context Language Modeling with Parallel Encodingsβ154Updated 10 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Lβ¦β48Updated 10 months ago
- Towards Systematic Measurement for Long Text Qualityβ34Updated 8 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.β62Updated 6 months ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both sameβ¦β49Updated 6 months ago