Xnhyacinth / Awesome-LLM-Long-Context-Modeling
📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
☆816Updated this week
Related projects: ⓘ
- ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training☆849Updated 2 months ago
- This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicit…☆534Updated last week
- [TMLR 2024] Efficient Large Language Models: A Survey☆959Updated this week
- [ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding☆618Updated last week
- Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.☆608Updated last month
- SimPO: Simple Preference Optimization with a Reference-Free Reward☆648Updated 3 weeks ago
- A curated list for Efficient Large Language Models☆1,119Updated this week
- Official Implementation of EAGLE-1 and EAGLE-2☆749Updated 3 weeks ago
- [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆539Updated 6 months ago
- Awesome LLM compression research papers and tools.☆1,062Updated this week
- A collection of AWESOME things about mixture-of-experts☆920Updated last month
- Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …☆901Updated 2 weeks ago
- Summarize existing representative LLMs text datasets.☆824Updated 2 weeks ago
- Fast inference from large lauguage models via speculative decoding☆508Updated 3 weeks ago
- DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models☆970Updated 8 months ago
- Must-read Papers on Knowledge Editing for Large Language Models.☆829Updated 2 weeks ago
- An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)☆2,026Updated this week
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆467Updated 3 months ago
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,041Updated 6 months ago
- Codebase for Merging Language Models (ICML 2024)☆745Updated 4 months ago
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,353Updated 6 months ago
- ☆1,194Updated this week
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,099Updated 7 months ago
- ☆836Updated 2 months ago
- Aligning Large Language Models with Human: A Survey☆671Updated last year
- Collection of training data management explorations for large language models☆266Updated last month
- An Awesome Collection for LLM Survey☆289Updated last week
- Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality s…☆398Updated this week
- Awesome-LLM-RAG: a curated list of advanced retrieval augmented generation (RAG) in Large Language Models☆871Updated last month
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks☆239Updated last month