A Comprehensive Survey on Long Context Language Modeling
☆252May 29, 2026Updated 2 months ago
Alternatives and similar repositories for A-Comprehensive-Survey-For-Long-Context-Language-Modeling
Users that are interested in A-Comprehensive-Survey-For-Long-Context-Language-Modeling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥☆2,147Updated this week
- LongAttn ：Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated last year
- The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism☆31Jul 17, 2024Updated 2 years ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆261Sep 12, 2025Updated 10 months ago
- IKEA: Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agent☆70May 13, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Dataset and baseline for Coling 2022 long paper (oral): "ConFiguRe: Exploring Discourse-level Chinese Figures of Speech"☆12Jul 27, 2023Updated 3 years ago
- [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs☆25Sep 26, 2024Updated last year
- Findings of EMNLP 2023: InfoCL: Alleviating Catastrophic Forgetting in Continual Text Classification from An Information Theoretic Perspe…☆14Aug 13, 2024Updated last year
- ☆47Nov 25, 2024Updated last year
- Rationale-enhanced language models are better continual relation learners (EMNLP 2023 Main Conference)☆12Oct 11, 2023Updated 2 years ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆241Aug 2, 2024Updated last year
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation☆36Feb 26, 2026Updated 5 months ago
- MPO: Boosting LLM Agents with Meta Plan Optimization (EMNLP 2025 Findings)☆81Aug 20, 2025Updated 11 months ago
- An (incomplete) overview of information extraction☆43Apr 28, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆148Nov 9, 2024Updated last year
- ☆16Nov 1, 2025Updated 8 months ago
- Official Repo for Open-Reasoner-Zero☆2,096Jun 2, 2025Updated last year
- [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models☆61Jul 23, 2024Updated 2 years ago
- official code for GliDe with a CaPE☆22Aug 13, 2024Updated last year
- [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain☆107Mar 14, 2024Updated 2 years ago
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆70Feb 21, 2025Updated last year
- ☆32Oct 17, 2022Updated 3 years ago
- Revisiting Mid-training in the Era of Reinforcement Learning Scaling☆189Jul 23, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ACL 2026 (Main)] LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification☆84Jul 14, 2025Updated last year
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆62Mar 31, 2025Updated last year
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆262Dec 16, 2024Updated last year
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆208May 20, 2024Updated 2 years ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆150Sep 20, 2024Updated last year
- [ACL 2023] Delving into the Openness of CLIP☆24Jan 11, 2023Updated 3 years ago
- This is a repo consisting of papers about LLMs' perception of their knowledge boundaries; Uncertainty Quantification; Honesty Alignment; …☆25Nov 25, 2025Updated 8 months ago
- Code for "SCL-RAI: Span-based Contrastive Learning with Retrieval Augmented Inference for Unlabeled Entity Problem in NER" @COLING-2022☆11Aug 20, 2022Updated 3 years ago
- 计算语言学22-23学年秋季学期 课程大作业baseline实现☆38Dec 8, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆63Oct 29, 2024Updated last year
- ☆14Apr 23, 2025Updated last year
- Chain-of-Thought Matters: Improving Long-Context Language Models with Reasoning Path Supervision☆19Apr 1, 2025Updated last year
- Code for "Retaining Key Information under High Compression Rates: Query-Guided Compressor for LLMs" (ACL 2024)☆19Jun 12, 2024Updated 2 years ago
- ☆549May 25, 2026Updated 2 months ago
- ☆12Apr 29, 2024Updated 2 years ago
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆251Jun 1, 2026Updated last month