"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang.
☆35May 7, 2024Updated 2 years ago
Alternatives and similar repositories for Ms-PoE
Users that are interested in Ms-PoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Jun 10, 2025Updated last year
- ☆17Jun 25, 2025Updated last year
- Learning AgenticRL Step by Step☆19May 24, 2026Updated 5 months ago
- To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …☆13Jun 18, 2024Updated 2 years ago
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆401Jan 4, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆20Jan 16, 2024Updated 2 years ago
- ☆26Dec 12, 2025Updated 10 months ago
- Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)☆62Feb 13, 2024Updated 2 years ago
- Google 공식 Rouge Implementation을 한국어에서 사용할 수 있도록 처리☆17Jan 3, 2024Updated 2 years ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆268Sep 12, 2025Updated last year
- Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"☆14Sep 19, 2025Updated last year
- Adapt full attention LLM to sliding window attention☆14Feb 20, 2026Updated 8 months ago
- QRHead: Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking☆44Jan 20, 2026Updated 9 months ago
- Implementation of our paper "Global Localization in Large-scale Point Clouds via Roll-pitch-yaw Invariant Place Recognition and Low-overl…☆10Nov 25, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code for paper: Long cOntext aliGnment via efficient preference Optimization☆26Oct 10, 2025Updated last year
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆243Aug 2, 2024Updated 2 years ago
- Python Implementation for Rethinking RAG based Decoding☆17Sep 10, 2025Updated last year
- [IJCV 2023] FlowNAS: Neural Architecture Search for Optical Flow Estimation☆15Feb 21, 2024Updated 2 years ago
- ucas hpc course code☆15May 24, 2023Updated 3 years ago
- Train DeepSat dataset with Torch☆10Jan 11, 2017Updated 9 years ago
- 한국어 자연어 처리 모델 미세조정☆18Jan 26, 2021Updated 5 years ago
- Cramming 1568 Tokens into a Single Vector and Back Again: Exploring the Limits of Embedding Space Capacity (ACL 2025, oral)☆35Jun 14, 2025Updated last year
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆54Jul 15, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Applies ROME and MEMIT on Mamba-S4 models☆16Apr 5, 2024Updated 2 years ago
- The repository for papaer "Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs"☆14Dec 16, 2024Updated last year
- The official implementation of the Paper: "UMI3D: Robust 3D Generation on Unconstrained Multi-Image Inputs via Simultaneous Focus Cross-A…☆11Jul 28, 2026Updated 3 months ago
- C++ implementation of the nonrigid descriptor Geobit presented at ICCV 2019 "GEOBIT: A Geodesic-Based Binary Descriptor Invariant to Non…☆15Nov 20, 2021Updated 4 years ago
- Code for After42, coming soon.☆24Updated this week
- Official source code for the paper "Neglected Free Lunch from Post-training: Progress Advantage for LLM Agents"☆13Oct 3, 2026Updated 3 weeks ago
- DySCO: Dynamic Attention-Scaling Decoding for Long-Context LMs☆19May 30, 2026Updated 5 months ago
- The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"☆22Apr 22, 2025Updated last year
- IAI MovieBot☆10May 7, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Jun 3, 2026Updated 4 months ago
- Marathon: A Multiple-choice Long Context Evaluation Benchmark for Large Language Models.☆10May 16, 2024Updated 2 years ago
- Linux /proc data in a consistent, parsed format.☆10Mar 28, 2016Updated 10 years ago
- LongMIT: Essential Factors in Crafting Effective Long Context Multi-Hop Instruction Datasets☆44Sep 30, 2024Updated 2 years ago
- VQVAE for video prediction☆31Apr 22, 2022Updated 4 years ago
- The HELMET Benchmark☆230Sep 19, 2026Updated last month
- ☆12Nov 11, 2025Updated 11 months ago