A training-free method for extending the maximum context length of language models
☆14Oct 6, 2025Updated last year
Alternatives and similar repositories for ReAttention
Users that are interested in ReAttention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2024] Can Language Models Learn to Skip Steps?☆22Jan 25, 2025Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆73Oct 16, 2023Updated 3 years ago
- OpenMOSS presents a collection of our research on LLMs, supported by SII, Fudan and Mosi.☆33Updated this week
- Towards Systematic Measurement for Long Text Quality☆39Sep 5, 2024Updated 2 years ago
- Methods and code for extending the context length of diffusion language models☆56Dec 7, 2025Updated 11 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Multi-GPU supported kmeans clustering for cluser-clip☆15Jun 3, 2024Updated 2 years ago
- Low-rank sparse attention decomposition for LLM interpretability; active development continues in Llamascopium☆30Nov 9, 2025Updated last year
- This is the code repo for the paper <UTC-IE: A Unified Token-pair Classification Architecture for Information Extraction>☆16Aug 10, 2023Updated 3 years ago
- Use the tokenizer in parallel to achieve superior acceleration☆20Mar 21, 2024Updated 2 years ago
- [ICML 2026] Prism: Spectral-Aware Block-Sparse Attention☆27May 22, 2026Updated 5 months ago
- An imaginary extension of rotary position embeddings for long-context language models☆35Dec 9, 2025Updated 11 months ago
- A survey of long-context language models covering architecture, infrastructure, training, and evaluation☆65Mar 31, 2025Updated last year
- [ICML 2026] Sparser Block-Sparse Attention via Token Permutation☆33May 22, 2026Updated 5 months ago
- [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"☆83Nov 25, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The official implementation of the paper "Self-Updatable Large Language Models by Integrating Context into Model Parameters"☆16May 18, 2025Updated last year
- Code and data for evaluating whether AI assistants know when they do not know the answer☆87Feb 5, 2024Updated 2 years ago
- ☆10May 23, 2025Updated last year
- Codes for Paper: From Hypergraph Energy Functions to Hypergraph Neural Networks☆23Jun 29, 2023Updated 3 years ago
- Reinforcement learning for improving embodied task planning in large language models☆28Mar 30, 2026Updated 7 months ago
- [Findings of EMNLP'2024] Unified Active Retrieval for Retrieval Augmented Generation☆23Sep 30, 2024Updated 2 years ago
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆20Mar 4, 2025Updated last year
- Research work aimed at addressing the problem of modeling infinite-length context☆53Dec 18, 2025Updated 10 months ago
- Code and models for the paper: Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long …☆44Oct 14, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [EMNLP 2022] RLET: A Reinforcement Learning Based Approach for Explainable QA with Entailment Trees☆11Jul 15, 2023Updated 3 years ago
- ☆26Mar 2, 2026Updated 8 months ago
- ToolBridge: An Open-Source Dataset to Equip LLMs with External Tool Capabilities☆14Feb 11, 2025Updated last year
- A tiny easily hackable implementation of a feature dashboard.☆18Oct 21, 2025Updated last year
- A training-free framework that accelerates diffusion language models through dynamic cache eviction and sparse attention☆30Oct 16, 2025Updated last year
- The official implementation of LIFT: Improving Long Context Understanding of Large Language Models through Long Input Fine-Tuning☆16Mar 14, 2025Updated last year
- ☆14Aug 13, 2024Updated 2 years ago
- Here is the repo for public scripts.☆12Jul 16, 2022Updated 4 years ago
- ☆27Jun 5, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).☆17Jan 8, 2025Updated last year
- ☆10Dec 7, 2024Updated last year
- ROUTE: Robust Multitask Tuning and Collaboration for Text-to-SQL (ICLR 2025 Pytorch Code)☆16May 15, 2025Updated last year
- ☆27Jan 16, 2025Updated last year
- ☆19Jul 5, 2024Updated 2 years ago
- PERK: Long-Context Reasoning as Test-Time Learning☆17Sep 25, 2026Updated last month
- An open-source personal academic homepage template characterized by its user-friendly design and extensive scalability.☆36Oct 6, 2025Updated last year
Are these results useful?