Extending the Context of Pretrained LLMs by Dropping Their Positional Embedding
☆225Jan 12, 2026Updated 9 months ago
Alternatives and similar repositories for DroPE
Users that are interested in DroPE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- RePo: Language Models with Context Re-Positioning☆85Mar 30, 2026Updated 7 months ago
- Torch implementation of Whisper-guided DDPM based Voice Conversion☆49Mar 7, 2023Updated 3 years ago
- A simple linear filter designed to refine text embeddings.☆27Jun 8, 2026Updated 4 months ago
- ☆18Jun 22, 2026Updated 4 months ago
- Code for Fast-weight Product Key Memory (FwPKM)☆26Mar 18, 2026Updated 7 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Code for Bolmo: Byteifying the Next Generation of Language Models☆149Oct 7, 2026Updated 3 weeks ago
- Spherical residual vector quantization (SRVQ)☆31Aug 25, 2024Updated 2 years ago
- ☆25Dec 11, 2024Updated last year
- ☆12Oct 10, 2026Updated 3 weeks ago
- Official JAX implementation of End-to-End Test-Time Training for Long Context☆715Feb 15, 2026Updated 8 months ago
- [ICLR 2026] GRAPE: Group Representational Position Encoding (https://arxiv.org/abs/2512.07805)☆122Jun 15, 2026Updated 4 months ago
- Landing repository for the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"☆48May 13, 2026Updated 5 months ago
- ☆22Jan 3, 2026Updated 9 months ago
- Efficient PScan implementation in PyTorch☆17Jan 2, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Variable Bitrate Residual Vector Quantization for Audio Coding☆56May 1, 2025Updated last year
- Delta Attention Residuals - supplementary code and pretrained models☆45Sep 26, 2026Updated last month
- ☆201Dec 18, 2025Updated 10 months ago
- Explorations into the proposed SDFT, Self-Distillation Enables Continual Learning, from Shenfeld et al. of MIT☆33Feb 6, 2026Updated 8 months ago
- DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation☆324Feb 18, 2026Updated 8 months ago
- Code and training scripts for FlexOlmo☆158Apr 20, 2026Updated 6 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆386Dec 12, 2024Updated last year
- Efficient Knowledge Injection in LLMs via Self-Distillation (TMLR)☆12Aug 5, 2025Updated last year
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆59Feb 20, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Implementation of Recurrent Independent Mechanisms in Pytorch☆27Apr 6, 2026Updated 6 months ago
- Towards a general language-audio model for computational paralinguistic tasks☆31Dec 14, 2024Updated last year
- Digital Red Queen: Adversarial Program Evolution in Core War with LLMs☆229Jan 13, 2026Updated 9 months ago
- Accelerating MoE with IO and Tile-aware Optimizations☆787Aug 29, 2026Updated 2 months ago
- A sample pattern for running CI tests on Modal☆21Apr 12, 2025Updated last year
- ☆19Mar 3, 2025Updated last year
- The source code for the paper CrossSinger (asru2023)☆18Oct 12, 2023Updated 3 years ago
- H-Net: Hierarchical Network with Dynamic Chunking☆922Nov 20, 2025Updated 11 months ago
- ☆42May 26, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [INTERSPEECH 2025 Oral]Official code for "Accelerating Diffusion-based Text-to-Speech Model Training with Dual Modality Alignment"☆68Jun 16, 2025Updated last year
- Efficient non-uniform quantization with GPTQ for GGUF☆67Sep 17, 2025Updated last year
- Pure JavaScript flexbox layout engine — Yoga-compatible API, 2.5x faster initial layout, 5.5x faster re-layout, zero WASM☆17Updated this week
- Code for Latent Speech-Text Transformer (LST)☆37Mar 12, 2026Updated 7 months ago
- FS-DFM: Fast and Accurate Long Text Generation with Few-Step Diffusion Language Models. FS-DFM accepted for ICLR 2026☆51Sep 11, 2026Updated last month
- ☆11Sep 9, 2026Updated last month
- OpenAnime için WebGPU destekli gayriresmi Linux istemcisi☆17Oct 11, 2026Updated 3 weeks ago