[ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization
☆117Jun 2, 2025Updated last year
Alternatives and similar repositories for Fourier-Position-Embedding
Users that are interested in Fourier-Position-Embedding are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆149Feb 25, 2026Updated 3 months ago
- Megatts2 use HierSpeechpp's vocoder☆18Dec 2, 2024Updated last year
- ☆19Mar 28, 2024Updated 2 years ago
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…☆86Jun 20, 2025Updated 11 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆41Oct 11, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆15Nov 11, 2024Updated last year
- UTAUTAI(Unrestricted Tune Automated Technology Artificial Interigence)☆16Oct 27, 2023Updated 2 years ago
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- ☆13Sep 12, 2024Updated last year
- ☆23May 8, 2025Updated last year
- Sequence alignement methods with helpers for PyTorch.☆24Nov 30, 2022Updated 3 years ago
- PyTorch Implementation of ViT-TTS (EMNLP'23)☆11Oct 20, 2023Updated 2 years ago
- Multispeaker Community Vocoder Model for DiffSinger☆38Aug 11, 2025Updated 10 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆78Mar 12, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official code for "F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization"☆162Mar 3, 2026Updated 3 months ago
- Mamba SSM architecture that supports training on variable-length sequences☆12Sep 1, 2025Updated 9 months ago
- 60k hours of phoneme-aligned audio from audio books☆19Jul 27, 2024Updated last year
- Vocal Remover using Deep Neural Networks☆20Dec 31, 2024Updated last year
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)…☆15Feb 25, 2026Updated 3 months ago
- Rectified Rotary Position Embeddings☆394May 20, 2024Updated 2 years ago
- Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719☆22Jun 5, 2024Updated 2 years ago
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper☆153Jul 20, 2024Updated last year
- RWKV6 in native pytorch and triton:)☆11Aug 4, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆12Jul 4, 2024Updated last year
- [ICLR 2025] Rectified Diffusion: Straightness Is Not Your Need☆252Mar 11, 2025Updated last year
- [ICLR2025] The code of Z-Sampling, proposed in our paper "Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflectio…☆100May 20, 2026Updated 3 weeks ago
- ☆15Apr 16, 2026Updated 2 months ago
- ☆31Apr 17, 2023Updated 3 years ago
- An unofficial implementation of Vector Quantization Voice Conversion (VQVC).☆29Apr 12, 2021Updated 5 years ago
- ☆16Mar 13, 2023Updated 3 years ago
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆466Oct 29, 2025Updated 7 months ago
- Official Code for "Rethinking Diffusion Model in High Dimension"☆25May 20, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆15Jul 18, 2024Updated last year
- Hangul pronunciation and romanisation based on Wiktionary ko-pron lua module☆21Oct 17, 2018Updated 7 years ago
- Torch implementation of NANSY, Neural Analysis and Synthesis, arXiv:2110.14513☆64Feb 13, 2023Updated 3 years ago
- Joint CTC-S2S Phoneme-level ASR for Voice Conversion and TTS (Text-Mel Alignment)☆126Jun 16, 2022Updated 4 years ago
- 🚀 Efficient implementations for emerging model architectures☆5,227Jun 11, 2026Updated last week
- [ICLR 2025 Spotlight] Official Implementation for ToST (Token Statistics Transformer)☆134Feb 25, 2025Updated last year
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.☆287Oct 28, 2025Updated 7 months ago