Oxen-AI / Score-Entropy-Discrete-DiffusionLinks
Modified Score-Entropy-Discrete-Diffusion to do a character level ml model and integrate with Oxen
☆16Updated last year
Alternatives and similar repositories for Score-Entropy-Discrete-Diffusion
Users that are interested in Score-Entropy-Discrete-Diffusion are comparing it to the libraries listed below
Sorting:
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆50Updated 7 months ago
- Official Code Implementation for 'A Simple Early Exiting Framework for Accelerated Sampling in Diffusion Models'☆20Updated last year
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆37Updated 6 months ago
- Implementation of Insertion-deletion Denoising Diffusion Probabilistic Models☆30Updated 3 years ago
- My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation☆88Updated 11 months ago
- Implementation of a Light Recurrent Unit in Pytorch☆48Updated 11 months ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆56Updated last year
- JAX Implementations of Descript Audio Codec and EnCodec☆31Updated 5 months ago
- A Pytorch Implementations for Various Vector Quantization Methods☆32Updated 4 years ago
- Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…☆79Updated 2 weeks ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Updated 6 months ago
- Official code implementation for the work Preference Alignment with Flow Matching (NeurIPS 2024)☆58Updated 10 months ago
- ResiDual: Transformer with Dual Residual Connections, https://arxiv.org/abs/2304.14802☆95Updated 2 years ago
- research impl of Native Sparse Attention (2502.11089)☆61Updated 7 months ago
- Here we will test various linear attention designs.☆62Updated last year
- ☆18Updated 9 months ago
- Implementation of "Audio xLSTMs: Learning Self-supervised audio representations with xLSTMs" in PyTorch☆19Updated this week
- Griffin MQA + Hawk Linear RNN Hybrid☆89Updated last year
- Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public☆90Updated 3 months ago
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆124Updated 9 months ago
- TriNet: stabilizing self-supervised learning from complete or slow collapse on ASR.☆26Updated 2 years ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Updated last year
- Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…☆46Updated 2 weeks ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆90Updated last year
- Official implementation for the paper "A Cheaper and Better Diffusion Language Model with Soft-Masked Noise"☆59Updated 2 years ago
- AudioBERT 📢 : Audio Knowledge Augmented Language Model (ICASSP 2025)☆41Updated 7 months ago
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆66Updated last year
- ☆107Updated 2 years ago
- HGRN2: Gated Linear RNNs with State Expansion☆54Updated last year