CUDA implementation of autoregressive linear attention, with all the latest research findings
☆46May 23, 2023Updated 2 years ago
Alternatives and similar repositories for autoregressive-linear-attention-cuda
Users that are interested in autoregressive-linear-attention-cuda are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Explorations into the recently proposed Taylor Series Linear Attention☆100Aug 18, 2024Updated last year
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Oct 22, 2023Updated 2 years ago
- A simple implementation of a deep linear Pytorch module☆21Oct 16, 2020Updated 5 years ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2☆15Jun 27, 2025Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in P…☆207Feb 14, 2024Updated 2 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆220Feb 13, 2023Updated 3 years ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆27Updated this week
- A library for squeakily cleaning and filtering language datasets.☆50Jul 10, 2023Updated 2 years ago
- ☆23Jun 18, 2024Updated last year
- Utilities for PyTorch distributed☆25Feb 27, 2025Updated last year
- A vast array of Multi-Modal Embodied Robotic Foundation Models!☆28Mar 18, 2024Updated 2 years ago
- Generate python ctypes classes from C headers. Requires LLVM clang☆16Aug 14, 2024Updated last year
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Oct 9, 2022Updated 3 years ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- Simple python library for generating your own perfetto traces for your application. Can be used for both app instrumentation and custom …☆25Jun 22, 2025Updated 9 months ago
- https://hf.co/hexgrad/Kokoro-82M☆14Jan 14, 2026Updated 2 months ago
- Hacks for PyTorch☆19Apr 18, 2023Updated 2 years ago
- Implementation of a holodeck, written in Pytorch☆18Nov 1, 2023Updated 2 years ago
- ☆21Mar 3, 2025Updated last year
- ☆34Sep 10, 2024Updated last year
- ☆15Nov 24, 2025Updated 4 months ago
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆207Aug 26, 2023Updated 2 years ago
- Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…☆31Nov 14, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A collection of free online materials for control engineering☆19Feb 4, 2025Updated last year
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆135Oct 15, 2025Updated 5 months ago
- [NeurIPS 2023] Neural Lyapunov Control for Discrete-Time Systems☆14Jul 29, 2024Updated last year
- Build modern UIs in Jupyter with Python☆12Dec 28, 2022Updated 3 years ago
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- ResiDual: Transformer with Dual Residual Connections, https://arxiv.org/abs/2304.14802☆98Aug 18, 2023Updated 2 years ago
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated 10 months ago
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆23Mar 11, 2026Updated 2 weeks ago
- Train vision models using JAX and 🤗 transformers☆101Dec 14, 2025Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Numerical Optimisation Library☆17Jul 9, 2023Updated 2 years ago
- Named tensors with first-class dimensions for PyTorch☆332Jun 14, 2023Updated 2 years ago
- The 2D discrete wavelet transform for JAX☆45Feb 28, 2023Updated 3 years ago
- ☆12Jan 4, 2024Updated 2 years ago
- Initially an Algorithmic Diffrentiation Library. Now has been extended to a Probabilistic Programming Library☆26Dec 21, 2021Updated 4 years ago
- ☆52Jun 10, 2024Updated last year
- [COLM 2025] Official code for "When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoni…☆15Oct 31, 2025Updated 4 months ago