Fast Discounted Cumulative Sums in PyTorch
☆99Aug 28, 2021Updated 5 years ago
Alternatives and similar repositories for torch-discounted-cumsum
Users that are interested in torch-discounted-cumsum are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆49Jan 27, 2022Updated 4 years ago
- ☆40Jan 5, 2024Updated 2 years ago
- ☆10Sep 13, 2021Updated 5 years ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆20Oct 9, 2022Updated 4 years ago
- To be a next-generation DL-based phenotype prediction from genome mutations.☆19May 17, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆48Nov 30, 2021Updated 4 years ago
- ESGD-M is a stochastic non-convex second order optimizer, suitable for training deep learning models, for PyTorch.☆57Sep 18, 2022Updated 4 years ago
- ☆21Mar 14, 2021Updated 5 years ago
- [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…☆14Oct 17, 2023Updated 3 years ago
- Simplistic Pytorch Implementation of the Dreamer-RL☆20May 7, 2025Updated last year
- Contrastive Language-Image Pretraining☆148Sep 6, 2022Updated 4 years ago
- ☆31Oct 3, 2022Updated 4 years ago
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Jan 16, 2022Updated 4 years ago
- Python Research Framework☆107Nov 3, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆21Mar 15, 2023Updated 3 years ago
- Implementation of QKVAE☆11Feb 24, 2023Updated 3 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆100Feb 25, 2023Updated 3 years ago
- ☆29Jul 9, 2024Updated 2 years ago
- Implementation of ICML 22 Paper: Scaling Structured Inference with Randomization☆13Jul 24, 2022Updated 4 years ago
- Accelerated First Order Parallel Associative Scan☆197Jan 7, 2026Updated 10 months ago
- A Pytree Module system for Deep Learning in JAX☆209Feb 26, 2023Updated 3 years ago
- Hidden Engrams: Long Term Memory for Transformer Model Inference☆35Jun 26, 2021Updated 5 years ago
- Efficient Householder Transformation in PyTorch☆70Jul 6, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- Simple tools to mix and match PyTorch and Jax - Get the best of both worlds!☆38Jan 8, 2026Updated 9 months ago
- ☆19Dec 4, 2025Updated 11 months ago
- CLASP - Contrastive Language-Aminoacid Sequence Pretraining☆143Sep 17, 2021Updated 5 years ago
- Implementation of a Transformer, but completely in Triton☆278Apr 5, 2022Updated 4 years ago
- Code publication to the paper "Normalized Attention Without Probability Cage"☆17Aug 24, 2026Updated 2 months ago
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆19Mar 15, 2024Updated 2 years ago
- ☆16Mar 22, 2023Updated 3 years ago
- Efficient PScan implementation in PyTorch☆17Jan 2, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Combining SOAP and MUON☆24Feb 11, 2025Updated last year
- Code for the paper "Understanding the Mechanics of SPIGOT: Surrogate Gradients for Latent Structure Learning"☆11May 5, 2021Updated 5 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆33May 25, 2024Updated 2 years ago
- ☆40May 2, 2021Updated 5 years ago
- A denoising diffusion probabilistic model (DDPM) tailored for conditional generation of protein distograms☆143Apr 20, 2022Updated 4 years ago
- ☆27Oct 29, 2026Updated last week
- ☆36Nov 22, 2024Updated last year