Implementation of Strassen attention, from Kozachinskiy et al. of National Center of AI in Chile
☆41Jul 8, 2025Updated 11 months ago
Alternatives and similar repositories for strassen-attention
Users that are interested in strassen-attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Ro…☆49Sep 2, 2025Updated 9 months ago
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆56Mar 25, 2025Updated last year
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆78Apr 3, 2026Updated 2 months ago
- Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch☆105Apr 3, 2026Updated 2 months ago
- Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk☆47Jul 16, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- My explorations into editing the knowledge and memories of an attention network☆35Dec 8, 2022Updated 3 years ago
- BlockRank makes LLMs efficient and scalable for RAG and in-context ranking☆44Dec 12, 2025Updated 6 months ago
- ☆27May 22, 2025Updated last year
- Adata Viewer: Head/Less/Shape h5ad file in terminal☆12Mar 19, 2025Updated last year
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆137May 5, 2026Updated last month
- Causal Attention with Lookahead Keys☆27Sep 26, 2025Updated 8 months ago
- open-arms-mini: cheap human like teleoperation device that supports human in the loop corrections☆101Mar 26, 2026Updated 2 months ago
- Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster☆71Jun 2, 2026Updated 2 weeks ago
- Implementation of AlphaGenome, Deepmind's updated genomic attention model☆100Mar 25, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code and data for paper "(How) do Language Models Track State?"☆25Mar 31, 2025Updated last year
- A simple app for recording speech datasets.☆26Jun 27, 2022Updated 3 years ago
- Implementation of a Light Recurrent Unit in Pytorch☆50Oct 6, 2024Updated last year
- Code for the C2KD paper (ICASSP 2023)☆19May 15, 2023Updated 3 years ago
- PyTorch implementation of Lessons on Parameter Sharing across Layers in Transformers☆26May 19, 2021Updated 5 years ago
- A dashboard for exploring timm learning rate schedulers☆20Nov 22, 2024Updated last year
- Code for paper: "Privately generating tabular data using language models".☆16Jun 13, 2023Updated 3 years ago
- Load any clip model with a standardized interface☆22Oct 20, 2025Updated 7 months ago
- Toy genetic algorithm in Pytorch☆57Apr 21, 2026Updated last month
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Recursive Self-Aggregation evals on ARC-AGI☆36Jan 26, 2026Updated 4 months ago
- ☆11May 2, 2022Updated 4 years ago
- Implementation of Infini-Transformer in Pytorch☆112Jan 4, 2025Updated last year
- Implementation of the new SOTA for model based RL, from the paper "Improving Transformer World Models for Data-Efficient RL", in Pytorch☆154May 2, 2025Updated last year
- ☆45Jun 11, 2024Updated 2 years ago
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆52Jul 26, 2024Updated last year
- Decision Making with Genetic Algorithms using DEAP☆16Aug 17, 2016Updated 9 years ago
- Expand -> Retrieve -> Rerank - simple method with strong results on BRIGHT benchmark☆22Aug 22, 2025Updated 9 months ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆126Jul 26, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A set of custom nodes that I've either written myself or adapted from other authors for my own convenience.☆11Sep 18, 2024Updated last year
- Grapheme-to-phoneme (G2P) conversion is the process of generating pronunciation for words based on their written form. It has a highly es…☆19Jun 14, 2021Updated 5 years ago
- Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch☆81Dec 4, 2022Updated 3 years ago
- Unofficial PyTorch implementation of "SCNet: Sparse Compression Network for Music Source Separation"☆63Apr 14, 2024Updated 2 years ago
- An Interpretable Self-Attention Network with block-attention and attention-attribution.☆12Sep 22, 2023Updated 2 years ago
- Universal Single-Cell Genomics Preprocessing package☆49Feb 21, 2026Updated 3 months ago
- ☆13Jun 7, 2023Updated 3 years ago