Reference implementation of "Self-Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation" (Heinsen and Kozachkov, 2026)
☆36Feb 21, 2026Updated 8 months ago
Alternatives and similar repositories for sata_attention
Users that are interested in sata_attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆25Jun 6, 2024Updated 2 years ago
- Implementation of approximate free-energy minimization in PyTorch☆21Oct 16, 2021Updated 5 years ago
- Sparton: Fast and Memory-Efficient Triton Kernel for Learned Sparse Retrieval☆11Mar 26, 2026Updated 7 months ago
- Evaluate state-of-the-art sparse embedding models on the LIMIT dataset (`limit-small` and `limit`) from google's paper `On the Theoretica…☆16Sep 4, 2025Updated last year
- Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Trans…☆12Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Simple and fast parallel scan over sequences of tensors, with any binary associative function you specify, for PyTorch (Franz A. Heinsen,…☆18Apr 15, 2025Updated last year
- A fermionic linear optics simulator backend for Yao.jl☆15Oct 7, 2026Updated last month
- Fun project to run your own LLM chat bot using llama.cpp☆11Jun 9, 2023Updated 3 years ago
- Tensor network contraction order optimizers (not only) for OMEinsum☆37Aug 25, 2026Updated 2 months ago
- ☆11Nov 5, 2023Updated 3 years ago
- new optimizer☆20Aug 4, 2024Updated 2 years ago
- [ICML'26] LEMUR reduces multi-vector retrieval for late interaction models such as ColBERT into regular single-vector retrieval.☆33Oct 6, 2026Updated last month
- This is a comprehensive guide on how you can automate your feature engineering process.☆11Jun 25, 2018Updated 8 years ago
- An adapted version of the Metamer Foveation Transform code from Deza et al. ICLR 2019☆14Apr 23, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for the paper "Cottention: Linear Transformers With Cosine Attention"☆21Nov 15, 2025Updated 11 months ago
- Korean MTEB Retrieval Evaluators for SPLADE, Dense, and Reranking models☆14Jul 21, 2026Updated 3 months ago
- We conduct a preregistered experiment to investigate whether fact checks provided by a large language model can serve as an effective mis…☆15Dec 14, 2024Updated last year
- Repo for solving arc problems with an Neural Cellular Automata☆27Mar 9, 2026Updated 7 months ago
- ☆40Jan 5, 2024Updated 2 years ago
- ☆12Sep 1, 2023Updated 3 years ago
- ☆35Jul 5, 2023Updated 3 years ago
- ☆11Oct 19, 2023Updated 3 years ago
- A novel approach for transformer model introspection that enables saving, compressing, and manipulating internal thought states for advan…☆35Mar 22, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Powered by ChatterboxTTS | Transformer | Llama | Gradio☆18Sep 7, 2025Updated last year
- ☆13Feb 3, 2025Updated last year
- Equation Learning Based Neural Network Model☆12May 20, 2024Updated 2 years ago
- High performance implementation of the WARP (SIGIR'25) retrieval engine.☆37Sep 8, 2026Updated last month
- ☆12Oct 3, 2020Updated 6 years ago
- Machine Learning for Mathematics and Logics☆16Apr 1, 2025Updated last year
- This is the code repository of DAG aware GAT for Causal Effect Estimation☆12Jun 21, 2026Updated 4 months ago
- Quick ADC☆27May 31, 2019Updated 7 years ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆97Dec 5, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tutorials on data science/machine learning using Python with a life-science perspective. When I started learning programming and machine …☆12Jun 18, 2022Updated 4 years ago
- A dashboard for exploring timm learning rate schedulers☆20Nov 22, 2024Updated last year
- Reduce several arbitrary-connectivity optimization problems into maximum independent set problems on a grid☆24Apr 12, 2025Updated last year
- Resources and references on solved and unsolved problems in agentic AI.☆15Aug 11, 2025Updated last year
- Repository for paper Decrypting Cryptic Crosswords☆11Jan 15, 2022Updated 4 years ago
- High-Performance K-Means Clustering Library☆41Jul 6, 2025Updated last year
- Code for the Avey-B paper (https://arxiv.org/abs/2602.15814)☆33Feb 21, 2026Updated 8 months ago