A high-performance attention mechanism that computes softmax normalization in a single streaming pass using running accumulators (online softmax).
☆31Jun 3, 2026Updated last month
Alternatives and similar repositories for StreamAttn
Users that are interested in StreamAttn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Learning about CUDA by writing PTX code.☆160Feb 27, 2024Updated 2 years ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 5 months ago
- ☆11Jan 27, 2025Updated last year
- Setting up Vscode to work with Pytorch in C/C++ with CUDA support☆25Feb 5, 2025Updated last year
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Jun 4, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Secure FTP client & multithreaded server (using threadpool) with on-the-fly Gzip compression/decompression, secure packet transmission us…☆15Jan 4, 2025Updated last year
- 📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism, etc. 🎉🎉☆21Mar 30, 2025Updated last year
- A repo for learning how to parallelize computations in the GPU using Apple's Metal, in Rust.☆10Mar 17, 2023Updated 3 years ago
- CDLS: Proving Knowledge of Committed Discrete Logarithms with Soundness☆12Apr 30, 2026Updated 2 months ago
- Tendermint implementation of the blockchain of Aleo verifiable computing model built by LambdaClass☆15Feb 8, 2023Updated 3 years ago
- ☆12Feb 18, 2025Updated last year
- A system for scheduling serverless edge functions☆11Aug 11, 2020Updated 5 years ago
- ☆14Jan 27, 2024Updated 2 years ago
- Because it's there.☆16Sep 22, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Jun 24, 2025Updated last year
- This repo contains basic Ocaml code examples.☆13Oct 5, 2016Updated 9 years ago
- Highly experimental fault-proof program for Optimism Bedrock☆20Mar 27, 2023Updated 3 years ago
- Fast approximation of similarity for sets of very different sizes☆20Mar 8, 2022Updated 4 years ago
- MIRIS: Fast Object Track Queries in Video☆17Mar 24, 2023Updated 3 years ago
- ☆16Sep 25, 2023Updated 2 years ago
- [AAAI 2025] Official Implementation of I-HallA v1.0☆16Feb 2, 2025Updated last year
- Interactive version of the CuTe layout paper☆57Apr 14, 2026Updated 3 months ago
- A tag editor written in C# and WPF☆12Aug 20, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 3 months ago
- Public repo for farreach☆17Feb 1, 2025Updated last year
- My Academic Website：https://jerrysys.top☆19Feb 21, 2025Updated last year
- Ethereum block hallucinator☆16Oct 1, 2025Updated 9 months ago
- Astro + React soundboard☆19Jun 14, 2024Updated 2 years ago
- Arkworks implementation of the VM of Aleo verifiable computing model built by LambdaClass☆21May 9, 2023Updated 3 years ago
- kernelboard is the webapp for https://www.gpumode.com☆18Updated this week
- This includes 2 separate tutorial series for OpenAI swarm library each 10 files from basic to advanced☆14Jan 14, 2025Updated last year
- Benchmarking guide for the Azure AI Infrastructure.☆41Jun 9, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Local LLM as a search relevance judge☆30Mar 2, 2025Updated last year
- Personal solutions to the Triton Puzzles☆22Jul 18, 2024Updated 2 years ago
- Implementation of Latent Replay, a Continual Learning strategy for Real-Time / On The Edge applications☆14May 7, 2020Updated 6 years ago
- YCSB-C for HWDB!☆18May 30, 2020Updated 6 years ago
- Houdini Python Wiki☆18Mar 18, 2024Updated 2 years ago
- Collective and Neighbor Collective Optimizations and Extensions☆15Jul 14, 2026Updated last week
- no matter what you are resisting here is a dose of opsec for you... godspeed☆22Mar 8, 2025Updated last year