A high-performance attention mechanism that computes softmax normalization in a single streaming pass using running accumulators (online softmax).
☆32Sep 1, 2026Updated this week
Alternatives and similar repositories for StreamAttn
Users that are interested in StreamAttn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Learning about CUDA by writing PTX code.☆161Feb 27, 2024Updated 2 years ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 6 months ago
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Jun 4, 2025Updated last year
- VSS: A Storage System for Video Analytics☆13Jul 9, 2021Updated 5 years ago
- Compare Bloxroute and Fiber transaction streams☆10Nov 22, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Proof of concept implementation of Sigmabus https://eprint.iacr.org/2023/1406☆10Dec 20, 2023Updated 2 years ago
- A repo for learning how to parallelize computations in the GPU using Apple's Metal, in Rust.☆10Mar 17, 2023Updated 3 years ago
- Tendermint implementation of the blockchain of Aleo verifiable computing model built by LambdaClass☆15Feb 8, 2023Updated 3 years ago
- Tasking 2.0☆17Nov 1, 2021Updated 4 years ago
- ☆12Jun 5, 2025Updated last year
- ☆12Feb 18, 2025Updated last year
- ☆16Jan 24, 2025Updated last year
- ☆12Sep 11, 2024Updated last year
- A fast 2-level, sparse bloom filter implementation☆16Jan 13, 2026Updated 7 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆14Jan 27, 2024Updated 2 years ago
- Code for Robust Fine-tuning (RbFT)☆19Jan 31, 2025Updated last year
- Because it's there.☆16Sep 22, 2024Updated last year
- This repo contains basic Ocaml code examples.☆13Oct 5, 2016Updated 9 years ago
- Highly experimental fault-proof program for Optimism Bedrock☆20Mar 27, 2023Updated 3 years ago
- Fast approximation of similarity for sets of very different sizes☆20Mar 8, 2022Updated 4 years ago
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 7 months ago
- ☆16Sep 25, 2023Updated 2 years ago
- ☆16Jul 24, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GraphQL client, server, and schema parsers with a focus on ease of use☆18Aug 24, 2026Updated last week
- [AAAI 2025] Official Implementation of I-HallA v1.0☆16Feb 2, 2025Updated last year
- Interactive version of the CuTe layout paper☆57Apr 14, 2026Updated 4 months ago
- A tag editor written in C# and WPF☆12Aug 20, 2023Updated 3 years ago
- Verified implementations for the Noise family of protocols☆17Jun 18, 2024Updated 2 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 4 months ago
- Ethereum block hallucinator☆15Oct 1, 2025Updated 11 months ago
- Astro + React soundboard☆19Jun 14, 2024Updated 2 years ago
- Arkworks implementation of the VM of Aleo verifiable computing model built by LambdaClass☆21May 9, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- We present the Automatic Helmet Detection System, a CNN model trained on image dataset that can detect motorbikes as well as riders weari…☆14Mar 28, 2022Updated 4 years ago
- kernelboard is the webapp for https://www.gpumode.com☆19Aug 17, 2026Updated 2 weeks ago
- A chrome extension that shows a Bing AI popup in the current tab when you click on the extension icon☆11May 11, 2023Updated 3 years ago
- This includes 2 separate tutorial series for OpenAI swarm library each 10 files from basic to advanced☆14Jan 14, 2025Updated last year
- Benchmarking guide for the Azure AI Infrastructure.☆41Jun 9, 2026Updated 2 months ago
- Local LLM as a search relevance judge☆30Mar 2, 2025Updated last year
- ☆23Nov 2, 2022Updated 3 years ago