Flash Attention from scratch, tiled CUDA forward kernel, online softmax with running max and correction factor, recomputation trick in backward, O(N) memory, full forward and backward verified against PyTorch autograd to 1e-6.
☆18Mar 6, 2026Updated 5 months ago
Alternatives and similar repositories for FlashAttention-CuPy
Users that are interested in FlashAttention-CuPy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a minimal paged attention implementation☆20Jan 30, 2026Updated 6 months ago
- kaggle - RSNA STR Pulmonary Embolism Detection☆10Nov 22, 2020Updated 5 years ago
- ☆11Apr 20, 2020Updated 6 years ago
- The best ChatGPT that $100 can buy.☆58Updated this week
- Integrates Imbue's Cost Aware pareto-Region Bayesian Search (CARBS) with Weights and Biases (WanDB)☆12Mar 17, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Nov 12, 2024Updated last year
- A minimalist quadcopter model and hover simulation built in MATLAB/Octave, based on Francesco Sabatino’s master thesis at KTH. This proje…☆12Aug 13, 2025Updated 11 months ago
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆43May 17, 2026Updated 2 months ago
- This is a simple automated license plate detector developed in C++ via OpenCV.☆11Sep 26, 2020Updated 5 years ago
- A visual representation of Dijkstra's Algorithm using Libgdx.☆16Dec 24, 2021Updated 4 years ago
- Centralized cooperative reinforcement learning☆13Jan 8, 2023Updated 3 years ago
- ☆22Jul 10, 2026Updated 3 weeks ago
- Implementation and explorations into Blackbox Gradient Sensing (BGS), an evolutionary strategies approach proposed in a Google Deepmind p…☆20Apr 17, 2026Updated 3 months ago
- A neural network library written in jax☆14Feb 3, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Ghana Crop Disease Detection Challenge - 5th Place Solution☆15Dec 17, 2024Updated last year
- ☆10May 21, 2024Updated 2 years ago
- Official implementation of "NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows"☆17Sep 22, 2025Updated 10 months ago
- Accompanying repo for the paper - High-speed Autonomous Racing using Trajectory-aided Deep Reinforcement Learning☆18Jan 17, 2024Updated 2 years ago
- Raw bindings to platform APIs for OCaml☆16Mar 18, 2024Updated 2 years ago
- A test for RL application on f1tenth gym environment☆11Apr 10, 2023Updated 3 years ago
- ☆11Nov 15, 2021Updated 4 years ago
- ☆23Jan 14, 2025Updated last year
- T-UNet: Triplet UNet for Change Detection in High-Resolution Remote Sensing Images☆21Apr 17, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆19Sep 16, 2024Updated last year
- ☆14May 25, 2023Updated 3 years ago
- AI-queryable MCP server for unified real-time air, sea, and space tracking — 25+ tools, agent skills, guardrails, and a 3D globe☆18Apr 15, 2026Updated 3 months ago
- Simply drag and drop your PDF files into Preve to get started. Ask Preve questions about your document. Get Summaries, key points, specif…☆11Apr 9, 2026Updated 3 months ago
- ☆18Aug 14, 2023Updated 2 years ago
- A unified framework for feed-forward neural networks☆15Nov 28, 2025Updated 8 months ago
- ☆15Jan 19, 2018Updated 8 years ago
- A NodeJS application to upload, watch and stream live videos.☆12Jan 24, 2023Updated 3 years ago
- Collection of resources on plasticity loss in deep reinforcement learning☆23Nov 12, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official Repository for the Paper - ViT BEVSeg: A Hierarchical Transformer Network for Monocular Birds-Eye-View Segmentation☆14May 30, 2022Updated 4 years ago
- JAX implementations of various deep reinforcement learning algorithms.☆25Feb 2, 2025Updated last year
- Rust FTL + WebRTC live streaming software.☆13Mar 12, 2022Updated 4 years ago
- ☆16Feb 11, 2017Updated 9 years ago
- CartPole-v0 via PPO with GAE, PyTorch☆22Feb 10, 2019Updated 7 years ago
- ☆18Sep 13, 2024Updated last year
- ☆25Jul 13, 2026Updated 3 weeks ago