An Attention Superoptimizer
☆22Jan 20, 2025Updated last year
Alternatives and similar repositories for attention_superoptimizer
Users that are interested in attention_superoptimizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Autonomous CUDA kernel optimization agent with structured task specs and per-config scoring☆19Jun 17, 2026Updated 4 months ago
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Jun 21, 2019Updated 7 years ago
- ☆20Sep 28, 2024Updated 2 years ago
- Saturn accelerates the training of large-scale deep learning models with a novel joint optimization approach.☆25Nov 22, 2023Updated 2 years ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆90Sep 15, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Automatic formal verification for warp-specialized GPU kernels.☆109Updated this week
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆25Nov 21, 2024Updated last year
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆57Aug 6, 2025Updated last year
- Repository to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines"☆10Mar 31, 2022Updated 4 years ago
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆127Jun 23, 2022Updated 4 years ago
- Triton to TVM transpiler.☆24Oct 14, 2024Updated 2 years ago
- Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies)…☆29Oct 12, 2021Updated 5 years ago
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆140Feb 22, 2024Updated 2 years ago
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆228Oct 14, 2026Updated 3 weeks ago
- An experimental parallel training platform☆58Mar 25, 2024Updated 2 years ago
- A research group at UCSD CSE focused on Advanced Data Analytics: data management and systems for ML/AI and data science.☆11Aug 28, 2026Updated 2 months ago
- ☆29Aug 14, 2024Updated 2 years ago
- Evaluating different memory managers for dynamic GPU memory☆26Dec 16, 2020Updated 5 years ago
- ☆17May 10, 2024Updated 2 years ago
- ☆13Jun 2, 2026Updated 5 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- ☆49Apr 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆246Sep 24, 2023Updated 3 years ago
- Artifacts for our SIGCOMM'23 paper Ditto☆16Oct 17, 2023Updated 3 years ago
- ☆18Apr 21, 2024Updated 2 years ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆145Mar 31, 2023Updated 3 years ago
- ☆13Jan 23, 2021Updated 5 years ago
- Dorylus: Affordable, Scalable, and Accurate GNN Training☆77May 31, 2021Updated 5 years ago
- A Distributed Multi-GPU System for Fast Graph Processing☆65Oct 25, 2018Updated 8 years ago
- ☆68Dec 3, 2024Updated last year
- Might be a graph storage engine. (WIP)☆13May 14, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆12Aug 4, 2022Updated 4 years ago
- A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.☆42May 29, 2022Updated 4 years ago
- nnScaler: Compiling DNN models for Parallel Training☆136Oct 26, 2026Updated last week
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆33Apr 2, 2025Updated last year
- Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training☆1,903Updated this week
- sgx-based encrypted deduplication prototype☆13May 14, 2021Updated 5 years ago
- ☆43Sep 6, 2021Updated 5 years ago