An Attention Superoptimizer
☆22Jan 20, 2025Updated last year
Alternatives and similar repositories for attention_superoptimizer
Users that are interested in attention_superoptimizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Autonomous CUDA kernel optimization agent with structured task specs and per-config scoring☆17Jun 17, 2026Updated 2 months ago
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Jun 21, 2019Updated 7 years ago
- ☆20Sep 28, 2024Updated last year
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆87Sep 15, 2025Updated 11 months ago
- Repository to go along with the paper "Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines"☆10Mar 31, 2022Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆57Aug 6, 2025Updated last year
- Triton to TVM transpiler.☆24Oct 14, 2024Updated last year
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆126Jun 23, 2022Updated 4 years ago
- ☆29Aug 14, 2024Updated 2 years ago
- An experimental parallel training platform☆57Mar 25, 2024Updated 2 years ago
- A research group at UCSD CSE focused on Advanced Data Analytics: data management and systems for ML/AI and data science.☆11Jul 24, 2026Updated 3 weeks ago
- ☆12Aug 4, 2022Updated 4 years ago
- ☆17May 10, 2024Updated 2 years ago
- Evaluating different memory managers for dynamic GPU memory☆26Dec 16, 2020Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆224Sep 21, 2024Updated last year
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆136Feb 22, 2024Updated 2 years ago
- ☆68Dec 3, 2024Updated last year
- Artifacts for our SIGCOMM'23 paper Ditto☆15Oct 17, 2023Updated 2 years ago
- ☆13Jun 2, 2026Updated 2 months ago
- sgx-based encrypted deduplication prototype☆13May 14, 2021Updated 5 years ago
- ☆49Apr 11, 2025Updated last year
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Apr 15, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆33Apr 2, 2025Updated last year
- ☆18Apr 21, 2024Updated 2 years ago
- A Distributed Multi-GPU System for Fast Graph Processing☆65Oct 25, 2018Updated 7 years ago
- Dorylus: Affordable, Scalable, and Accurate GNN Training☆76May 31, 2021Updated 5 years ago
- nnScaler: Compiling DNN models for Parallel Training☆135Jul 2, 2026Updated last month
- ☆13Jan 23, 2021Updated 5 years ago
- paper and its code for AI System☆378May 14, 2026Updated 3 months ago
- Might be a graph storage engine. (WIP)☆13May 14, 2023Updated 3 years ago
- A schedule language for large model training☆153Aug 21, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A resilient distributed training framework☆100Jul 24, 2026Updated 3 weeks ago
- ☆43Sep 6, 2021Updated 4 years ago
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆247Sep 24, 2023Updated 2 years ago
- Automatic resource configuration for serverless workflows.☆22Mar 24, 2024Updated 2 years ago
- Mamba support for transformer lens☆20Sep 17, 2024Updated last year
- A GPU algorithm for sparse matrix-matrix multiplication☆74Oct 1, 2020Updated 5 years ago
- [ICML 2026] Less Is More: Training-Free Sparse Attention with Global Locality for Efficient Reasoning☆35Sep 12, 2025Updated 11 months ago