Optimize softmax in triton in many cases
☆24Sep 6, 2024Updated 2 years ago
Alternatives and similar repositories for optimize_softmax
Users that are interested in optimize_softmax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FlagGems is an operator library for large language models implemented in the Triton Language.☆1,165Updated this week
- ☆13Feb 2, 2026Updated 9 months ago
- 基于 vLLM 上游社区版本建设的 das 插件仓库，为 hcu 平台提供功能适配、兼容支持与性能优化。☆27Updated this week
- Accepted paper of SIGMOD 2023, DUCATI: A Dual-Cache Training System for Graph Neural Networks on Giant Graphs with the GPU☆16Dec 15, 2023Updated 2 years ago
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆38Sep 15, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆37Aug 31, 2026Updated 2 months ago
- ☆20Aug 27, 2026Updated 2 months ago
- ☆19Nov 21, 2024Updated last year
- ☆156Mar 4, 2025Updated last year
- 基于 sgl-project/sglang 上游社区版本建设的 das 下游适配仓库，面向 hcu 平台进行功能适配与优化。☆47Updated this week
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- Official Code Implementation for the CCS 2022 Paper "On the Privacy Risks of Cell-Based NAS Architectures"☆11Nov 21, 2022Updated 3 years ago
- 一个轻量化的大模型推理框架☆23May 26, 2025Updated last year
- ☆23Aug 14, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Code repository for the research paper "A Systematic Look at Ciphertext Side Channels on AMD SEV-SNP"☆13May 17, 2022Updated 4 years ago
- ☆32Jul 2, 2025Updated last year
- GPU-initiated Large-scale GNN System [ATC 23]☆19Aug 31, 2026Updated 2 months ago
- CIPHERH: Automated Detection of Ciphertext Side-channel Vulnerabilities in Cryptographic Implementations☆13Dec 17, 2023Updated 2 years ago
- This is a GIT syncronization of https://wiki.newae.com☆10Feb 21, 2018Updated 8 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Nov 8, 2024Updated last year
- casket is an easy-to-use web file storage.☆13Jul 31, 2021Updated 5 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆31Mar 12, 2024Updated 2 years ago
- ☆13Dec 9, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 使用 cutlass 实现 flash-attention 精简版，具有教学意义☆59Aug 12, 2024Updated 2 years ago
- ☆49Apr 15, 2024Updated 2 years ago
- ☆13Oct 2, 2023Updated 3 years ago
- Implementation of the Reusable Enclaves paper☆15Sep 25, 2023Updated 3 years ago
- Fabric Stain Detection System based on YOLO algorithm☆20Jan 28, 2025Updated last year
- Artifact evaluation of the paper "Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and Pipelining"☆23Mar 7, 2022Updated 4 years ago
- A public tool to estimate GPU, VRAM, RAM, disk, and system requirements for running or training LLMs locally.☆11Apr 23, 2026Updated 6 months ago
- The codes for ECCV'22: Learning to Train a Point Cloud Reconstruction Network without Matching☆10Nov 16, 2022Updated 3 years ago
- TensorRT encapsulation, learn, rewrite, practice.☆32Oct 19, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Statistically Acceptable GAussian☆15Jul 10, 2026Updated 3 months ago
- A minimal bootstrap scheme for fast boot of serverless microVMs with AMD Secure Encrypted Virtualization (SEV)☆15Feb 7, 2024Updated 2 years ago
- [VLDB 2024] Source code for FusionQuery: On-demand Fusion Queries over Multi-source Heterogeneous Data☆11Mar 11, 2025Updated last year
- ☆69Mar 19, 2023Updated 3 years ago
- [ICLR 2022] "PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication" by Cheng Wan, Y…☆34Mar 15, 2023Updated 3 years ago
- ☆99Apr 2, 2025Updated last year
- 笔记整理 Skill：一个用于 Claude Code 的课程资料、PDF、PPT、题库整理成 Markdown/Obsidian 复习笔记的 Claude Skill。☆17Jun 30, 2026Updated 4 months ago