☆92Feb 29, 2024Updated 2 years ago
Alternatives and similar repositories for inference-optimization-blog-post
Users that are interested in inference-optimization-blog-post are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Jan 4, 2024Updated 2 years ago
- ring-attention experiments☆169Oct 17, 2024Updated last year
- ModernBERT model optimized for Apple Neural Engine.☆32Jan 10, 2025Updated last year
- Cataloging released Triton kernels.☆310Sep 9, 2025Updated 9 months ago
- Explore training for quantized models☆26Jul 12, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆19Dec 31, 2025Updated 6 months ago
- Mixed precision training from scratch with Tensors and CUDA☆30May 14, 2024Updated 2 years ago
- ☆93Jul 5, 2024Updated last year
- Building Blocks for Equivariant Neural Networks in e3nn and PyTorch 2.0☆19Nov 16, 2025Updated 7 months ago
- Experimental GPU language with meta-programming☆31Sep 6, 2024Updated last year
- GPU programming related news and material links☆2,206Jun 15, 2026Updated 2 weeks ago
- Profile your CoreML models directly from Python 🐍☆30Sep 8, 2025Updated 9 months ago
- Personal solutions to the Triton Puzzles☆21Jul 18, 2024Updated last year
- minimal C implementation of speculative decoding based on llama2.c☆30Jul 15, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Continual Multi-agent Reinforcement Learning in Dynamic Environments☆11Jul 1, 2021Updated 5 years ago
- Standalone commandline CLI tool for compiling Triton kernels☆20Sep 13, 2024Updated last year
- BFloat16 Fused Adam Operator for PyTorch☆20Nov 16, 2024Updated last year
- Learn CUDA with PyTorch☆339Jun 1, 2026Updated last month
- Train small sequence models in your browser with WebGPU.☆35Dec 3, 2025Updated 7 months ago
- ☆13Dec 22, 2024Updated last year
- RAPIDS Deployment Documentation☆15Jun 10, 2026Updated 3 weeks ago
- LLM training parallelisms (DP, FSDP, TP, PP) in pure C☆30Jan 27, 2026Updated 5 months ago
- ☆20May 30, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Implement Neural Networks in Cuda from Scratch☆23May 17, 2024Updated 2 years ago
- Automatic differentiation for Triton Kernels☆29Aug 12, 2025Updated 10 months ago
- ☆39Oct 3, 2022Updated 3 years ago
- Using multiple LLMs for ensemble Forecasting☆16Jan 17, 2024Updated 2 years ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- Puzzles for learning Triton☆2,505Apr 1, 2026Updated 3 months ago
- Fastest kernels written from scratch☆583Sep 18, 2025Updated 9 months ago
- Apply GPU in ML and DL☆68Mar 23, 2026Updated 3 months ago
- Repository for the EuroSciPy sprint☆14May 21, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for my workshop "Production-ready WebAssembly with Rust" presented at RustLab 2023 in Florence☆16Nov 23, 2023Updated 2 years ago
- Cute layout visualization☆42Jan 18, 2026Updated 5 months ago
- Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…☆40Jan 6, 2026Updated 5 months ago
- Experimental compiler for deep learning models☆75Sep 18, 2025Updated 9 months ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- Applied AI experiments and examples for PyTorch☆323Aug 22, 2025Updated 10 months ago
- Flash Attention in ~100 lines of CUDA (forward pass only)☆1,166Dec 30, 2024Updated last year