nebuly-ai / exploring-AI-optimization
Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient 🚀
☆111Updated 11 months ago
Related projects: ⓘ
- ☆234Updated last month
- ML/DL Math and Method notes☆56Updated 9 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆248Updated 10 months ago
- End-to-End LLM Guide☆91Updated 2 months ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆145Updated this week
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆84Updated last year
- Google TPU optimizations for transformers models☆62Updated this week
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆231Updated last week
- Mixed precision training from scratch with Tensors and CUDA☆18Updated 4 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆324Updated last week
- experiments with inference on llama☆106Updated 3 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆144Updated this week
- ☆97Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆250Updated this week
- A set of scripts and notebooks on LLM finetunning and dataset creation☆89Updated last week
- vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs☆87Updated this week
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆129Updated last month
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆144Updated this week
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated 11 months ago
- This repository contains the experimental PyTorch native float8 training UX☆210Updated last month
- A scalable & efficient active learning/data selection system for everyone.☆212Updated 2 months ago
- A library to analyze PyTorch traces.☆270Updated 2 weeks ago
- Functional local implementations of main model parallelism approaches☆93Updated last year
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆77Updated 9 months ago
- Torch Distributed Experimental☆115Updated last month
- Codes for paper "KNAS: Green Neural Architecture Search"☆92Updated 2 years ago
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆81Updated 6 months ago
- ☆124Updated 7 months ago
- Implementation of a Transformer, but completely in Triton☆242Updated 2 years ago
- Simple and fast low-bit matmul kernels in CUDA☆48Updated this week