This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.
☆94Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for pytorch-memory-optim
Users that are interested in pytorch-memory-optim are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Gzip and nearest neighbors for text classification☆57Aug 1, 2023Updated 3 years ago
- Materials for "Transformers from the Ground Up" at PyData Jeddah on August 5, 2021☆20Aug 5, 2021Updated 5 years ago
- ☆17Jun 19, 2023Updated 3 years ago
- ☆10Nov 6, 2024Updated last year
- RAPIDS Deployment Documentation☆15Aug 14, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.☆16Sep 18, 2024Updated last year
- Modular, flexible, cross-platform workload profiling and characterization☆13Mar 1, 2021Updated 5 years ago
- ☆130Oct 25, 2023Updated 2 years ago
- ☆15Feb 13, 2018Updated 8 years ago
- ☆14Apr 6, 2025Updated last year
- Comparing Deep Learning Inference of Pytorch models running on CPU, CUDA and TensorRT☆17Feb 20, 2022Updated 4 years ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆37Jul 6, 2023Updated 3 years ago
- a version of baby agi using dspy and typed predictors☆15Mar 9, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆258Nov 24, 2025Updated 9 months ago
- Sharing the codebase and steps for artifact evaluation for ISCA 2023 paper☆16Feb 20, 2024Updated 2 years ago
- Loop Nest - Linear algebra compiler and code generator.☆20Oct 22, 2022Updated 3 years ago
- ☆54Jul 18, 2024Updated 2 years ago
- Neural Network Implemented in C++: An Object Oriented Approach From Scratch☆14Jun 6, 2019Updated 7 years ago
- ☆19Nov 24, 2025Updated 9 months ago
- Finetuning BLOOM on a single GPU using gradient-accumulation☆32Mar 29, 2023Updated 3 years ago
- ☆28Apr 26, 2023Updated 3 years ago
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆34May 1, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- notebooks of cool EBM visualizations☆15Feb 12, 2021Updated 5 years ago
- ☆23Feb 16, 2022Updated 4 years ago
- Implementation from scratch in CUDA C++ of image processing algorithms.☆25Oct 26, 2020Updated 5 years ago
- Testing paligemma2 finetuning on reasoning dataset☆18Dec 28, 2024Updated last year
- Simple C++ reader for CIFAR-10 dataset☆17Apr 29, 2023Updated 3 years ago
- ☆11Aug 22, 2023Updated 3 years ago
- Object-Centric-Representation Library (OCRL): This repo is to explore OCR on various downstream tasks from supervised learning tasks to R…☆12Feb 23, 2024Updated 2 years ago
- A tiny server to run local inference on MLX model in the style of OpenAI☆13Jan 31, 2024Updated 2 years ago
- All my experiments with the various transformers and various transformer frameworks available☆14Apr 30, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A minimal implementation of vllm.☆73Jul 27, 2024Updated 2 years ago
- Implementations of various parallel algorithms for matrix factorization (including DSGD++)☆16Jul 14, 2017Updated 9 years ago
- ☆30Jul 22, 2024Updated 2 years ago
- https://footprints.baulab.info☆17Oct 4, 2024Updated last year
- Zenodo Developers Site☆18Apr 10, 2026Updated 4 months ago
- ☆13Dec 3, 2021Updated 4 years ago
- ☆10Jul 13, 2026Updated last month