This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.
☆94Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for pytorch-memory-optim
Users that are interested in pytorch-memory-optim are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Gzip and nearest neighbors for text classification☆57Aug 1, 2023Updated 3 years ago
- Materials for "Transformers from the Ground Up" at PyData Jeddah on August 5, 2021☆20Aug 5, 2021Updated 5 years ago
- ☆17Jun 19, 2023Updated 3 years ago
- Removing empty droplets in multiome datasets☆17Jun 3, 2024Updated 2 years ago
- ☆10Nov 6, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.☆16Sep 18, 2024Updated last year
- ☆130Oct 25, 2023Updated 2 years ago
- Distilling key points, reorganizing, and modestly augmenting the points from books and lectures.☆12May 17, 2026Updated 2 months ago
- Python Vascular Network Analysis☆28Aug 2, 2026Updated last week
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆24Oct 5, 2024Updated last year
- AI-powered browser extension to chat with any webpage☆10Aug 12, 2025Updated 11 months ago
- Fairness in single-cell data☆21Mar 25, 2026Updated 4 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆37Jul 6, 2023Updated 3 years ago
- Python intefrace for evaluation on chatgpt models☆19Feb 13, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆255Nov 24, 2025Updated 8 months ago
- ☆16Jun 12, 2023Updated 3 years ago
- ☆54Jul 18, 2024Updated 2 years ago
- Source code for COLING 2022 paper "Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models"☆24Sep 21, 2022Updated 3 years ago
- ☆19Nov 24, 2025Updated 8 months ago
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 2 years ago
- ☆28Apr 26, 2023Updated 3 years ago
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆34May 1, 2025Updated last year
- Handy list of network visualisation libraries for R☆12Nov 11, 2019Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- notebooks of cool EBM visualizations☆15Feb 12, 2021Updated 5 years ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆33Jul 28, 2023Updated 3 years ago
- Testing paligemma2 finetuning on reasoning dataset☆18Dec 28, 2024Updated last year
- Object-Centric-Representation Library (OCRL): This repo is to explore OCR on various downstream tasks from supervised learning tasks to R…☆12Feb 23, 2024Updated 2 years ago
- A tiny server to run local inference on MLX model in the style of OpenAI☆13Jan 31, 2024Updated 2 years ago
- All my experiments with the various transformers and various transformer frameworks available☆14Apr 30, 2021Updated 5 years ago
- A minimal implementation of vllm.☆73Jul 27, 2024Updated 2 years ago
- ☆11Nov 5, 2021Updated 4 years ago
- Identify the unused properties in your CSS☆15Jan 5, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Zenodo Developers Site☆18Apr 10, 2026Updated 3 months ago
- ☆13Dec 3, 2021Updated 4 years ago
- Elrond NFT minting platform POC (Also check out: www.elven.tools)☆12Aug 10, 2023Updated 3 years ago
- Welcome to Power BI Embedded Step by Step Series. Using this GitHub Repository you can download complete solution.☆15Jan 2, 2021Updated 5 years ago
- The fully connected neural network implemented in Numpy, from scratch, in Tensorflow and in Keras. The bonus code: Implementation of many…☆12Jul 28, 2017Updated 9 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆88Mar 14, 2022Updated 4 years ago
- [EMNLP’24 Main] Encoding and Controlling Global Semantics for Long-form Video Question Answering☆18Oct 9, 2024Updated last year