This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.
☆94Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for pytorch-memory-optim
Users that are interested in pytorch-memory-optim are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- scikit-learn: machine learning in Python☆17Oct 16, 2021Updated 5 years ago
- ☆17Jun 19, 2023Updated 3 years ago
- Convert arctic_shift Reddit data dumps into thread-view documents☆11Jun 19, 2024Updated 2 years ago
- ☆29Apr 26, 2023Updated 3 years ago
- ☆129Oct 25, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Finetuning BLOOM on a single GPU using gradient-accumulation☆31Mar 29, 2023Updated 3 years ago
- Gzip and nearest neighbors for text classification☆57Aug 1, 2023Updated 3 years ago
- LoRA and DoRA from Scratch Implementations☆232Mar 5, 2024Updated 2 years ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆37Jul 6, 2023Updated 3 years ago
- Python scripts for generating images of Lego structures (masks, normals, Blender Cycles renders) for training ML models.☆14Jan 20, 2022Updated 4 years ago
- This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)☆56May 22, 2023Updated 3 years ago
- Materials for "Transformers from the Ground Up" at PyData Jeddah on August 5, 2021☆20Aug 5, 2021Updated 5 years ago
- Modular, flexible, cross-platform workload profiling and characterization☆13Mar 1, 2021Updated 5 years ago
- ☆52Jan 18, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is a simple guide to help you build an Anthropic Claude Sonnet 3.5 chatbot interface with Gradio☆13Jun 23, 2024Updated 2 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆38Jun 14, 2022Updated 4 years ago
- ☆11Jan 11, 2024Updated 2 years ago
- TinySNN lets you build tiny spiking neural networks in C.☆10Oct 13, 2020Updated 6 years ago
- Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.☆26Jan 31, 2022Updated 4 years ago
- Images processing library☆11Jul 20, 2024Updated 2 years ago
- a version of baby agi using dspy and typed predictors☆15Mar 9, 2024Updated 2 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆88Mar 14, 2022Updated 4 years ago
- AI-powered browser extension to chat with any webpage☆10Aug 12, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Explore the content of Arabic text datasets.☆18May 23, 2022Updated 4 years ago
- PyTorch examples modified to run in gem5 in reasonable time☆10Jun 29, 2024Updated 2 years ago
- ☆15Feb 13, 2018Updated 8 years ago
- Scaling Sparse Fine-Tuning to Large Language Models☆20Jan 31, 2024Updated 2 years ago
- ☆12Jul 2, 2024Updated 2 years ago
- Python intefrace for evaluation on chatgpt models☆19Feb 13, 2024Updated 2 years ago
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 3 years ago
- notebooks of cool EBM visualizations☆15Feb 12, 2021Updated 5 years ago
- ☆17Oct 8, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆20Nov 24, 2025Updated 11 months ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated 2 years ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆280Nov 3, 2023Updated 3 years ago
- Testing paligemma2 finetuning on reasoning dataset☆18Dec 28, 2024Updated last year
- Instruction dataset for Arabic with 10,000 instruction and output pairs. CIDAR can be used to fine-tune LLMs to follow instructions.☆45Apr 3, 2025Updated last year
- Simple C++ reader for CIFAR-10 dataset☆17Apr 29, 2023Updated 3 years ago
- A tiny server to run local inference on MLX model in the style of OpenAI☆13Jan 31, 2024Updated 2 years ago
Are these results useful?