This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.
☆94Jul 14, 2023Updated 3 years ago
Alternatives and similar repositories for pytorch-memory-optim
Users that are interested in pytorch-memory-optim are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Jun 19, 2023Updated 3 years ago
- ☆29Apr 26, 2023Updated 3 years ago
- A package that helps visualize the comments while writing LaTeX☆33Oct 15, 2026Updated 2 weeks ago
- ☆130Oct 25, 2023Updated 3 years ago
- Finetuning BLOOM on a single GPU using gradient-accumulation☆32Mar 29, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LoRA and DoRA from Scratch Implementations☆231Mar 5, 2024Updated 2 years ago
- ☆14Jul 22, 2026Updated 3 months ago
- This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)☆56May 22, 2023Updated 3 years ago
- ☆10Nov 6, 2024Updated last year
- ☆51Jan 18, 2024Updated 2 years ago
- ☆15Feb 13, 2018Updated 8 years ago
- TinySNN lets you build tiny spiking neural networks in C.☆10Oct 13, 2020Updated 6 years ago
- A web-based platform for annotating short-text documents to be used in applied text-mining based research.☆10Jan 28, 2021Updated 5 years ago
- ☆15Oct 8, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Scaling Sparse Fine-Tuning to Large Language Models☆20Jan 31, 2024Updated 2 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆88Mar 14, 2022Updated 4 years ago
- AI-powered browser extension to chat with any webpage☆10Aug 12, 2025Updated last year
- ☆12Jul 2, 2024Updated 2 years ago
- [AAAI’24 Main] READ: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Vi…☆10Jan 24, 2025Updated last year
- Read custom dataset☆12Mar 31, 2023Updated 3 years ago
- Neural Network Implemented in C++: An Object Oriented Approach From Scratch☆14Jun 6, 2019Updated 7 years ago
- Python intefrace for evaluation on chatgpt models☆19Feb 13, 2024Updated 2 years ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"☆400Feb 24, 2024Updated 2 years ago
- Instruction dataset for Arabic with 10,000 instruction and output pairs. CIDAR can be used to fine-tune LLMs to follow instructions.☆45Apr 3, 2025Updated last year
- QLoRA for Masked Language Modeling☆23Sep 11, 2023Updated 3 years ago
- FIWARE 401: IDM - Managing Users and Organizations☆10May 15, 2026Updated 5 months ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Aug 25, 2023Updated 3 years ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆279Nov 3, 2023Updated 2 years ago
- Testing paligemma2 finetuning on reasoning dataset☆18Dec 28, 2024Updated last year
- ☆16Apr 20, 2020Updated 6 years ago
- Implementations of various parallel algorithms for matrix factorization (including DSGD++)☆16Jul 14, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Power Platform Connectors snippets☆11Aug 11, 2022Updated 4 years ago
- A minimal implementation of vllm.☆73Jul 27, 2024Updated 2 years ago
- Open-weights speaker diarization for pyannote.audio 4.x: WavLM-Base+ / Conformer segmentation + SimAM-ResNet34 embeddings, by Reway.☆23Sep 10, 2026Updated last month
- ☆54Jul 18, 2024Updated 2 years ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,082Jul 1, 2025Updated last year
- Handy list of network visualisation libraries for R☆12Nov 11, 2019Updated 6 years ago
- Chrome Extension for YouTube. Acts as an assistant for the YouTube video you are watching☆22Apr 26, 2023Updated 3 years ago