A place to store reusable transformer components of my own creation or found on the interwebs
☆84Oct 26, 2026Updated last week
Alternatives and similar repositories for transformer_nuggets
Users that are interested in transformer_nuggets are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Dec 4, 2025Updated 11 months ago
- Personal solutions to the Triton Puzzles☆22Jul 18, 2024Updated 2 years ago
- Mixtral finetuning☆19Feb 2, 2024Updated 2 years ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆160Updated this week
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Jan 20, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Quirky Assortment of CuTe Kernels☆1,189Updated this week
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 3 years ago
- ☆182Feb 3, 2024Updated 2 years ago
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated 7 months ago
- This repository contains the experimental PyTorch native float8 training UX☆226Aug 1, 2024Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆92Sep 22, 2025Updated last year
- Helpful tools and examples for working with flex-attention☆1,263Updated this week
- ☆21Mar 3, 2025Updated last year
- ☆12Mar 18, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆18Mar 18, 2024Updated 2 years ago
- Easy recipes to speed up latency of Flux, QwenImage, and LTX-2 with NVFP4 and MXFP8 on Blackwell.☆14Apr 10, 2026Updated 6 months ago
- torch_remat fine-grained activation checkpointing API☆23Updated this week
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated 2 years ago
- kernelboard is the webapp for https://www.gpumode.com☆20Updated this week
- Ship correct and fast LLM kernels to PyTorch☆156Jan 14, 2026Updated 9 months ago
- NSA Triton Kernels written with GPT5 and Opus 4.1☆71Aug 12, 2025Updated last year
- ☆77Dec 10, 2025Updated 10 months ago
- Prototype routines for GPU quantization written using PyTorch.☆21Apr 15, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation and explorations into DiscoRL, Discovering state-of-the-art reinforcement learning algorithms, David Silver's last work at…☆22Oct 20, 2026Updated 2 weeks ago
- Accelerated First Order Parallel Associative Scan☆197Jan 7, 2026Updated 9 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Jun 21, 2023Updated 3 years ago
- ☆365Updated this week
- ☆17Jun 19, 2023Updated 3 years ago
- ☆126May 28, 2024Updated 2 years ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆196May 6, 2024Updated 2 years ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆605Aug 14, 2026Updated 2 months ago
- extensible collectives library in triton☆98Mar 31, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- User facing skill definitions for PyTorch users☆12Sep 28, 2026Updated last month
- A PyTorch native platform for training generative AI models☆5,871Updated this week
- ☆72May 22, 2023Updated 3 years ago
- What would you do with 1000 H100s...☆1,202Jan 10, 2024Updated 2 years ago
- ☆18Jul 28, 2023Updated 3 years ago
- ☆65Apr 26, 2025Updated last year
- Optimizing diffusion for production-ready speeds☆41Jan 10, 2026Updated 9 months ago