Transformer: PyTorch Implementation of "Attention Is All You Need"
☆4,606Jul 15, 2025Updated 11 months ago
Alternatives and similar repositories for transformer
Users that are interested in transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A PyTorch implementation of the Transformer model in "Attention is All You Need".☆9,754Apr 16, 2024Updated 2 years ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,430May 19, 2023Updated 3 years ago
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Py…☆25,405Jun 22, 2026Updated 3 weeks ago
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆162,403Updated this week
- An annotated implementation of the Transformer paper.☆7,365Apr 7, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A TensorFlow Implementation of the Transformer: Attention Is All You Need☆4,470May 21, 2023Updated 3 years ago
- 🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, fee…☆67,068Jan 22, 2026Updated 5 months ago
- Implementation of Denoising Diffusion Probabilistic Model in Pytorch☆10,626Feb 11, 2026Updated 5 months ago
- ☆12,627Jul 2, 2026Updated last week
- This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".☆15,983Jul 24, 2024Updated last year
- CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image☆33,935Mar 25, 2026Updated 3 months ago
- 深度学习经典、新论文逐段精读☆33,550Mar 22, 2025Updated last year
- Google AI 2018 BERT pytorch implementation☆6,532Sep 15, 2023Updated 2 years ago
- The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --…☆36,958Jul 4, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fast and memory-efficient exact attention☆24,389Updated this week
- Mamba SSM architecture☆18,575Updated this week
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆73,120Updated this week
- Transformer implementation in PyTorch.☆491Mar 7, 2019Updated 7 years ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆21,369Updated this week
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"☆13,651Dec 17, 2024Updated last year
- A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"☆579Oct 1, 2020Updated 5 years ago
- This repository contains demos I made with the Transformers library by HuggingFace.☆11,672Apr 20, 2026Updated 2 months ago
- Latest Advances on Multimodal Large Language Models☆17,921Jul 2, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.☆5,700Jan 20, 2024Updated 2 years ago
- Attention is all you need implementation☆1,245Jun 8, 2024Updated 2 years ago
- Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"☆8,665May 31, 2024Updated 2 years ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆60,878Nov 12, 2025Updated 8 months ago
- Implementation of Transformer model (originally from Attention is All You Need) applied to Time Series.☆906Apr 8, 2026Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆85,665Updated this week
- A Collection of Variational Autoencoders (VAE) in PyTorch.☆7,655Mar 21, 2025Updated last year
- Train transformer language models with reinforcement learning.☆18,793Updated this week
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆24,682Aug 15, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Inference code for Llama models☆59,500Jan 26, 2025Updated last year
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆22,157Jan 23, 2026Updated 5 months ago
- 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）☆24,702Jul 1, 2026Updated last week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆42,685Updated this week
- PyTorch implementations of Generative Adversarial Networks.☆17,462Jun 18, 2024Updated 2 years ago
- Curation note of NLP datasets☆99Dec 6, 2022Updated 3 years ago
- PyTorch Tutorial for Deep Learning Researchers☆32,407Aug 15, 2023Updated 2 years ago