Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
☆295Mar 27, 2026Updated 4 months ago
Alternatives and similar repositories for transformer-from-scratch
Users that are interested in transformer-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)☆1,097Mar 20, 2025Updated last year
- The code for the video tutorial series on building a Transformer from scratch: https://www.youtube.com/watch?v=XR4VDnJzB8o☆19Apr 15, 2023Updated 3 years ago
- Repository for "BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluation", accepted at EAMT 2…☆21Jul 19, 2023Updated 3 years ago
- Overview of corpora/datasets for Germanic low-resource languages and dialects. Accompanies "A Survey of Corpora for Germanic Low-Resource…☆28Feb 16, 2026Updated 5 months ago
- ☆23Jun 10, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code base for the EMNLP 2021 Findings paper: Cartography Active Learning☆14Jun 3, 2025Updated last year
- Python package to augment multilingual data☆15Feb 15, 2023Updated 3 years ago
- Code for Neural Estimation of the Rate-Distortion Function With Applications to Operational Source Coding☆14Nov 2, 2023Updated 2 years ago
- CSC Training: High-Level GPU Programming☆14Oct 16, 2025Updated 9 months ago
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆50Dec 6, 2024Updated last year
- ☆23May 6, 2020Updated 6 years ago
- ☆18Mar 20, 2019Updated 7 years ago
- A community repository for benchmarking Bayesian methods☆11May 25, 2023Updated 3 years ago
- Repository for DEMETR: Diagnosing Evaluation Metrics for Translation☆17Nov 29, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Laplace Redux -- Effortless Bayesian Deep Learning☆46Jun 6, 2025Updated last year
- RRT*(RRT Star)-based algorithms for Path Planning of Autonomous Driving, in Python2.☆12Jun 28, 2020Updated 6 years ago
- [NAACL 2022] TIE: Topological Information Enhanced Structural Reading Comprehension on Web Pages☆22Jun 3, 2022Updated 4 years ago
- Source code for paper "Discrete Latent Factor Model for Cross-Modal Hashing"☆18Aug 21, 2020Updated 5 years ago
- Concise tutorials for distributed training using PyTorch☆10Apr 18, 2023Updated 3 years ago
- Cross-modal Coherence Modeling for Caption Generation☆11Jul 24, 2020Updated 6 years ago
- Riemannian metrics to measure distances in latent space of VAEs☆14Jan 7, 2019Updated 7 years ago
- This repository contains examples of using PaliGemma for tasks such as object detection, segmentation, image captioning, etc.☆22Feb 17, 2025Updated last year
- ☆10Oct 27, 2020Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆11Sep 28, 2022Updated 3 years ago
- ☆17Jun 8, 2021Updated 5 years ago
- ☆11Oct 15, 2021Updated 4 years ago
- CrossRE: A Cross-Domain Dataset for Relation Extraction (Findings of EMNLP 2022)☆49Aug 20, 2024Updated last year
- [TOIS 2024] Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue☆14Oct 18, 2025Updated 9 months ago
- ☆18May 25, 2026Updated 2 months ago
- Awesome list for asm2vec☆17Feb 1, 2021Updated 5 years ago
- ☆14Apr 12, 2026Updated 3 months ago
- Pure pursuit algorithm with PI control☆15Oct 30, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Oct 4, 2022Updated 3 years ago
- ☆12Dec 8, 2022Updated 3 years ago
- ☆13May 10, 2022Updated 4 years ago
- A step-by-step tutorial about how to use Distributed Data Parallel feature of PyTorch☆16Nov 20, 2020Updated 5 years ago
- A rule-based algorithm enabled the automatic extraction of disease labels from tens of thousands of radiology reports. These weak labels …☆12Apr 6, 2025Updated last year
- This code adds camera streaming, zooming, image capturing, and video recording using openCV.☆34Jul 27, 2020Updated 6 years ago
- Scalable GPU Kernel Fission/Fusion Transformation for Memory-Bound Kernels☆14Aug 26, 2015Updated 10 years ago