Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
☆294Mar 27, 2026Updated 3 months ago
Alternatives and similar repositories for transformer-from-scratch
Users that are interested in transformer-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)☆1,098Mar 20, 2025Updated last year
- Repository collecting resources and best practices to improve experimental rigour in deep learning research.☆27Mar 30, 2023Updated 3 years ago
- Distributed Communication-Optimal Shuffle and Transpose Algorithm☆14Apr 18, 2026Updated 3 months ago
- Distributed Communication-Optimal LU-factorization Algorithm☆12Aug 1, 2021Updated 4 years ago
- Communication Avoiding Numerical Dense Matrix Computations☆11Dec 20, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Simplified PyTorch Implementation of Vision Transformer (ViT)☆256Jun 10, 2024Updated 2 years ago
- Academic papers and works related to SWE-bench and SWE-agents☆15Dec 8, 2025Updated 7 months ago
- ☆23Jun 10, 2025Updated last year
- Code base for the EMNLP 2021 Findings paper: Cartography Active Learning☆14Jun 3, 2025Updated last year
- CSC Training: High-Level GPU Programming☆14Oct 16, 2025Updated 9 months ago
- Pacmed Labs experiments on uncertainty estimation, focusing on unbalanced tabular data and classification tasks.☆21May 26, 2021Updated 5 years ago
- OpenCopilot flows editor☆11Oct 31, 2023Updated 2 years ago
- Quantum Algorithms and Quantum Error Correction codes.☆13Feb 14, 2024Updated 2 years ago
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆33Apr 2, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Source Code for 'Cryptography and Cryptanalysis in MATLAB' by Marius Iulian Mihailescu and Stefania Loredana Nita☆15Sep 14, 2021Updated 4 years ago
- Discrete Bayesian optimization with LLMs, PEFT finetuning methods, and the Laplace approximation.☆23Jul 30, 2024Updated last year
- ☆13Jul 26, 2023Updated 2 years ago
- A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …☆50Dec 6, 2024Updated last year
- Continuous Bag-of-Words (CBOW model implemented in pytorch☆14Feb 27, 2018Updated 8 years ago
- Multiple Generalized Additive Models implemented in Python (EBM, XGB, Spline, FLAM). Code for our KDD 2021 paper "How Interpretable and T…☆14Aug 15, 2021Updated 4 years ago
- [NAACL 2022] TIE: Topological Information Enhanced Structural Reading Comprehension on Web Pages☆22Jun 3, 2022Updated 4 years ago
- Cold Start Similar Artists Ranking with Gravity-Inspired Graph Autoencoders (RecSys 2021)☆19Oct 17, 2021Updated 4 years ago
- Contains slides and hands-on tutorials for understanding and implementing Transformers in Natural Language Processing. Uses the HuggingFa…☆27Jun 28, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Feb 7, 2023Updated 3 years ago
- Concise tutorials for distributed training using PyTorch☆10Apr 18, 2023Updated 3 years ago
- Cross-modal Coherence Modeling for Caption Generation☆11Jul 24, 2020Updated 5 years ago
- A repository for the EMNLP 2021 paper "Is Information Density Uniform in Task-Oriented Dialogues?" and for the CoNLL 2021 paper "Analysin…☆10Jun 17, 2024Updated 2 years ago
- Dataset used to evaluate Skill Extraction systems based on the ESCO skills taxonomy.☆17Jul 18, 2024Updated 2 years ago
- This is the implemention of named entity recognition model☆29Jul 7, 2020Updated 6 years ago
- Universal style in autonn☆14Mar 6, 2018Updated 8 years ago
- ☆11Oct 15, 2021Updated 4 years ago
- ☆11Aug 3, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Algorithms written in Python and Explained using Jupyter 📓 from the Cryptography 🔐 Book ~Forouzan.☆18Feb 20, 2022Updated 4 years ago
- ☆13Mar 22, 2023Updated 3 years ago
- SKILLSPAN: Competences as Spans for Skill Extraction from Job Postings☆68Feb 13, 2025Updated last year
- FeelingBlue: A Corpus for Understanding the Emotional Connotation of Color in Context, accepted at TACL 2022, presented at ACL 2023☆13Dec 28, 2023Updated 2 years ago
- Imshow - Flexible and Customizable Image Display with Python☆14Dec 27, 2025Updated 6 months ago
- Lets build a Deep Learning Framework!☆28Mar 12, 2026Updated 4 months ago
- Monitoring of AI Regulations☆19May 30, 2021Updated 5 years ago