Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch
☆98Aug 7, 2023Updated 2 years ago
Alternatives and similar repositories for transformer-from-scratch
Users that are interested in transformer-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Sep 17, 2022Updated 3 years ago
- AltugCar on 0xMonaco☆10Aug 22, 2022Updated 3 years ago
- Template repo for Python projects, especially those focusing on machine learning and/or deep learning.☆15Jan 14, 2026Updated 5 months ago
- Port of OpenAI's Whisper model in C/C++☆10Jul 12, 2023Updated 2 years ago
- Simple implementation of a GPT (training and inference) in PyTorch.☆13Dec 11, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implementation of VQ-VAE with a GPT-style sampler in the JAX and Haiku ecosystem.☆11Nov 23, 2023Updated 2 years ago
- AniPortrait with Gradio: Audio-Driven Synthesis of Photorealistic Portrait Animation☆22Mar 31, 2024Updated 2 years ago
- Using satellite imagery to identify the leading indicators of deforestation.☆18May 23, 2021Updated 5 years ago
- Demo of using Airflow☆11Jun 24, 2022Updated 3 years ago
- CS231n Convolutional Neural Networks for Visual Recognition☆12Aug 17, 2021Updated 4 years ago
- foundry-x-chainlink☆32Mar 17, 2022Updated 4 years ago
- Code to generate textbooks using GPT as well as several fully-generated examples☆19Jan 18, 2023Updated 3 years ago
- Code example for pretraining an LLM with vanilla PyTorch training loop☆10Jun 6, 2024Updated 2 years ago
- Project for Course Database System in Fudan and also ERP System for NGO(上海彩虹桥公益社)☆10May 11, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Ring Signature-like Protocol for Anonymous Ethereum Signatures☆11Nov 21, 2024Updated last year
- ☆14Jun 29, 2017Updated 8 years ago
- ☆35Jul 8, 2022Updated 3 years ago
- A multy-layer feed-forward neural network implementation in assembly x86 32 bits☆21Dec 1, 2019Updated 6 years ago
- Easy OCR demo + Invoice for Youtube☆11Jul 15, 2020Updated 5 years ago
- Feature Selection using Simulated Annealing☆11Aug 10, 2022Updated 3 years ago
- Demonstrating the usage of FGYM: A Toolkit for benchmarking FPGA-accelerated Reinforcement Learning☆14Aug 12, 2021Updated 4 years ago
- Search for a model and corresponding hyperparameters that best model your data☆11Mar 7, 2026Updated 3 months ago
- Demo of crawl 20 years lottery data and do EDA☆11May 6, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Web3 video platform, powered by the Lens Protocol.☆33Nov 3, 2022Updated 3 years ago
- Cerule - A Tiny Mighty Vision Model☆70Nov 9, 2025Updated 7 months ago
- ☆10Mar 17, 2021Updated 5 years ago
- Deep Unsupervised Learning Course Tracking☆10Oct 23, 2020Updated 5 years ago
- ☆13Jul 25, 2020Updated 5 years ago
- ☆41May 31, 2022Updated 4 years ago
- A curated list of awesome quantum computing resources. Inspired by the various awesome-* projects☆11Feb 26, 2017Updated 9 years ago
- A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…☆105Nov 24, 2023Updated 2 years ago
- This repository contains source codes for SoftCTC. Original paper can be found here: https://arxiv.org/abs/2212.02135☆19Mar 7, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- https://rinkeby.etherscan.io/address/0xffb9205c84d0b209c215212a3cdfc50bf1cfb0e0#code☆40Jan 18, 2022Updated 4 years ago
- Low-cost and fast L2 to L1 token withdrawal☆10Feb 9, 2022Updated 4 years ago
- Long-context pretrained encoder-decoder models☆96Oct 28, 2022Updated 3 years ago
- python re-implementation of stochastic fractal search☆12Jan 29, 2021Updated 5 years ago
- ☆11Oct 26, 2022Updated 3 years ago
- [Optimism] State Dumps & Regenesis Automation☆15Apr 10, 2021Updated 5 years ago
- The Object-Oriented-Programming (OOP) version of the "Coffee Machine Project" from Dr. Angela Yu's Python Bootcamp (London App Brewery)☆17Jan 7, 2023Updated 3 years ago