AliHaiderAhmad001 / BERT-from-Scratch-with-PyTorchLinks
Implementation of BERT-based Language Models
☆23Updated last year
Alternatives and similar repositories for BERT-from-Scratch-with-PyTorch
Users that are interested in BERT-from-Scratch-with-PyTorch are comparing it to the libraries listed below
Sorting:
- Contains the public resources of Hands on GenAI book☆208Updated 10 months ago
- Tutorial for how to build BERT from scratch☆101Updated last year
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆321Updated 2 years ago
- Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.☆270Updated last year
- Learn Generative AI with PyTorch (Manning Publications, 2024)☆126Updated 5 months ago
- Accelerate Model Training with PyTorch 2.X, published by Packt☆47Updated last week
- PDFs and Codelabs for the Efficient Deep Learning book.☆202Updated 2 years ago
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆117Updated 2 years ago
- Llama from scratch, or How to implement a paper without crying☆580Updated last year
- LoRA and DoRA from Scratch Implementations☆211Updated last year
- ☆126Updated 9 months ago
- Playground for Transformers☆53Updated last year
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆190Updated last year
- ☆82Updated last year
- 🧠 A study guide to learn about Transformers☆12Updated last year
- Getting Started with PyTorch Lightning, Published by Packt☆161Updated 2 months ago
- Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation: https://www.youtube.com/watch?v=vAmKB7iPkWw☆566Updated 11 months ago
- LLaMA 2 implemented from scratch in PyTorch☆358Updated 2 years ago
- A work in progress. Trying to write about all interesting or necessary pieces in the current development of LLMs and generative AI. Gra…☆198Updated 2 years ago
- Attention Is All You Need | a PyTorch Tutorial to Transformers☆355Updated last year
- ☆189Updated last year
- Machine Learning Q and AI book☆682Updated 2 months ago
- Distributed training (multi-node) of a Transformer model☆86Updated last year
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆160Updated last year
- ☆393Updated 10 months ago
- Research projects built on top of Transformers☆96Updated 8 months ago
- Transformers 3rd Edition☆456Updated 3 months ago
- I will build Transformer from scratch☆86Updated 3 months ago
- Python code (in the form of Jupyter ipython notebooks) to support the book "Math and Architectures of Deep Learning" (Krishnendu Chaudhur…☆222Updated last year
- ☆158Updated last year