Alternatives and similar repositories for BERT-from-Scratch-with-PyTorch

Users that are interested in BERT-from-Scratch-with-PyTorch are comparing it to the libraries listed below

• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆93Updated 11 months ago
• PacktPublishing / Accelerate-Model-Training-with-PyTorch-2.X
  Accelerate Model Training with PyTorch 2.X, published by Packt
  ☆43Updated 11 months ago
• hkproj / dpo-notes
  Notes on Direct Preference Optimization
  ☆19Updated last year
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆51Updated last month
• neubig / nlp-from-scratch-assignment-spring2024
  An assignment for building an NLP system from scratch.
  ☆25Updated last year
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆69Updated last year
• knotgrass / How-Transformers-Work
  🧠 A study guide to learn about Transformers
  ☆11Updated last year
• d-kleine / NER_decoder
  Named Entity Recognition with an decoder-only (autoregressive) LLM using HuggingFace
  ☆42Updated 6 months ago
• neubig / minllama-assignment
  ☆85Updated 7 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆92Updated last year
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆129Updated 2 years ago
• s-smits / modernbert-finetune
  Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training
  ☆66Updated 3 months ago
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆38Updated last month
• genaibook / genaibook
  Contains the public resources of Hands on GenAI book
  ☆142Updated 4 months ago
• markhliu / DGAI
  Learn Generative AI with PyTorch (Manning Publications, 2024)
  ☆96Updated 5 months ago
• nlp-with-transformers / website
  Website for the Natural Language Processing with Transformers book
  ☆25Updated last year
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆217Updated last year
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆50Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆109Updated 7 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 8 months ago
• neubig / anlp-code
  ☆177Updated last year
• VatsaDev / nanoChatGPT
  nanogpt turned into a chat model
  ☆68Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆202Updated last year
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆243Updated last year
• ChanCheeKean / DataScience
  ☆83Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 2 months ago
• aykutcayir34 / DifferentialTransformer
  ☆11Updated 7 months ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆142Updated 2 months ago
• wjbmattingly / qwen2-vl-finetune-huggingface
  This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.
  ☆65Updated 8 months ago