Alternatives and similar repositories for BERT-from-Scratch-with-PyTorch:

Users that are interested in BERT-from-Scratch-with-PyTorch are comparing it to the libraries listed below

• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆92Updated 11 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆202Updated last year
• timothelaborie / text_classification_scripts
  Scripts for text classification with llama and bert
  ☆14Updated 3 weeks ago
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆68Updated 11 months ago
• PacktPublishing / Accelerate-Model-Training-with-PyTorch-2.X
  Accelerate Model Training with PyTorch 2.X, published by Packt
  ☆43Updated 10 months ago
• AIMO-CMU-MATH / CMU_MATH-AIMO
  ☆76Updated 9 months ago
• tensorops / TransformerX
  Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)
  ☆53Updated last year
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆49Updated last year
• knotgrass / How-Transformers-Work
  🧠 A study guide to learn about Transformers
  ☆11Updated last year
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆42Updated 3 weeks ago
• CRCTransformers / deepdive-book
  ☆171Updated 2 years ago
• neubig / minllama-assignment
  ☆85Updated 7 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆86Updated last year
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆150Updated 10 months ago
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆46Updated last year
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆17Updated 10 months ago
• FareedKhan-dev / create-stable-diffusion-from-scratch
  Implemented a stable diffusion architecture using PyTorch.
  ☆58Updated last year
• stanford-cs336 / assignment1-basics
  Student version of Assignment 1 for Stanford CS336 - Language Modeling From Scratch
  ☆51Updated last week
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆131Updated last month
• rsshyam / GRPO
  ☆57Updated 8 months ago
• genaibook / genaibook
  Contains the public resources of Hands on GenAI book
  ☆126Updated 3 months ago
• chainyo / transformers-pipeline-onnx
  How to export Hugging Face's 🤗 NLP Transformers models to ONNX and use the exported model with the appropriate Transformers pipeline.
  ☆24Updated 3 years ago
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆82Updated 3 months ago
• hkproj / triton-flash-attention
  ☆157Updated 3 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆65Updated last year
• nickd16 / Diffusion-Models-from-Scratch
  Implementation of different diffusion models for probabilistic image generation
  ☆24Updated 9 months ago
• hbchen-one / Transformer-Models-from-Scratch
  implementing various transformer models for various tasks
  ☆65Updated 2 years ago
• wjbmattingly / qwen2-vl-finetune-huggingface
  This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.
  ☆65Updated 7 months ago
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆157Updated 8 months ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated last year