Alternatives and similar repositories for gpt2-from-scratch

Users that are interested in gpt2-from-scratch are comparing it to the libraries listed below

• akhi07rx / WIFI-Password-Recovery
  Recover Wi-Fi Password Using CMD, Windows PowerShell
  ☆12Updated last year
• SzymonOzog / GPU_Programming
  ☆54Updated last week
• cosmo3769 / Quantized-LLMs
  Quantization of LLMs and benchmarking.
  ☆10Updated last year
• zhangpiu / llm.cpp
  LLM training in simple, C++/CUDA(with Eigen3)
  ☆14Updated 9 months ago
• thevasudevgupta / gpt-triton
  Triton implementation of GPT/LLAMA
  ☆18Updated 9 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆105Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆329Updated last year
• Blaizzy / Coding-LLMs-from-scratch
  ☆31Updated 11 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆185Updated this week
• hkproj / multi-latent-attention
  ☆36Updated 2 weeks ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆46Updated last year
• Laz4rz / mup
  Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation
  ☆14Updated 2 weeks ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆204Updated last year
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆196Updated last month
• Programmer-RD-AI / Programmer-RD-AI
  Personal GitHub profile showcasing AI, machine learning, and software development expertise.
  ☆10Updated 3 weeks ago
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆36Updated 2 months ago
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆93Updated last year
• hkproj / triton-flash-attention
  ☆169Updated 5 months ago
• SwayamInSync / MIRA
  MIRA - Multimodal Image Reconstruction with Attention is a transformer (Encoder-Decoder) based architecture for Text / Image to 3D recons…
  ☆13Updated last year
• hu-po / docs
  documentation for content creation
  ☆199Updated this week
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆220Updated last year
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆132Updated 6 months ago
• VikParuchuri / triton_tutorial
  Tutorials for Triton, a language for writing gpu kernels
  ☆18Updated last year
• evintunador / minGemma
  a simplified version of Google's Gemma model to be used for learning
  ☆25Updated last year
• liyuan24 / deepseek_from_scratch
  ☆14Updated last month
• HeegyuKim / torch-xla-SPMD
  Pytorch/XLA SPMD Test code in Google TPU
  ☆23Updated last year
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆301Updated last month
• broskicodes / slms
  Experimenting with small language models
  ☆67Updated last year
• NVlabs / hymba
  ☆178Updated 5 months ago
• shreydan / VisionGPT2
  Combining ViT and GPT-2 for image captioning. Trained on MS-COCO. The model was implemented mostly from scratch.
  ☆42Updated last year