Alternatives and similar repositories for deepseek_from_scratch

Users that are interested in deepseek_from_scratch are comparing it to the libraries listed below

• 1y33 / 100Days
  GPU Kernels
  ☆209Updated 7 months ago
• a-hamdi / GPU
  100 days of building GPU kernels!
  ☆540Updated 7 months ago
• hkproj / triton-flash-attention
  ☆219Updated 10 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆437Updated 8 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆196Updated 5 months ago
• stanford-cs336 / spring2024-lectures
  ☆399Updated 11 months ago
• hkproj / 100-days-of-gpu
  ☆398Updated 7 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆118Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆360Updated 2 years ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆543Updated last month
• SwekeR-463 / Papers-Implemented
  repo of paper implementations
  ☆20Updated 9 months ago
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆390Updated 2 weeks ago
• hkproj / multi-latent-attention
  ☆45Updated 6 months ago
• ThinamXx / build-GPT
  Building GPT ...
  ☆18Updated 11 months ago
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆73Updated 3 months ago
• huggingface / picotron_tutorial
  ☆225Updated last month
• Open-Deep-ML / DML-OpenProblem
  ☆555Updated 2 weeks ago
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆68Updated 8 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆117Updated 2 years ago
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆334Updated last year
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆324Updated 2 years ago
• bkitano / llama-from-scratch
  Llama from scratch, or How to implement a paper without crying
  ☆580Updated last year
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆826Updated 4 months ago
• kmohan321 / LLMs
  ☆90Updated 7 months ago
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆562Updated last month
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆87Updated last year
• Cohere-Labs-Community / AI-Alignment-Cohort
  ☆29Updated last year
• stanford-cs336 / assignment5-alignment
  ☆78Updated 4 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆215Updated 8 months ago
• silvaxxx1 / MyLLM
  "LLM from Zero to Hero: An End-to-End Large Language Model Journey from Data to Application!"
  ☆141Updated last week