liyuan24 / deepseek_from_scratchLinks
☆16Updated 8 months ago
Alternatives and similar repositories for deepseek_from_scratch
Users that are interested in deepseek_from_scratch are comparing it to the libraries listed below
Sorting:
- GPU Kernels☆212Updated 8 months ago
- 100 days of building GPU kernels!☆555Updated 8 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 6 months ago
- ☆228Updated 11 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆444Updated 9 months ago
- LLaMA 2 implemented from scratch in PyTorch☆363Updated 2 years ago
- ☆45Updated 7 months ago
- repo of paper implementations☆20Updated 10 months ago
- Building GPT ...☆18Updated last year
- ☆406Updated 8 months ago
- Notes and commented code for RLHF (PPO)☆120Updated last year
- A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch☆397Updated last month
- ☆225Updated last month
- Distributed training (multi-node) of a Transformer model☆90Updated last year
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆118Updated 2 years ago
- ☆403Updated last year
- Best practices & guides on how to write distributed pytorch training code☆553Updated 2 months ago
- Slides, notes, and materials for the workshop☆337Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆219Updated 9 months ago
- PyTorch implementations of algorithms from "Reinforcement Learning: An Introduction by Sutton and Barto", along with various RL research …☆206Updated 4 months ago
- Notes about LLaMA 2 model☆71Updated 2 years ago
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆333Updated 2 years ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆49Updated last year
- ☆49Updated last week
- ☆548Updated last year
- This repository is a curated collection of resources, tutorials, and practical examples designed to guide you through the journey of mast…☆428Updated 10 months ago
- Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/☆69Updated 9 months ago
- ☆568Updated last month
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆569Updated 2 months ago
- Llama from scratch, or How to implement a paper without crying☆581Updated last year