liyuan24 / deepseek_from_scratchLinks
☆16Updated 9 months ago
Alternatives and similar repositories for deepseek_from_scratch
Users that are interested in deepseek_from_scratch are comparing it to the libraries listed below
Sorting:
- GPU Kernels☆218Updated 9 months ago
- 100 days of building GPU kernels!☆567Updated 9 months ago
- ☆411Updated 9 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆457Updated 10 months ago
- ☆235Updated last year
- ☆45Updated 8 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 7 months ago
- This repository is a curated collection of resources, tutorials, and practical examples designed to guide you through the journey of mast…☆435Updated 11 months ago
- A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch☆400Updated 2 months ago
- Slides, notes, and materials for the workshop☆338Updated last year
- ☆409Updated last year
- Best practices & guides on how to write distributed pytorch training code☆571Updated 3 months ago
- ☆593Updated 2 months ago
- Building GPT ...☆18Updated last year
- repo of paper implementations☆20Updated 11 months ago
- Distributed training (multi-node) of a Transformer model☆92Updated last year
- Llama from scratch, or How to implement a paper without crying☆585Updated last year
- PyTorch implementations of algorithms from "Reinforcement Learning: An Introduction by Sutton and Barto", along with various RL research …☆206Updated 5 months ago
- LLaMA 2 implemented from scratch in PyTorch☆365Updated 2 years ago
- Learnings and programs related to CUDA☆431Updated 7 months ago
- Notes and commented code for RLHF (PPO)☆124Updated last year
- Natural Language Processing Courses with Resources☆42Updated 4 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆829Updated 6 months ago
- An extension of the nanoGPT repository for training small MOE models.☆231Updated 10 months ago
- Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.☆280Updated last year
- ☆229Updated 2 months ago
- ☆29Updated last year
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆121Updated 2 years ago
- Recipes to scale inference-time compute of open models☆1,124Updated 8 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆584Updated 3 months ago