krupadav3 / Encoder-Block-in-CUDALinks
Here's all my Python/Numba (CUDA) code for the encoder block I made :)
☆71Updated 9 months ago
Alternatives and similar repositories for Encoder-Block-in-CUDA
Users that are interested in Encoder-Block-in-CUDA are comparing it to the libraries listed below
Sorting:
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆276Updated last year
- This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…☆229Updated last year
- Learnings and programs related to CUDA☆432Updated 7 months ago
- ☆120Updated 2 months ago
- ☆46Updated 10 months ago
- A PyTorch implementation of the GPT-OSS-20B architecture. All components are coded from scratch: RoPE with YaRN, RMSNorm, SwiGLU with cla…☆204Updated 2 months ago
- ☆89Updated 2 weeks ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆85Updated 5 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆198Updated 8 months ago
- (WIP) A small but powerful, homemade PyTorch from scratch.☆672Updated last week
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Updated 10 months ago
- GPU Kernels☆220Updated 9 months ago
- Implementations of Papers that I read, you can read my breakdown in my blog☆89Updated 3 months ago
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆81Updated 8 months ago
- ☆415Updated 9 months ago
- This repository contain the simple llama3 implementation in pure jax.☆71Updated 11 months ago
- A really tiny autograd engine☆99Updated 8 months ago
- Following Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆172Updated last year
- Simple & Scalable Pretraining for Neural Architecture Research☆307Updated 2 months ago
- Repository of implementations of classic and sota rl algorithms from scratch in PyTorch☆221Updated last month
- Learning about CUDA by writing PTX code.☆152Updated last year
- A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch☆402Updated 2 months ago
- Alex Krizhevsky's original code from Google Code☆199Updated 9 years ago
- pytorch from scratch in pure C/CUDA and python☆41Updated last year
- Low memory full parameter finetuning of LLMs☆53Updated 6 months ago
- ☆90Updated last month
- SIMD quantization kernels☆94Updated 5 months ago
- a tiny vectorstore implementation built with numpy.☆64Updated last year
- ☆45Updated 9 months ago
- Quantized LLM training in pure CUDA/C++.☆238Updated 2 weeks ago