PraveenRaja42 / Tiny-Stories-GPTLinks
A minimal PyTorch re-implementation of GPT (Generative Pretrained Transformer) language model training
☆15Updated last year
Alternatives and similar repositories for Tiny-Stories-GPT
Users that are interested in Tiny-Stories-GPT are comparing it to the libraries listed below
Sorting:
- Jax like function transformation engine but micro, microjax☆33Updated 8 months ago
- LLM training in simple, raw C/CUDA☆14Updated 6 months ago
- ☆38Updated 11 months ago
- Simple repository for training small reasoning models☆33Updated 4 months ago
- ☆22Updated last year
- NanoGPT-speedrunning for the poor T4 enjoyers☆66Updated 2 months ago
- Various handy scripts to quickly setup new Linux and Windows sandboxes, containers and WSL.☆40Updated 2 months ago
- Andrej Kapathy's micrograd implemented in c☆28Updated 10 months ago
- Low-Rank Adaptation of Large Language Models clean implementation☆8Updated last year
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated last year
- QLoRA for Masked Language Modeling☆22Updated last year
- This repository contain the simple llama3 implementation in pure jax.☆67Updated 4 months ago
- gzip Predicts Data-dependent Scaling Laws☆35Updated last year
- A place to store reusable transformer components of my own creation or found on the interwebs☆56Updated this week
- A sample pattern for running CI tests on Modal☆18Updated 2 months ago
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆21Updated last year
- A reading list of relevant papers and projects on foundation model annotation☆27Updated 4 months ago
- ☆27Updated 11 months ago
- ☆34Updated 9 months ago
- ☆9Updated 8 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated 3 weeks ago
- Clean RL implementation using MLX☆32Updated last year
- ☆39Updated last month
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆51Updated last year
- ☆61Updated last year
- Simple GRPO scripts and configurations.☆59Updated 4 months ago
- ☆20Updated last year
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated 5 months ago
- Simplified implementation of UMAP like dimensionality reduction algorithm☆49Updated 7 months ago
- alternative way to calculating self attention☆18Updated last year