Chillee / llm.c
LLM training in simple, raw C/CUDA
☆17Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for llm.c
- Gpu benchmark☆43Updated last month
- ☆51Updated 6 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆20Updated this week
- ☆49Updated 7 months ago
- ☆82Updated 8 months ago
- A really tiny autograd engine☆87Updated 6 months ago
- a highly efficient compression algorithm for the n1 implant (neuralink's compression challenge)☆45Updated 5 months ago
- Video+code lecture on building nanoGPT from scratch☆64Updated 4 months ago
- ☆27Updated 4 months ago
- σ-GPT: A New Approach to Autoregressive Models☆59Updated 2 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 2 months ago
- look how they massacred my boy☆53Updated 3 weeks ago
- Jax like function transformation engine but micro, microjax☆26Updated 2 weeks ago
- Because it's there.☆14Updated last month
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆60Updated 5 months ago
- Simple Transformer in Jax☆115Updated 4 months ago
- Low-Rank Adaptation of Large Language Models clean implementation☆9Updated last year
- implementation of https://arxiv.org/pdf/2312.09299☆19Updated 4 months ago
- Collection of autoregressive model implementation☆66Updated this week
- ☆72Updated 4 months ago
- alternative way to calculating self attention☆18Updated 5 months ago
- Multi-Layer Key-Value sharing experiments on Pythia models☆32Updated 4 months ago
- Exploration into the Firefly algorithm in Pytorch☆35Updated last month
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆49Updated 7 months ago
- ☆55Updated 11 months ago
- RWKV-7: Surpassing GPT☆40Updated this week
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆20Updated 4 months ago
- [WIP] Transformer to embed Danbooru labelsets☆13Updated 7 months ago
- Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2☆16Updated this week
- Testing LLM reasoning abilities with family relationship quizzes.☆42Updated 2 weeks ago