angry-kratos / Simple_Llama3_from_scratchLinks
☆31Updated last year
Alternatives and similar repositories for Simple_Llama3_from_scratch
Users that are interested in Simple_Llama3_from_scratch are comparing it to the libraries listed below
Sorting:
- ☆39Updated last month
- ☆41Updated last month
- ☆46Updated 2 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆55Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated last year
- Collection of autoregressive model implementation☆85Updated 2 months ago
- Building GPT ...☆18Updated 6 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆47Updated last year
- Quantization of LLMs and benchmarking.☆10Updated last year
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆38Updated 8 months ago
- Making of cuda kernel☆16Updated last month
- Fine tune Gemma 3 on an object detection task☆57Updated this week
- A really tiny autograd engine☆94Updated last month
- ☆38Updated last year
- My fork os allen AI's OLMo for educational purposes.☆30Updated 6 months ago
- Composition of Multimodal Language Models From Scratch☆14Updated 10 months ago
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.☆37Updated last year
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆60Updated last month
- Hub for researchers exploring VLMs and Multimodal Learning:)☆39Updated this week
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆92Updated last year
- I learn about and explain quantization☆26Updated last year
- This is the code that went into our practical dive using mamba as information extraction☆53Updated last year
- Prune transformer layers☆69Updated last year
- rl from zero pretrain, can it be done? we'll see.☆56Updated this week
- Notebooks to demonstrate TimmWrapper☆16Updated 5 months ago
- Memory-Efficient CUDA kernels for training ConvNets with PyTorch.☆41Updated 4 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆119Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated 9 months ago
- Notebooks for fine tuning pali gemma☆111Updated 2 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year