angry-kratos / Simple_Llama3_from_scratchLinks
☆30Updated last year
Alternatives and similar repositories for Simple_Llama3_from_scratch
Users that are interested in Simple_Llama3_from_scratch are comparing it to the libraries listed below
Sorting:
- Collection of autoregressive model implementation☆85Updated 2 weeks ago
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆38Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆122Updated last year
- ☆46Updated 8 months ago
- Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.☆122Updated last year
- RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct☆31Updated 11 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated 2 years ago
- ☆46Updated 10 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆61Updated last year
- From scratch implementation of a vision language model in pure PyTorch☆254Updated last year
- We study toy models of skill learning.☆31Updated last year
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆53Updated last year
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆49Updated last year
- Set of scripts to finetune LLMs☆37Updated last year
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆85Updated last year
- ☆137Updated last year
- Quantization of LLMs and benchmarking.☆10Updated last year
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆98Updated last year
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆181Updated 6 months ago
- ☆45Updated 8 months ago
- A really tiny autograd engine☆99Updated 8 months ago
- Notebooks for fine tuning pali gemma☆117Updated 9 months ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆92Updated 2 years ago
- ☆114Updated 4 months ago
- LoRA and DoRA from Scratch Implementations☆215Updated last year
- ☆68Updated last year
- A compact LLM pretrained in 9 days by using high quality data☆340Updated 9 months ago
- World's Smallest Vision-Language Model☆32Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆115Updated last year
- ☆55Updated 5 months ago