evintunador / minLlama3Links
a simplified version of Meta's Llama 3 model to be used for learning
☆41Updated last year
Alternatives and similar repositories for minLlama3
Users that are interested in minLlama3 are comparing it to the libraries listed below
Sorting:
- LLaMA 2 implemented from scratch in PyTorch☆345Updated last year
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆112Updated 2 years ago
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆70Updated last year
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…☆290Updated last year
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆153Updated 2 weeks ago
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆181Updated last year
- Combining ViT and GPT-2 for image captioning. Trained on MS-COCO. The model was implemented mostly from scratch.☆43Updated last year
- LLM Workshop by Sourab Mangrulkar☆388Updated last year
- From scratch implementation of a vision language model in pure PyTorch☆234Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆164Updated 5 months ago
- Distributed training (multi-node) of a Transformer model☆76Updated last year
- LoRA and DoRA from Scratch Implementations☆208Updated last year
- a simplified version of Google's Gemma model to be used for learning☆26Updated last year
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆175Updated 11 months ago
- A project to improve skills of large language models☆507Updated this week
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated last year
- ☆1,260Updated 5 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆121Updated last year
- Implementation of DoRA☆301Updated last year
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆299Updated 2 years ago
- Fine-tuning LLMs using QLoRA☆261Updated last year
- Scripts for fine-tuning Llama2 via SFT and DPO.☆203Updated last year
- A family of compressed models obtained via pruning and knowledge distillation☆347Updated 8 months ago
- RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct☆29Updated 5 months ago
- minimal GRPO implementation from scratch☆94Updated 4 months ago
- A compact LLM pretrained in 9 days by using high quality data☆320Updated 4 months ago
- A bagel, with everything.☆323Updated last year
- Notes and commented code for RLHF (PPO)☆102Updated last year
- Official repository for ORPO☆462Updated last year
- ☆43Updated 2 months ago