FareedKhan-dev / train-llama4Links
Building LLaMA 4 MoE from Scratch
☆53Updated 2 months ago
Alternatives and similar repositories for train-llama4
Users that are interested in train-llama4 are comparing it to the libraries listed below
Sorting:
- ☆41Updated last month
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆64Updated 2 months ago
- ☆92Updated 3 months ago
- Composition of Multimodal Language Models From Scratch☆14Updated 10 months ago
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆58Updated last year
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆175Updated last year
- Maximizing the Performance of a Simple RAG using RL☆62Updated 3 months ago
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆93Updated 6 months ago
- Simple examples using Argilla tools to build AI☆53Updated 7 months ago
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆32Updated last month
- A new novel multi-modality (Vision) RAG architecture☆28Updated 8 months ago
- OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation☆76Updated 3 months ago
- Fine tune Gemma 3 on an object detection task☆57Updated this week
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆169Updated 10 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆86Updated last month
- minimal GRPO implementation from scratch☆90Updated 3 months ago
- From scratch implementation of a vision language model in pure PyTorch☆222Updated last year
- RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct☆29Updated 4 months ago
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆45Updated 9 months ago
- ☆39Updated last month
- Notes and commented code for RLHF (PPO)☆96Updated last year
- Set of scripts to finetune LLMs☆37Updated last year
- Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed☆18Updated last year
- [ICLR'25] ApolloMoE: Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts☆44Updated 7 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆81Updated last year
- ☆101Updated 9 months ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆105Updated last month
- Code for KaLM-Embedding models☆78Updated 3 months ago
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆47Updated last month
- Qwen2 VL Fine Tuning using Llama Factory☆20Updated 9 months ago