FareedKhan-dev / train-llama4Links
Building LLaMA 4 MoE from Scratch
☆60Updated 4 months ago
Alternatives and similar repositories for train-llama4
Users that are interested in train-llama4 are comparing it to the libraries listed below
Sorting:
- minimal GRPO implementation from scratch☆96Updated 5 months ago
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆182Updated last year
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆178Updated last year
- This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.☆73Updated last month
- Fine tune Gemma 3 on an object detection task☆78Updated last month
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆69Updated 4 months ago
- From scratch implementation of a vision language model in pure PyTorch☆235Updated last year
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆56Updated last week
- Maximizing the Performance of a Simple RAG using RL☆79Updated 5 months ago
- Inference, Fine Tuning and many more recipes with Gemma family of models☆267Updated last month
- (ICCV 2025) OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation☆86Updated last month
- ☆94Updated 5 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆92Updated 3 months ago
- Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.☆58Updated last year
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆178Updated last month
- Composition of Multimodal Language Models From Scratch☆15Updated last year
- ☆102Updated 11 months ago
- Self-host LLMs with vLLM and BentoML☆140Updated this week
- ComoRAG is a Retrieval-Augmented Generation (RAG) system for long documents and multi-document QA, information extraction, and knowledge …☆195Updated last week
- ☆44Updated 3 months ago
- ☆158Updated last week
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆96Updated 8 months ago
- Utils for Unsloth https://github.com/unslothai/unsloth☆134Updated this week
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆34Updated 3 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆83Updated last year
- Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…☆12Updated 11 months ago
- Distributed training (multi-node) of a Transformer model☆79Updated last year
- Benchmarking the serving capabilities of vLLM☆49Updated last year
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆238Updated 9 months ago
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆38Updated 10 months ago