Building LLaMA 4 MoE from Scratch
☆79Apr 15, 2025Updated last year
Alternatives and similar repositories for train-llama4
Users that are interested in train-llama4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆79Apr 4, 2025Updated last year
- Outlier Detection with AI + ML☆16Sep 12, 2025Updated last year
- A Beginner's Guide to Monetizing Your Python AI Chatbot☆19Apr 22, 2025Updated last year
- Train a 29M parameter GPT from Scratch☆51Mar 4, 2025Updated last year
- A Straightforward, Step-by-Step Implementation of a Video Diffusion Model☆87Aug 18, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A straightforward method to reduce your LLM inference API costs and token usage.☆25May 18, 2025Updated last year
- Handling Big Data with Knowledge Graph: A Detailed Guide☆30May 11, 2025Updated last year
- eIDAS Italian node☆11May 24, 2022Updated 4 years ago
- A Step-by-Step Implementation of Google Veo 3 Architecture from Scratch☆82Jun 16, 2025Updated last year
- ☆12Feb 3, 2025Updated last year
- An end-to-end pipeline to optimize and host LLM for 100K parallel queries☆38Jul 6, 2025Updated last year
- ☆16Mar 18, 2025Updated last year
- A distilled DeepSeek-R1 variant built on Qwen2.5-32B, fine-tuned with curated data for enhanced performance and efficiency. <metadata> gp…☆14Mar 11, 2025Updated last year
- Implementation of contextual engineering pipeline with LangChain and LangGraph Agents☆95Jul 29, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆217Aug 23, 2024Updated 2 years ago
- The 4chan clone with a one up☆11Oct 23, 2022Updated 3 years ago
- A straightforward explanation of how DeepSeek R1 works☆19Feb 7, 2025Updated last year
- 动手训练一个简单的CLIP模型，加深对CLIP的理解。☆27May 20, 2025Updated last year
- ☆13Feb 27, 2024Updated 2 years ago
- Equivalent Linear Mappings of Large Language Models☆36Nov 7, 2025Updated 10 months ago
- ☆13Dec 6, 2024Updated last year
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated last year
- An automated Python tool that uses LLMs and internet to automatically fix your code until it runs perfectly.☆33Jan 22, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- RuCLIP-SB (Russian Contrastive Language–Image Pretraining SWIN-BERT) is a multimodal model for obtaining images and text similarities and…☆15Jan 25, 2022Updated 4 years ago
- Vietnamese Large Language Model (LLM) fine-tuned for the task of Question Answering within the medical and healthcare domain☆26Mar 1, 2024Updated 2 years ago
- ☆14Jun 16, 2020Updated 6 years ago
- Forty hands-on recipes for production-grade retrieval-augmented generation, Nebius-first and provider-agnostic.☆28May 29, 2026Updated 3 months ago
- A Step-by-Step Implementation of RAPTOR based RAG implementation☆42Sep 1, 2025Updated last year
- ☆25Apr 28, 2025Updated last year
- Implemented a stable diffusion architecture using PyTorch.☆91Jan 3, 2024Updated 2 years ago
- ☆16Jun 12, 2024Updated 2 years ago
- Image captioning using CNN and RNN☆11Mar 24, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Learn LangChain for Genearative AI with OpenAI API using Python☆11Feb 15, 2024Updated 2 years ago
- Code for "Guiding Large Language Models to Post-Edit Machine Translation with Error Annotations" [NAACL Findings 2024]☆14Apr 3, 2026Updated 5 months ago
- ☆12Dec 14, 2024Updated last year
- Notes and commented code for RLHF (PPO)☆137Feb 27, 2024Updated 2 years ago
- Курс дата-инженера на Karpov Courses☆17Apr 22, 2023Updated 3 years ago
- Code to BraTS 2023 challenge.☆16May 5, 2025Updated last year
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆212May 12, 2024Updated 2 years ago