FareedKhan-dev / create-million-parameter-llm-from-scratchLinks
Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
☆182Updated last year
Alternatives and similar repositories for create-million-parameter-llm-from-scratch
Users that are interested in create-million-parameter-llm-from-scratch are comparing it to the libraries listed below
Sorting:
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆184Updated last year
- Implementation of a GPT-4o like Multimodal from Scratch using Python☆71Updated 5 months ago
- Maximizing the Performance of a Simple RAG using RL☆79Updated 5 months ago
- Building LLaMA 4 MoE from Scratch☆64Updated 5 months ago
- LLM (Large Language Model) FineTuning☆559Updated 5 months ago
- A straightforward method for training your LLM, from downloading data to generating text.☆426Updated last month
- From scratch implementation of a vision language model in pure PyTorch☆239Updated last year
- Various installation guides for Large Language Models☆74Updated 4 months ago
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆308Updated 2 years ago
- a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model☆155Updated last year
- RAG-VectorDB-Embedings-LlamaIndex-Langchain☆260Updated 3 months ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…☆384Updated last year
- Building a GPT-like LLM from scratch with PyTorch.☆288Updated 8 months ago
- This repository contains a pipeline for fine-tuning Large Language Models (LLMs) for Text-to-SQL conversion using General Reward Proximal…☆33Updated 5 months ago
- Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 , A…☆97Updated last year
- Unlock the potential of finetuning Large Language Models (LLMs). Learn from industry expert, and discover when to apply finetuning, data …☆68Updated last year
- ☆84Updated last year
- ☆89Updated 5 months ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆129Updated last year
- ☆113Updated 9 months ago
- Training and Fine-tuning an llm in Python and PyTorch.☆42Updated 2 years ago
- Composition of Multimodal Language Models From Scratch☆15Updated last year
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆116Updated 2 years ago
- ☆44Updated 4 months ago
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems☆129Updated 7 months ago
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆125Updated 2 years ago
- Various projects using Large Language Model (GPT & LLAMA) other open source model from HuggingFace and OpenAI. OpenAI API required for ru…☆104Updated last month
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆178Updated last month
- GPU Kernels☆193Updated 4 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated last year