Alternatives and similar repositories for Pretraining-LLMs

Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below

• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆196Updated last year
• ChanCheeKean / DataScience
  ☆82Updated last year
• FudanDNN-NLP / RAG
  This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)
  ☆344Updated last year
• alexriggio / BERT-LoRA-TensorRT
  This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…
  ☆78Updated 2 years ago
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆196Updated last year
• lamm-mit / LLM-finetuning
  ☆29Updated last year
• frank-morales2020 / MLxDL
  ☆89Updated last week
• jihyechoi77 / malade
  Repository for the paper "MALADE: Orchestration of LLM-powered Agents with Retrieval Augmented Generation for Pharmacovigilance"
  ☆22Updated 10 months ago
• lucifertrj / Awesome-RAG
  RAG-VectorDB-Embedings-LlamaIndex-Langchain
  ☆277Updated 2 months ago
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆566Updated 9 months ago
• ALucek / LLM-distillation-guide
  ☆26Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆113Updated last year
• rbiswasfc / llm-detect-ai
  1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition
  ☆210Updated last year
• VizuaraAI / nano-gpt-oss
  Learn the building blocks of how to build gpt-oss from scratch
  ☆110Updated 3 months ago
• pdaicode / awesome-LLMs-finetuning
  Collection of resources for finetuning Large Language Models (LLMs).
  ☆109Updated last year
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆77Updated 8 months ago
• openlifescience-ai / Open-Medical-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)
  ☆132Updated last year
• Ashufet / Complex-PDF-RAG-Agent-using-QueryPipeline-from-Scratch_Llamaparse_OS-LLM
  ☆44Updated last year
• ksm26 / LangChain-for-LLM-Application-Development
  Apply LLMs to your data, build personal assistants, and expand your use of LLMs with agents, chains, and memories.
  ☆138Updated 4 months ago
• ali-bahrainian / RAG_best_practices
  ☆104Updated 9 months ago
• AIAnytime / Multimodal-RAG-using-Langchain
  Multimodal RAG using Langchain
  ☆57Updated last year
• Pleias / RL-Reasoning
  Collection of resources for RL and Reasoning
  ☆27Updated 11 months ago
• githubpradeep / notebooks
  ☆55Updated 4 months ago
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆141Updated 11 months ago
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆236Updated 3 months ago
• AIAnytime / Fine-Tune-DeepSeek
  Fine Tune DeepSeek
  ☆44Updated 11 months ago
• abhinand5 / MedEmbed
  MedEmbed is a collection of embedding models fine-tuned specifically for medical and clinical data.
  ☆84Updated last month
• lamm-mit / AtomAgents
  ☆91Updated 8 months ago
• SteveHedden / kg_llm
  Integrating knowledge graphs (KG) with large language models (LLM)
  ☆184Updated 2 months ago