Alternatives and similar repositories for Pretraining-LLMs

Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below

• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆197Updated last year
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆200Updated last year
• FudanDNN-NLP / RAG
  This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)
  ☆344Updated last year
• lamm-mit / LLM-finetuning
  ☆30Updated last year
• alexriggio / BERT-LoRA-TensorRT
  This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…
  ☆78Updated 2 years ago
• ChanCheeKean / DataScience
  ☆82Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆116Updated last year
• frank-morales2020 / MLxDL
  ☆92Updated last week
• FareedKhan-dev / ai-agents-eval-techniques
  Implementation of 12 AI agents evaluation techniques
  ☆35Updated 6 months ago
• githubpradeep / notebooks
  ☆55Updated 5 months ago
• rbiswasfc / llm-detect-ai
  1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition
  ☆211Updated last year
• AIAnytime / Multimodal-RAG-using-Langchain
  Multimodal RAG using Langchain
  ☆58Updated 2 years ago
• ALucek / LLM-distillation-guide
  ☆27Updated last year
• AIAnytime / Medical-RAG-using-Meditron-7B-LLM
  Medical RAG QA App using Meditron 7B LLM, Qdrant Vector Database, and PubMedBERT Embedding Model.
  ☆62Updated 2 years ago
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆53Updated last year
• jihyechoi77 / malade
  Repository for the paper "MALADE: Orchestration of LLM-powered Agents with Retrieval Augmented Generation for Pharmacovigilance"
  ☆23Updated 11 months ago
• pdaicode / awesome-LLMs-finetuning
  Collection of resources for finetuning Large Language Models (LLMs).
  ☆111Updated last year
• NisaarAgharia / Advanced_RAG
  Advanced Retrieval-Augmented Generation (RAG) through practical notebooks, using the power of the Langchain, OpenAI GPTs ,META LLAMA3 ,A…
  ☆443Updated last year
• youssefHosni / Weekly-Top-LLM-Papers
  Curated list of weekly published LLM papers
  ☆200Updated 3 weeks ago
• lumpenspace / raft
  RAFT, or Retrieval-Augmented Fine-Tuning, is a method comprising of a fine-tuning and a RAG-based retrieval phase. It is particularly sui…
  ☆164Updated last year
• Pleias / RL-Reasoning
  Collection of resources for RL and Reasoning
  ☆27Updated last year
• FareedKhan-dev / rag-with-rl
  Maximizing the Performance of a Simple RAG using RL
  ☆90Updated 10 months ago
• FreedomIntelligence / ApolloMoE
  [ICLR'25] ApolloMoE: Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Experts
  ☆52Updated last year
• ali-bahrainian / RAG_best_practices
  ☆107Updated 10 months ago
• openlifescience-ai / Open-Medical-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)
  ☆132Updated last year
• ibm-self-serve-assets / Blended-RAG
  Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers
  ☆84Updated 8 months ago
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆565Updated 10 months ago
• Shekswess / LLM-Medical-Finetuning
  A code repository that cointains all the code for finetuning some of the popular LLMs on medical data
  ☆71Updated last year
• AIAnytime / Synthetic-Data-Generation-using-LLM
  Synthetic Data Generation using LLM via Argilla, Distilabel, ChatGPT, etc.
  ☆30Updated last year
• ThomasRochefortB / open-agentinstruct
  An open-source recreation of the AgentInstruct agentic workflow for synthetic data generation
  ☆24Updated 9 months ago