Alternatives and similar repositories for Pretraining-LLMs

Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below

• ChanCheeKean / DataScience
  ☆81Updated last year
• alexriggio / BERT-LoRA-TensorRT
  This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…
  ☆78Updated 2 years ago
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆191Updated last year
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆190Updated last year
• FudanDNN-NLP / RAG
  This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)
  ☆342Updated 11 months ago
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆565Updated 7 months ago
• rbiswasfc / llm-detect-ai
  1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition
  ☆208Updated last year
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆116Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated last year
• frank-morales2020 / MLxDL
  ☆85Updated this week
• lamm-mit / LLM-finetuning
  ☆28Updated last year
• rajkstats / PharmAssistAI
  An innovative application designed to help pharmacists and pharmacy students quickly research FDA-approved drugs by retrieving relevant i…
  ☆21Updated 8 months ago
• pdaicode / awesome-LLMs-finetuning
  Collection of resources for finetuning Large Language Models (LLMs).
  ☆104Updated 10 months ago
• ksm26 / LangChain-for-LLM-Application-Development
  Apply LLMs to your data, build personal assistants, and expand your use of LLMs with agents, chains, and memories.
  ☆132Updated 2 months ago
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆76Updated 6 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• FareedKhan-dev / train-llama4
  Building LLaMA 4 MoE from Scratch
  ☆68Updated 7 months ago
• philschmid / evaluate-llms
  Includes examples on how to evaluate LLMs
  ☆23Updated last year
• FormulaMonks / llm-benchmarker-suite
  LLM Evals Leaderboard
  ☆48Updated 2 years ago
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆396Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆140Updated 10 months ago
• geronimi73 / qlora-minimal
  ☆88Updated 2 years ago
• lucifertrj / Awesome-RAG
  RAG-VectorDB-Embedings-LlamaIndex-Langchain
  ☆270Updated last month
• ashishjamarkattel / reinforment-learning-with-human-feedback
  ☆17Updated last year
• jihyechoi77 / malade
  Repository for the paper "MALADE: Orchestration of LLM-powered Agents with Retrieval Augmented Generation for Pharmacovigilance"
  ☆21Updated 9 months ago
• kyegomez / Python-Package-Template
  A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much muc…
  ☆194Updated last month
• AIAnytime / Medical-RAG-using-Meditron-7B-LLM
  Medical RAG QA App using Meditron 7B LLM, Qdrant Vector Database, and PubMedBERT Embedding Model.
  ☆60Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆99Updated 8 months ago
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆19Updated last year
• openlifescience-ai / Open-Medical-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)
  ☆130Updated last year