Alternatives and similar repositories for Pretraining-LLMs

Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below

• alexriggio / BERT-LoRA-TensorRT
  This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…
  ☆77Updated last year
• ChanCheeKean / DataScience
  ☆84Updated last year
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆179Updated last year
• FudanDNN-NLP / RAG
  This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)
  ☆333Updated 8 months ago
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆182Updated last year
• rbiswasfc / llm-detect-ai
  1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition
  ☆202Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 11 months ago
• openlifescience-ai / Open-Medical-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)
  ☆128Updated 11 months ago
• fshnkarimi / Fine-tuning-an-LLM-using-LoRA
  📚 Text Classification with LoRA (Low-Rank Adaptation) of Language Models - Efficiently fine-tune large language models for text classifi…
  ☆52Updated last year
• ALucek / LLM-distillation-guide
  ☆22Updated last year
• lamm-mit / LLM-finetuning
  ☆27Updated 11 months ago
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆560Updated 5 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆80Updated last year
• ksm26 / LangChain-for-LLM-Application-Development
  Apply LLMs to your data, build personal assistants, and expand your use of LLMs with agents, chains, and memories.
  ☆127Updated last week
• ali-bahrainian / RAG_best_practices
  ☆94Updated 5 months ago
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆129Updated last year
• AIAnytime / Multimodal-RAG-using-Langchain
  Multimodal RAG using Langchain
  ☆54Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 10 months ago
• apple / ml-superposition-prompting
  ☆145Updated last year
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆104Updated last year
• Rachnog / intro_to_llm_agents
  Simple introduction to LLM Agents
  ☆139Updated last year
• githubpradeep / notebooks
  ☆54Updated last week
• geronimi73 / qlora-minimal
  ☆86Updated last year
• SteveHedden / kg_llm
  Integrating knowledge graphs (KG) with large language models (LLM)
  ☆171Updated 8 months ago
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆226Updated 2 months ago
• evintunador / gpt-lab
  cheap & easy LLM experiments for amateurs (alpha)
  ☆21Updated 2 weeks ago
• Ransaka / ai-agents-with-llama3
  ☆46Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆322Updated 4 months ago
• FareedKhan-dev / train-llama4
  Building LLaMA 4 MoE from Scratch
  ☆62Updated 4 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆125Updated 2 years ago