Alternatives and similar repositories for Pretraining-LLMs

Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below

• ChanCheeKean / DataScience
  ☆83Updated last year
• pdaicode / awesome-LLMs-finetuning
  Collection of resources for finetuning Large Language Models (LLMs).
  ☆101Updated 9 months ago
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆186Updated last year
• alexriggio / BERT-LoRA-TensorRT
  This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…
  ☆78Updated last year
• FudanDNN-NLP / RAG
  This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)
  ☆336Updated 9 months ago
• Shekswess / LLM-Medical-Finetuning
  A code repository that cointains all the code for finetuning some of the popular LLMs on medical data
  ☆63Updated last year
• githubpradeep / notebooks
  ☆54Updated last month
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆186Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated 11 months ago
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆228Updated last week
• lamm-mit / LLM-finetuning
  ☆27Updated last year
• openlifescience-ai / Open-Medical-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)
  ☆128Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 6 months ago
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆15Updated last year
• YHPeter / Awesome-RAG-Evaluation
  The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.
  ☆178Updated 5 months ago
• rohan-paul / LLM-FineTuning-Large-Language-Models
  LLM (Large Language Model) FineTuning
  ☆563Updated 6 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated 2 months ago
• rbiswasfc / llm-detect-ai
  1st Place Solution for LLM - Detect AI Generated Text Kaggle Competition
  ☆203Updated last year
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆129Updated last year
• smallporridge / AssistRAG
  ☆23Updated 9 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated last year
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆105Updated last year
• aymeric-roucher / benchmark_agents
  ☆27Updated last year
• Ashufet / Complex-PDF-RAG-Agent-using-QueryPipeline-from-Scratch_Llamaparse_OS-LLM
  ☆43Updated last year
• fate-ubw / RAGLAB
  [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation
  ☆308Updated 11 months ago
• zjunlp / OneGen
  [EMNLP 2024] OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs.
  ☆148Updated 11 months ago
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆48Updated last year
• AIAnytime / Multimodal-RAG-using-Langchain
  Multimodal RAG using Langchain
  ☆55Updated last year
• dmis-lab / self-biorag
  [ISMB 2024] Self-BioRAG: Improving Medical Reasoning through Retrieval and Self-Reflection with Retrieval-Augmented Large Language Models
  ☆64Updated last year
• geronimi73 / qlora-minimal
  ☆87Updated last year