Alternatives and similar repositories for LLM-finetuning

Users that are interested in LLM-finetuning are comparing it to the libraries listed below

• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 3 months ago
• AgnostiqHQ / multi-agent-llm
  Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)
  ☆115Updated 4 months ago
• lamm-mit / AtomAgents
  ☆74Updated last month
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• ALucek / LLM-distillation-guide
  ☆22Updated 10 months ago
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆45Updated 9 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 7 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆55Updated last year
• spcl / MRAG
  Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"
  ☆212Updated last week
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆94Updated 3 months ago
• writer / writing-in-the-margins
  ☆118Updated 10 months ago
• fairyshine / Chain-of-Tools
  The official implementation of the paper "Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models".
  ☆78Updated 3 months ago
• cornstarch-org / Cornstarch
  ☆93Updated last month
• togethercomputer / open-data-scientist
  Open AI data scientist agent that automates complex data analysis tasks using the ReAct framework. Execute Python code locally or in the …
  ☆62Updated this week
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆18Updated last year
• Future-House / ldp
  A Software Framework Enabling Modular Interchange of Language Agents, Environments, and Optimizers
  ☆92Updated this week
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆71Updated this week
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆195Updated last month
• cognitivecomputations / kraken
  ☆66Updated last year
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆42Updated 5 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆69Updated 4 months ago
• kyle8581 / LanguageModelsasCompilers
  Official implementation of Language Models as Compilers: Simulating the Execution Of Pseudocode Improves Algorithmic Reasoning in Languag…
  ☆22Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 5 months ago
• openlifescience-ai / Open-Medical-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for Medical LLMs (and beyond)
  ☆123Updated 9 months ago
• 7shoe / AdaParse
  Adaptive Parallel PDF Parsing and Resource Scaling Engine
  ☆43Updated last month
• YZ-Cai / SimGRAG
  Official code of the paper "SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generation"
  ☆114Updated 6 months ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆68Updated 3 months ago