Alternatives and similar repositories for lora_bakeoff:

Users that are interested in lora_bakeoff are comparing it to the libraries listed below

• arcee-ai / DAM
  ☆48Updated 5 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 7 months ago
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆43Updated 8 months ago
• kevinwu23 / StanfordFineTuneBench
  ☆28Updated 5 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆41Updated 2 months ago
• google-deepmind / asyncdiloco
  ☆43Updated last year
• pgasawa / BARE
  Combining Base and Instruction-Tuned Language Models for Better Synthetic Data Generation
  ☆29Updated 2 months ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• KaiNylund / lm-weights-encode-time
  ☆67Updated 8 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 11 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆23Updated 3 months ago
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last week
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆24Updated 4 months ago
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆32Updated 6 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 7 months ago
• allenai / infinigram-api
  ☆53Updated last week
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 7 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• dinobby / MAgICoRE
  ☆24Updated 7 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 5 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆54Updated 11 months ago
• Zyphra / Zyda_processing
  ☆33Updated 10 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• JoshuaPurtell / SmallBench
  Small, simple agent task environments for training and evaluation
  ☆18Updated 5 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 10 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆12Updated 2 months ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆21Updated 5 months ago
• raphaelsty / LeNLP
  NLP with Rust for Python 🦀🐍
  ☆62Updated 10 months ago