Alternatives and similar repositories for zeus-llm-trainer

Users that are interested in zeus-llm-trainer are comparing it to the libraries listed below

• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• arcee-ai / DAM
  ☆48Updated 6 months ago
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• pacman100 / peft-codegen-25
  ☆24Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 11 months ago
• CarperAI / treasure_trove
  ☆22Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆52Updated 3 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 7 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 3 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• geronimi73 / phi2-finetune
  ☆87Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• huu4ontocord / MDEL
  Multi-Domain Expert Learning
  ☆67Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆37Updated last week
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• catid / lllm
  Latent Large Language Models
  ☆18Updated 8 months ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• character-ai / MuKoe
  ☆53Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 9 months ago
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated last year