Alternatives and similar repositories for opensloth

Users that are interested in opensloth are comparing it to the libraries listed below

• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆225Updated 7 months ago
• nyunAI / PruneGPT
  ☆53Updated last year
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆238Updated last year
• cognitivecomputations / grokadamw
  ☆132Updated 10 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆198Updated 11 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆85Updated last month
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆78Updated last month
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆94Updated 3 months ago
• unslothai / unsloth-zoo
  Utils for Unsloth
  ☆99Updated this week
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• cognitivecomputations / spectrum
  ☆124Updated 2 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆113Updated 5 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆140Updated 4 months ago
• writer / writing-in-the-margins
  ☆118Updated 9 months ago
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆28Updated 3 weeks ago
• arcee-ai / DAM
  ☆51Updated 7 months ago
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆108Updated 2 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 5 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆101Updated 3 months ago
• menloresearch / ReZero
  ☆149Updated 2 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 4 months ago
• mkurman / grpo-llm-evaluator
  Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…
  ☆44Updated last month
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆149Updated last month
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 4 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• IST-DASLab / Quartet
  ☆65Updated 2 weeks ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 7 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 3 months ago
• brendanhogan / picoDeepResearch
  ☆63Updated last month