Alternatives and similar repositories for opensloth

Users that are interested in opensloth are comparing it to the libraries listed below

• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆229Updated 8 months ago
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆240Updated last year
• cognitivecomputations / spectrum
  ☆128Updated 3 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆198Updated 11 months ago
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆318Updated 3 months ago
• cognitivecomputations / grokadamw
  ☆134Updated 10 months ago
• writer / writing-in-the-margins
  ☆118Updated 10 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆105Updated 3 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆88Updated 2 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆265Updated last year
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆112Updated this week
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• menloresearch / ReZero
  ☆156Updated 2 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 6 months ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆194Updated 2 months ago
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆132Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆92Updated 4 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆359Updated this week
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆146Updated 11 months ago
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆211Updated this week
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆153Updated last year
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆217Updated last month
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆140Updated 4 months ago
• unslothai / unsloth-zoo
  Utils for Unsloth
  ☆113Updated this week
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆678Updated last week
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆232Updated 8 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆112Updated 5 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆81Updated last month
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆260Updated 6 months ago
• IlyaGusev / ping_pong_bench
  A benchmark for role-playing language models
  ☆99Updated last month