Alternatives and similar repositories for subcloning:

Users that are interested in subcloning are comparing it to the libraries listed below

• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last month
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 3 months ago
• fal-ai-community / llmdifftracker
  Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)
  ☆34Updated 2 months ago
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆21Updated 9 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆27Updated this week
• catid / lllm
  Latent Large Language Models
  ☆18Updated 8 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 3 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 9 months ago
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated 11 months ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• euclaise / supertrainer2000
  ☆49Updated last year
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• ethansmith2000 / AutoLoRADiscovery
  ☆28Updated 9 months ago
• cloneofsimo / repa-rf
  ☆33Updated 6 months ago
• LLM360 / k2-data-prep
  ☆20Updated 11 months ago
• cloneofsimo / project_RF
  ☆25Updated 11 months ago
• RE-N-Y / sae
  ☆14Updated 5 months ago
• kyutai-labs / dactory
  ☆19Updated this week
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated last year
• ethansmith2000 / TransformerExperiments
  ☆19Updated last month
• EleutherAI / training-jacobian
  ☆21Updated 4 months ago
• Zyphra / Zyda_processing
  ☆33Updated 10 months ago
• cloneofsimo / auto_llm_codebase_analysis
  ☆26Updated last year
• fal-ai-community / minDDPD
  ☆34Updated 4 months ago
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated last year