Alternatives and similar repositories for lowmem_finetuning

Users that are interested in lowmem_finetuning are comparing it to the libraries listed below

• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 7 months ago
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆68Updated 3 months ago
• kmohan321 / Research_Papers
  ☆46Updated 4 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆103Updated 5 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 6 months ago
• tokenbender / avataRL
  rl from zero pretrain, can it be done? we'll see.
  ☆66Updated 2 weeks ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 6 months ago
• AnswerDotAI / fastkmeans
  ☆64Updated last month
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆196Updated 2 months ago
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆143Updated 2 months ago
• SinatrasC / entropix-smollm
  smolLM with Entropix sampler on pytorch
  ☆150Updated 9 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆83Updated 3 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 3 months ago
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆95Updated 2 weeks ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 5 months ago
• AI-Hypercomputer / RecML
  ☆186Updated this week
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆222Updated this week
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆15Updated 8 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated 11 months ago
• attentionmech / smolbox
  smolbox of recipies
  ☆28Updated 3 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆283Updated this week
• rosmineb / unit_test_rl
  Project code for training LLMs to write better unit tests + code
  ☆21Updated 2 months ago
• AK391 / dailypapersHN
  ☆86Updated 10 months ago
• huggingface / large-scale-image-deduplication
  ☆123Updated 2 weeks ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 9 months ago
• KindXiaoming / grow-crystals
  Getting crystal-like representations with harmonic loss
  ☆192Updated 4 months ago
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆28Updated 2 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆140Updated 5 months ago
• brendanhogan / picoDeepResearch
  ☆64Updated 2 months ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆288Updated 2 months ago