Alternatives and similar repositories for SmolLlama:

Users that are interested in SmolLlama are comparing it to the libraries listed below

• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆31Updated 2 months ago
• kmohan321 / Research_Papers
  ☆46Updated last month
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆31Updated this week
• kmohan321 / LLMs
  ☆87Updated last month
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆91Updated 2 months ago
• atullchaurasia / transformers
  Transformers from scratch using PyTorch & NumPy.
  ☆23Updated 3 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆73Updated last week
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆98Updated 2 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆52Updated 5 months ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated last month
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 2 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 6 months ago
• nano-R1 / resources
  Compiling useful links, papers, benchmarks, ideas, etc.
  ☆46Updated last month
• SinatrasC / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆17Updated 6 months ago
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆41Updated 4 months ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆65Updated last month
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆64Updated 6 months ago
• Pleias / RL-Reasoning
  Collection of resources for RL and Reasoning
  ☆25Updated 3 months ago
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆27Updated last month
• HarleyCoops / StoneyNakoda
  A locally trained model of Stoney Nakoda has been developed and released. You can access the working model here or train your own instanc…
  ☆10Updated last month
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆64Updated 2 weeks ago
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆189Updated last week
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆55Updated 3 weeks ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 3 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 3 months ago
• AK391 / dailypapersHN
  ☆85Updated 7 months ago
• kabir2505 / tiny-mixtral
  ☆27Updated this week
• axeld5 / pali_reason
  Testing paligemma2 finetuning on reasoning dataset
  ☆18Updated 4 months ago
• willccbb / trl
  Train transformer language models with reinforcement learning.
  ☆18Updated 2 months ago
• mkurman / grpo-llm-evaluator
  Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…
  ☆41Updated 2 months ago