Alternatives and similar repositories for smoltropix

Users that are interested in smoltropix are comparing it to the libraries listed below

• samefarrar / entropix_mlx
  Modify Entropy Based Sampling to work with Mac Silicon via MLX
  ☆49Updated last year
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆84Updated 4 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• brendanhogan / picoDeepResearch
  ☆68Updated 7 months ago
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆99Updated 7 months ago
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆77Updated 10 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 2 months ago
• SinatrasC / entropix-smollm
  smolLM with Entropix sampler on pytorch
  ☆149Updated last year
• JD-P / RetroInstruct
  Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.
  ☆32Updated 2 months ago
• xjdr-alt / entropix-trainer
  train entropix like a champ!
  ☆20Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆108Updated 9 months ago
• SinatrasC / entropix
  Entropy Based Sampling and Parallel CoT Decoding
  ☆17Updated last year
• swyxio / openlangmem
  ☆47Updated last year
• doomslide / attention-graph
  A graph visualization of attention
  ☆57Updated 7 months ago
• xjdr-alt / muzero_sketch
  ☆40Updated last year
• rosmineb / unit_test_rl
  Project code for training LLMs to write better unit tests + code
  ☆21Updated 7 months ago
• doomslide / autoloom
  Approximating the joint distribution of language models via MCTS
  ☆22Updated last year
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated 2 years ago
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 11 months ago
• QuixiAI / dolphin-logger
  ☆107Updated last month
• ai8hyf / OpenResearchAssistant
  An automated tool for discovering insights from research papaer corpora
  ☆137Updated last year
• SouthBridgeAI / llm-transcription-study
  Useful resources for LLM-based Diarization and Transcription.
  ☆55Updated last year
• teknium1 / ShareGPT-Builder
  ☆117Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆35Updated last year
• AtakanTekparmak / tiny_fnc_engine
  tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.
  ☆38Updated last year
• waefrebeorn / KAN-WuBu-Memory
  An AI character interaction system with emotional modeling and advanced memory management
  ☆17Updated last year
• kyegomez / NeoSapiens
  The next evolution of Agents
  ☆48Updated this week
• vgel / logitloom
  explore token trajectory trees on instruct and base models
  ☆149Updated 6 months ago
• xjdr-alt / entropix-local
  smol models are fun too
  ☆92Updated last year