Alternatives and similar repositories for nanoXLSTM:

Users that are interested in nanoXLSTM are comparing it to the libraries listed below

• cognitivecomputations / grokadamw
  ☆129Updated 8 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 3 months ago
• arcee-ai / DAM
  ☆48Updated 5 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• euclaise / supertrainer2000
  ☆49Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• cognitivecomputations / spectrum
  ☆115Updated 3 weeks ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 8 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆91Updated last month
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 11 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last week
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆98Updated last month
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆66Updated 10 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 11 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 6 months ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆27Updated this week
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆83Updated 5 months ago
• mkurman / grpo-llm-evaluator
  Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…
  ☆41Updated 2 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated last month
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆91Updated 2 weeks ago
• nyunAI / PruneGPT
  ☆53Updated 11 months ago
• cg123 / bitnet
  Modeling code for a BitNet b1.58 Llama-style model.
  ☆25Updated last year
• axolotl-ai-cloud / axolotl-cookbook
  ☆31Updated last month
• joshuacnf / Ctrl-G
  ☆80Updated 3 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆180Updated 3 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 3 months ago