Alternatives and similar repositories for tiny-mixtral

Users that are interested in tiny-mixtral are comparing it to the libraries listed below

• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆41Updated 4 months ago
• YuvrajSingh-mist / SmolLlama
  So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset…
  ☆14Updated 2 months ago
• kmohan321 / Research_Papers
  ☆46Updated 2 months ago
• hkproj / multi-latent-attention
  ☆35Updated last week
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆67Updated 2 months ago
• ariG23498 / gemma3-object-detection
  Fine tune Gemma 3 on an object detection task
  ☆43Updated this week
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last month
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 7 months ago
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆34Updated 2 months ago
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last month
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 4 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆184Updated last week
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆58Updated last week
• hkproj / triton-flash-attention
  ☆168Updated 5 months ago
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆66Updated last month
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆32Updated 2 weeks ago
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆44Updated 8 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆100Updated 2 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 9 months ago
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆30Updated last month
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆68Updated last year
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆29Updated 3 months ago
• brendanhogan / picoDeepResearch
  ☆57Updated last week
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆69Updated 2 weeks ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 2 months ago
• OpenMachine-ai / transformer-tricks
  A collection of tricks and tools to speed up transformer models
  ☆166Updated last week
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• ictorv / Large-Language-Pretraining
  Building large language foundational model
  ☆9Updated 2 months ago