Alternatives and similar repositories for tiny-mixtral:

Users that are interested in tiny-mixtral are comparing it to the libraries listed below

• kmohan321 / Research_Papers
  ☆46Updated last month
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆64Updated 2 weeks ago
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆41Updated 4 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 3 months ago
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆31Updated 2 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 weeks ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆87Updated last month
• Zyphra / transformers_zamba2
  ☆48Updated 3 months ago
• mingyin0312 / RL4LLM
  RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct
  ☆28Updated 2 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 8 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 3 months ago
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 6 months ago
• ZihanWang314 / coeCheck
  ☆16Updated 2 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated last month
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆27Updated last month
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆98Updated 2 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆27Updated 3 months ago
• BorealisAI / neuzip
  Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…
  ☆58Updated 6 months ago
• zaydzuhri / pythia-mlkv
  Multi-Layer Key-Value sharing experiments on Pythia models
  ☆32Updated 10 months ago
• YuvrajSingh-mist / SmolLlama
  So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset…
  ☆14Updated last month
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆47Updated last year
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated last month
• axeld5 / pali_reason
  Testing paligemma2 finetuning on reasoning dataset
  ☆18Updated 4 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• ali-bahrainian / RAG_best_practices
  ☆91Updated last month
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• mmhamdy / open-language-models
  A list of language models with permissive licenses such as MIT or Apache 2.0
  ☆24Updated 2 months ago
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆56Updated last month
• mkurman / grpo-llm-evaluator
  Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…
  ☆41Updated 2 months ago