Alternatives and similar repositories for nanoRLHF

Users that are interested in nanoRLHF are comparing it to the libraries listed below

• g588928812 / qlora

  View on GitHub
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆11Jul 22, 2023Updated 2 years ago
• rsshyam / GRPO-bandits

  View on GitHub
  ☆13Sep 12, 2024Updated last year
• CoderWanFeng / poai

  View on GitHub
  pip install poai
  ☆14Jul 7, 2025Updated 7 months ago
• FreedomIntelligence / FastLLM

  View on GitHub
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Jan 4, 2024Updated 2 years ago
• DBGroup-SUSTech / GHive

  View on GitHub
  GHive: Accelerating Analytical Query Processing in Apache Hive via CPU-GPU Heterogeneous Computing.
  ☆15Nov 8, 2023Updated 2 years ago
• harvard-cns / Harvard-CNS-Seminar

  View on GitHub
  Reading seminar in Harvard Cloud Networking and Systems Group
  ☆16Aug 29, 2022Updated 3 years ago
• nyu-systems / gauntlet

  View on GitHub
  Finding bugs in P4 compilers using translation validation.
  ☆38Nov 4, 2025Updated 3 months ago
• amulil / vector_by_onnxmodel

  View on GitHub
  accelerate generating vector by using onnx model
  ☆18Jan 23, 2024Updated 2 years ago
• rkuo2000 / GenAI

  View on GitHub
  ☆11Feb 6, 2026Updated last week
• Froot-NetSys / Arya

  View on GitHub
  Arya: Arbitrary Graph Pattern Mining with Decomposition-based Sampling
  ☆16Sep 27, 2023Updated 2 years ago
• BY571 / DistRL-LLM

  View on GitHub
  Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization
  ☆21Mar 12, 2025Updated 11 months ago
• li-plus / flash-preference

  View on GitHub
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆51Jul 4, 2025Updated 7 months ago
• lwangbm / Metis

  View on GitHub
  Metis: Learning to Schedule Long-Running Applications in Shared Container Clusters with at Scale
  ☆19May 27, 2020Updated 5 years ago
• bytedance / QSync

  View on GitHub
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆20Feb 23, 2024Updated last year
• sunshine-JLU / deepseek-r1-distill-llama-8b-lora

  View on GitHub
  The objective of this project is to demonstrate how to fine-tune deepseek-r1-distill-llama-8b.
  ☆16Feb 19, 2025Updated 11 months ago
• swyang50066 / rl-stock-trading

  View on GitHub
  WATERMELON: Multi-Agent Reinforcement Learning Based Algorithmic Stock Trading System with GUI Application
  ☆17Sep 8, 2022Updated 3 years ago
• uiuctml / HypStructure

  View on GitHub
  [NeurIPS '24] Code repo for the paper entitled "Learning Structured Representations with Hyperbolic Embeddings" at NeurIPS 2024
  ☆24Jan 22, 2025Updated last year
• hellangleZ / Qwen3_autothink_adapter

  View on GitHub
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆22May 9, 2025Updated 9 months ago
• Ying1123 / llm-caching-multiplexing

  View on GitHub
  ☆20Jun 3, 2023Updated 2 years ago
• openanthem / nimbus-core

  View on GitHub
  Getting Starting with NIMBUS-CORE
  ☆10Dec 16, 2023Updated 2 years ago
• jsonch / StarFlow

  View on GitHub
  *flow source code
  ☆23Aug 27, 2020Updated 5 years ago
• ustcadsl / GraphWalker

  View on GitHub
  ☆19Jul 1, 2020Updated 5 years ago
• Azure99 / BlossomData

  View on GitHub
  A fluent, scalable, and easy-to-use LLM data processing framework.
  ☆28Jan 31, 2026Updated 2 weeks ago
• Laoyu84 / 4onebench

  View on GitHub
  A minimalist benchmarking tool designed to test the routine-generation capabilities of LLMs.
  ☆27Nov 28, 2024Updated last year
• egcode / facerec

  View on GitHub
  Face recognition using Pytorch (Arcface, Cosface, Centerloss)
  ☆22Nov 22, 2022Updated 3 years ago
• dywsjtu / apparate

  View on GitHub
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Nov 21, 2024Updated last year
• casys-kaist / EnvPipe

  View on GitHub
  ☆26Aug 31, 2023Updated 2 years ago
• Vic0428 / Paper-Reading-Lists

  View on GitHub
  Random collections of my interested research papers / projects
  ☆20May 20, 2021Updated 4 years ago
• msr-fiddle / CheckFreq

  View on GitHub
  ☆56Jan 25, 2021Updated 5 years ago
• JF-D / Proteus

  View on GitHub
  ☆24Jul 7, 2024Updated last year
• GATECH-EIC / BNS-GCN

  View on GitHub
  [MLSys 2022] "BNS-GCN: Efficient Full-Graph Training of Graph Convolutional Networks with Partition-Parallelism and Random Boundary Node …
  ☆56Oct 6, 2023Updated 2 years ago
• ShannonAI / KNN-NER

  View on GitHub
  ☆55Apr 7, 2022Updated 3 years ago
• DS3Lab / AC-SGD

  View on GitHub
  Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.
  ☆28Apr 25, 2023Updated 2 years ago
• percent4 / multi-modal-image-search

  View on GitHub
  本项目使用LLaVA 1.6多模态模型实现以文搜图和以图搜图功能。
  ☆28Feb 26, 2024Updated last year
• Unakar / Logic-RL

  View on GitHub
  Reproduce R1 Zero on Logic Puzzle
  ☆2,432Mar 20, 2025Updated 10 months ago
• cnsdqd-dyb / Guide-GRPO

  View on GitHub
  Aims for memory-efficient training (24GB VRAM) on consumer GPUs. Optimizing language models through guidance tokens in reasoning chains, …
  ☆29Feb 23, 2025Updated 11 months ago
• john-hewitt / implicit-ins

  View on GitHub
  Codebase for Instruction Following without Instruction Tuning
  ☆36Sep 24, 2024Updated last year
• mgmalek / efficient_cross_entropy

  View on GitHub
  ☆124May 28, 2024Updated last year
• owenliang / another-pytorch

  View on GitHub
  A simple deep learning framework inspired by Dezero and PyTorch
  ☆31Jan 27, 2025Updated last year