Alternatives and similar repositories for hfai-models:

Users that are interested in hfai-models are comparing it to the libraries listed below

• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆333Updated last month
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆130Updated 9 months ago
• Ascend / AscendSpeed
  ☆78Updated last year
• HFAiLab / hai-platform
  一种任务级GPU算力分时调度的高性能深度学习训练平台
  ☆611Updated last year
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆185Updated 6 months ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆180Updated last month
• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆206Updated 2 years ago
• step-law / steplaw
  ☆143Updated 2 weeks ago
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆255Updated 2 months ago
• volcengine / veGiantModel
  ☆214Updated last year
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆463Updated 2 weeks ago
• yuandong-tian / arXiv_recbot
  A Telegram bot to recommend arXiv papers
  ☆261Updated last month
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆398Updated last week
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆111Updated 3 months ago
• fla-org / native-sparse-attention
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆601Updated 2 weeks ago
• hengjiUSTC / learn-llm
  ☆105Updated 4 months ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆50Updated last month
• HFAiLab / pytorch_distributed
  The test of different distributed-training methods on High-Flyer AIHPC
  ☆24Updated 2 years ago
• inclusionAI / AReaL
  Distributed RL System for LLM Reasoning
  ☆201Updated 3 weeks ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated 2 years ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆257Updated last week
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆161Updated 2 weeks ago
• madsys-dev / deepseekv2-profile
  ☆128Updated 3 weeks ago
• SomeoneKong / llm_long_context_bench202405
  ☆29Updated 7 months ago
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆721Updated last month
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆170Updated last week
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆370Updated last week
• microsoft / RedStone
  The RedStone repository includes code for preparing extensive datasets used in training large language models.
  ☆125Updated last month
• hpcaitech / SwiftInfer
  Efficient AI Inference & Serving
  ☆469Updated last year
• dhcode-cpp / NSA-pytorch
  DeepSeek Native Sparse Attention pytorch implementation
  ☆54Updated last month