Alternatives and similar repositories for hfai-models:

Users that are interested in hfai-models are comparing it to the libraries listed below

• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆121Updated 2 years ago
• Ascend / AscendSpeed
  ☆76Updated last year
• yuandong-tian / arXiv_recbot
  A Telegram bot to recommend arXiv papers
  ☆221Updated last week
• madsys-dev / deepseekv2-profile
  ☆72Updated 5 months ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆106Updated last week
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆61Updated last year
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆198Updated last week
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆128Updated 7 months ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆397Updated 2 months ago
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆44Updated last year
• OpenRL-Lab / Ray_Tutorial
  Tutorial for Ray
  ☆17Updated 9 months ago
• hengjiUSTC / learn-llm
  ☆95Updated 2 months ago
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆276Updated this week
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆276Updated last year
• GPT-Fathom / GPT-Fathom
  GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well a…
  ☆348Updated 9 months ago
• codefuse-ai / Collinear-Constrained-Attention
  ☆61Updated 7 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆403Updated 3 weeks ago
• iamhankai / Forest-of-Thought
  Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning
  ☆14Updated last week
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆192Updated last week
• TemporaryLoRA / Temp-LoRA
  ☆92Updated 9 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆64Updated 7 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆50Updated last month
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆44Updated 6 months ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆88Updated 10 months ago
• PKU-Alignment / AlignmentSurvey
  AI Alignment: A Comprehensive Survey
  ☆133Updated last year
• LLaMafia / llamafia.github
  ☆317Updated 6 months ago
• SparkJiao / llama-pipeline-parallel
  A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to…
  ☆53Updated last year
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆125Updated last year
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆57Updated 7 months ago
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆151Updated last year