HFAiLab / hfai-models

Related projects ⓘ

Alternatives and complementary repositories for hfai-models

• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆116Updated last year
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆209Updated this week
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆123Updated this week
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆57Updated last year
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆43Updated last year
• Ascend / AscendSpeed
  ☆74Updated 11 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆126Updated 5 months ago
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆144Updated 2 weeks ago
• TemporaryLoRA / Temp-LoRA
  ☆89Updated 7 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆362Updated this week
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆57Updated 5 months ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆104Updated 11 months ago
• madsys-dev / deepseekv2-profile
  ☆64Updated 4 months ago
• boson-ai / RPBench-Auto
  An automated pipeline for evaluating LLMs for role-playing.
  ☆137Updated 2 months ago
• SparkJiao / llama-pipeline-parallel
  A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to…
  ☆49Updated last year
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆119Updated last year
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆68Updated 4 months ago
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆41Updated 4 months ago
• HFAiLab / hai-platform
  一种任务级GPU算力分时调度的高性能深度学习训练平台
  ☆311Updated last year
• liziniu / ReMax
  Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)
  ☆151Updated 11 months ago
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆274Updated last year
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆229Updated 9 months ago
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆123Updated last year
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆171Updated this week
• kyegomez / FlashAttention20Triton
  Triton implementation of Flash Attention2.0
  ☆22Updated last year
• SomeoneKong / llm_long_context_bench202405
  ☆28Updated 2 months ago
• THUDM / icetk
  A unified tokenization tool for Images, Chinese and English.
  ☆150Updated last year
• shuyhere / about-super-alignment
  Feeling confused about super alignment? Here is a reading list
  ☆43Updated 10 months ago
• HFAiLab / pytorch_distributed
  The test of different distributed-training methods on High-Flyer AIHPC
  ☆21Updated 2 years ago
• volcengine / verl
  veRL: Volcano Engine Reinforcement Learning for LLM
  ☆327Updated this week