HFAiLab / hfai-models
HFAI deep learning models
☆132Updated last year
Alternatives and similar repositories for hfai-models:
Users that are interested in hfai-models are comparing it to the libraries listed below
- FireFlyer Record file format, writer and reader for DL training samples.☆139Updated 2 years ago
- 一种任务级GPU算力分时调度的高性能深度学习训练平台☆491Updated last year
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆128Updated 8 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆148Updated this week
- A flexible and efficient training framework for large-scale alignment tasks☆304Updated last week
- ☆104Updated 3 months ago
- ☆76Updated last year
- LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training☆398Updated last month
- The test of different distributed-training methods on High-Flyer AIHPC☆23Updated 2 years ago
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆61Updated last year
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆219Updated last month
- ☆318Updated 7 months ago
- Mixture-of-Experts (MoE) Language Model☆184Updated 5 months ago
- A Telegram bot to recommend arXiv papers☆244Updated last week
- The RedStone repository includes code for preparing extensive datasets used in training large language models.☆83Updated last week
- The related works and background techniques about Openai o1☆210Updated last month
- GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well a…☆349Updated 10 months ago
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆428Updated this week
- 中文版 llm-numbers☆119Updated last year
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆238Updated 11 months ago
- ATC23 AE☆45Updated last year
- InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…☆348Updated this week
- A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …☆107Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆94Updated last month
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆53Updated 3 months ago
- Tutorial for Ray☆18Updated 10 months ago