Alternatives and similar repositories for ffrecord

Users that are interested in ffrecord are comparing it to the libraries listed below

• HFAiLab / hfai-models
  HFAI deep learning models
  ☆149Updated 2 years ago
• volcengine / veGiantModel
  ☆217Updated last year
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated 2 years ago
• HFAiLab / hai-platform
  一种任务级GPU算力分时调度的高性能深度学习训练平台
  ☆649Updated last year
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆396Updated last month
• megvii-research / megfile
  Megvii FILE Library - Working with Files in Python same as the standard library
  ☆144Updated last week
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆216Updated 2 months ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆94Updated 2 years ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆254Updated last week
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆147Updated last week
• volcengine / veScale
  A PyTorch Native LLM Training Framework
  ☆816Updated 5 months ago
• Azure / msccl-executor-nccl
  ☆37Updated 5 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆281Updated this week
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆112Updated last year
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆132Updated last year
• pcg-mlp / KsanaLLM
  ☆332Updated 4 months ago
• HFAiLab / pytorch_distributed
  The test of different distributed-training methods on High-Flyer AIHPC
  ☆24Updated 2 years ago
• Victarry / PP-Schedule-Visualization
  Pipeline Parallelism Emulation and Visualization
  ☆40Updated 2 weeks ago
• BaguaSys / bagua
  Bagua Speeds up PyTorch
  ☆883Updated 10 months ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆81Updated 3 weeks ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆387Updated this week
• ByteDance-Seed / VeOmni
  VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework
  ☆339Updated 3 weeks ago
• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆49Updated 3 months ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆406Updated 3 weeks ago
• antgroup / ant-ray
  Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…
  ☆127Updated last week
• microsoft / NPKit
  NCCL Profiling Kit
  ☆135Updated 11 months ago
• volcengine / ml-platform-sdk-python
  ☆31Updated 2 years ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆463Updated 2 months ago
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆66Updated last month
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆285Updated 3 years ago