Alternatives and similar repositories for ffrecord

Users that are interested in ffrecord are comparing it to the libraries listed below

• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆389Updated 2 months ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆271Updated 2 years ago
• HFAiLab / hfai-models
  HFAI deep learning models
  ☆155Updated 2 years ago
• HFAiLab / hai-platform
  一种任务级GPU算力分时调度的高性能深度学习训练平台
  ☆733Updated 2 years ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆268Updated last month
• bytedance-iaas / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆18Updated this week
• megvii-research / megfile
  Megvii FILE Library - Working with Files in Python same as the standard library
  ☆168Updated 2 weeks ago
• volcengine / veGiantModel
  ☆219Updated 2 years ago
• volcengine / veScale
  Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs
  ☆923Updated 2 months ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆99Updated 2 years ago
• antgroup / ant-ray
  Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…
  ☆164Updated this week
• bytedance / matxscript
  A high-performance, extensible Python AOT compiler.
  ☆450Updated 2 years ago
• Victarry / PP-Schedule-Visualization
  Pipeline Parallelism Emulation and Visualization
  ☆77Updated 3 weeks ago
• stepfun-ai / StepMesh
  ☆342Updated this week
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆449Updated 8 months ago
• taco-project / FlexKV
  ☆145Updated this week
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆294Updated 3 years ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆497Updated 10 months ago
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆523Updated 4 months ago
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆192Updated 3 months ago
• inclusionAI / asystem-amem
  A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.
  ☆87Updated last month
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆123Updated 2 years ago
• OpenSQZ / MegatronApp
  Toolchain built around the Megatron-LM for Distributed Training
  ☆84Updated last month
• bytedance / xpu-perf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆298Updated 2 weeks ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆123Updated last month
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆122Updated 2 years ago
• Ascend / AscendSpeed
  ☆79Updated 2 years ago
• antgroup / DeepXTrace
  DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.
  ☆91Updated 2 weeks ago
• Jack47 / hack-SysML
  The road to hack SysML and become an system expert
  ☆510Updated last year
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆66Updated 4 months ago