Alternatives and similar repositories for concurrent-dataloader

Users that are interested in concurrent-dataloader are comparing it to the libraries listed below

• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• spcl / substation
  Research and development for optimizing transformers
  ☆131Updated 4 years ago
• guanh01 / CS692-mlsys
  This is the (evolving) reading list for the seminar.
  ☆61Updated 5 years ago
• apd10 / universal_memory_allocation
  ☆15Updated 3 years ago
• smartnets / dataloader-benchmarks
  DL Dataloader Benchmarks
  ☆20Updated 10 months ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 4 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆34Updated 4 years ago
• Aleph-Alpha-Research / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated 2 years ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆123Updated last year
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆162Updated this week
• petuum / autodist
  Simple Distributed Deep Learning on TensorFlow
  ☆134Updated 6 months ago
• NVIDIA / LDDL
  Distributed preprocessing and data loading for language datasets
  ☆40Updated last year
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆27Updated this week
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆117Updated last year
• stanford-futuredata / stk
  ☆115Updated last year
• cake-lab / perseus
  ☆10Updated 2 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆137Updated 3 years ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆55Updated 4 years ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆167Updated this week
• HKBU-HPML / ddl-benchmarks
  ddl-benchmarks: Benchmarks for Distributed Deep Learning
  ☆36Updated 5 years ago
• saareliad / FTPipe
  FTPipe and related pipeline model parallelism research.
  ☆43Updated 2 years ago
• HazyResearch / anchor-stability
  A study of the downstream instability of word embeddings
  ☆12Updated 3 years ago
• FCSLab / torpor
  ☆17Updated 6 months ago
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆88Updated last year
• kanonjz / paper
  Machine Learning System
  ☆14Updated 5 years ago
• anyscale / llm-continuous-batching-benchmarks
  ☆122Updated last year
• Infini-AI-Lab / vortex_torch
  Vortex: A Flexible and Efficient Sparse Attention Framework
  ☆43Updated 3 weeks ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆50Updated 2 years ago