Alternatives and similar repositories for data

Users that are interested in data are comparing it to the libraries listed below

• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,431Updated this week
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,053Updated last year
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,336Updated 2 months ago
• pytorch / torcharrow
  High performance model preprocessing library on PyTorch
  ☆649Updated last year
• facebookincubator / submitit
  Python 3.8+ toolbox for submitting jobs to Slurm
  ☆1,464Updated last month
• Lightning-AI / torchmetrics
  Machine learning metrics for distributed, scalable PyTorch applications.
  ☆2,304Updated this week
• pytorch / benchmark
  TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
  ☆958Updated this week
• google / ml_collections
  ML Collections is a library of Python Collections designed for ML use cases.
  ☆962Updated this week
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆235Updated 5 months ago
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆933Updated this week
• facebookresearch / recipes
  Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…
  ☆322Updated this week
• Lightning-Universe / lightning-bolts
  Toolbox of models, callbacks, and datasets for AI/ML researchers.
  ☆1,730Updated last month
• webdataset / webdataset
  A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
  ☆2,675Updated 2 weeks ago
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆824Updated this week
• google / fiddle
  ☆350Updated this week
• microsoft / mup
  maximal update parametrization (µP)
  ☆1,551Updated 11 months ago
• NVIDIA-Merlin / dataloader
  The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX
  ☆418Updated last year
• Lightning-Universe / lightning-transformers
  Flexible components pairing 🤗 Transformers with Pytorch Lightning
  ☆609Updated 2 years ago
• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆716Updated 2 years ago
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆368Updated this week
• libffcv / ffcv
  FFCV: Fast Forward Computer Vision (and other ML workloads!)
  ☆2,943Updated last year
• patrick-kidger / torchtyping
  Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.
  ☆1,433Updated 2 months ago
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,061Updated 11 months ago
• BlackHC / toma
  Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
  ☆437Updated 10 months ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆503Updated 3 years ago
• google / seqio
  Task-based datasets, preprocessing, and evaluation for sequence models.
  ☆583Updated last month
• archinetai / surgeon-pytorch
  A library to inspect and extract intermediate layers of PyTorch models.
  ☆473Updated 3 years ago
• Lightning-AI / deep-learning-project-template
  Pytorch Lightning code guideline for conferences
  ☆1,270Updated last year
• Lightning-AI / litData
  Transform datasets at scale. Optimize datasets for fast AI model training.
  ☆503Updated this week
• ray-project / ray_lightning
  Pytorch Lightning Distributed Accelerators using Ray
  ☆211Updated last year