Alternatives and similar repositories for data

Users that are interested in data are comparing it to the libraries listed below

• pytorch / functorch
  functorch is JAX-like composable function transforms for PyTorch.
  ☆1,429Updated this week
• pytorch / torchdynamo
  A Python-level JIT compiler designed to make unmodified PyTorch programs faster.
  ☆1,046Updated last year
• facebookresearch / fairscale
  PyTorch extensions for high performance and large scale training.
  ☆3,322Updated last month
• pytorch / torcharrow
  High performance model preprocessing library on PyTorch
  ☆650Updated last year
• Lightning-AI / torchmetrics
  Machine learning metrics for distributed, scalable PyTorch applications.
  ☆2,279Updated this week
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆925Updated this week
• Lightning-Universe / lightning-transformers
  Flexible components pairing 🤗 Transformers with Pytorch Lightning
  ☆609Updated 2 years ago
• Lightning-Universe / lightning-bolts
  Toolbox of models, callbacks, and datasets for AI/ML researchers.
  ☆1,730Updated 3 weeks ago
• patrick-kidger / torchtyping
  Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.
  ☆1,431Updated 3 weeks ago
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆233Updated 4 months ago
• facebookincubator / submitit
  Python 3.8+ toolbox for submitting jobs to Slurm
  ☆1,438Updated last week
• libffcv / ffcv
  FFCV: Fast Forward Computer Vision (and other ML workloads!)
  ☆2,930Updated 11 months ago
• google / ml_collections
  ML Collections is a library of Python Collections designed for ML use cases.
  ☆955Updated last month
• webdataset / webdataset
  A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.
  ☆2,615Updated this week
• facebookresearch / recipes
  Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…
  ☆318Updated this week
• archinetai / surgeon-pytorch
  A library to inspect and extract intermediate layers of PyTorch models.
  ☆473Updated 3 years ago
• facebookresearch / bitsandbytes
  Library for 8-bit optimizers and quantization routines.
  ☆716Updated 2 years ago
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆366Updated last week
• microsoft / mup
  maximal update parametrization (µP)
  ☆1,526Updated 10 months ago
• Lightning-AI / litData
  Transform datasets at scale. Optimize datasets for fast AI model training.
  ☆482Updated this week
• Lightning-Universe / lightning-flash
  Your PyTorch AI Factory - Flash enables you to easily configure and run complex AI recipes for over 15 tasks across 7 data domains
  ☆1,742Updated last year
• google / fiddle
  ☆348Updated 3 weeks ago
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆818Updated this week
• Stonesjtu / pytorch_memlab
  Profiling and inspecting memory in pytorch
  ☆1,059Updated 9 months ago
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆766Updated 9 months ago
• ray-project / ray_lightning
  Pytorch Lightning Distributed Accelerators using Ray
  ☆210Updated last year
• NVIDIA-Merlin / dataloader
  The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX
  ☆418Updated last year
• patrick-kidger / jaxtyping
  Type annotations and runtime checking for shape and dtype of JAX/NumPy/PyTorch/etc. arrays. https://docs.kidger.site/jaxtyping/
  ☆1,415Updated last month
• getkeops / keops
  KErnel OPerationS, on CPUs and GPUs, with autodiff and without memory overflows
  ☆1,095Updated last month
• google-deepmind / xmanager
  A platform for managing machine learning experiments
  ☆853Updated last week