A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed training of machine learning models.
☆18Jan 5, 2023Updated 3 years ago
Alternatives and similar repositories for ray_shuffling_data_loader
Users that are interested in ray_shuffling_data_loader are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Distributed ML Optimizer☆35Jul 28, 2021Updated 4 years ago
- Deadline-based hyperparameter tuning on RayTune.☆32Jan 16, 2020Updated 6 years ago
- Ludwig benchmark☆19Mar 13, 2022Updated 4 years ago
- Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.☆67Dec 29, 2023Updated 2 years ago
- Is the GIL seeing someone else? How's about repetitively calling and seeing how long it takes to answer?☆16Jan 7, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Codebase for the paper "Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning"☆17Jul 12, 2021Updated 4 years ago
- High performance NCCL plugin for Bagua.☆15Sep 15, 2021Updated 4 years ago
- ☆16May 1, 2011Updated 14 years ago
- Elastic Deep Learning for deep learning framework on Kubernetes☆176Jul 5, 2023Updated 2 years ago
- Resource-adaptive cluster scheduler for deep learning training.☆459Mar 5, 2023Updated 3 years ago
- Terraform module to create an Elastic Kubernetes (EKS) cluster and associated worker instances on AWS☆14Aug 26, 2020Updated 5 years ago
- "Learning Rate Dropout" in PyTorch☆34Dec 6, 2019Updated 6 years ago
- FalkorDB port to Rust☆13Mar 26, 2026Updated 2 weeks ago
- Some recommendation algorithms and research☆12Sep 16, 2016Updated 9 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆12Aug 26, 2021Updated 4 years ago
- ☆16Nov 2, 2025Updated 5 months ago
- Efficient solutions to Project Euler (https://projecteuler.net/) problems.☆11Feb 12, 2017Updated 9 years ago
- 非沪籍高校毕业生留沪各项流程汇总☆17Jan 24, 2018Updated 8 years ago
- LightGBM on Ray☆51Feb 4, 2024Updated 2 years ago
- RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.☆371Mar 17, 2026Updated 3 weeks ago
- My Python solutions to Udacity's CS262 Programming Languages assignments☆16Jun 28, 2012Updated 13 years ago
- Automated neural architecture search algorithms implemented in PyTorch and Autogluon toolkit.☆12Apr 17, 2020Updated 5 years ago
- Github repo for Peifeng's internship project☆13Nov 7, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Kubernetes Operator for AI and Bigdata Elastic Training☆91Jan 10, 2025Updated last year
- [NeurIPS 2024 D&B Track] DACO: Towards Application-Driven and Comprehensive Data Analysis via Code Generation☆12Mar 5, 2025Updated last year
- Distributed optimization framework with parameter server☆23Jun 14, 2015Updated 10 years ago
- A decentralised application that creates high quality machine learning datasets☆13Jan 22, 2019Updated 7 years ago
- The tool is to fetch github discussion as blog post and deploy to vercel or github page☆12Jan 16, 2023Updated 3 years ago
- Code for "SePPO: Semi-Policy Preference Optimization for Diffusion Alignment."☆18Oct 7, 2024Updated last year
- Memory footprint reduction for transformer models☆11Jan 24, 2023Updated 3 years ago
- A simple tool for parsing the profile.json file of mxnet☆14Aug 1, 2018Updated 7 years ago
- Pytorch Lightning Distributed Accelerators using Ray☆216Nov 3, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- ☆12May 3, 2020Updated 5 years ago
- An overview of text mining visualisations possibilities with R on the CETA trade agreement (Canada / EU)☆10Nov 9, 2016Updated 9 years ago
- Monitor to supervise hyperopt deployment in K8s☆12Sep 26, 2022Updated 3 years ago
- A simple sparse bitmap implementation in java☆22Jan 28, 2016Updated 10 years ago
- Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Juli…☆10Aug 7, 2020Updated 5 years ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Feb 22, 2021Updated 5 years ago
- Deep exponential family models in MXNet/Gluon. Layers o' latents 💤☆17Oct 16, 2017Updated 8 years ago