ghostplant / tf-image-generator
An extremely-fast Tensorflow Native Ops in place of tf.keras.ImageDataGenerator for image data input to GPU device (more simple than tf.dataset.TFRecord)
☆7Updated 2 months ago
Alternatives and similar repositories for tf-image-generator:
Users that are interested in tf-image-generator are comparing it to the libraries listed below
- OS for Virtual Private Cloud☆237Updated 3 years ago
- An experimental parallel training platform☆54Updated last year
- Intercepting CUDA runtime calls with LD_PRELOAD☆39Updated 11 years ago
- A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems☆156Updated 5 months ago
- Fine-grained GPU sharing primitives☆141Updated 5 years ago
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆112Updated last year
- ☆186Updated 5 years ago
- High performance Transformer implementation in C++.☆111Updated 2 months ago
- An interference-aware scheduler for fine-grained GPU sharing☆129Updated 2 months ago
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆60Updated 9 months ago
- Microsoft Collective Communication Library☆344Updated last year
- Compiler for Dynamic Neural Networks☆45Updated last year
- Predict the performance of LLM inference services☆16Updated 9 months ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆116Updated last year
- Microsoft Collective Communication Library☆60Updated 4 months ago
- Helios Traces from SenseTime☆53Updated 2 years ago
- ☆24Updated last year
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)☆82Updated last year
- NCCL Profiling Kit☆128Updated 8 months ago
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆72Updated last year
- Artifacts for our ASPLOS'23 paper ElasticFlow☆53Updated 10 months ago
- Dynamic resources changes for multi-dimensional parallelism training☆24Updated 4 months ago
- ☆27Updated 8 months ago
- Artifacts for our NSDI'23 paper TGS☆75Updated 9 months ago
- ☆18Updated 10 months ago
- Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access (ACM EuroSys '23)☆57Updated last year
- ☆53Updated 4 years ago
- ☆281Updated last year
- GPU-scheduler-for-deep-learning☆203Updated 4 years ago
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆127Updated 8 months ago