4paradigm / OpenEmbedding
OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
☆31Updated last year
Alternatives and similar repositories for OpenEmbedding:
Users that are interested in OpenEmbedding are comparing it to the libraries listed below
- HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…☆137Updated 3 weeks ago
- A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster☆158Updated 9 months ago
- Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for …☆67Updated 3 years ago
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆90Updated last year
- High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph☆49Updated 2 years ago
- Key/Value Datastore for Persistent Memory☆27Updated 3 years ago
- A Benchmark for Real-Time Relational Data Feature Extraction (VLDB'23 Best Industry Paper Runnerup)☆49Updated last year
- ☆51Updated last year
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆93Updated 7 months ago
- Fine-grained GPU sharing primitives☆140Updated 4 years ago
- Enhanced networking support for TensorFlow. Maintained by SIG-networking.☆98Updated 3 years ago
- GPU-scheduler-for-deep-learning☆201Updated 4 years ago
- A high-performance serving system for DeepRec based on TensorFlow Serving.☆18Updated last year
- Automatic tuning for ML model deployment on Kubernetes☆80Updated 2 months ago
- A lightweight parameter server interface☆75Updated 2 years ago
- NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.☆114Updated last year
- Fault-tolerant for DL frameworks☆69Updated last year
- PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications☆127Updated 2 years ago
- BytePS examples (Vision, NLP, GAN, etc)☆19Updated 2 years ago
- This is OpenMLDB's Spark Distribution, which is particularly optimized for feature extraction. It includes a few novel techniques, such a…☆12Updated 6 months ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆266Updated last year
- ☆83Updated 2 years ago
- OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development…☆95Updated 3 years ago
- distributed-embeddings is a library for building large embedding based models in Tensorflow 2.☆43Updated last year
- The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes☆44Updated 3 years ago
- Reducing the cache misses of SIMD vectorization using IMV☆27Updated 2 years ago
- Model-less Inference Serving☆83Updated last year
- Grasper: A High Performance Distributed System for OLAP on Property Graphs.☆31Updated 3 years ago
- gossip: Efficient Communication Primitives for Multi-GPU Systems☆58Updated 2 years ago
- Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020☆126Updated 6 months ago