baidu / bigflow
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,134Updated 2 years ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆673Updated 5 years ago
- An Internet-Scale Database.☆1,903Updated 11 months ago
- A Toolkit for Industrial Topic Modeling☆2,643Updated 3 years ago
- AI on Hadoop☆1,731Updated this week
- An industrial deep learning framework for high-dimension sparse data☆4,283Updated 7 months ago
- Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,077Updated last month
- 腾讯高性能分布式图计算框架Plato☆1,915Updated 3 years ago
- A lightweight parameter server interface☆1,546Updated 2 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,754Updated last year
- A light-weight RPC implement of google protobuf RPC framework.☆2,142Updated last year
- Galaxy is a cluster management system.☆326Updated 7 years ago
- BaikalDB, A Distributed HTAP Database.☆1,211Updated 2 months ago
- A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆491Updated 2 years ago
- FAQ-based Question Answering System☆2,594Updated 4 years ago
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆951Updated 5 months ago
- a TensorFlow-based distributed training framework optimized for large-scale sparse data.☆326Updated 2 weeks ago
- ODPS Python SDK and data analysis framework☆435Updated last week
- Deep Learning Chinese Word Segment☆2,080Updated 7 years ago
- A distributed graph deep learning framework.☆2,898Updated last year
- A common bricks library for building scalable and portable distributed machine learning.☆869Updated this week
- Kubernetes-native Deep Learning Framework☆740Updated last year
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,900Updated 2 years ago
- Reliable Allreduce and Broadcast Interface for distributed machine learning☆509Updated 4 years ago
- A distributed key-value storage system developed by Alibaba Group☆2,235Updated 5 years ago
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,689Updated 4 years ago
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆348Updated 2 years ago
- Deep Learning 101 with PaddlePaddle （『飞桨』深度学习框架入门教程）☆2,750Updated 3 years ago
- A high available service discovery & registration & fault-tolerance framework☆676Updated 2 years ago
- A light weight, super fast, large scale machine learning library on spark .☆677Updated 7 years ago
- Common library☆132Updated 7 years ago