baidu / bigflow
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,142Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for bigflow
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆673Updated 5 years ago
- A lightweight parameter server interface☆1,539Updated last year
- 腾讯高性能分布式图计算框架Plato☆1,902Updated 3 years ago
- A distributed graph deep learning framework.☆2,898Updated last year
- A Toolkit for Industrial Topic Modeling☆2,637Updated 3 years ago
- AI on Hadoop☆1,729Updated 4 months ago
- BaikalDB, A Distributed HTAP Database.☆1,177Updated last week
- Galaxy is a cluster management system.☆326Updated 7 years ago
- Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,052Updated last week
- ☆318Updated 2 weeks ago
- An Internet-Scale Database.☆1,891Updated 5 months ago
- Kubernetes-native Deep Learning Framework☆732Updated 9 months ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,130Updated last year
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,901Updated last year
- An industrial deep learning framework for high-dimension sparse data☆4,259Updated last month
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆941Updated 10 months ago
- Deep Learning Chinese Word Segment☆2,082Updated 6 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,743Updated 9 months ago
- iNexus, coordinate large scale services☆214Updated 4 years ago
- Common library☆132Updated 7 years ago
- Multi-thread implementation of Factorization Machines with FTRL for binary-class classification problem.☆885Updated 3 years ago
- CTR prediction model based on spark(LR, GBDT, DNN)☆906Updated 4 years ago
- A common bricks library for building scalable and portable distributed machine learning.☆865Updated 4 months ago
- Distributed training framework with parameter server☆339Updated 7 years ago
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,680Updated 4 years ago
- ODPS Python SDK and data analysis framework☆435Updated last month
- Papers on Computational Advertising☆4,219Updated 3 years ago
- Easy Machine Learning is a general-purpose dataflow-based system for easing the process of applying machine learning algorithms to real w…☆1,974Updated 10 months ago
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆348Updated 2 years ago
- PArallel Distributed Deep LEarning （PaddlePaddle核心框架，高性能单机、分布式训练和跨平台部署）☆29Updated last week