baidu / bigflow
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,141Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for bigflow
- BaikalDB, A Distributed HTAP Database.☆1,180Updated this week
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆673Updated 5 years ago
- 腾讯高性能分布式图计算框架Plato☆1,901Updated 3 years ago
- ☆318Updated 3 weeks ago
- A distributed graph deep learning framework.☆2,900Updated last year
- An Internet-Scale Database.☆1,891Updated 5 months ago
- Galaxy is a cluster management system.☆326Updated 7 years ago
- ODPS Python SDK and data analysis framework☆434Updated last month
- An industrial deep learning framework for high-dimension sparse data☆4,260Updated last month
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,680Updated 4 years ago
- A Toolkit for Industrial Topic Modeling☆2,637Updated 3 years ago
- AI on Hadoop☆1,730Updated 4 months ago
- Deep Learning Chinese Word Segment☆2,081Updated 6 years ago
- A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆485Updated last year
- CTR prediction model based on spark(LR, GBDT, DNN)☆907Updated 4 years ago
- Multi-thread implementation of Factorization Machines with FTRL for binary-class classification problem.☆885Updated 3 years ago
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,902Updated last year
- A light-weight RPC implement of google protobuf RPC framework.☆2,133Updated last year
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆941Updated 11 months ago
- PArallel Distributed Deep LEarning （PaddlePaddle核心框架，高性能单机、分布式训练和跨平台部署）☆29Updated 3 weeks ago
- Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,052Updated 3 weeks ago
- A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)☆2,655Updated this week
- FAQ-based Question Answering System☆2,585Updated 3 years ago
- A lightweight parameter server interface☆1,539Updated last year
- 推荐、广告工业界经典以及最前沿的论文、资料集合/ Must-read Papers on Recommendation System and CTR Prediction☆994Updated 10 months ago
- Baidu Elasticsearch☆432Updated 6 years ago
- Common library☆132Updated 7 years ago
- An Industrial Graph Neural Network Framework☆1,287Updated 4 months ago
- Kubernetes-native Deep Learning Framework☆734Updated 9 months ago
- TensorFlow Script☆681Updated 7 months ago