Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,134Dec 11, 2025Updated 3 months ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Mac…☆17,471Mar 16, 2026Updated last week
- BaikalDB, A Distributed HTAP Database.☆1,235Feb 26, 2026Updated 3 weeks ago
- An Internet-Scale Database.☆1,906Jun 5, 2024Updated last year
- An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available dis…☆4,207Oct 25, 2024Updated last year
- PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）☆23,762Updated this week
- The Baidu File System.☆2,851Dec 3, 2018Updated 7 years ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,145Aug 24, 2023Updated 2 years ago
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆953Jan 31, 2026Updated last month
- A Toolkit for Industrial Topic Modeling☆2,645Jul 1, 2021Updated 4 years ago
- ☆15Dec 21, 2016Updated 9 years ago
- A modern layer 7 load balancer from baidu☆6,228Updated this week
- Apache Doris is an easy-to-use, high performance and unified analytics database.☆15,139Updated this week
- Common library☆133Jun 29, 2017Updated 8 years ago
- Galaxy is a cluster management system.☆326Aug 22, 2017Updated 8 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,784Oct 13, 2025Updated 5 months ago
- A fast computing framework based on Galaxy☆64Jul 29, 2018Updated 7 years ago
- iNexus, coordinate large scale services☆214Oct 26, 2020Updated 5 years ago
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,713Jul 17, 2020Updated 5 years ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,373Dec 4, 2023Updated 2 years ago
- Streaming System 相关的论文读物☆736Feb 12, 2022Updated 4 years ago
- AI on Hadoop☆1,729Jul 1, 2025Updated 8 months ago
- FAQ-based Question Answering System☆2,581Nov 28, 2020Updated 5 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,044Mar 13, 2026Updated last week
- Deep Learning 101 with PaddlePaddle （『飞桨』深度学习框架入门教程）☆2,752Nov 12, 2021Updated 4 years ago
- A high performance and generic framework for distributed DNN training☆3,716Oct 3, 2023Updated 2 years ago
- Baidu Ksarch Redis - a production solution of redis cluster☆89May 15, 2017Updated 8 years ago
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,903Apr 7, 2023Updated 2 years ago
- High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and …☆3,095Aug 28, 2023Updated 2 years ago
- Using the tensorgo API for TensorFlow Async Model Parallel☆36Oct 8, 2017Updated 8 years ago
- Baidu Elasticsearch☆436Jul 29, 2018Updated 7 years ago
- Brings SQL and AI together.☆5,189Apr 18, 2024Updated last year
- PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）☆7,236May 22, 2025Updated 10 months ago
- A distributed in-memory NOSQL system based on TARS framework, support LRU algorithm and data persists on back-end database. Users can ea…☆746Jan 20, 2024Updated 2 years ago
- Elastic Deep Learning for deep learning framework on Kubernetes☆176Jul 5, 2023Updated 2 years ago
- High-Performance C++ Fundamental Library☆636Mar 16, 2026Updated last week
- A lightweight parameter server interface☆1,561Mar 2, 2026Updated 3 weeks ago
- A raft consensus implementation that is simply and understandable☆319Nov 17, 2018Updated 7 years ago
- A Scalable, High-Performance Distributed Key-Value Platform☆398Feb 9, 2018Updated 8 years ago
- Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.☆6,946Jan 15, 2025Updated last year