Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,135Dec 11, 2025Updated 2 months ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Mac…☆17,459Updated this week
- BaikalDB, A Distributed HTAP Database.☆1,233Oct 15, 2025Updated 4 months ago
- An Internet-Scale Database.☆1,907Jun 5, 2024Updated last year
- An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available dis…☆4,201Oct 25, 2024Updated last year
- The Baidu File System.☆2,853Dec 3, 2018Updated 7 years ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,148Aug 24, 2023Updated 2 years ago
- PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）☆23,642Updated this week
- A Toolkit for Industrial Topic Modeling☆2,647Jul 1, 2021Updated 4 years ago
- Galaxy is a cluster management system.☆326Aug 22, 2017Updated 8 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,784Oct 13, 2025Updated 4 months ago
- A modern layer 7 load balancer from baidu☆6,232Feb 13, 2026Updated 2 weeks ago
- Apache Doris is an easy-to-use, high performance and unified analytics database.☆15,036Updated this week
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,715Jul 17, 2020Updated 5 years ago
- iNexus, coordinate large scale services☆215Oct 26, 2020Updated 5 years ago
- A fast computing framework based on Galaxy☆64Jul 29, 2018Updated 7 years ago
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,905Apr 7, 2023Updated 2 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,047Feb 11, 2026Updated 2 weeks ago
- AI on Hadoop☆1,732Jul 1, 2025Updated 8 months ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,375Dec 4, 2023Updated 2 years ago
- ☆15Dec 21, 2016Updated 9 years ago
- Baidu Ksarch Redis - a production solution of redis cluster☆89May 15, 2017Updated 8 years ago
- Common library☆133Jun 29, 2017Updated 8 years ago
- A high performance and generic framework for distributed DNN training☆3,716Oct 3, 2023Updated 2 years ago
- High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and …☆3,097Aug 28, 2023Updated 2 years ago
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆672Jun 17, 2019Updated 6 years ago
- Brings SQL and AI together.☆5,191Apr 18, 2024Updated last year
- A distributed in-memory NOSQL system based on TARS framework, support LRU algorithm and data persists on back-end database. Users can ea…☆745Jan 20, 2024Updated 2 years ago
- A raft consensus implementation that is simply and understandable☆318Nov 17, 2018Updated 7 years ago
- FAQ-based Question Answering System☆2,580Nov 28, 2020Updated 5 years ago
- A Scalable, High-Performance Distributed Key-Value Platform☆398Feb 9, 2018Updated 8 years ago
- Deep Learning 101 with PaddlePaddle （『飞桨』深度学习框架入门教程）☆2,753Nov 12, 2021Updated 4 years ago
- A lightweight parameter server interface☆1,560Jan 11, 2023Updated 3 years ago
- Streaming System 相关的论文读物☆736Feb 12, 2022Updated 4 years ago
- A distributed key-value storage system developed by Alibaba Group☆2,304Nov 19, 2019Updated 6 years ago
- Baidu Elasticsearch☆437Jul 29, 2018Updated 7 years ago
- PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）☆7,227May 22, 2025Updated 9 months ago
- Solitaire is a Faster Linearizability Checker Supporting Multiple Data Model☆18Aug 9, 2018Updated 7 years ago
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆350Jul 6, 2022Updated 3 years ago
- Has been migrated to https://github.com/apache/incubator-pegasus/tree/master/rdsn☆142Jun 21, 2022Updated 3 years ago