Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,131Dec 11, 2025Updated 7 months ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Mac…☆17,558Updated this week
- BaikalDB, A Distributed HTAP Database.☆1,237Jun 15, 2026Updated last month
- An Internet-Scale Database.☆1,903Jun 5, 2024Updated 2 years ago
- An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available dis…☆4,221Oct 25, 2024Updated last year
- PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）☆24,019Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The Baidu File System.☆2,846Dec 3, 2018Updated 7 years ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,139Aug 24, 2023Updated 2 years ago
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆950Jun 26, 2026Updated 3 weeks ago
- ☆15Dec 21, 2016Updated 9 years ago
- A modern layer 7 load balancer from baidu☆6,254Updated this week
- A Toolkit for Industrial Topic Modeling☆2,645Jul 1, 2021Updated 5 years ago
- Apache Doris is a real-time analytics and hybrid search database for AI agents.☆15,628Updated this week
- Common library☆132Jun 29, 2017Updated 9 years ago
- Galaxy is a cluster management system.☆327Aug 22, 2017Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,784Jun 8, 2026Updated last month
- iNexus, coordinate large scale services☆214Oct 26, 2020Updated 5 years ago
- A fast computing framework based on Galaxy☆64Jul 29, 2018Updated 7 years ago
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,714Jul 17, 2020Updated 6 years ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,375Dec 4, 2023Updated 2 years ago
- AI on Hadoop☆1,729Jul 1, 2025Updated last year
- Streaming System 相关的论文读物☆735Feb 12, 2022Updated 4 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,061Jun 16, 2026Updated last month
- FAQ-based Question Answering System☆2,578Nov 28, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Deep Learning 101 with PaddlePaddle （『飞桨』深度学习框架入门教程）☆2,753Nov 12, 2021Updated 4 years ago
- A high performance and generic framework for distributed DNN training☆3,718Oct 3, 2023Updated 2 years ago
- Baidu Ksarch Redis - a production solution of redis cluster☆96May 15, 2017Updated 9 years ago
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,896Apr 7, 2023Updated 3 years ago
- High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and …☆3,094Aug 28, 2023Updated 2 years ago
- Baidu Elasticsearch☆434Jul 29, 2018Updated 7 years ago
- Brings SQL and AI together.☆5,188Apr 18, 2024Updated 2 years ago
- Using the tensorgo API for TensorFlow Async Model Parallel☆36Oct 8, 2017Updated 8 years ago
- PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）☆7,260Apr 27, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A distributed in-memory NOSQL system based on TARS framework, support LRU algorithm and data persists on back-end database. Users can ea…☆744Jan 20, 2024Updated 2 years ago
- Elastic Deep Learning for deep learning framework on Kubernetes☆176Jul 5, 2023Updated 3 years ago
- High-Performance C++ Fundamental Library☆647Mar 16, 2026Updated 4 months ago
- A lightweight parameter server interface☆1,561Mar 2, 2026Updated 4 months ago
- A raft consensus implementation that is simply and understandable☆318Nov 17, 2018Updated 7 years ago
- Paddle Graph Learning (PGL) is an efficient and flexible graph learning framework based on PaddlePaddle☆1,585Dec 11, 2023Updated 2 years ago
- Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.☆6,933Jan 15, 2025Updated last year