Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,132Dec 11, 2025Updated 10 months ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Mac…☆17,640Updated this week
- BaikalDB, A Distributed HTAP Database.☆1,240Jun 15, 2026Updated 4 months ago
- An Internet-Scale Database.☆1,904Jun 5, 2024Updated 2 years ago
- An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available dis…☆4,233Oct 25, 2024Updated 2 years ago
- PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）☆24,128Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The Baidu File System.☆2,846Dec 3, 2018Updated 7 years ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,140Aug 24, 2023Updated 3 years ago
- Galaxy is a cluster management system.☆328Aug 22, 2017Updated 9 years ago
- A Toolkit for Industrial Topic Modeling☆2,645Jul 1, 2021Updated 5 years ago
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆949Jun 26, 2026Updated 4 months ago
- A modern layer 7 load balancer from baidu☆6,272Updated this week
- ☆15Dec 21, 2016Updated 9 years ago
- Apache Doris is a real-time analytics and hybrid search database for AI agents.☆16,144Updated this week
- Common library☆133Jun 29, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PArallel Distributed Deep LEarning （PaddlePaddle核心框架，高性能单机、分布式训练和跨平台部署）☆35Oct 30, 2024Updated last year
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,795Updated this week
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,718Jul 17, 2020Updated 6 years ago
- iNexus, coordinate large scale services☆214Oct 26, 2020Updated 6 years ago
- A fast computing framework based on Galaxy☆64Jul 29, 2018Updated 8 years ago
- FAQ-based Question Answering System☆2,571Nov 28, 2020Updated 5 years ago
- AI on Hadoop☆1,729Jul 1, 2025Updated last year
- High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and …☆3,090Aug 28, 2023Updated 3 years ago
- A high performance and generic framework for distributed DNN training☆3,719Oct 3, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,895Apr 7, 2023Updated 3 years ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,381Dec 4, 2023Updated 2 years ago
- An industrial deep learning framework for high-dimension sparse data☆4,299Sep 25, 2024Updated 2 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,064Jun 16, 2026Updated 4 months ago
- Streaming System 相关的论文读物☆731Feb 12, 2022Updated 4 years ago
- A Scalable, High-Performance Distributed Key-Value Platform☆393Feb 9, 2018Updated 8 years ago
- Deep Learning 101 with PaddlePaddle （『飞桨』深度学习框架入门教程）☆2,750Nov 12, 2021Updated 4 years ago
- High-Performance C++ Fundamental Library☆655Mar 16, 2026Updated 7 months ago
- Baidu Elasticsearch☆431Jul 29, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A lightweight parameter server interface☆1,560Mar 2, 2026Updated 7 months ago
- Brings SQL and AI together.☆5,188Apr 18, 2024Updated 2 years ago
- A raft consensus implementation that is simply and understandable☆318Nov 17, 2018Updated 7 years ago
- A distributed in-memory NOSQL system based on TARS framework, support LRU algorithm and data persists on back-end database. Users can ea…☆745Oct 12, 2026Updated 2 weeks ago
- Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.☆6,932Jan 15, 2025Updated last year
- baidu redis cluster☆117Jan 12, 2017Updated 9 years ago
- 百度NLP：分词，词性标注，命名实体识别，词重要性☆3,999May 25, 2021Updated 5 years ago