Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,133Dec 11, 2025Updated 4 months ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Mac…☆17,490Apr 20, 2026Updated last week
- BaikalDB, A Distributed HTAP Database.☆1,233Feb 26, 2026Updated 2 months ago
- An Internet-Scale Database.☆1,906Jun 5, 2024Updated last year
- An industrial-grade C++ implementation of RAFT consensus algorithm based on brpc, widely used inside Baidu to build highly-available dis…☆4,215Oct 25, 2024Updated last year
- PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）☆23,843Apr 21, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The Baidu File System.☆2,850Dec 3, 2018Updated 7 years ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,144Aug 24, 2023Updated 2 years ago
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆951Apr 2, 2026Updated 3 weeks ago
- A Toolkit for Industrial Topic Modeling☆2,646Jul 1, 2021Updated 4 years ago
- ☆15Dec 21, 2016Updated 9 years ago
- A modern layer 7 load balancer from baidu☆6,234Apr 9, 2026Updated 2 weeks ago
- Apache Doris is an easy-to-use, high performance and unified analytics database.☆15,266Updated this week
- Common library☆133Jun 29, 2017Updated 8 years ago
- Galaxy is a cluster management system.☆327Aug 22, 2017Updated 8 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,784Oct 13, 2025Updated 6 months ago
- A fast computing framework based on Galaxy☆64Jul 29, 2018Updated 7 years ago
- iNexus, coordinate large scale services☆214Oct 26, 2020Updated 5 years ago
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,714Jul 17, 2020Updated 5 years ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,369Dec 4, 2023Updated 2 years ago
- Streaming System 相关的论文读物☆736Feb 12, 2022Updated 4 years ago
- AI on Hadoop☆1,731Jul 1, 2025Updated 9 months ago
- FAQ-based Question Answering System☆2,580Nov 28, 2020Updated 5 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,048Apr 15, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Deep Learning 101 with PaddlePaddle （『飞桨』深度学习框架入门教程）☆2,751Nov 12, 2021Updated 4 years ago
- A high performance and generic framework for distributed DNN training☆3,715Oct 3, 2023Updated 2 years ago
- Baidu Ksarch Redis - a production solution of redis cluster☆89May 15, 2017Updated 8 years ago
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,901Apr 7, 2023Updated 3 years ago
- High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and …☆3,097Aug 28, 2023Updated 2 years ago
- Using the tensorgo API for TensorFlow Async Model Parallel☆36Oct 8, 2017Updated 8 years ago
- Baidu Elasticsearch☆434Jul 29, 2018Updated 7 years ago
- Brings SQL and AI together.☆5,188Apr 18, 2024Updated 2 years ago
- PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）☆7,249May 22, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A distributed in-memory NOSQL system based on TARS framework, support LRU algorithm and data persists on back-end database. Users can ea…☆747Jan 20, 2024Updated 2 years ago
- Elastic Deep Learning for deep learning framework on Kubernetes☆176Jul 5, 2023Updated 2 years ago
- High-Performance C++ Fundamental Library☆640Mar 16, 2026Updated last month
- A lightweight parameter server interface☆1,561Mar 2, 2026Updated last month
- A raft consensus implementation that is simply and understandable☆319Nov 17, 2018Updated 7 years ago
- A Scalable, High-Performance Distributed Key-Value Platform☆396Feb 9, 2018Updated 8 years ago
- Officially maintained, supported by PaddlePaddle, including CV, NLP, Speech, Rec, TS, big models and so on.☆6,942Jan 15, 2025Updated last year