baidu / bigflowLinks
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,133Updated 3 weeks ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- An Internet-Scale Database.☆1,905Updated last year
- AI on Hadoop☆1,735Updated 2 months ago
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆673Updated 6 years ago
- A lightweight parameter server interface☆1,559Updated 2 years ago
- 腾讯高性能分布式图计算框架Plato☆1,913Updated 4 years ago
- Galaxy is a cluster management system.☆326Updated 8 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,023Updated last week
- BaikalDB, A Distributed HTAP Database.☆1,219Updated last week
- A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆491Updated 2 years ago
- a TensorFlow-based distributed training framework optimized for large-scale sparse data.☆329Updated 2 months ago
- Deep Learning Chinese Word Segment☆2,080Updated 7 years ago
- A Toolkit for Industrial Topic Modeling☆2,642Updated 4 years ago
- ODPS Python SDK and data analysis framework☆443Updated 3 weeks ago
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,706Updated 5 years ago
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,904Updated 2 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,777Updated 2 weeks ago
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆351Updated 3 years ago
- Distributed training framework with parameter server☆338Updated 8 years ago
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆954Updated 9 months ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,367Updated last year
- ☆53Updated 9 years ago
- A light weight, super fast, large scale machine learning library on spark .☆680Updated 7 years ago
- A common bricks library for building scalable and portable distributed machine learning.☆878Updated last week
- Common library☆133Updated 8 years ago
- Easy Machine Learning is a general-purpose dataflow-based system for easing the process of applying machine learning algorithms to real w…☆1,979Updated last year
- FAQ-based Question Answering System☆2,592Updated 4 years ago
- ☆15Updated 8 years ago
- iNexus, coordinate large scale services☆215Updated 4 years ago
- A high available service discovery & registration & fault-tolerance framework☆675Updated last week
- A stand alone industrial serving system for angel.☆65Updated 3 years ago