baidu / bigflowLinks
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,133Updated 2 months ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,092Updated 3 months ago
- An Internet-Scale Database.☆1,905Updated last year
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆672Updated 6 years ago
- A lightweight parameter server interface☆1,559Updated 2 years ago
- 腾讯高性能分布式图计算框架Plato☆1,912Updated 4 years ago
- AI on Hadoop☆1,736Updated 3 months ago
- An industrial deep learning framework for high-dimension sparse data☆4,300Updated last year
- A light-weight RPC implement of google protobuf RPC framework.☆2,147Updated 2 years ago
- ODPS Python SDK and data analysis framework☆446Updated last month
- BaikalDB, A Distributed HTAP Database.☆1,222Updated 2 weeks ago
- Galaxy is a cluster management system.☆326Updated 8 years ago
- A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆493Updated 2 years ago
- a TensorFlow-based distributed training framework optimized for large-scale sparse data.☆330Updated last week
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,706Updated 5 years ago
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,902Updated 2 years ago
- A light weight, super fast, large scale machine learning library on spark .☆680Updated 7 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,032Updated 2 weeks ago
- 中文文档simhash值计算☆1,157Updated 5 months ago
- 挖坑与填坑☆689Updated 9 years ago
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆952Updated 10 months ago
- Deep Learning Chinese Word Segment☆2,079Updated 7 years ago
- A high available service discovery & registration & fault-tolerance framework☆675Updated last month
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,374Updated last year
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆351Updated 3 years ago
- Distributed training framework with parameter server☆338Updated 8 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,778Updated 2 weeks ago
- Streaming System 相关的论文读物☆735Updated 3 years ago
- spark ml 算法原理剖析以及具体的源码实现分析☆1,958Updated 6 years ago
- A distributed key-value storage system developed by Alibaba Group☆2,267Updated 5 years ago
- ☆15Updated 8 years ago