baidu / bigflowLinks
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,136Updated last month
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- An Internet-Scale Database.☆1,907Updated last year
- 腾讯高性能分布式图计算框架Plato☆1,913Updated 4 years ago
- Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,099Updated last week
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆672Updated 6 years ago
- An industrial deep learning framework for high-dimension sparse data☆4,306Updated last year
- AI on Hadoop☆1,732Updated 6 months ago
- A lightweight parameter server interface☆1,559Updated 3 years ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,149Updated 2 years ago
- A Toolkit for Industrial Topic Modeling☆2,646Updated 4 years ago
- ODPS Python SDK and data analysis framework☆448Updated last month
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,906Updated 2 years ago
- Galaxy is a cluster management system.☆327Updated 8 years ago
- BaikalDB, A Distributed HTAP Database.☆1,230Updated 3 months ago
- Deep Learning Chinese Word Segment☆2,076Updated 7 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,044Updated this week
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,713Updated 5 years ago
- a TensorFlow-based distributed training framework optimized for large-scale sparse data.☆333Updated last month
- A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆496Updated 2 years ago
- 中文文档simhash值计算☆1,164Updated 8 months ago
- spark ml 算法原理剖析以及具体的源码实现分析☆1,964Updated 6 years ago
- A distributed key-value storage system developed by Alibaba Group☆2,298Updated 6 years ago
- Kubernetes-native Deep Learning Framework☆745Updated 2 years ago
- A light weight, super fast, large scale machine learning library on spark .☆680Updated 7 years ago
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆351Updated 3 years ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.