baidu / bigflowLinks
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,133Updated 2 years ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆673Updated 6 years ago
- AI on Hadoop☆1,732Updated this week
- BaikalDB, A Distributed HTAP Database.☆1,215Updated 4 months ago
- An industrial deep learning framework for high-dimension sparse data☆4,289Updated 9 months ago
- a TensorFlow-based distributed training framework optimized for large-scale sparse data.☆327Updated 2 weeks ago
- Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,080Updated 2 months ago
- A lightweight parameter server interface☆1,551Updated 2 years ago
- A distributed graph deep learning framework.☆2,903Updated last year
- 腾讯高性能分布式图计算框架Plato☆1,914Updated 3 years ago
- Galaxy is a cluster management system.☆326Updated 7 years ago
- Kubernetes-native Deep Learning Framework☆742Updated last year
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆953Updated 6 months ago
- PArallel Distributed Deep LEarning （PaddlePaddle核心框架，高性能单机、分布式训练和跨平台部署）☆34Updated 7 months ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,143Updated last year
- Multi-thread implementation of Factorization Machines with FTRL for binary-class classification problem.☆907Updated 4 years ago
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,013Updated last week
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,698Updated 4 years ago
- A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆490Updated 2 years ago
- TensorFlow Script☆683Updated last year
- ODPS Python SDK and data analysis framework☆436Updated last month
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,899Updated 2 years ago
- CTR prediction model based on spark(LR, GBDT, DNN)☆913Updated 5 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,757Updated last week
- An Internet-Scale Database.☆1,905Updated last year
- Papers on Computational Advertising☆4,316Updated 4 years ago
- Deep Learning 101 with PaddlePaddle （『飞桨』深度学习框架入门教程）☆2,750Updated 3 years ago
- Distributed training framework with parameter server☆338Updated 8 years ago
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆349Updated 2 years ago
- DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foun…☆1,106Updated 5 months ago
- A Scalable, High-Performance Distributed Key-Value Platform☆398Updated 7 years ago