baidu / bigflowLinks
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,136Updated last week
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆673Updated 6 years ago
- 腾讯高性能分布式图计算框架Plato☆1,912Updated 4 years ago
- An Internet-Scale Database.☆1,906Updated last year
- AI on Hadoop☆1,736Updated 5 months ago
- An industrial deep learning framework for high-dimension sparse data☆4,307Updated last year
- A lightweight parameter server interface☆1,558Updated 2 years ago
- Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,094Updated 2 weeks ago
- A distributed graph deep learning framework.☆2,901Updated 2 years ago
- Galaxy is a cluster management system.☆327Updated 8 years ago
- BaikalDB, A Distributed HTAP Database.☆1,228Updated 2 months ago
- A Toolkit for Industrial Topic Modeling☆2,646Updated 4 years ago
- a TensorFlow-based distributed training framework optimized for large-scale sparse data.☆332Updated last month
- ODPS Python SDK and data analysis framework☆446Updated last week
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,038Updated this week
- 中文文档simhash值计算☆1,162Updated 7 months ago
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,709Updated 5 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,783Updated 2 months ago
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,903Updated 2 years ago
- 挖坑与填坑☆688Updated 9 years ago
- A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆495Updated 2 years ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,148Updated 2 years ago
- Deep Learning Chinese Word Segment☆2,078Updated 7 years ago
- Kubernetes-native Deep Learning Framework☆744Updated last year
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆953Updated last year
- Easy Machine Learning is a general-purpose dataflow-based system for easing the process of applying machine learning algorithms to real w…☆1,979Updated 2 years ago
- Distributed training framework with parameter server☆338Updated 9 years ago
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆351Updated 3 years ago
- A light weight, super fast, large scale machine learning library on spark .☆680Updated 7 years ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,378Updated 2 years ago
- Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.☆1,850Updated last year