baidu / bigflowLinks
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,135Updated 2 years ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- AI on Hadoop☆1,731Updated last week
- BaikalDB, A Distributed HTAP Database.☆1,213Updated 3 months ago
- An Internet-Scale Database.☆1,904Updated last year
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆673Updated 5 years ago
- a TensorFlow-based distributed training framework optimized for large-scale sparse data.☆327Updated this week
- Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,077Updated last month
- An industrial deep learning framework for high-dimension sparse data☆4,285Updated 8 months ago
- Galaxy is a cluster management system.☆326Updated 7 years ago
- A light-weight RPC implement of google protobuf RPC framework.☆2,142Updated last year
- A Toolkit for Industrial Topic Modeling☆2,643Updated 3 years ago
- Deep Learning Chinese Word Segment☆2,078Updated 7 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,754Updated this week
- CUP, common useful python-lib. (Currently, Most popular python lib in baidu). Python 开发底层库, 涵盖util、service(threadpool/generator/executo…☆951Updated 5 months ago
- 挖坑与填坑☆691Updated 8 years ago
- ODPS Python SDK and data analysis framework☆435Updated 2 weeks ago
- A distributed graph deep learning framework.☆2,900Updated last year
- Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,010Updated last week
- TBase is an enterprise-level distributed HTAP database. Through a single database cluster to provide users with highly consistent distrib…☆1,416Updated 8 months ago
- A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆490Updated 2 years ago
- PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,695Updated 4 years ago
- TensorFlow Script☆684Updated last year
- A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,901Updated 2 years ago
- CTR prediction model based on spark(LR, GBDT, DNN)☆914Updated 5 years ago
- A distributed in-memory NOSQL system based on TARS framework, support LRU algorithm and data persists on back-end database. Users can ea…☆746Updated last year
- A lightweight parameter server interface☆1,548Updated 2 years ago
- Streaming System 相关的论文读物☆733Updated 3 years ago
- The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,367Updated last year
- A light weight, super fast, large scale machine learning library on spark .☆677Updated 7 years ago
- Common library☆132Updated 7 years ago
- Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logi…☆348Updated 2 years ago