baidu / bigflowLinks
Baidu Bigflow is an interface that allows for writing distributed computing programs and provides lots of simple, flexible, powerful APIs. Using Bigflow, you can easily handle data of any scale. Bigflow processes 4P+ data inside Baidu and runs about 10k jobs every day.
☆1,133Updated 2 months ago
Alternatives and similar repositories for bigflow
Users that are interested in bigflow are comparing it to the libraries listed below
Sorting:
- Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosop…☆672Updated 6 years ago
 - 腾讯高性能分布式图计算框架Plato☆1,912Updated 4 years ago
 - A lightweight parameter server interface☆1,559Updated 2 years ago
 - An Internet-Scale Database.☆1,905Updated last year
 - Blade is a powerful build system from Tencent, supports many mainstream programming languages, such as C/C++, java, scala, python, protob…☆2,093Updated 3 months ago
 - AI on Hadoop☆1,734Updated 4 months ago
 - ODPS Python SDK and data analysis framework☆446Updated last month
 - An industrial deep learning framework for high-dimension sparse data☆4,302Updated last year
 - A light-weight RPC implement of google protobuf RPC framework.☆2,147Updated 2 years ago
 - Apache Pegasus - A horizontally scalable, strongly consistent and high-performance key-value store☆2,031Updated this week
 - a TensorFlow-based distributed training framework optimized for large-scale sparse data.☆330Updated last week
 - A Toolkit for Industrial Topic Modeling☆2,643Updated 4 years ago
 - Galaxy is a cluster management system.☆326Updated 8 years ago
 - A distributed graph deep learning framework.☆2,899Updated 2 years ago
 - A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.☆1,902Updated 2 years ago
 - BaikalDB, A Distributed HTAP Database.☆1,227Updated 2 weeks ago
 - PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat b…☆1,706Updated 5 years ago
 - A light weight, super fast, large scale machine learning library on spark .☆680Updated 7 years ago
 - A Flexible and Powerful Parameter Server for large-scale machine learning☆6,778Updated 3 weeks ago
 - PArallel Distributed Deep LEarning (PaddlePaddle核心框架,高性能单机、分布式训练和跨平台部署)☆34Updated last year
 - A full-text search engine supporting massive users, real-time updating, fast fuzzy matching and flexible table splitting.☆493Updated 2 years ago
 - Distributed LR、 FM model on Parameter Server. FTRL and SGD Optimization Algorithm.☆225Updated 7 years ago
 - Distributed training framework with parameter server☆338Updated 8 years ago
 - Deep Learning Chinese Word Segment☆2,078Updated 7 years ago
 - A stand alone industrial serving system for angel.☆65Updated 3 years ago
 - Kubernetes-native Deep Learning Framework☆743Updated last year
 - A distributed in-memory NOSQL system based on TARS framework, support LRU algorithm and data persists on back-end database. Users can ea…☆746Updated last year
 - The Paxos library implemented in C++ that has been used in the WeChat production environment.☆3,375Updated last year
 - Multi-thread implementation of Factorization Machines with FTRL for binary-class classification problem.☆908Updated 4 years ago
 - 中文文档simhash值计算☆1,157Updated 6 months ago