bloomreach / briefly

Related projects: ⓘ

• Byhiras / pyavroc
  ☆49Updated this week
• miku / gluish
  Utils around luigi.
  ☆65Updated 3 years ago
• plecto / motorway
  Cloud ready pure-python streaming data pipeline library
  ☆154Updated 3 weeks ago
• linkedin / python-avro-json-serializer
  Serializes data into a JSON format using AVRO schema.
  ☆137Updated 2 years ago
• spotify / pyschema
  Python library for class-based schema definition, object serialization and data validation
  ☆62Updated 8 years ago
• steveniemitz / scales
  A python RPC client stack
  ☆45Updated 2 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 9 years ago
• aht / stream.py
  Lazily-evaluated, parallelizable Python pipeline.
  ☆96Updated 2 years ago
• dask / hdfs3
  A wrapper for libhdfs3 to interact with HDFS from Python
  ☆136Updated 3 years ago
• dask / knit
  Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
  ☆53Updated 6 years ago
• Yelp / data_pipeline
  Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
  ☆109Updated 2 years ago
• kurtbrose / faststat
  fast online statistics collection
  ☆78Updated 2 years ago
• stitchfix / splits
  A Python library for dealing with splittable files
  ☆42Updated 4 years ago
• pystorm / pystorm
  Battle-tested Apache Storm Multi-Lang implementation for Python
  ☆71Updated 2 years ago
• omergertel / pyformance
  Performance metrics, based on Coda Hale's Yammer metrics
  ☆195Updated last year
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆35Updated 8 years ago
• gterzian / Python-Parallel-Collections
  Python collections supporting parallel map/reduce style methods
  ☆40Updated last year
• PolicyStat / terrarium
  Package and ship relocatable python virtualenvs, like a boss.
  ☆171Updated 4 years ago
• Yelp / schematizer
  A schema store service that tracks and manages all the schemas used in the Data Pipeline
  ☆86Updated 3 years ago
• martindurant / fastparquet
  python implementation of the parquet columnar file format.
  ☆22Updated last week
• blaze / castra
  Partitioned storage system based on blosc. **No longer actively maintained.**
  ☆153Updated 7 years ago
• agiliq / notebooks
  ☆82Updated 5 years ago
• alonho / pystuck
  a utility for debugging stuck python programs
  ☆92Updated 2 years ago
• glyph / deployme
  Example project for deployment
  ☆92Updated 8 years ago
• Yelp / data_pipeline_avro_util
  Provides a Pythonic interface for reading and writing Avro schemas
  ☆26Updated 2 years ago
• airbnb / transformpy
  transformpy is a Python 2/3 module for doing transforms on "streams" of data
  ☆29Updated 7 years ago
• robdmc / consecution
  A pipeline abstraction for Python
  ☆168Updated 3 years ago
• eXascaleInfolab / PyExPool
  Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity,…
  ☆164Updated 5 years ago
• blaze / chest
  Simple spill-to-disk dictionary
  ☆60Updated 2 years ago