A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and modular
☆334Dec 10, 2024Updated last year
Alternatives and similar repositories for sciluigi
Users that are interested in sciluigi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Utils around luigi.☆66Aug 22, 2025Updated last year
- Robust, flexible and resource-efficient pipelines using Go and the commandline☆1,109Aug 14, 2024Updated 2 years ago
- ☆17Sep 24, 2013Updated 13 years ago
- A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).☆936Updated this week
- deploy Dask.distributed to GridEngine (sge/pbs) cluster systems☆21Jan 11, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Send summary messages of your Luigi jobs to Slack☆46Apr 25, 2019Updated 7 years ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,783Updated this week
- TheSparkBox is an all-in-one Spark deployment that you can use to fire up a local cluster.☆12Jun 26, 2018Updated 8 years ago
- Tasks around metadata.☆22Apr 21, 2026Updated 5 months ago
- A workflow system for Natural Language Processing.☆21Oct 17, 2019Updated 6 years ago
- Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊☆1,478Sep 20, 2026Updated 3 weeks ago
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,626Updated this week
- An experimental repo for common snakemake rules and workflows☆44Mar 17, 2015Updated 11 years ago
- Automated CWL and Galaxy XML generation for Python tools that use argparse and click☆11Jul 29, 2019Updated 7 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A tool for running bioinformatics workflows locally or in the cloud.☆30Dec 13, 2019Updated 6 years ago
- *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…☆43May 13, 2016Updated 10 years ago
- A workflow language for data-driven computational pipelines☆3,503Updated this week
- a Graph database and R package for omic data integration☆20Oct 28, 2016Updated 9 years ago
- A pipelining tool to automate and standardise bioinformatics analyses on cluster environments.☆99Apr 9, 2023Updated 3 years ago
- Luigi pipelines and Dockerized apps for bioinformatics and data science☆11Oct 2, 2018Updated 8 years ago
- Pinball is a scalable workflow manager☆1,045Dec 10, 2019Updated 6 years ago
- SVG format genome browser style pictures☆17Oct 17, 2015Updated 10 years ago
- qtools has helper functions to submit jobs to compute clusters (PBS on TSCC, SGE on oolite) from within Python☆21Sep 20, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Common Workflow Language reference implementation☆376Sep 29, 2026Updated last week
- Deploy Dask on job schedulers like PBS, SLURM, and SGE☆256Dec 19, 2025Updated 9 months ago
- High throughput, pain-free big data pipelines.☆29Mar 11, 2017Updated 9 years ago
- RNA-Seq Snakemake example with Jekyll homepage creation☆20Feb 20, 2014Updated 12 years ago
- [Historical] Reproducible Analyses for Bioinformatics☆107Mar 11, 2019Updated 7 years ago
- 🚧⛔ Tools help with continuous integration on services such as travis-ci and appveyor. (mostly replaced by conda-smithy)☆15Jun 20, 2018Updated 8 years ago
- Simple tokenised template system for SGE☆10Mar 1, 2023Updated 3 years ago
- Tool to easily start up an IPython cluster on different schedulers.☆147May 1, 2020Updated 6 years ago
- MDAnalysis Tutorial at the 2015 CECAM Macromolecular simulation software workshop☆13Jul 22, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- See the main fork of this repository here >>>☆39Sep 18, 2026Updated 3 weeks ago
- Bpipe - a tool for running and managing bioinformatics pipelines☆241Sep 19, 2026Updated 3 weeks ago
- A project to help develop Luigi pipelines using Docker ✳️☆80Apr 21, 2021Updated 5 years ago
- CGAT-ruffus is a lightweight python module for running computational pipelines☆175Jul 12, 2021Updated 5 years ago
- Import a CWL workflow specification to Nextflow script (experimental)☆27Aug 9, 2018Updated 8 years ago
- Data workflow tool, like a "Make for data"☆1,483Apr 12, 2022Updated 4 years ago
- A library for defensive data analysis.☆500Jan 6, 2020Updated 6 years ago