A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and modular
☆334Dec 10, 2024Updated last year
Alternatives and similar repositories for sciluigi
Users that are interested in sciluigi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Utils around luigi.☆65Aug 22, 2025Updated last year
- Robust, flexible and resource-efficient pipelines using Go and the commandline☆1,113Aug 14, 2024Updated 2 years ago
- ☆17Sep 24, 2013Updated 13 years ago
- A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).☆936Updated this week
- Send summary messages of your Luigi jobs to Slack☆46Apr 25, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- deploy Dask.distributed to GridEngine (sge/pbs) cluster systems☆21Jan 11, 2017Updated 9 years ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,792Updated this week
- Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊☆1,481Sep 20, 2026Updated 2 months ago
- TheSparkBox is an all-in-one Spark deployment that you can use to fire up a local cluster.☆12Jun 26, 2018Updated 8 years ago
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,637Updated this week
- Deploy Dask on job schedulers like PBS, SLURM, and SGE☆256Dec 19, 2025Updated 11 months ago
- Heterogeneity-incorporating Workflow ApplicationMaster for YARN☆26Oct 31, 2017Updated 9 years ago
- A project to help develop Luigi pipelines using Docker ✳️☆80Apr 21, 2021Updated 5 years ago
- An experimental repo for common snakemake rules and workflows☆44Mar 17, 2015Updated 11 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- CGAT-ruffus is a lightweight python module for running computational pipelines☆174Oct 16, 2026Updated last month
- Common Workflow Language reference implementation☆375Updated this week
- Tasks around metadata.☆22Apr 21, 2026Updated 6 months ago
- Automated CWL and Galaxy XML generation for Python tools that use argparse and click☆11Jul 29, 2019Updated 7 years ago
- Bio3D an HTML5 visualization tool for biological datasets☆24May 31, 2020Updated 6 years ago
- A tool for running bioinformatics workflows locally or in the cloud.☆30Dec 13, 2019Updated 6 years ago
- prioritize effects of variant annotations from VEP, SnpEff, et al.☆35Sep 25, 2026Updated last month
- Pinball is a scalable workflow manager☆1,044Dec 10, 2019Updated 6 years ago
- Bpipe - a tool for running and managing bioinformatics pipelines☆241Nov 8, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- SVG format genome browser style pictures☆17Oct 17, 2015Updated 11 years ago
- a Graph database and R package for omic data integration☆20Oct 28, 2016Updated 10 years ago
- Luigi pipelines and Dockerized apps for bioinformatics and data science☆11Oct 2, 2018Updated 8 years ago
- qtools has helper functions to submit jobs to compute clusters (PBS on TSCC, SGE on oolite) from within Python☆21Sep 20, 2023Updated 3 years ago
- A pipelining tool to automate and standardise bioinformatics analyses on cluster environments.☆99Apr 9, 2023Updated 3 years ago
- 🚧⛔ Tools help with continuous integration on services such as travis-ci and appveyor. (mostly replaced by conda-smithy)☆15Jun 20, 2018Updated 8 years ago
- RNA-Seq Snakemake example with Jekyll homepage creation☆20Feb 20, 2014Updated 12 years ago
- [Historical] Reproducible Analyses for Bioinformatics☆107Mar 11, 2019Updated 7 years ago
- Validated, scalable, community developed variant calling, RNA-seq and small RNA analysis☆1,031Aug 24, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Tool to easily start up an IPython cluster on different schedulers.☆147May 1, 2020Updated 6 years ago
- Data workflow tool, like a "Make for data"☆1,481Apr 12, 2022Updated 4 years ago
- Phase I & part of Phase II of NASA SBIR - Parallel Machine Learning on Satellite Data☆45Jul 31, 2023Updated 3 years ago
- A library for defensive data analysis.☆500Jan 6, 2020Updated 6 years ago
- Feather: fast, interoperable binary data frame storage for Python, R, and more powered by Apache Arrow☆2,755Dec 8, 2025Updated 11 months ago
- Homebrew repository for CloudBioLinux: incubator for formulas to end up in homebrew-science☆19Oct 17, 2016Updated 10 years ago
- 🐍 🐳 Luigi in Docker - alpine and ubuntu images available☆51May 7, 2021Updated 5 years ago
Are these results useful?