A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and modular
☆334Dec 10, 2024Updated last year
Alternatives and similar repositories for sciluigi
Users that are interested in sciluigi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Utils around luigi.☆66Aug 22, 2025Updated last year
- Robust, flexible and resource-efficient pipelines using Go and the commandline☆1,110Aug 14, 2024Updated 2 years ago
- ☆17Sep 24, 2013Updated 13 years ago
- A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).☆936Updated this week
- Send summary messages of your Luigi jobs to Slack☆46Apr 25, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- deploy Dask.distributed to GridEngine (sge/pbs) cluster systems☆21Jan 11, 2017Updated 9 years ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,781Oct 14, 2026Updated 2 weeks ago
- Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊☆1,480Sep 20, 2026Updated last month
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,629Oct 11, 2026Updated 2 weeks ago
- TheSparkBox is an all-in-one Spark deployment that you can use to fire up a local cluster.☆12Jun 26, 2018Updated 8 years ago
- Heterogeneity-incorporating Workflow ApplicationMaster for YARN☆26Oct 31, 2017Updated 9 years ago
- Deploy Dask on job schedulers like PBS, SLURM, and SGE☆256Dec 19, 2025Updated 10 months ago
- CGAT-ruffus is a lightweight python module for running computational pipelines☆174Oct 16, 2026Updated 2 weeks ago
- A project to help develop Luigi pipelines using Docker ✳️☆80Apr 21, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Common Workflow Language reference implementation☆376Updated this week
- An experimental repo for common snakemake rules and workflows☆44Mar 17, 2015Updated 11 years ago
- Automated CWL and Galaxy XML generation for Python tools that use argparse and click☆11Jul 29, 2019Updated 7 years ago
- prioritize effects of variant annotations from VEP, SnpEff, et al.☆35Sep 25, 2026Updated last month
- Bio3D an HTML5 visualization tool for biological datasets☆24May 31, 2020Updated 6 years ago
- A tool for running bioinformatics workflows locally or in the cloud.☆30Dec 13, 2019Updated 6 years ago
- A workflow language for data-driven computational pipelines☆3,521Updated this week
- Bpipe - a tool for running and managing bioinformatics pipelines☆241Oct 23, 2026Updated last week
- Pinball is a scalable workflow manager☆1,046Dec 10, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SVG format genome browser style pictures☆17Oct 17, 2015Updated 11 years ago
- Luigi pipelines and Dockerized apps for bioinformatics and data science☆11Oct 2, 2018Updated 8 years ago
- qtools has helper functions to submit jobs to compute clusters (PBS on TSCC, SGE on oolite) from within Python☆21Sep 20, 2023Updated 3 years ago
- Validated, scalable, community developed variant calling, RNA-seq and small RNA analysis☆1,031Aug 24, 2024Updated 2 years ago
- 🚧⛔ Tools help with continuous integration on services such as travis-ci and appveyor. (mostly replaced by conda-smithy)☆15Jun 20, 2018Updated 8 years ago
- [Historical] Reproducible Analyses for Bioinformatics☆107Mar 11, 2019Updated 7 years ago
- Geospatial operations for NetCDF and numpy☆13Jul 30, 2026Updated 3 months ago
- RNA-Seq Snakemake example with Jekyll homepage creation☆20Feb 20, 2014Updated 12 years ago
- AXIOME - Automation, Extension, and Integration Of Microbial Ecology: Helper tools to make managing numerical ecology pipelines easier☆13Jun 20, 2014Updated 12 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Tool to easily start up an IPython cluster on different schedulers.☆147May 1, 2020Updated 6 years ago
- Deprecated☆101Aug 12, 2019Updated 7 years ago
- Data workflow tool, like a "Make for data"☆1,482Apr 12, 2022Updated 4 years ago
- Python pipeline for analysis of SafeSeqS DNA sequencing data.☆11Apr 2, 2018Updated 8 years ago
- Phase I & part of Phase II of NASA SBIR - Parallel Machine Learning on Satellite Data☆45Jul 31, 2023Updated 3 years ago
- A library for defensive data analysis.☆500Jan 6, 2020Updated 6 years ago
- MDAnalysis Tutorial at the 2015 CECAM Macromolecular simulation software workshop☆13Jul 22, 2016Updated 10 years ago