A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and modular
☆335Dec 10, 2024Updated last year
Alternatives and similar repositories for sciluigi
Users that are interested in sciluigi are comparing it to the libraries listed below
Sorting:
- Robust, flexible and resource-efficient pipelines using Go and the commandline☆1,117Aug 14, 2024Updated last year
- A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).☆926Mar 2, 2026Updated last week
- Send summary messages of your Luigi jobs to Slack☆46Apr 25, 2019Updated 6 years ago
- deploy Dask.distributed to GridEngine (sge/pbs) cluster systems☆21Jan 11, 2017Updated 9 years ago
- A tool for running bioinformatics workflows locally or in the cloud.☆30Dec 13, 2019Updated 6 years ago
- Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊☆1,480Jan 8, 2026Updated 2 months ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,683Feb 28, 2026Updated last week
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,535Updated this week
- A pipelining tool to automate and standardise bioinformatics analyses on cluster environments.☆99Apr 9, 2023Updated 2 years ago
- A DSL for data-driven computational pipelines☆3,316Updated this week
- qtools has helper functions to submit jobs to compute clusters (PBS on TSCC, SGE on oolite) from within Python☆21Sep 20, 2023Updated 2 years ago
- See the main fork of this repository here >>>☆39Updated this week
- Automated CWL and Galaxy XML generation for Python tools that use argparse and click☆11Jul 29, 2019Updated 6 years ago
- prioritize effects of variant annotations from VEP, SnpEff, et al.☆34Dec 10, 2024Updated last year
- A bioinformatics API to interface with public multi-omics bio databases for wicked fast data integration.☆36Jul 10, 2024Updated last year
- Bio3D an HTML5 visualization tool for biological datasets☆25May 31, 2020Updated 5 years ago
- A genomics pipeline build on top of the GATK Queue framework. Main repository: https://github.com/NationalGenomicsInfrastructure/piper (m…☆21Sep 6, 2016Updated 9 years ago
- Tasks around metadata.☆21Updated this week
- 🚧⛔ Tools help with continuous integration on services such as travis-ci and appveyor. (mostly replaced by conda-smithy)☆14Jun 20, 2018Updated 7 years ago
- Geospatial operations for NetCDF and numpy☆13Jan 22, 2026Updated last month
- An experimental repo for common snakemake rules and workflows☆46Mar 17, 2015Updated 10 years ago
- Common Workflow Language reference implementation☆362Feb 28, 2026Updated last week
- Phase I & part of Phase II of NASA SBIR - Parallel Machine Learning on Satellite Data☆45Jul 31, 2023Updated 2 years ago
- High throughput, pain-free big data pipelines.☆30Mar 11, 2017Updated 8 years ago
- A project to help develop Luigi pipelines using Docker ✳️☆80Apr 21, 2021Updated 4 years ago
- [Historical] Reproducible Analyses for Bioinformatics☆106Mar 11, 2019Updated 6 years ago
- An in depth tutorial on sklearn's Pipeline and FeatureUnion classes.☆16May 5, 2017Updated 8 years ago
- A Flow-based Programming inspired micro-framework / un-framework for Go (Golang)☆171Mar 28, 2025Updated 11 months ago
- Pinball is a scalable workflow manager☆1,045Dec 10, 2019Updated 6 years ago
- Snakemake skeleton - Build workflows with Snakemake☆19May 17, 2024Updated last year
- Tool to easily start up an IPython cluster on different schedulers.☆146May 1, 2020Updated 5 years ago
- Import a CWL workflow specification to Nextflow script (experimental)☆27Aug 9, 2018Updated 7 years ago
- Quick access to gene synonyms☆29Mar 1, 2026Updated last week
- Simple tokenised template system for SGE☆10Mar 1, 2023Updated 3 years ago
- Luigi pipelines and Dockerized apps for bioinformatics and data science☆11Oct 2, 2018Updated 7 years ago
- a Graph database and R package for omic data integration☆19Oct 28, 2016Updated 9 years ago
- Deploy Dask on job schedulers like PBS, SLURM, and SGE☆254Dec 19, 2025Updated 2 months ago
- Validated, scalable, community developed variant calling, RNA-seq and small RNA analysis☆1,027Aug 24, 2024Updated last year
- Bpipe - a tool for running and managing bioinformatics pipelines☆239Feb 2, 2026Updated last month