A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and modular
☆334Dec 10, 2024Updated last year
Alternatives and similar repositories for sciluigi
Users that are interested in sciluigi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Robust, flexible and resource-efficient pipelines using Go and the commandline☆1,109Aug 14, 2024Updated 2 years ago
- ☆17Sep 24, 2013Updated 12 years ago
- A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).☆936Updated this week
- deploy Dask.distributed to GridEngine (sge/pbs) cluster systems☆21Jan 11, 2017Updated 9 years ago
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,776Jul 18, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- TheSparkBox is an all-in-one Spark deployment that you can use to fire up a local cluster.☆12Jun 26, 2018Updated 8 years ago
- A workflow system for Natural Language Processing.☆21Oct 17, 2019Updated 6 years ago
- Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊☆1,480Aug 15, 2026Updated last month
- A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin☆6,627Updated this week
- An experimental repo for common snakemake rules and workflows☆45Mar 17, 2015Updated 11 years ago
- Automated CWL and Galaxy XML generation for Python tools that use argparse and click☆11Jul 29, 2019Updated 7 years ago
- A tool for running bioinformatics workflows locally or in the cloud.☆30Dec 13, 2019Updated 6 years ago
- A DSL for data-driven computational pipelines☆3,489Updated this week
- A pipelining tool to automate and standardise bioinformatics analyses on cluster environments.☆99Apr 9, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Pinball is a scalable workflow manager☆1,045Dec 10, 2019Updated 6 years ago
- Luigi pipelines and Dockerized apps for bioinformatics and data science☆11Oct 2, 2018Updated 7 years ago
- qtools has helper functions to submit jobs to compute clusters (PBS on TSCC, SGE on oolite) from within Python☆21Sep 20, 2023Updated 3 years ago
- Common Workflow Language reference implementation☆376Updated this week
- Deploy Dask on job schedulers like PBS, SLURM, and SGE☆256Dec 19, 2025Updated 9 months ago
- prioritize effects of variant annotations from VEP, SnpEff, et al.☆34Aug 14, 2026Updated last month
- High throughput, pain-free big data pipelines.☆29Mar 11, 2017Updated 9 years ago
- RNA-Seq Snakemake example with Jekyll homepage creation☆20Feb 20, 2014Updated 12 years ago
- [Historical] Reproducible Analyses for Bioinformatics☆107Mar 11, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🚧⛔ Tools help with continuous integration on services such as travis-ci and appveyor. (mostly replaced by conda-smithy)☆15Jun 20, 2018Updated 8 years ago
- Tool to easily start up an IPython cluster on different schedulers.☆147May 1, 2020Updated 6 years ago
- An in depth tutorial on sklearn's Pipeline and FeatureUnion classes.☆16May 5, 2017Updated 9 years ago
- MDAnalysis Tutorial at the 2015 CECAM Macromolecular simulation software workshop☆13Jul 22, 2016Updated 10 years ago
- See the main fork of this repository here >>>☆39Updated this week
- Bpipe - a tool for running and managing bioinformatics pipelines☆241Updated this week
- CGAT-ruffus is a lightweight python module for running computational pipelines☆175Jul 12, 2021Updated 5 years ago
- Homebrew repository for CloudBioLinux: incubator for formulas to end up in homebrew-science☆19Oct 17, 2016Updated 9 years ago
- A framework (comand line tool + libraries) for creating flexible compute pipelines☆55Jan 29, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Import a CWL workflow specification to Nextflow script (experimental)☆27Aug 9, 2018Updated 8 years ago
- Data workflow tool, like a "Make for data"☆1,483Apr 12, 2022Updated 4 years ago
- A library for defensive data analysis.☆500Jan 6, 2020Updated 6 years ago
- Analysis from kallisto paper☆32Feb 10, 2016Updated 10 years ago
- Geospatial operations for NetCDF and numpy☆13Jul 30, 2026Updated last month
- variant discovery and annotation using GATK and Ensembl☆17Jun 27, 2013Updated 13 years ago
- Phase I & part of Phase II of NASA SBIR - Parallel Machine Learning on Satellite Data☆45Jul 31, 2023Updated 3 years ago