Pipelines.jl

A lightweight and powerful Julia package for computational pipelines.

Building reusable pipelines and workflows is easier than you have ever thought.

Package Features

Easy to build both simple and complex tasks.
Supports external command lines and pure Julia functions.
Supports resuming interrupted tasks, retrying failed tasks, and skipping finished tasks.
Supports dependency check.
Supports inputs, outputs validation, and so on.
Supports program queuing and workload management with JobSchedulers.jl

Pipelines.jl can be installed using the Julia package manager. From the Julia REPL, type ] to enter the Pkg REPL mode and run

pkg> add Pipelines

To use the package, type

using Pipelines