ExternalScheduler#

class gordias.dask_setup.ExternalScheduler(scheduler_file: str | Path, auto_shutdown: bool = True, **kwargs: Any)#

Scheduler using an externally started distributed.Cluster.

This is useful if the cluster needs to be set up outside of the program, for example in a HPC environment or for debugging purposes.

Parameters:
  • scheduler_file (str or Path) – Path to a file with scheduler information.

  • auto_shutdown (bool) – Turn on auto shutdown. By default set to True.

scheduler_file#

Path to a file with scheduler information.

Type:

str or Path

auto_shutdown#

Turn on auto shutdown. By default set to True.

Type:

bool

client#

A client that connect to and submit computation to a Dask cluster.

Type:

dask.Client

Methods