Cluster

Dask cluster orchestration and diagnostics contexts.

Quick usage:

from hipscatalog_gen.cluster import setup_cluster, shutdown_cluster
runtime, diag_ctx = setup_cluster(cfg.cluster, report_dir, log_fn)
shutdown_cluster(runtime)

hipscatalog_gen.cluster.runtime.ClusterRuntime

Runtime handles for the Dask cluster.

hipscatalog_gen.cluster.runtime.setup_cluster

Create and configure the Dask cluster and diagnostics context.

hipscatalog_gen.cluster.runtime.shutdown_cluster

Gracefully close client and cluster.