Pipeline
Execution flow, mode registry, and shared pipeline utilities.
Use these helpers to wire configs, run the pipeline, or extend selection modes:
from hipscatalog_gen.pipeline import get_selection_mode, run_pipeline
mode = get_selection_mode("mag_global")
run_pipeline(cfg)
Run the full HiPS catalog generation pipeline. |
|
Registry entry for a selection mode. |
|
Return a selection mode entry, raising on unsupported names. |
|
Represents a single ordered pipeline step. |
|
Shared state passed between pipeline stages. |
|
Execute ordered pipeline stages, threading a context object. |
|
Cross-field validation for cluster/output and shared algorithm settings. |
|
Surface mag_global config issues early. |
|
|
Surface score_global config issues early. |
|
Surface score_density_hybrid config issues early. |
Emit the initial pipeline log lines. |
|
Emit closing log lines and optionally persist process.log. |
|
Load inputs, validate RA/DEC, repartition, and persist when needed. |
|
Compute density maps for all depths and write them to disk. |
|
Finalize tiles and write optional Allsky.tsv. |
|
Build output counts from selection-stage precomputed depth totals. |
|
|
Configure a structured logger that writes to stdout and process.log; optionally JSON lines. |