Skip to content

sgnl.bin.dagger

prepare_osdf_support(config, dag_dir)

Prepare config for frame transfer by writing flat frame caches with every osdf:// and file:// URI rewritten to point at the job's scratch directory on the execute node. Call this once after loading config, before any workflow generation.

Source code in sgnl/bin/dagger.py
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
def prepare_osdf_support(config, dag_dir):
    """
    Prepare config for frame transfer by writing flat frame caches with every
    osdf:// and file:// URI rewritten to point at the job's scratch directory
    on the execute node. Call this once after loading config, before any
    workflow generation.
    """
    if config.source and config.source.frame_cache:
        flat_cache_path = os.path.join(dag_dir, "flat_frame_cache.cache")
        config.source.transfer_frame_cache = osdf_flatten_frame_cache(
            config.source.frame_cache, new_cache_name=flat_cache_path
        )

    if config.source and config.source.inj_frame_cache:
        flat_inj_cache_path = os.path.join(dag_dir, "flat_inj_frame_cache.cache")
        config.source.transfer_inj_frame_cache = osdf_flatten_frame_cache(
            config.source.inj_frame_cache, new_cache_name=flat_inj_cache_path
        )