[8.3.2] Viz PC + Prefect Agent + Tiled Ingestion Flow

[davramov]

Currently, the view tomography reconstruction app is set up with a file watcher to check if new Zarr files have been added to the data folder.

Rather than polling, we can set up a Prefect Agent on the Viz PC, or the flow-prd VM, that is triggered at the end of our reconstruction flows/code and registers the new reconstruction in Tiled. With SciCat dataset ingestion, we could link directly to the vis app from our SciCat portal.

[davramov]

This came up again when talking to Dula. I will look into making a Prefect worker live on the Viz PC, which is triggered when reconstruction is done. This worker would perform a data transfer flow from data832 to the directory that the Tiled server watches (probably set in the dispatcher).

Additionally, I should look into copying the Tiffs to data832 before Zarr, just so it is more immediately available to the user.