[21pt] Create HydroVIS release package for HAND

[RobHanna-NOAA]

Updated: Nov 26, 2024:

• Hold. HV is re-evaluating how to load data, when and what formats.
• We will likely just drop the branch level hydrotables and use the HUC level aggregated version. It does not appear they are using the HUC level hydrotables, but are confirming it. Either way, that hydrotable should be parquet.

---

Create a new tool that can be run only as needed for Production BED runs to be released to HydroVIS. The new tool needs to do the following:

• Accept an argument for which fim run folder to be used as source: ie) /data/previous_fim/HAND_4_5_11_1
• An argument for where to put the output files for HydroVIS. ie)/data/release/HAND_4_5_11_1 (yes.. I will start keeping seperate folders for what I send to HV which I do not currently do.
• The folder structure continues to be the same as our current hand output folder. ie) /HAND_4_5_11_1/{huc number}/branches/{branch number}/xxxx.files.
• Make a new parquet file in the branch folder that has the rem_zeroed_masked. tif and the hydroTable.csv inside of it.
• Copy over the gw_catchments_reaches_filtered_addedAttributes_{branch number}.tif into the branch folder.
• At each HUC level, there may / may not be a osm_bridge_centroids.gpkg file. Copy that into the huc level folder.
• An optional config file (details below), but defaults to one already embedded in our foss_fim/config folder.
• pick a reasonable name for the branch parquet file.

We may have other files, so we need some sort of a config file that tells us: (and it doesn't need to be overly fancy)

• which branch files are copied into the branch parquet.
• which branch files file are simply copied over to the branch folder
• which files are copied over from the HUC level (ie. osm_bridge_centroids.gpkg is the only one at this time.

Note: I strongly do not recommend making this parquet file as part of the hand run time processing (multiple reasons why)

Need it sooner than later, but not urgent but by Jan 1 at the latest if reasonably possible. It allows time for us to do some dev and testing in HV.

In theory, if this works, we don't have to wait until the March release, to run this tool and re-hand over HAND_4_5_11_1 over to them. We believe it will have major gains in performance for them.