Skip to content

DataTree

RichardWagener edited this page Jul 8, 2020 · 2 revisions

~nowcast/data Directory Structure

SITE: Site code(alb = Albany; bnl = BNL)
images
camera_id (e.g. HD1A)
YYYYMMDD (archived raw .jpg images)
cache
camera_id (e.g. HD1A): current days images

latest (most recent image for each camera)

masks (static masks in .pkl and .npy files, not sure what created them and how to produce these for the Albany cameras)

GHI
YYYY-MM (raw GHI data files)
GHI_new
YYYYMM (output of GHI_preprocessing.py in .npz files, needed by predict.py)
tmp
YYYYMMDD (intermediate output of preprocess.py in .hkl and .pkl files)
stitch
YYYYMMDD (final output of generate_stitch.py in .sth and quicklooks in .png)
feature
YYYYMMDD (output from extract_features.py in .csv' and quicklooks in `.png showing the location where forecasted data would be coming from)
forecast
YYYYMMDD (output of predict.py in .csv for each GHI sensor and the specified forecast intervals)
plots (quicklook comparison plots in .png)
Clone this wiki locally