cpex-cv_forecasting

Forecasting template and tools for creating daily weather forecasts for the CPEX-CV field experiment.

To run the scripts in this directory, you will need to following:

1. ImageMagick (for image processing).
2. Python v3.x (I use 3.7.4) with following modules:
   • bs4 (HTML parsing; if python yells at you about "Couldn't find a tree builder ", you may have to conda/pip install lxml)
   • datetime (dealing with dates)
   • numpy (number stuff)
   • PIL (Create gif files)
   • os (reading existing files)
   • subprocess (executing code outside python)
   • urllib (retrieving images)
   • time
3. Microsoft Powerpoint.

• Google Drive document with links and resources: https://docs.google.com/document/d/1fbgHyg7smXdD6AVZyczOzl1UvFjeB5TxeZdQ1_8xoxE/edit?usp=sharing
• Google Drive link: https://drive.google.com/drive/folders/14g2MU2wh6fWceYqPDgEeQqtZ734wW_zm?usp=sharing
• Zoom Meeting: https://uwmadison.zoom.us/j/96904936558?pwd=SFh2aHFKR3FHcGVxaVVnbnFQYzZ3dz09

---

Steps for automatically downloading the figures

(This won't work unless your manual steps work.)

• Before you run them for the first time, you will need to make the files executable (on Mac/Linux: chmod +x run_forecast_scripts.sh)

1. python ./run_forecast_scripts.py will run all the steps in the manual section BUT

• You will need to open it up and edit a few things (instructions at the top of the .sh file)
  • Decide on steps you need to run for true/false switches.
  • Change True/False in switched_download.txt according to what you want to download

---

Steps for manually downloading the figures

These should be run from the main directory.

1. Archive previous day's images: python ./supplementary/archive_yesterdays_images.py

This will take all the images from ./figs_final/ and move them into a new directory, if they are not already saved. It will then remove all the images from ./figs/, ./figs_cropped/, and ./figs_final/.

2. Download updated images for the forecast: python ./supplementary/download_daily_images_master.py

This will: - download images for the forecasting template. - reports on status of images (e.g. tells you if they are not available). - saves all the available images in the ./figs/ directory.

3. Create basic animations: python ./supplementary/create_animations.py

This will: - extend the last frame of each future animations by 3 frames, so a looping animation will stay longer at the last frame.

4. Crop, process, and annotate downloaded images: python ./supplementary/crop_edit_daily_images.py

This reads in switches_process.txt that was created in 2. It's automatic, so no need for any changes. It: - adds the locations of Sal wherever applicable. - crops images. - joins images together for animations. - creates final animations. - puts all intermediate imagery to ./figs_cropped/. - puts all final imagery (for the .pptx template) to ./figs_final/.

---

Steps for creating the Microsoft PowerPoint template

Make sure you have downloaded image files and cropped them before starting this.

1. Copy the forecast_template_link.pptx file and rename it. Then open the new file.

2. You will need to set the links working on your personal computer. This might vary from machine to machine, or from one PowerPoint version to another. But in general, here's what you need to do for each image in the template:

• Click on the image and open the Format picture panel (Picture Format in top menu var, then Format Pane).
• Under Shape Options, click on Fill and Line tab (the one that looks like a paint bucket).
• Under the Fill section, make sure Picture or texture fill is chosen, and click on the Insert .... button under Picture source. This will open a window where you can search for the image you want to link to.
• Find the image you want to link (the number at the beginning of the file name is the slide page you should insert them) and highlight it. All images for the ppt are stored in /figs_final/.
• Click Insert.

As you add each new link, the empty figure should be replaced with what it is being linked to. As you go through the file, you will see the file size increase (from <500KB to >60MB).

Preparing forecast template slides

3. After downloading and processing new images (daily), open the forecast template PowerPoint file and check that the images have updated. For example, model images have a timestamp on the top right, you can check over there. Also compare with individual images in the ./figs_final/ directory.

4. Go through and manually update all the dates that appear in titles. The dates in the footer (bottom left corner) will update automatically.

5. Annotate the document with comments, highlights, summaries, etc.

6. Copy (or Duplicate) the finished PPT file, and name it following this example: CPEX-CV_Forecast_YYYY-MM-DD.pptx

7. Move the final document to Google Drive.

---

FAQ

1. The script stuck at downloading ICAP_aerosol. What should I do?

• Always Check if the products exist on the source website first!
• ICAP_aerosol sometimes don't run and produce figures, so you may want to (1) set "icap_aerosol_ensemble = False" in switches_download.txt (2) use ASKOS forecasting as a replacement.

2. The joint precipitation animations are not created. What should I do?

• Always Check if the products exist on the source website first!
• Sometimes there is a data transfer issue between UW and UTAH, so check if UTAH website produces figures. If yes, set "uutah_precipitation = False" and "UTAH_website = True" in switches_download.txt
• Execute the script again.

3. The script stuck at downloading GEOS_forecasing information. What should I do?

• Always Check if the products exist on the source website first!
• In the most of time, you'll get them downloaded on your second try.
• If the script stops at downloading the cross section set "nasa_geos_cross_section = False" in switches_download.txt
• If the script still can't run through smoothly, set "nasa_geos = False" in switches_download.txt