Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option for lat/lon gridlines or inset map #1

Open
hcronk opened this issue Apr 6, 2017 · 0 comments
Open

Option for lat/lon gridlines or inset map #1

hcronk opened this issue Apr 6, 2017 · 0 comments
Assignees

Comments

@hcronk
Copy link
Owner

hcronk commented Apr 6, 2017

Create configurable option to display location using lat/lon gridlines or the mini map insert

@hcronk hcronk self-assigned this Apr 6, 2017
hcronk pushed a commit that referenced this issue Jul 27, 2020
Merge plot title in config file (may require some resolution with the GOES related change)
hcronk pushed a commit that referenced this issue Jul 17, 2021
commit a93b7e7c060cb49d3070c9f32209f1b9e7788ab1
Author: Heather Cronk <[email protected]>
Date:   Fri Jul 16 16:37:37 2021 -0600

    Added netcdf4, owslib, and pillow to support updates. Updated miniconda image and versions of h5py, pandas, and cartopy for environment upgrade and compatability

commit 30fc534176b941ef221da818948ac1dd64b14915
Merge: 757ed99 1eabfcf
Author: Heather Cronk <[email protected]>
Date:   Fri Jul 16 14:58:51 2021 -0600

    Testing PR #14: Cartopy Method

    Merge branch 'cartopy_method' of https://github.com/tkach940/oco2_modis_vistool into tkach940-cartopy_method

commit 1eabfcf
Merge: 4f7d55d 42a900c
Author: tkach940 <[email protected]>
Date:   Thu Jul 15 20:24:12 2021 +0300

    Merge pull request #3 from aronnem/cartopy_method

    Cartopy method

commit 42a900c
Author: Aronne Merrelli <[email protected]>
Date:   Thu Jul 15 15:55:40 2021 +0000

    update the JSON input config files so that they both directly work with the repository contents
    added a sample OCO-2 Lite CO2 netCDF file, extracted from real sounding locations

commit 2202e1f
Author: Aronne Merrelli <[email protected]>
Date:   Thu Jul 15 15:54:36 2021 +0000

    bugfix for the auto output name, it was creating a double underscore if Region was not set

commit c52e439
Author: Aronne Merrelli <[email protected]>
Date:   Thu Jul 15 15:49:16 2021 +0000

    rearrange the Encodings, so that the most likely used layers occur first.
    In particular, made the original hardcoded layer the first one (MODIS Aqua RGB)

commit 4f7d55d
Merge: 7fcab2e f23acf4
Author: tkach940 <[email protected]>
Date:   Tue Jul 13 17:17:30 2021 +0300

    Merge pull request #2 from aronnem/cartopy_method

    Cartopy method

commit f23acf4
Author: Aronne Merrelli <[email protected]>
Date:   Mon Jul 12 22:01:52 2021 +0000

    bugfix: only retrieve the layer name and URL when Worldview is selected

commit 9b07d47
Author: Aronne Merrelli <[email protected]>
Date:   Mon Jul 12 21:37:50 2021 +0000

    a few more replacements of the module name - replace oco2_modis_vistool with oco_vistool

commit bcc70b6
Author: Aronne Merrelli <[email protected]>
Date:   Mon Jul 12 21:35:30 2021 +0000

    update documentation for the new default filenames and input JSON field for background image

commit 8323964
Author: Aronne Merrelli <[email protected]>
Date:   Mon Jul 12 21:34:08 2021 +0000

    update the creation of default filenames.
    added a new JSON field to optionally control the name of the background only plot image file
    simplified the default filename tags

commit 7fcab2e
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 22:32:56 2021 +0000

    Fixed the bug because of which the layer colorbar wasn't shown on the layer-only image.

commit 85d0820
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 20:50:50 2021 +0000

    Removed all output files. Deleted all mentions of MODIS and adapted the vistool to the sensor being a required field in the config JSON file. Updated ReadMe according to all updates that have been made in that branch. Moved the second colorbar part of the script to the helper method.

commit d3d7108
Merge: cbb5ff5 0378dce
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 19:46:57 2021 +0300

    Merge pull request #1 from aronnem/cartopy_method

    remove ipython/jupyter dependency

commit 0378dce
Author: Aronne Merrelli <[email protected]>
Date:   Thu Jun 24 14:32:03 2021 +0000

    remove ipython/jupyter dependency

    copied the contents of the jupyter notebook to a plain python script, added some comments
    removed the ipython checkpoint directory

commit cbb5ff5
Author: Matvey Tkachev <[email protected]>
Date:   Tue Jun 22 15:49:35 2021 +0000

    Removed unneeded and repetitive output files.

commit a22821f
Author: Matvey Tkachev <[email protected]>
Date:   Tue Jun 22 15:44:48 2021 +0000

    The Cartopy method has been functionally integrated (despite possible future changes in styling and plotting parameters). Unneeded changes to the OCO-3 parts have been removed. The documentations have been updated accordingly to the new method.

commit 85743c6
Author: Matvey Tkachev <[email protected]>
Date:   Mon Jun 21 15:20:01 2021 +0000

    Removed unneeded and repetitive output files.

commit ff44978
Author: Matvey Tkachev <[email protected]>
Date:   Mon Jun 21 15:16:09 2021 +0000

    The script parsed the whole wmts XML (capabilities) file to create the relation: layer name (by NASA Worldview standards) -- layer XML url. Script, input, and output are included in the repo. The functionality is added to the script so that it can now create the second colorbar (when needed).

commit dbc1ba6
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 23:50:07 2021 +0000

    Deleted unneeded output files. Just execute the vistool with current default params to get these output files back. Still no solution to the layer colorbar problem.

commit f6cf384
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 17:21:04 2021 +0000

    Removed all XML and GDAL dependents from the code and repo. Next step is to research into the possibility of having the second colorbar (for the chosen layer).

commit 2850ddb
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 17:15:41 2021 +0000

    The overlayed image has appeared and behaves as expected. Need to investigate the second colorbar options and the get rid of the GDAL and XML dependents.

commit 9ffe49a
Author: Matvey Tkachev <[email protected]>
Date:   Thu Jun 10 22:47:09 2021 +0000

    Continued the Cartopy transformation. Handled all bugs so that the script compiles and has output now while having the new method integrated. The layer imagery doesn't appear for some reason yet. However, everything else is as expected.

commit 92a1975
Author: Matvey Tkachev <[email protected]>
Date:   Wed Jun 9 21:17:17 2021 +0000

    Started the XML --> Cartopy transformation in the overlay function.

commit e2a1fab
Author: Matvey Tkachev <[email protected]>
Date:   Wed Jun 9 19:48:23 2021 +0000

    Started Cartopy transformation. The layer processing (from the dict and in the script) and csv encoding are integrated at this stage. Haven't transformed the XML method into Cartopy yet.
hcronk pushed a commit that referenced this issue Oct 14, 2021
The main new functionality is the auto-download of GOES and Himawari background files from the AWS S3 NOAA buckets. Also, reparsed the updated version of the WMTS capabilities file to extract the information about new layers, two of which we already added to the known layers: GOES-16 & GOES-17 Geocolor layers. There are other new minor features implemented with regards to plotting styles and formats.

Squashed commit of the following:

commit e23b8bd
Author: tkach940 <[email protected]>
Date:   Fri Oct 8 18:47:19 2021 +0000

    Fixed the bug due to which the out_data_dir JSON key wasn't working as expected.

commit 3c9c3cc
Author: tkach940 <[email protected]>
Date:   Mon Oct 4 22:51:16 2021 +0000

    Solved a bug because of which the script wasn't working without a specified out_plot_dir key in JSON.

commit 6a6e349
Author: tkach940 <[email protected]>
Date:   Mon Sep 27 22:50:17 2021 +0000

    Solved a bug so that the output can be written to the folder now. Added a line which enabled Cartopy to download the Natural Earth images from inside the Docker container. Create a file with environment variables for the easier use of them inside the Docker container.

commit f839fc2
Merge: 59f8bdc 3d79081
Author: tkach940 <[email protected]>
Date:   Wed Sep 15 01:26:31 2021 +0300

    Merge pull request #5 from aronnem/himawari_functions

    Update to resolve merge conflicts with hcronk/master

commit 3d79081
Merge: 59f8bdc dffee76
Author: Aronne Merrelli <[email protected]>
Date:   Tue Sep 14 17:27:45 2021 +0000

    This was a manual resolution to the merge conflict between himawari_functions
    and the parent master branch.
    Himawari_functions was not re-synched to the parent master branch before
    the previous PR was merged with a squash commit. Here, I re-merged the
    current parent master branch into himawari_functions, and manually resolved
    the conflicted files. Hopefully this allows himawari_functions to be
    easily merged.

    Merge branch 'master' into himawari_functions

    Conflicts:
    	Dockerfile
    	Encoding.csv
    	Layer_xml.csv
    	README.md
    	annotated_json_format.txt
    	oco_goes-abi_vistool_config.json
    	oco_vistool.py
    	satpy_overlay_plots.py
    	wmts.xml

commit 59f8bdc
Author: tkach940 <[email protected]>
Date:   Wed Aug 11 10:15:05 2021 +0000

    Rewrote the AWS Himawari parts of the script: separated the downloading function; changed the behavior so that it follows the GOES process patterns.

commit 407afa4
Author: tkach940 <[email protected]>
Date:   Mon Aug 9 16:01:26 2021 +0000

    Got a new wmts capabilities file which has Geocolor GOES Worldview layers and reparsed it using the python script. Thus, updated the Encoding.csv file accordingly (added 2 Geocolor layers and their codes).

commit a0e8615
Merge: f2a4c6e 5fe1070
Author: tkach940 <[email protected]>
Date:   Mon Aug 9 13:41:06 2021 +0300

    Merge pull request #4 from aronnem/himawari_functions

    Implement correct time offsets for AHI and for ABI & AHI worldview data

commit 5fe1070
Author: Aronne Merrelli <[email protected]>
Date:   Sun Aug 8 21:57:05 2021 +0000

    change the time adjustment for Worldview, to apply to both AHI and ABI.

    I think the similar approximation can be made for the full disk imagery
    from each sensor.

commit f4baad5
Author: Aronne Merrelli <[email protected]>
Date:   Sun Aug 8 20:53:23 2021 +0000

    add an optional time_shift variable in the input JSON file

    This allows for the overlay date time to be shifted, to account for
    possible mismatch in the time offset with respect to the background image.
    Note, had to remove the line in satpy_overlay_plots that recomputes the datetime
    based on the overlay data - this was already done in the parent function, so
    this was redundant, and would undo the time shift.

commit e2d5a3c
Author: Aronne Merrelli <[email protected]>
Date:   Sun Aug 8 15:12:47 2021 +0000

    implement time offset for Worldview - Himwari imagery:

    refactored the scanline time functions so they are split out into new
        separate module (geo_scan_time)
    both worldview and satpy plots now use similar method to compute the
        exact scanline time for AHI

commit 00cf2b9
Author: Aronne Merrelli <[email protected]>
Date:   Sun Aug 8 02:06:55 2021 +0000

    bugfix for AHI reading, so that it will now correctly ignore a timestep with no files

commit bcfc5b0
Author: Aronne Merrelli <[email protected]>
Date:   Sat Aug 7 20:20:28 2021 +0000

    fix minor bug, the ValueError for invalid files_loc in input JSON had a syntax error

commit e1641e6
Author: Aronne Merrelli <[email protected]>
Date:   Thu Aug 5 16:30:11 2021 +0000

    significant rewrite of local AHI data access to improve handling of observation time:

    added function to compute more exact obs time by using satpy to read file contents
    added function to compute exact obs times from AHI files (not currently used, mainly
        used during testing and prototyping)
    rewrote AHI file access, to initially check the time step equal to requested time
        (rounded down to nearest 10 minutes) as well as -10 and +10 minutes.
        Uses approximate obs times to calculate the nearest AHI time to requested time

    This update breaks the AWS AHI access.

commit 6c31d91
Author: Aronne Merrelli <[email protected]>
Date:   Wed Aug 4 19:52:07 2021 +0000

    change automatic output filename creation so that it works when no overlay data is input.
    In this case, the automatic name cannot be created from fields in the overlay metadata.

commit 8cc60ca
Author: Aronne Merrelli <[email protected]>
Date:   Wed Aug 4 19:47:37 2021 +0000

    change the output format for the date in autogenerated filenames
    it should now better accomodate time requests including H,M,S

commit f2a4c6e
Author: tkach940 <[email protected]>
Date:   Mon Aug 2 14:31:21 2021 +0000

    Changed the config files to their default versions. Updated Dockerfile.

commit a47663a
Author: tkach940 <[email protected]>
Date:   Fri Jul 30 21:01:13 2021 +0000

    Updated .gitignore: no need to ignore the Hima directory anymore since the user chooses his/her own directory name.

commit 7ef511b
Author: tkach940 <[email protected]>
Date:   Fri Jul 30 20:59:11 2021 +0000

    Broke down get_AHI_files into multiple helper functions. Added a time_offset calculation for the Himawari case. Updated the logic for the data_home key: it also acts as a destination directory for the AWS case now.

commit 165a0f4
Author: tkach940 <[email protected]>
Date:   Mon Jul 26 20:35:24 2021 +0000

    Added an output for the non-Worldview figures when they're saved (same with the Worldview images).

commit ff4417a
Author: tkach940 <[email protected]>
Date:   Mon Jul 26 19:39:18 2021 +0000

    Corrected the GOES config JSON file (added the necessary files_loc key).

commit 8d4a231
Author: tkach940 <[email protected]>
Date:   Tue Jul 20 20:51:40 2021 +0000

    Commented the functions and code fragments implemented by me.

commit 8cb0a38
Author: tkach940 <[email protected]>
Date:   Mon Jul 19 20:51:23 2021 +0000

    Changed the Dockerfile according to all of the changes made so far.

commit 01e9910
Author: tkach940 <[email protected]>
Date:   Mon Jul 19 15:28:13 2021 +0000

    Added a description regarding the AWS keys to the ReadMe.

commit c8669ea
Author: tkach940 <[email protected]>
Date:   Thu Jul 15 22:11:49 2021 +0000

    Transferred the cartopy_method branch recent minor changes, which are a part of the current PR, to this branch. These changes are mostly focused around the plotting and filename formats.

commit 4423207
Author: tkach940 <[email protected]>
Date:   Thu Jul 15 20:37:48 2021 +0000

    Added the functions for the new AWS/local milestone for the GOES data. The script can now operate with GOES as a sensor using background files from either AWS S3 bucket or local filesystem.

commit 2f1eb38
Author: tkach940 <[email protected]>
Date:   Mon Jul 12 23:17:54 2021 +0000

    Fixed a minor bug because of which the list of AWS Himawari files had unneeded duplicates.

commit 041964b
Author: tkach940 <[email protected]>
Date:   Mon Jul 12 20:25:36 2021 +0000

    Added a new field to the JSON config file which defines whether the user wants to use the local filesystem or AWS for the background files of non-worldview sensors. The functionalities of this new field are already well- integrated into the script for the Himawari data. More testing is needed for this case. After that, I'll start implementing this selection functionality for the GOES data.

commit d8d190e
Author: tkach940 <[email protected]>
Date:   Tue Jul 6 22:17:23 2021 +0000

    Changed the script so that the Worldview sensor can now process and output the GOES/Himawari layers. Fixed a minor bug of constructing the second colorbar for GOES/Himawari Band 13 layer.

commit 852404c
Author: tkach940 <[email protected]>
Date:   Mon Jun 28 21:25:27 2021 +0000

    Integrated the Himawari prototype into the script. The vistool can now overlay the CO-2 data over the Himawari-8 background imagery. The script has worked on multiple different inputs. However, more testing is needed to find any unexpected bugs.

commit 7fcab2e
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 22:32:56 2021 +0000

    Fixed the bug because of which the layer colorbar wasn't shown on the layer-only image.

commit 85d0820
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 20:50:50 2021 +0000

    Removed all output files. Deleted all mentions of MODIS and adapted the vistool to the sensor being a required field in the config JSON file. Updated ReadMe according to all updates that have been made in that branch. Moved the second colorbar part of the script to the helper method.

commit d3d7108
Merge: cbb5ff5 0378dce
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 19:46:57 2021 +0300

    Merge pull request #1 from aronnem/cartopy_method

    remove ipython/jupyter dependency

commit 0378dce
Author: Aronne Merrelli <[email protected]>
Date:   Thu Jun 24 14:32:03 2021 +0000

    remove ipython/jupyter dependency

    copied the contents of the jupyter notebook to a plain python script, added some comments
    removed the ipython checkpoint directory

commit cbb5ff5
Author: Matvey Tkachev <[email protected]>
Date:   Tue Jun 22 15:49:35 2021 +0000

    Removed unneeded and repetitive output files.

commit a22821f
Author: Matvey Tkachev <[email protected]>
Date:   Tue Jun 22 15:44:48 2021 +0000

    The Cartopy method has been functionally integrated (despite possible future changes in styling and plotting parameters). Unneeded changes to the OCO-3 parts have been removed. The documentations have been updated accordingly to the new method.

commit 85743c6
Author: Matvey Tkachev <[email protected]>
Date:   Mon Jun 21 15:20:01 2021 +0000

    Removed unneeded and repetitive output files.

commit ff44978
Author: Matvey Tkachev <[email protected]>
Date:   Mon Jun 21 15:16:09 2021 +0000

    The script parsed the whole wmts XML (capabilities) file to create the relation: layer name (by NASA Worldview standards) -- layer XML url. Script, input, and output are included in the repo. The functionality is added to the script so that it can now create the second colorbar (when needed).

commit dbc1ba6
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 23:50:07 2021 +0000

    Deleted unneeded output files. Just execute the vistool with current default params to get these output files back. Still no solution to the layer colorbar problem.

commit f6cf384
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 17:21:04 2021 +0000

    Removed all XML and GDAL dependents from the code and repo. Next step is to research into the possibility of having the second colorbar (for the chosen layer).

commit 2850ddb
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 17:15:41 2021 +0000

    The overlayed image has appeared and behaves as expected. Need to investigate the second colorbar options and the get rid of the GDAL and XML dependents.

commit 9ffe49a
Author: Matvey Tkachev <[email protected]>
Date:   Thu Jun 10 22:47:09 2021 +0000

    Continued the Cartopy transformation. Handled all bugs so that the script compiles and has output now while having the new method integrated. The layer imagery doesn't appear for some reason yet. However, everything else is as expected.

commit 92a1975
Author: Matvey Tkachev <[email protected]>
Date:   Wed Jun 9 21:17:17 2021 +0000

    Started the XML --> Cartopy transformation in the overlay function.

commit e2a1fab
Author: Matvey Tkachev <[email protected]>
Date:   Wed Jun 9 19:48:23 2021 +0000

    Started Cartopy transformation. The layer processing (from the dict and in the script) and csv encoding are integrated at this stage. Haven't transformed the XML method into Cartopy yet.
hcronk pushed a commit that referenced this issue Oct 18, 2021
remove ipython/jupyter dependency
hcronk pushed a commit that referenced this issue Oct 18, 2021
The main new functionality is the auto-download of GOES and Himawari background files from the AWS S3 NOAA buckets. Also, reparsed the updated version of the WMTS capabilities file to extract the information about new layers, two of which we already added to the known layers: GOES-16 & GOES-17 Geocolor layers. There are other new minor features implemented with regards to plotting styles and formats.

Squashed commit of the following:

commit e23b8bd
Author: tkach940 <[email protected]>
Date:   Fri Oct 8 18:47:19 2021 +0000

    Fixed the bug due to which the out_data_dir JSON key wasn't working as expected.

commit 3c9c3cc
Author: tkach940 <[email protected]>
Date:   Mon Oct 4 22:51:16 2021 +0000

    Solved a bug because of which the script wasn't working without a specified out_plot_dir key in JSON.

commit 6a6e349
Author: tkach940 <[email protected]>
Date:   Mon Sep 27 22:50:17 2021 +0000

    Solved a bug so that the output can be written to the folder now. Added a line which enabled Cartopy to download the Natural Earth images from inside the Docker container. Create a file with environment variables for the easier use of them inside the Docker container.

commit f839fc2
Merge: 59f8bdc 3d79081
Author: tkach940 <[email protected]>
Date:   Wed Sep 15 01:26:31 2021 +0300

    Merge pull request #5 from aronnem/himawari_functions

    Update to resolve merge conflicts with hcronk/master

commit 3d79081
Merge: 59f8bdc dffee76
Author: Aronne Merrelli <[email protected]>
Date:   Tue Sep 14 17:27:45 2021 +0000

    This was a manual resolution to the merge conflict between himawari_functions
    and the parent master branch.
    Himawari_functions was not re-synched to the parent master branch before
    the previous PR was merged with a squash commit. Here, I re-merged the
    current parent master branch into himawari_functions, and manually resolved
    the conflicted files. Hopefully this allows himawari_functions to be
    easily merged.

    Merge branch 'master' into himawari_functions

    Conflicts:
    	Dockerfile
    	Encoding.csv
    	Layer_xml.csv
    	README.md
    	annotated_json_format.txt
    	oco_goes-abi_vistool_config.json
    	oco_vistool.py
    	satpy_overlay_plots.py
    	wmts.xml

commit 59f8bdc
Author: tkach940 <[email protected]>
Date:   Wed Aug 11 10:15:05 2021 +0000

    Rewrote the AWS Himawari parts of the script: separated the downloading function; changed the behavior so that it follows the GOES process patterns.

commit 407afa4
Author: tkach940 <[email protected]>
Date:   Mon Aug 9 16:01:26 2021 +0000

    Got a new wmts capabilities file which has Geocolor GOES Worldview layers and reparsed it using the python script. Thus, updated the Encoding.csv file accordingly (added 2 Geocolor layers and their codes).

commit a0e8615
Merge: f2a4c6e 5fe1070
Author: tkach940 <[email protected]>
Date:   Mon Aug 9 13:41:06 2021 +0300

    Merge pull request #4 from aronnem/himawari_functions

    Implement correct time offsets for AHI and for ABI & AHI worldview data

commit 5fe1070
Author: Aronne Merrelli <[email protected]>
Date:   Sun Aug 8 21:57:05 2021 +0000

    change the time adjustment for Worldview, to apply to both AHI and ABI.

    I think the similar approximation can be made for the full disk imagery
    from each sensor.

commit f4baad5
Author: Aronne Merrelli <[email protected]>
Date:   Sun Aug 8 20:53:23 2021 +0000

    add an optional time_shift variable in the input JSON file

    This allows for the overlay date time to be shifted, to account for
    possible mismatch in the time offset with respect to the background image.
    Note, had to remove the line in satpy_overlay_plots that recomputes the datetime
    based on the overlay data - this was already done in the parent function, so
    this was redundant, and would undo the time shift.

commit e2d5a3c
Author: Aronne Merrelli <[email protected]>
Date:   Sun Aug 8 15:12:47 2021 +0000

    implement time offset for Worldview - Himwari imagery:

    refactored the scanline time functions so they are split out into new
        separate module (geo_scan_time)
    both worldview and satpy plots now use similar method to compute the
        exact scanline time for AHI

commit 00cf2b9
Author: Aronne Merrelli <[email protected]>
Date:   Sun Aug 8 02:06:55 2021 +0000

    bugfix for AHI reading, so that it will now correctly ignore a timestep with no files

commit bcfc5b0
Author: Aronne Merrelli <[email protected]>
Date:   Sat Aug 7 20:20:28 2021 +0000

    fix minor bug, the ValueError for invalid files_loc in input JSON had a syntax error

commit e1641e6
Author: Aronne Merrelli <[email protected]>
Date:   Thu Aug 5 16:30:11 2021 +0000

    significant rewrite of local AHI data access to improve handling of observation time:

    added function to compute more exact obs time by using satpy to read file contents
    added function to compute exact obs times from AHI files (not currently used, mainly
        used during testing and prototyping)
    rewrote AHI file access, to initially check the time step equal to requested time
        (rounded down to nearest 10 minutes) as well as -10 and +10 minutes.
        Uses approximate obs times to calculate the nearest AHI time to requested time

    This update breaks the AWS AHI access.

commit 6c31d91
Author: Aronne Merrelli <[email protected]>
Date:   Wed Aug 4 19:52:07 2021 +0000

    change automatic output filename creation so that it works when no overlay data is input.
    In this case, the automatic name cannot be created from fields in the overlay metadata.

commit 8cc60ca
Author: Aronne Merrelli <[email protected]>
Date:   Wed Aug 4 19:47:37 2021 +0000

    change the output format for the date in autogenerated filenames
    it should now better accomodate time requests including H,M,S

commit f2a4c6e
Author: tkach940 <[email protected]>
Date:   Mon Aug 2 14:31:21 2021 +0000

    Changed the config files to their default versions. Updated Dockerfile.

commit a47663a
Author: tkach940 <[email protected]>
Date:   Fri Jul 30 21:01:13 2021 +0000

    Updated .gitignore: no need to ignore the Hima directory anymore since the user chooses his/her own directory name.

commit 7ef511b
Author: tkach940 <[email protected]>
Date:   Fri Jul 30 20:59:11 2021 +0000

    Broke down get_AHI_files into multiple helper functions. Added a time_offset calculation for the Himawari case. Updated the logic for the data_home key: it also acts as a destination directory for the AWS case now.

commit 165a0f4
Author: tkach940 <[email protected]>
Date:   Mon Jul 26 20:35:24 2021 +0000

    Added an output for the non-Worldview figures when they're saved (same with the Worldview images).

commit ff4417a
Author: tkach940 <[email protected]>
Date:   Mon Jul 26 19:39:18 2021 +0000

    Corrected the GOES config JSON file (added the necessary files_loc key).

commit 8d4a231
Author: tkach940 <[email protected]>
Date:   Tue Jul 20 20:51:40 2021 +0000

    Commented the functions and code fragments implemented by me.

commit 8cb0a38
Author: tkach940 <[email protected]>
Date:   Mon Jul 19 20:51:23 2021 +0000

    Changed the Dockerfile according to all of the changes made so far.

commit 01e9910
Author: tkach940 <[email protected]>
Date:   Mon Jul 19 15:28:13 2021 +0000

    Added a description regarding the AWS keys to the ReadMe.

commit c8669ea
Author: tkach940 <[email protected]>
Date:   Thu Jul 15 22:11:49 2021 +0000

    Transferred the cartopy_method branch recent minor changes, which are a part of the current PR, to this branch. These changes are mostly focused around the plotting and filename formats.

commit 4423207
Author: tkach940 <[email protected]>
Date:   Thu Jul 15 20:37:48 2021 +0000

    Added the functions for the new AWS/local milestone for the GOES data. The script can now operate with GOES as a sensor using background files from either AWS S3 bucket or local filesystem.

commit 2f1eb38
Author: tkach940 <[email protected]>
Date:   Mon Jul 12 23:17:54 2021 +0000

    Fixed a minor bug because of which the list of AWS Himawari files had unneeded duplicates.

commit 041964b
Author: tkach940 <[email protected]>
Date:   Mon Jul 12 20:25:36 2021 +0000

    Added a new field to the JSON config file which defines whether the user wants to use the local filesystem or AWS for the background files of non-worldview sensors. The functionalities of this new field are already well- integrated into the script for the Himawari data. More testing is needed for this case. After that, I'll start implementing this selection functionality for the GOES data.

commit d8d190e
Author: tkach940 <[email protected]>
Date:   Tue Jul 6 22:17:23 2021 +0000

    Changed the script so that the Worldview sensor can now process and output the GOES/Himawari layers. Fixed a minor bug of constructing the second colorbar for GOES/Himawari Band 13 layer.

commit 852404c
Author: tkach940 <[email protected]>
Date:   Mon Jun 28 21:25:27 2021 +0000

    Integrated the Himawari prototype into the script. The vistool can now overlay the CO-2 data over the Himawari-8 background imagery. The script has worked on multiple different inputs. However, more testing is needed to find any unexpected bugs.

commit 7fcab2e
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 22:32:56 2021 +0000

    Fixed the bug because of which the layer colorbar wasn't shown on the layer-only image.

commit 85d0820
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 20:50:50 2021 +0000

    Removed all output files. Deleted all mentions of MODIS and adapted the vistool to the sensor being a required field in the config JSON file. Updated ReadMe according to all updates that have been made in that branch. Moved the second colorbar part of the script to the helper method.

commit d3d7108
Merge: cbb5ff5 0378dce
Author: tkach940 <[email protected]>
Date:   Thu Jun 24 19:46:57 2021 +0300

    Merge pull request #1 from aronnem/cartopy_method

    remove ipython/jupyter dependency

commit 0378dce
Author: Aronne Merrelli <[email protected]>
Date:   Thu Jun 24 14:32:03 2021 +0000

    remove ipython/jupyter dependency

    copied the contents of the jupyter notebook to a plain python script, added some comments
    removed the ipython checkpoint directory

commit cbb5ff5
Author: Matvey Tkachev <[email protected]>
Date:   Tue Jun 22 15:49:35 2021 +0000

    Removed unneeded and repetitive output files.

commit a22821f
Author: Matvey Tkachev <[email protected]>
Date:   Tue Jun 22 15:44:48 2021 +0000

    The Cartopy method has been functionally integrated (despite possible future changes in styling and plotting parameters). Unneeded changes to the OCO-3 parts have been removed. The documentations have been updated accordingly to the new method.

commit 85743c6
Author: Matvey Tkachev <[email protected]>
Date:   Mon Jun 21 15:20:01 2021 +0000

    Removed unneeded and repetitive output files.

commit ff44978
Author: Matvey Tkachev <[email protected]>
Date:   Mon Jun 21 15:16:09 2021 +0000

    The script parsed the whole wmts XML (capabilities) file to create the relation: layer name (by NASA Worldview standards) -- layer XML url. Script, input, and output are included in the repo. The functionality is added to the script so that it can now create the second colorbar (when needed).

commit dbc1ba6
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 23:50:07 2021 +0000

    Deleted unneeded output files. Just execute the vistool with current default params to get these output files back. Still no solution to the layer colorbar problem.

commit f6cf384
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 17:21:04 2021 +0000

    Removed all XML and GDAL dependents from the code and repo. Next step is to research into the possibility of having the second colorbar (for the chosen layer).

commit 2850ddb
Author: Matvey Tkachev <[email protected]>
Date:   Fri Jun 11 17:15:41 2021 +0000

    The overlayed image has appeared and behaves as expected. Need to investigate the second colorbar options and the get rid of the GDAL and XML dependents.

commit 9ffe49a
Author: Matvey Tkachev <[email protected]>
Date:   Thu Jun 10 22:47:09 2021 +0000

    Continued the Cartopy transformation. Handled all bugs so that the script compiles and has output now while having the new method integrated. The layer imagery doesn't appear for some reason yet. However, everything else is as expected.

commit 92a1975
Author: Matvey Tkachev <[email protected]>
Date:   Wed Jun 9 21:17:17 2021 +0000

    Started the XML --> Cartopy transformation in the overlay function.

commit e2a1fab
Author: Matvey Tkachev <[email protected]>
Date:   Wed Jun 9 19:48:23 2021 +0000

    Started Cartopy transformation. The layer processing (from the dict and in the script) and csv encoding are integrated at this stage. Haven't transformed the XML method into Cartopy yet.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant