NOAA data - are all sources "equal"? #265
Replies: 1 comment 3 replies
-
|
All roads point to nodd@noaa.gov as being the official contact for this. See https://www.noaa.gov/big-data-project-frequently-asked-questions |
Beta Was this translation helpful? Give feedback.
-
|
Perfect. Thanks! |
Beta Was this translation helpful? Give feedback.
-
|
Hi Will, As cmo84 mentioned, nodd@noaa.gov is the best contact for NOAA data being disseminated to AWS, Google, and Azure through the NOAA Open Data Dissemination (NODD) Program. With regard to the three cloud service providers we work with, we do replicate many datasets across all three cloud services providers that we work with. We do our due diligence to ensure that data is arriving on all three in the most efficient manner possible in order to provide the lowest latency. The data reliability from our delivery end, is the same across the platforms and then the storage reliability depends on that cloud service providers service level agreement with their public customers. To directly answer your first question we do not utilize one for archive and another for dissemination. All data we move to the cloud service providers is done so for public consumption and its delivery is based on the manner at which it is produced within NOAA. To address your additional comments, there may be different historical records on each provider. This has to do with the inter workings of our relationships with them. If you have data that you would like to see on the cloud, please let us know. Thanks, Patrick Keown |
Beta Was this translation helpful? Give feedback.
-
|
Thanks, @Patrick-Keown! |
Beta Was this translation helpful? Give feedback.
-
Background:
This is related to PR #248 and issue #247. I'm having odd issues with a corporate firewall and AWS. We can now simply use Azure or Google instead, which is great, but I'm wondering if there are any downsides to giving up on getting AWS to work on our network.
Main questions:
Additional comments:
I seem to recall that I've seen different lengths of historical data in the different sources, which is relevant, but I'm more interested in ongoing latency, reliability, etc. Obviously, NOAA can't control all aspects of what the 3rd parties do and how they perform, but I'm wondering if they (NOAA) have their own prioritization, or if anyone has observed consistent meaningful differences.
Beta Was this translation helpful? Give feedback.
All reactions