[Esip-infoquality] Peng's slides: FW: IQC telecon

Wed Nov 14 11:24:35 EST 2018

Indeed, I can’t agree more with Peng – many thanks to Denise and Peter for another rounds of excellent comments, and again great lessons being learned by me.  A specially thanks goes to Peng again.

As a long-time science data user and provider, honestly speaking, I personally was genuinely worried about (losing) “politically endangered data” (thanks Peng again for picking up the perfect term) and thought we might want to “rescue” (thanks Peter for clarifying on the more legitimate definition, and Denise for further sharing crucial info) them as needed and appropriate timely.  Again, I’m truly grateful to see that we (the “broad” science data community) have precious peers/colleagues like you (again, filled with knowledge and conscience) have walked the real walks aiming at protecting our valuable and useful data from being ruined or lost irrationally or carelessly.  I have “advocated” for years that “No Data, No Science; and vice versa.”  In any case, you all have genuinely minimized my “overly concern” that I thank you all so much again!   All the best to you all and our Data.

-- Chung-Lin

From: Ge Peng - NOAA Affiliate <ge.peng at noaa.gov>
Date: Wednesday, November 14, 2018 at 10:28 AM
To: Denise Hills <dhills at gsa.state.al.us>, Matthew Mayernik <mayernik at ucar.edu>
Cc: Peter Cornillon <pcornillon at me.com>, Chung-Lin Shie <chung-lin.shie-1 at nasa.gov>, "esip-infoquality at lists.esipfed.org" <esip-infoquality at lists.esipfed.org>
Subject: Re: [Esip-infoquality] Peng's slides: FW: IQC telecon

Thank you, Denise and Peter, for your excellent comments.

I am looping Matt, who is the DSC Chair, in as I think that this discussion clearly demonstrates the need and urgency for the Data-Rick-Factors (White) paper.

Thanks a lot, Chung-lin, for getting this great discussion started.

--- Peng

On Wed, Nov 14, 2018 at 9:27 AM, Denise Hills via Esip-infoquality <esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>> wrote:
All,

This is a great discussion, and one that is near and dear to my heart. Data preservation and data rescue definitely overlap, but do also cover some different aspects of the data life cycle.

Several of us have proposed a session at the upcoming winter meeting that I encourage you all to look into that hopes to explore some of these issues, particularly around how you assess data risk. The Data Stewardship committee also has been working on collecting “data risk factors” which might be of interest (there’s lots of good links here): http://wiki.esipfed.org/index.php/Data_Risk_Factors

D

--
Denise Hills
Director, Energy Investigations

From: Esip-infoquality <esip-infoquality-bounces at lists.esipfed.org<mailto:esip-infoquality-bounces at lists.esipfed.org>> on behalf of Peter Cornillon via Esip-infoquality <esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>>
Reply-To: Peter Cornillon <pcornillon at me.com<mailto:pcornillon at me.com>>
Date: Tuesday, November 13, 2018 at 11:16 PM
To: "Shie, Chung-lin (GSFC-610.2)[UNIVERSITY OF MARYLAND BALTIMORE COUNTY]" <chung-lin.shie-1 at nasa.gov<mailto:chung-lin.shie-1 at nasa.gov>>
Cc: "esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>" <esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>>

Subject: Re: [Esip-infoquality] Peng's slides: FW: IQC telecon

Hi Chung-Lin,

I do not think that you are overly concerned with regard to data rescue/preservation although I must admit that I struggle with the distinction between the two terms. To me, data rescue means preserving for the future data that is in danger of being lost. Regardless of how it is defined, there are a LOT of data that are in danger of being lost and there are horror stories of massive amounts of data that have been lost. For example, I have boxes of data on old digital media that may no longer be recoverable but that may be of value, if not now, in the not too distant future. Although the data may not be documented to the extent required for some applications they may be for others. For example, VHRR data (the predecessor of AVHRR) extended back to 1975. They were of too low quality to provide good sea surface temperature fields but they were fine to delineate the edge of the Gulf Stream and the large eddies in the vicinity of the stream — both extremely important in climate considerations. But, because they did not provide good SST values they were discarded. In a changing climate with questions about possible changes in the Gulf Stream these data might have been of significant value now had they been preserved/rescued. The problem is that decisions to retain data often do not look into alternative uses of the data or value that the data may have in the future. It is also particularly galling that the cost of preserving the data is relatively low compared to the cost of collecting it.

Peter

On Nov 13, 2018, at 3:40 PM, Shie, Chung-lin (GSFC-610.2)[UNIVERSITY OF MARYLAND BALTIMORE COUNTY] via Esip-infoquality <esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>> wrote:

Hello Peng,

What an excellent lesson on data rescue I’ve just learned from you!  Many thanks.  I guess I must have been “overconcerned” about the fate of those potential “politically endangered data”.  In any case, I’m truly glad and grateful for having professional peers like you with both knowledge and conscience.  Thanks again!

All the best,

Chung-Lin

From: Ge Peng - NOAA Affiliate <ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>>
Date: Tuesday, November 13, 2018 at 4:21 PM
To: Chung-Lin Shie <chung-lin.shie-1 at nasa.gov<mailto:chung-lin.shie-1 at nasa.gov>>
Cc: Hampapuram Ramapriyan <hampapuram.ramapriya at ssaihq.com<mailto:hampapuram.ramapriya at ssaihq.com>>, "esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>" <esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>>, Ge Peng <ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>>
Subject: Re: [Esip-infoquality] Peng's slides: FW: IQC telecon

Hi Chung-Lin,

Thanks a lot for your positive comment. Glad you enjoyed the presentation.

The data rescue issue touches on many different areas and perspectives – some of those are beyond the scope of data preservation. It can be related to rescue data from its obsolete format such as physical records. It can also be related to rescue data from politically endangered data sources as you have mentioned. You may have already known that ESIP DSC had a session at the ESIP 2018 Summer Meeting to identify data risk factors – there are a lot of them!

In my opinion and generally speaking, if a dataset is well-managed, well-preserved, well-documented, publicly available and usable, the risk for it to disappear is low; so is the need for it to be rescued. Perhaps, stewardship maturity models can be used to measure the data risk and the need of data rescue from the stewardship practice perspective.

Having said that, I do not consider myself as an expert on data rescue so please correct me if I am wrong.

Appreciate the discussions.

--- Peng

On Tue, Nov 13, 2018 at 12:18 PM, Shie, Chung-lin (GSFC-610.2)[UNIVERSITY OF MARYLAND BALTIMORE COUNTY] <chung-lin.shie-1 at nasa.gov<mailto:chung-lin.shie-1 at nasa.gov>> wrote:
Peng, thank you very much again for giving an excellent presentation full of crucial and useful info.  Just one more comment: wonder the WMO SMM-CD might also consider to include “data rescue” into “data preservation” if not yet?  The “news” about the Department Interior’s recent request to destroy data, if indeed true, should have concerned us, in my opinion.  Thanks.  – Chung-Lin

From: Esip-infoquality <esip-infoquality-bounces at lists.esipfed.org<mailto:esip-infoquality-bounces at lists.esipfed.org>> on behalf of Ge Peng - NOAA Affiliate via Esip-infoquality <esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>>
Reply-To: Ge Peng - NOAA Affiliate <ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>>
Date: Tuesday, November 13, 2018 at 11:33 AM
To: Hampapuram Ramapriyan <hampapuram.ramapriya at ssaihq.com<mailto:hampapuram.ramapriya at ssaihq.com>>
Cc: "esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>" <esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>>
Subject: [Esip-infoquality] Peng's slides: FW: IQC telecon

Peng's slides

On Tue, Nov 13, 2018 at 11:15 AM, Hampapuram Ramapriyan via Esip-infoquality <esip-infoquality at lists.esipfed.org<mailto:esip-infoquality at lists.esipfed.org>> wrote:
In case you have not received Megan’s message, I am forwarding it.

From: Moroni, David F (398G) [mailto:David.F.Moroni at jpl.nasa.gov<mailto:David.F.Moroni at jpl.nasa.gov>]
Sent: Tuesday, November 13, 2018 8:08 AM
To: Hampapuram Ramapriyan; Ge Peng - NOAA Affiliate
Subject: Re: IQC telecon

Hi Rama,

Here’s the updated link that Megan just created: https://global.gotomeeting.com/join/841228325

You may want to try using a different browser. It wasn’t working right for me in Firefox.

Cheers,
David

From: Hampapuram Ramapriyan <hampapuram.ramapriya at ssaihq.com<mailto:hampapuram.ramapriya at ssaihq.com>>
Date: Tuesday, November 13, 2018 at 8:04 AM
To: "Moroni, David F (398G)" <David.F.Moroni at jpl.nasa.gov<mailto:David.F.Moroni at jpl.nasa.gov>>, Ge Peng - NOAA Affiliate <ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>>
Subject: RE: IQC telecon

That is the link I have been trying and I get a message saying that it is an invalid number.

From: Moroni, David F (398G) [mailto:David.F.Moroni at jpl.nasa.gov<mailto:David.F.Moroni at jpl.nasa.gov>]
Sent: Tuesday, November 13, 2018 8:01 AM
To: Ge Peng - NOAA Affiliate; Hampapuram Ramapriyan
Subject: Re: IQC telecon

Try this link: https://www.gotomeeting.com/join/240974205. You have to do the drop down menu to select the meeting once GoToMeeting app loads.

I was able to get on, but it says it’s waiting for “ESIP Staff” before the meeting starts. I’m using computer audio.

Cheers,
David

From: Ge Peng - NOAA Affiliate <ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>>
Date: Tuesday, November 13, 2018 at 7:59 AM
To: Hampapuram Ramapriyan <hampapuram.ramapriya at ssaihq.com<mailto:hampapuram.ramapriya at ssaihq.com>>
Cc: "Moroni, David F (398G)" <David.F.Moroni at jpl.nasa.gov<mailto:David.F.Moroni at jpl.nasa.gov>>, Ge Peng <ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>>
Subject: Re: FW: IQC telecon

Me too - invalid meeting number ...

On Tue, Nov 13, 2018 at 10:56 AM, Hampapuram Ramapriyan <hampapuram.ramapriya at ssaihq.com<mailto:hampapuram.ramapriya at ssaihq.com>> wrote:
FYI. I am having trouble with the link. Do you know if it has changed?

From: Hampapuram Ramapriyan [mailto:hampapuram.ramapriya at ssaihq.com<mailto:hampapuram.ramapriya at ssaihq.com>]
Sent: Tuesday, November 13, 2018 7:56 AM
To: 'Megan Carter'
Cc: 'Erin Robinson'
Subject: IQC telecon
Importance: High

Hi Megan,
I just tried the IQC meeting link https://www.gotomeeting.com/join/240974205 which does not work. This is the link everyone in the group has. I get a message that the link is invalid. Could you help? Need to start meeting in 5 minutes.
Thanks.
Rama.

H. K. Ramapriyan (Rama)
Science Systems and Applications, Inc.
NASA Goddard Space Flight Center
Hampapuram.Ramapriyan at ssaihq.com<mailto:Hampapuram.Ramapriyan at ssaihq.com>
(805) 402-7125
(orcid.org/0000-0002-8425-8943<http://orcid.org/0000-0002-8425-8943>)
Note: I am not a government employee and have no legal authority to obligate any federal, state, or local government to perform any action or payment.

--
Ge Peng, PhD
Research Scholar
Cooperative Institute for Climate and Satellites - NC (CICS-NC)/NCSU at
NOAA’s National Centers for Environmental Information (NCEI)
Center for Weather and Climate (CWC)
151 Patton Ave, Asheville, NC 28801<https://maps.google.com/?q=151+Patton+Ave,+Asheville,+NC+28801&entry=gmail&source=g>
+1 828 257 3009; ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>
ORCID: http://orcid.org/0000-0002-1986-9115<http://orcid.org/0000-0002-1986-9115>
Following CICS-NC on Facebook<http://www.facebook.com/cicsnc>

_______________________________________________
Esip-infoquality mailing list
Esip-infoquality at lists.esipfed.org<mailto:Esip-infoquality at lists.esipfed.org>
https://lists.esipfed.org/mailman/listinfo/esip-infoquality

--
Ge Peng, PhD
Research Scholar
Cooperative Institute for Climate and Satellites - NC (CICS-NC)/NCSU at
NOAA’s National Centers for Environmental Information (NCEI)
Center for Weather and Climate (CWC)
151 Patton Ave, Asheville, NC 28801<https://maps.google.com/?q=151+Patton+Ave,+Asheville,+NC+28801&entry=gmail&source=g>
+1 828 257 3009; ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>
ORCID: http://orcid.org/0000-0002-1986-9115<http://orcid.org/0000-0002-1986-9115>
Following CICS-NC on Facebook<http://www.facebook.com/cicsnc>

--
Ge Peng, PhD
Research Scholar
Cooperative Institute for Climate and Satellites - NC (CICS-NC)/NCSU at
NOAA’s National Centers for Environmental Information (NCEI)
Center for Weather and Climate (CWC)
151 Patton Ave, Asheville, NC 28801<https://maps.google.com/?q=151+Patton+Ave,+Asheville,+NC+28801&entry=gmail&source=g>
+1 828 257 3009; ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>
ORCID: http://orcid.org/0000-0002-1986-9115<http://orcid.org/0000-0002-1986-9115>
Following CICS-NC on Facebook<http://www.facebook.com/cicsnc>

_______________________________________________
Esip-infoquality mailing list
Esip-infoquality at lists.esipfed.org<mailto:Esip-infoquality at lists.esipfed.org>
https://lists.esipfed.org/mailman/listinfo/esip-infoquality

_______________________________________________
Esip-infoquality mailing list
Esip-infoquality at lists.esipfed.org<mailto:Esip-infoquality at lists.esipfed.org>
https://lists.esipfed.org/mailman/listinfo/esip-infoquality

--

Ge Peng, PhD
Research Scholar
Cooperative Institute for Climate and Satellites - NC (CICS-NC)/NCSU at

NOAA’s National Centers for Environmental Information (NCEI)

Center for Weather and Climate (CWC)

151 Patton Ave, Asheville, NC 28801
+1 828 257 3009; ge.peng at noaa.gov<mailto:ge.peng at noaa.gov>

ORCID: http://orcid.org/0000-0002-1986-9115<http://orcid.org/0000-0002-1986-9115>

Following CICS-NC on Facebook<http://www.facebook.com/cicsnc>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.esipfed.org/pipermail/esip-infoquality/attachments/20181114/b75c52bd/attachment-0001.html>