[esip-semantictech] NASA GCMD Keywords Version 9.0 Released (2019-11-12)

Mon Jan 13 12:20:58 EST 2020

	An observation regarding the data formats:  As SiriJodha's spreadsheet begins to demonstrate, many of the data formats used in science today are ubiquitous and general.  If I have a GeoTIFF file, what is it of?  What does it represent?  Is it self-descriptive?  Same goes with HDF5.  It's used both in its natural form and as a series of offshoot formats that support specific needs.  Should we be pairing more information with the data format, as pertains to what comes from a specific data center?  To what end?  Will this point us to the correct tool to utilize to decode and display the information?

	I'm probably too disconnected from the design and aims of the GCMD to pose better questions, so apologies if I am off the mark.

	-Rob


> On Jan 13, 2020, at 5:15 AM, Siri Jodha Khalsa via esip-semanticweb <esip-semanticweb at lists.esipfed.org> wrote:
> 
> Hi John,
> 
> 
> 
> I agree, it would be good to have the DAACs compile their list of formats. Ideally, there would be a shared spreadsheet, where each DAAC would check against what was already there, to avoid have the same format called different things.
> 
> 
> 
> I've taken the GCMD list and assigned encodings to all that I could identify.  The categories are ASCII, Binary, Image, Library (i.e. associated with a software library like HDF), and Proprietary (which is somewhat of a mixed bag, could be ASCII or Binary, open or closed).
> 
> 
> 
> The spreadsheet is here: https://docs.google.com/spreadsheets/d/1Lt7hl-_NKbp37FZkQ870b9c9LhlS39ZMq1N-UZdPUp8/edit?usp=sharing <https://docs.google.com/spreadsheets/d/1Lt7hl-_NKbp37FZkQ870b9c9LhlS39ZMq1N-UZdPUp8/edit?usp=sharing>
> Feedback, corrections, additions welcome. I'll give edit permission as requested. 
> 
> 
> 
> Cheers,
> 
> SiriJodha
> 
> 
> 
> On 1/11/20 12:04 AM, John Scialdone wrote:
>> Siri Jodha,
>> 
>> We've been kicking around the the Data Format Controlled Vocabulary list as well. We had a call with Valerie, Tyler and Scott recently about inconsistencies in this list. One of the goals of this list (from ARC team review of our metadata) was to help users understand the software needed to read/use the data. We suggested to add a field to this structure whereby values such as "ESRI", "Microsoft", "QGIS", "Adobe", "Google" etc. could be associated with a format. I think it would be a good exercise for all the DAACs to generate a list of formats they use and associated s/w, then bring them together over some telecons, face to face meetings, and thru tracking this effort via the Earthdata wiki, to eventually help generate a more well-thought-out list.
>> 
>> Thanx..
>> John
>> 
>> 
>> On 1/10/2020 4:08 PM, Siri Jodha Khalsa via esip-semanticweb wrote:
>>> I'm curious whether the ESIP semantic community has any opinions on these two controlled vocabularies. 
>>> 
>>> One question I have is why a measurement keyword list was necessary when GCMD already has the science keywords (a source for the original SWEET). i.e. why not integrate measurements (which are represented as variables in the science keywords) into the science keywords?
>>> 
>>> 
>>> 
>>> the data format list is even more perplexing to me. "incidence angle file" is a format? Georeferenced TIFF in addition to GeoTIFF?  DV? (digital value?) is a format?  KML as well as OGC KML? ASCII and text (what about unicode?) DEM, if this refers to digital elevation models with a .DEM extension from USGS, are ASCII files.
>>> 
>>> 
>>> 
>>> Many formats are subtypes of other formats listed. Wouldn't a better approach be to list the encodings (a much smaller list, which would tell users how to read the data with software) and then add the conventions that have been applied (e.g. CF for netCDF or GRIB for binary). For the encodings list, why not start with mime types?
>>> 
>>> 
>>> 
>>> sjs
>>> 
>>> 
>>> 
>>> On 11/12/19 5:00 PM, Stevens, Tyler B. (GSFC-423.0)[Stinger Ghaffarian Technologies] via esip-semanticweb wrote:
>>>> The NASA Global Change Master Directory (GCMD) staff is pleased to announce the release of the GCMD keywords version 9.0. Version 9.0 consists of two new keyword schemes: (1) Measurement Name and (2) Granule Data Format. 
>>>> 
>>>> The Measurement Name <https://gcmdservices.gsfc.nasa.gov/kms/concepts/concept_scheme/MeasurementName/?format=csv> list is a preliminary set of (~100) keywords that represent an observable property, usually geophysical, geo-biophysical, physical, or chemical. The Granule Data Format <https://gcmdservices.gsfc.nasa.gov/kms/concepts/concept_scheme/GranuleDataFormat/?format=csv> list of keywords represent the format of the data that is distributed by the data center. 
>>>> The keywords help facilitate the classification and discovery of Earth Science data by providing a rich vocabulary for characterizing the data. The GCMD keywords are used by hundreds of data providers worldwide for categorizing the ~33,000 records stored in the Common Metadata Repository <http://earthdata.nasa.gov/cmr>.
>>>> 
>>>> For more information about the keywords and how to access them, please visit the Keyword Landing Page. <https://earthdata.nasa.gov/about/gcmd/global-change-master-directory-gcmd-keywords> Questions about the keywords can be submitted to support at earthdata.nasa.gov <mailto:support at earthdata.nasa.gov> or directed to Valerie Dixon at valerie.dixon at nasa.gov <mailto:valerie.dixon at nasa.gov>. 
>>>> 
>>>> _______________________________________________
>>>> esip-semanticweb mailing list
>>>> esip-semanticweb at lists.esipfed.org <mailto:esip-semanticweb at lists.esipfed.org>
>>>> https://lists.esipfed.org/mailman/listinfo/esip-semanticweb <https://lists.esipfed.org/mailman/listinfo/esip-semanticweb>
>>> -- 
>>> Siri-Jodha Singh KHALSA, Ph.D., SMIEEE
>>> National Snow and Ice Data Center
>>> University of Colorado
>>> Boulder, CO 80309-0449 Phone: 1-303-492-1445 GV: 1-303-736-9976
>>> http://cires.colorado.edu/~khalsa <http://cires.colorado.edu/%7Ekhalsa>
>>> http://orcid.org/0000-0001-9217-5550 <http://orcid.org/0000-0001-9217-5550>
>>> 
>>> 
>>> _______________________________________________
>>> esip-semanticweb mailing list
>>> esip-semanticweb at lists.esipfed.org <mailto:esip-semanticweb at lists.esipfed.org>
>>> https://lists.esipfed.org/mailman/listinfo/esip-semanticweb <https://lists.esipfed.org/mailman/listinfo/esip-semanticweb>
>> 
>> -- 
>> John Scialdone
>> Manager, Data Center Services: NASA Socioeconomic Data and Applications Center (SEDAC)
>> Project Lead: Jamaica Bay Research and Management Information Network (JBRMIN)
>> Project Lead: Jamaica Bay & Sandy Hook BioBlitz Events
>> --------------------------------------------------------------------------------------
>> Center for International Earth Science Information Network (CIESIN)
>> Earth Institute @ Columbia University
>> Lamont-Doherty Earth Observatory (LDEO)
>> 61 Route 9W, PO Box 1000, Palisades, New York 10964 USA
>> Phone: (845) 365-8978; FAX: (845) 365-8922
>> Email: jscialdo at ciesin.columbia.edu <mailto:jscialdo at ciesin.columbia.edu>; jns74 at columbia.edu <mailto:jns74 at columbia.edu>
>> CIESIN web site: www.ciesin.columbia.edu <http://www.ciesin.columbia.edu/>
>> SEDAC web site: sedac.ciesin.columbia.edu <http://sedac.ciesin.columbia.edu/>
>> JBRMIN web site: www.ciesin.columbia.edu/jamaicabay <http://www.ciesin.columbia.edu/jamaicabay>
>> Sandy Hook web site: bioblitz17.ciesin.columbia.edu <http://bioblitz17.ciesin.columbia.edu/>
>> Follow us on:
>>  <https://twitter.com/ciesin/> Twitter |  <https://www.facebook.com/socioeconomicdataandappsctr> Facebook |  <https://www.youtube.com/channel/UCjUjAvV7M04SxxpM5wq4fMw?view_as=public> Youtube 
>> 
> -- 
> Siri-Jodha Singh KHALSA, Ph.D., SMIEEE
> National Snow and Ice Data Center
> University of Colorado
> Boulder, CO 80309-0449 Phone: 1-303-492-1445 GV: 1-303-736-9976
> http://cires.colorado.edu/~khalsa <http://cires.colorado.edu/~khalsa>
> http://orcid.org/0000-0001-9217-5550 <http://orcid.org/0000-0001-9217-5550>
> _______________________________________________
> esip-semanticweb mailing list
> esip-semanticweb at lists.esipfed.org <mailto:esip-semanticweb at lists.esipfed.org>
> https://lists.esipfed.org/mailman/listinfo/esip-semanticweb <https://lists.esipfed.org/mailman/listinfo/esip-semanticweb>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.esipfed.org/pipermail/esip-semanticweb/attachments/20200113/27603e9e/attachment-0001.htm>