[Esip-cloud] August 28: Reading and Analyzing Mission HDF5 Files in the Cloud

Aimee Barciauskas aimee at developmentseed.org
Mon Aug 21 11:28:00 EDT 2023


We are excited to have JP Swinski and Rachel Wegener present at the next
ESIP Cloud Computing Cluster meeting on HDF5 Files in the Cloud.

Topic: Reading and Analyzing Mission HDF5 Files in the Cloud
When: Monday August 28th, 10:00-11:00 am PT / 1:00-2:00 pm ET / 7pm CEST
Where: Find joining information on ESIP Community Calendar
<https://www.esipfed.org/get-involved/community-calendar>
<https://discourse.pangeo.io/t/reading-and-analyzing-mission-hdf5-files-in-the-cloud-esip-cloud-computing-cluster-session-august-28-at-10am-pt-1pm-et/3636#speakers-jp-swinski-goddard-space-flight-center-and-rachel-wegener-phd-student-at-university-of-maryland-2>Speakers:
JP Swinski (Goddard Space Flight Center) and Rachel Wegener (PhD student at
University of Maryland)
<https://discourse.pangeo.io/t/reading-and-analyzing-mission-hdf5-files-in-the-cloud-esip-cloud-computing-cluster-session-august-28-at-10am-pt-1pm-et/3636#abstract-3>
Abstract

HDF5 is a flexible scientific data format which is used for many high-value
Earth observation datasets, such as the ICESat-2 standard data products.
However, the HDF5 library and tools were designed for local file systems,
and to date have not performed well in cloud environments. The ICESat-2
program funded the development of an on-demand data service called
SlideRule. SlideRule needed performant access to HDF5 files in S3, and in
response, developed the HDF5 Cloud-Optimized Read-Only Library (h5coro). JP
will present the key features of h5coro that enable performant cloud access
to HDF5 data. Rachel Wegener will present an in progress effort to
integrate h5coro as an xarray backend, and will discuss the need for more
robust data formats for Icesat-2 point cloud data.

   - 5-10 minutes - Announcements
   - 30 minutes - Presentation
   - 20 minutes - Q at A

<https://discourse.pangeo.io/t/reading-and-analyzing-mission-hdf5-files-in-the-cloud-esip-cloud-computing-cluster-session-august-28-at-10am-pt-1pm-et/3636#bonus-round-4>Bonus
Round

If you are available to stick around after the H5 in the Cloud session to
talk about your takeaways from the summer meeting or ideas for the cluster,
please join us in doing so.

Aimee
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.esipfed.org/pipermail/esip-cloud/attachments/20230821/b1ab32c8/attachment.htm>


More information about the Esip-cloud mailing list