[Esip-cloud] Telecon Recap on 03/28/2016

[Fei Hu]

Hi All,

Thank you for dialing in the telecon on 03/28. Here is a quick recap. If you have any comments or revision, please feel free to edit it at http://wiki.esipfed.org/index.php/Cloud_Telecons_03/28/2016.

Participants:Michael R. Berganski, Christopher Lynnes, Frank Greguska, Hook Hua, Namrata Malarout, Nga T Quach, Phil Yang, Stephan Klene, Thomas Huang, Annie Burgess, Fei Hu
Presentation: Migrating the Earth Observing System Data and Information System into the Cloud (Presented By Chris Lynnes)

  *   Slides: http://wiki.esipfed.org/index.php/File:Migrating_the_Earth_Observing_System_Data_and_Information_System_into_the_Cloud.pdf
  *   EOSDIS: data downlink, capture, clean, archive, and distribute
  *   EOSDIS comprises discipline-focused Distributed Active Archive Centers (DAAC): browse images, metadata repository, user logs, etc.

  *   One-stop shopping: https://earthdata.nasa.gov/

  *   Science Driver: users need download data from archives → distribution volumes are very big in petabytes level → EOSDIS in the Big Data epoch will enable more analysis closer to data.

  *   More analysis: subset(data variables -> spatial area -> quality filter); transform: reprojection & mosaicking.

  *   Analyze: simple stats, complex stats, and end user’s algorithm

  *   EOSDIS Cloud prototypes:

1. archive management(cloud storage): cloud-based data distribution of Sentinel radar data by the Alaska Satellite Facility DAAC

  *   Pros: use bigger datasets; cost savings; Flexibility in assigning archiving and data servicing
  *   Cons: egress charge policy for the average scientists; user paradigm shift
  *   Any DAAC can add services to any product to serve their user community

2. Cloud-based analytics support: community open source tools; DAAC-developed tools;Cloud analytics examples and recipes

  *   Pros: analyze any subset slice of large datasets with long time series; avoid data management drudgery; reuse code from colleagues
  *   Cons: Long term paradigm shift

3. application hosting(EOSIDS Services): Common metadata repository; Global imagery browse system; Earthdata search client

  *   Compliance-as-a-Service: security controls, authorization to operate
  *   NGAP Services: monitoring, logging, security, autoscaling, biling, etc.
  *   Paradigm shift: IaaS, PaaS, SaaS
  *   Pros: Faster time to initial release; more effort on software; smaller custom code footprint; more code and service reuse

  *   Questions:

  1.  How can we supply data to all users on a non-discriminatory basis?
  2.  How can we avoid or mitigate vendor lock-in?
  3.  How can we predict pricing 2-5 years out?
  4.  How can we attract end users to the cloud?
  5.  How can we migrate data-proximal services to Web Object Storage?
  6.  What functionality or data should NOT go into the cloud?
  7.  How do we handle provisioning and accounting of cycles and storage across the DAACs?
  8.  Do we need new operations policies or procedures?

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.deltaforce.net/pipermail/esip-cloud/attachments/20160411/642cec34/attachment.html>