[Esip-discovery] Impact of Discovery services

Thu Mar 10 23:33:58 EST 2011

Hi Hook,

> We did something similar with the WSNEWS OpenSearch service. We also used SOLR and mapped the SOLR Response into the ESIP Federated Search 1.0 spec response. For us we wanted to keep SOLR loosely coupled from ESIP, and so did the mapping in an external Python package. We leveraged Google’s gdata API to help create the Atom response. 

Cool thanks for the pointer.

> 
> Sample granule OpenSearch (noticed the query time that was pass-through from SOLR)
> http://wsnews.jpl.nasa.gov:8100/opensearch/granule?dataset=NEWS%20Regrid%20airs.aqua%201.0hr%20Nearest%20Neighbor%200.50x0.50degrees%20v1.0&q=temperature&bbox=-180,-90,180,90&datetimestart=2000-01-1T00:00:00Z&datetimeend=2010-01-1T00:00:00Z&startindex=0&itemsperpage=10&format=atom
> 
> The new issue tracking for SOLR-2419 links to an older ESIP 1.0 spec.

Gotcha. I added your URL as a comment on the issue:

https://issues.apache.org/jira/browse/SOLR-2419?focusedCommentId=13005478#comment-13005478

I'll try and figure out the differences between the 2 and attach a patch to SOLR that can flexibly implement both of them.

> 
> We are hoping the community will start updating implementations to the 1.1 spec once finalized:
> http://wiki.esipfed.org/index.php/Discovery_Cast_Atom_Response_Format_v1.1

Awesome thanks for the link. What are the major differences between 1.0 and 1.1?

> 
> But we still need more DCPs that “extend” DCP-1 with specifics for granule and collection responses. DCP-1 is meant as a baseline common spec.

Great. Yeah specs are constantly evolving, so it's been my experience that doing a reference implementation and then making it available can help to grow community use.

If I get some free time I'll try and throw up a patch for SOLR-2419. Would be happy to have your help as time permits.

Thanks!

Cheers,
Chris

> 
> 
> From: Chris Mattmann <chris.a.mattmann at jpl.nasa.gov>
> Date: Thu, 10 Mar 2011 08:06:11 -0800
> To: "Lynnes, Christopher S. (GSFC-6102)" <christopher.s.lynnes at nasa.gov>
> Cc: Hook Hua <hook.hua at jpl.nasa.gov>, <esip-discovery at lists.esipfed.org>
> Subject: Re: [Esip-discovery] Impact of Discovery services
> 
> Hey Chris,
> 
> We just used the default SOLR Response Writers (one of which is RSS, and others being XML, JSON, etc.) on those projects. In some prior projects, I did use Apache Nutch's OpenSearch response writer (circa 2005) and found it to be quite effective:
> 
> http://s.apache.org/DfZ
> 
> Here's some docs on the SOLR Response Writers:
> 
> http://wiki.apache.org/solr/QueryResponseWriter
> 
> It would be really useful to write an ESIP Federated Search response writer and maybe contribute it back to the SOLR community so that downstream users of SOLR (us and any other NASA project) could get the ESIP Federated Search protocol for free.
> 
> I've created:
> 
> https://issues.apache.org/jira/browse/SOLR-2419
> 
> to track this.
> 
> Cheers,
> Chris
> 
> 
> On Mar 10, 2011, at 7:34 AM, Lynnes, Christopher S. (GSFC-6102) wrote:
> 
> > Chris,
> >  Did either of those efforts use OpenSearch and/or the ESIP Federated Search conventions?  If not, any thought about migrating to those conventions?
> >
> > On Mar 10, 2011, at 12:19 AM, Mattmann, Chris A (388J) wrote:
> >
> >> Hi Guys,
> >>
> >> I've been part of two efforts in the Discovery service arena:
> >>
> >> 1. for the NASA Virtual Oceanographic Data Center project, where we focused on NASA and NOAA oceanographic datasets (NVODS, OSTM, PO.DAAC), and making them available via a Solr facet+free text search. http://vodc.jpl.nasa.gov. This was an ACCESS 2007 funded project.
> >>
> >> 2. for the NASA Coastal Marine Discovery Service (CMDS), where we are extending on our VODC work, and focusing mostly on coastal ocean datasets (fisheries, etc.), looking at e.g., ERRDAP, Coastwatch, etc., and focused on linking the data into the EasyGIS system. This is an ACCESS 2009 project.
> >>
> >> Both #1 and #2 include the use of Apache Solr, and Apache OODT search services.
> >>
> >> Cheers,
> >> Chris
> >>
> >>
> >> On Mar 9, 2011, at 4:58 AM, Lynnes, Christopher S. (GSFC-6102) wrote:
> >>
> >>>
> >>> On Mar 8, 2011, at 2:50 PM, Hua, Hook (388C) wrote:
> >>>
> >>>> It would be useful to eventually get an assessment of the impact of
> >>>> Discovery services to the community. More specifically, to be able to answer
> >>>> these two questions:
> >>>> (1) Where Discovery services have been implemented and deployed?
> >>>
> >>> Also, we should distinguish between server and client implementations.  Here at GES DISC, we have implemented:
> >>> (1) server - Mirador
> >>> (2) client - Mirador cross-data center search
> >>> (3) client - Giovanni
> >>> (4) client - Simple Subset Wizard
> >>>
> >>>> (2) Have there been any improvements to data and service discovery/access?
> >>>
> >>> Not sure what to put for this--can you provide an example or two?
> >>>
> >>>>
> >>>> We could get a good start on (1). Some wiki pages were setup with listings
> >>>> of Discovery services and clients. Some people have already begun submitting
> >>>> entries. But we want to invite more to submit your deployed or
> >>>> in-development Discovery services/clients. These are not meant as an
> >>>> official registry, but rather meant to give ourselves a better understanding
> >>>> of who has or is implementing what.
> >>>>
> >>>> http://wiki.esipfed.org/index.php/Discovery_OpenSearch_Services
> >>>> http://wiki.esipfed.org/index.php/Discovery_DataCasting_Services
> >>>> http://wiki.esipfed.org/index.php/Discovery_ServiceCasting_Services
> >>>> http://wiki.esipfed.org/index.php/Discovery_Clients
> >>>>
> >>>> Thanks,
> >>>> Hook
> >>>>
> >>>> _______________________________________________
> >>>> Esip-discovery mailing list
> >>>> Esip-discovery at lists.esipfed.org
> >>>> http://www.lists.esipfed.org/mailman/listinfo/esip-discovery
> >>>
> >>> Christopher Lynnes
> >>> Goddard Earth Sciences Data and Information Center, NASA/GSFC
> >>> 301-614-5185
> >>>
> >>> _______________________________________________
> >>> Esip-discovery mailing list
> >>> Esip-discovery at lists.esipfed.org
> >>> http://www.lists.esipfed.org/mailman/listinfo/esip-discovery
> >>
> >>
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Chris Mattmann, Ph.D.
> >> Senior Computer Scientist
> >> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> >> Office: 171-266B, Mailstop: 171-246
> >> Email: chris.a.mattmann at nasa.gov
> >> WWW:   http://sunset.usc.edu/~mattmann/
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >> Adjunct Assistant Professor, Computer Science Department
> >> University of Southern California, Los Angeles, CA 90089 USA
> >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> >>
> >
> > --
> > Dr. Christopher Lynnes     NASA/GSFC, Code 610.2    phone: 301-614-5185
> >
> >
> 
> 
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattmann at nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> Phone: +1 (818) 354-8810
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> 
> 

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann at nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
Phone: +1 (818) 354-8810
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++