PODAAC Solr search server down

PODAAC Solr search server down

Postby omkarr » Wed Jun 15, 2016 12:47 am

Hi,

I have been developing a toolkit for PODAAC's web services[0] as a part of GSoC project along with my mentor. The name of the tool kit is podaacpy[1] and I have been using PODAAC's Solr search[2] for retreiving the list of datasetIds and shortNames of datasets. Recently the server was pulled down for maintenance and we are unable to fetch the datasetIds and shortNames of datasets. I would be glad if anyone could please let me know when the server is going to get back working.

Thanks :)

P.S : The url I was using to send a get request to the solr server is http://podaac.jpl.nasa.gov/dmasSolr/solr/dataset/select/?q=*:*&fl=Dataset-PersistentId,Dataset-ShortName-Full&rows=2147483647&fq=DatasetPolicy-AccessType-Full:(OPEN+OR+PREVIEW+OR+SIMULATED+OR+REMOTE)+AND+DatasetPolicy-ViewOnline:Y&wt=json

[0] http://podaac.jpl.nasa.gov/ws
[1] https://github.com/lewismc/podaacpy
[2] http://podaac.jpl.nasa.gov/dmasSolr/solr/
omkarr
 
Posts: 25
Joined: Wed Jun 15, 2016 12:34 am

Re: PODAAC Solr search server down

Postby podaac » Wed Jun 15, 2016 11:43 am

Thank you for your inquiry.

Going forward, please use our Search Dataset Web Services. (http://podaac.jpl.nasa.gov/ws)

Documentation can be found here: http://podaac.jpl.nasa.gov/ws/search/dataset/index.html

There is a max of 400 datasets that can be returned per request, so to retrieve all datasets (520) you will need to issue two requests:

http://podaac.jpl.nasa.gov/ws/search/da ... erPage=400
http://podaac.jpl.nasa.gov/ws/search/da ... ormat=atom

You can parse the XML to get dataset persistent id and short name.

For example,
<podaac:datasetId>PODAAC-AQR40-3W1AS</podaac:datasetId>
<podaac:shortName>AQUARIUS_L3_WIND_SPEED_SMIA_DAILY_V4</podaac:shortName>
podaac
Site Admin
 
Posts: 549
Joined: Mon Oct 22, 2012 4:00 pm

Re: PODAAC Solr search server down

Postby omkarr » Wed Jun 15, 2016 11:54 am

Thank you very much for your reply. It helps! :D
omkarr
 
Posts: 25
Joined: Wed Jun 15, 2016 12:34 am

Re: PODAAC Solr search server down

Postby omkarr » Fri Jun 17, 2016 3:36 am

Hi,

Your suggestion of using the web service instead of solr search service helped. Thanks a lot for that! :)

I have a suggestion, the webpage @ http://podaac.jpl.nasa.gov/ws/search/granule/index.html which is a search granule web service and when I was hacking my code I recorded the HTTP traffic and found out that it uses solr server to retrieve and display available datasetIds and ShortNames. This is how I found the link mentioned in the P.S in the first message. Since the server is down the web service does not display the datasetIds and ShortNames under the 'Available Dataset' section as can be seen here @
Screen Shot 2016-06-17 at 4.59.20 pm.png
Image attachment
Screen Shot 2016-06-17 at 4.59.20 pm.png (115.18 KiB) Viewed 13873 times
. This is not stable since the server is down for too many days for maintenance.

So, why don't you display them in the same way that you have suggested me (retrieving xml and parsing the datasetIds)?? Just a thought. It would help many users.

Thanks,
Omkar.
omkarr
 
Posts: 25
Joined: Wed Jun 15, 2016 12:34 am

Re: PODAAC Solr search server down

Postby podaac » Fri Jun 17, 2016 3:45 pm

Thank you for your suggestion and bringing this matter to our attention. The issue has now been fixed.

Have a great weekend!
podaac
Site Admin
 
Posts: 549
Joined: Mon Oct 22, 2012 4:00 pm


Return to Data Access

cron