[Geoserver-users] netCDF thought bubble

Hi all

Is there any movement toward supporting ‘point data’ in netCDF format for geoserver? The current netCDF plugin treats data as a raster source, but we are also looking at using netCDF to store ungridded point data.

Just an off the top of my head question, since I just hit a little conceptual wall with a task. From my point of view it would be super handy - but I realise it’s not (yet) a common use of netCDF files.

Thanks!

Adam

Dear Adam,
I can talk about our (as in GeoSolutions) plan as I can't speak for the others.

In the past we have done some minor work in exposing trajectories
straight out of netcdf-cf (if my memory serves me right) but we ended
up transferring this information to Postgis at ingestion time since we
did not want to reinvent the wheel as the amount of data we had was
huge.

Long story short, I don't see plans in the short term to support
vector data out of netcdf.
Probably not the answer you wanted to hear, but at least you have an answer :slight_smile:

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate.
Il loro utilizzo è consentito esclusivamente al destinatario del
messaggio, per le finalità indicate nel messaggio stesso. Qualora
riceviate questo messaggio senza esserne il destinatario, Vi preghiamo
cortesemente di darcene notizia via e-mail e di procedere alla
distruzione del messaggio stesso, cancellandolo dal Vostro sistema.
Conservare il messaggio stesso, divulgarlo anche in parte,
distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità
diverse, costituisce comportamento contrario ai principi dettati dal
D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New
Data Protection Code).Any use not in accord with its purpose, any
disclosure, reproduction, copying, distribution, or either
dissemination, either whole or partial, is strictly forbidden except
previous formal approval of the named addressee(s). If you are not the
intended recipient, please contact immediately the sender by
telephone, fax or e-mail and delete the information in this message
that has been received in error. The sender does not give any warranty
or accept liability as the content, accuracy or completeness of sent
messages and accepts no responsibility for changes made after they
were sent or for other risks which arise as a result of e-mail
transmission, viruses, etc.

On Fri, Jul 8, 2016 at 3:35 AM, Adam Steer <Adam.Steer@anonymised.com> wrote:

Hi all

Is there any movement toward supporting ‘point data’ in netCDF format for geoserver? The current netCDF plugin treats data as a raster source, but we are also looking at using netCDF to store ungridded point data.

Just an off the top of my head question, since I just hit a little conceptual wall with a task. From my point of view it would be super handy - but I realise it’s not (yet) a common use of netCDF files.

Thanks!

Adam

------------------------------------------------------------------------------
Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
Francisco, CA to explore cutting-edge tech and listen to tech luminaries
present their vision of the future. This family event has something for
everyone, including kids. Get more information and register today.
http://sdm.link/attshape
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Thanks Simone,

It’s interesting enough to hear that you went to postGIS instead of building ways to use netCDF. We face the reverse problem: very big datasets in netCDF files that would preferably remain in netCDF files, but cannot always be treated as rasters or grids.

At least figuring out how to deal with it will keep us entertained!

Regards

Adam

On 11 Jul 2016, at 11:18 PM, Simone Giannecchini <simone.giannecchini@...1107...> wrote:

Dear Adam,
I can talk about our (as in GeoSolutions) plan as I can't speak for the others.

In the past we have done some minor work in exposing trajectories
straight out of netcdf-cf (if my memory serves me right) but we ended
up transferring this information to Postgis at ingestion time since we
did not want to reinvent the wheel as the amount of data we had was
huge.

Long story short, I don't see plans in the short term to support
vector data out of netcdf.
Probably not the answer you wanted to hear, but at least you have an answer :slight_smile:

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate.
Il loro utilizzo è consentito esclusivamente al destinatario del
messaggio, per le finalità indicate nel messaggio stesso. Qualora
riceviate questo messaggio senza esserne il destinatario, Vi preghiamo
cortesemente di darcene notizia via e-mail e di procedere alla
distruzione del messaggio stesso, cancellandolo dal Vostro sistema.
Conservare il messaggio stesso, divulgarlo anche in parte,
distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità
diverse, costituisce comportamento contrario ai principi dettati dal
D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New
Data Protection Code).Any use not in accord with its purpose, any
disclosure, reproduction, copying, distribution, or either
dissemination, either whole or partial, is strictly forbidden except
previous formal approval of the named addressee(s). If you are not the
intended recipient, please contact immediately the sender by
telephone, fax or e-mail and delete the information in this message
that has been received in error. The sender does not give any warranty
or accept liability as the content, accuracy or completeness of sent
messages and accepts no responsibility for changes made after they
were sent or for other risks which arise as a result of e-mail
transmission, viruses, etc.

On Fri, Jul 8, 2016 at 3:35 AM, Adam Steer <Adam.Steer@...7673...> wrote:

Hi all

Is there any movement toward supporting ‘point data’ in netCDF format for geoserver? The current netCDF plugin treats data as a raster source, but we are also looking at using netCDF to store ungridded point data.

Just an off the top of my head question, since I just hit a little conceptual wall with a task. From my point of view it would be super handy - but I realise it’s not (yet) a common use of netCDF files.

Thanks!

Adam

------------------------------------------------------------------------------
Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
Francisco, CA to explore cutting-edge tech and listen to tech luminaries
present their vision of the future. This family event has something for
everyone, including kids. Get more information and register today.
http://sdm.link/attshape
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Adam Steer
Earth systems data service specialist
National Computational Infrastructure
Leonard Huxley Building, Mills Road
The Australian National University
Acton ACT 2600 Australia

adam.steer@...7673...
+61 2 6125 1413
http://nci.org.au

Dear Adam,
mind you, I don't claim our approach to be a good one or even a _very_ good one.
I just felt that with such a large amount of vector data a spatial
DBMS would be better suited (we also tried mongodb for the point
sampling if I remember correctly).

I don't think it is _too_ difficult to implement good support for a
single NetCDF but problems might arise if you want to merge multiple
netcdf files into a single datasource. By experience that is usually
the use case since most of the time these netcdf files are either
produced as part of a stream of forecasts or in-situ acquisitions.

I am anyway interested in seeing what you will do in the end with this data.

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate.
Il loro utilizzo è consentito esclusivamente al destinatario del
messaggio, per le finalità indicate nel messaggio stesso. Qualora
riceviate questo messaggio senza esserne il destinatario, Vi preghiamo
cortesemente di darcene notizia via e-mail e di procedere alla
distruzione del messaggio stesso, cancellandolo dal Vostro sistema.
Conservare il messaggio stesso, divulgarlo anche in parte,
distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità
diverse, costituisce comportamento contrario ai principi dettati dal
D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New
Data Protection Code).Any use not in accord with its purpose, any
disclosure, reproduction, copying, distribution, or either
dissemination, either whole or partial, is strictly forbidden except
previous formal approval of the named addressee(s). If you are not the
intended recipient, please contact immediately the sender by
telephone, fax or e-mail and delete the information in this message
that has been received in error. The sender does not give any warranty
or accept liability as the content, accuracy or completeness of sent
messages and accepts no responsibility for changes made after they
were sent or for other risks which arise as a result of e-mail
transmission, viruses, etc.

On Tue, Jul 12, 2016 at 1:46 AM, Adam Steer <Adam.Steer@anonymised.com> wrote:

Thanks Simone,

It’s interesting enough to hear that you went to postGIS instead of building ways to use netCDF. We face the reverse problem: very big datasets in netCDF files that would preferably remain in netCDF files, but cannot always be treated as rasters or grids.

At least figuring out how to deal with it will keep us entertained!

Regards

Adam

On 11 Jul 2016, at 11:18 PM, Simone Giannecchini <simone.giannecchini@anonymised.com.1107...> wrote:

Dear Adam,
I can talk about our (as in GeoSolutions) plan as I can't speak for the others.

In the past we have done some minor work in exposing trajectories
straight out of netcdf-cf (if my memory serves me right) but we ended
up transferring this information to Postgis at ingestion time since we
did not want to reinvent the wheel as the amount of data we had was
huge.

Long story short, I don't see plans in the short term to support
vector data out of netcdf.
Probably not the answer you wanted to hear, but at least you have an answer :slight_smile:

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------
AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate.
Il loro utilizzo è consentito esclusivamente al destinatario del
messaggio, per le finalità indicate nel messaggio stesso. Qualora
riceviate questo messaggio senza esserne il destinatario, Vi preghiamo
cortesemente di darcene notizia via e-mail e di procedere alla
distruzione del messaggio stesso, cancellandolo dal Vostro sistema.
Conservare il messaggio stesso, divulgarlo anche in parte,
distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità
diverse, costituisce comportamento contrario ai principi dettati dal
D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New
Data Protection Code).Any use not in accord with its purpose, any
disclosure, reproduction, copying, distribution, or either
dissemination, either whole or partial, is strictly forbidden except
previous formal approval of the named addressee(s). If you are not the
intended recipient, please contact immediately the sender by
telephone, fax or e-mail and delete the information in this message
that has been received in error. The sender does not give any warranty
or accept liability as the content, accuracy or completeness of sent
messages and accepts no responsibility for changes made after they
were sent or for other risks which arise as a result of e-mail
transmission, viruses, etc.

On Fri, Jul 8, 2016 at 3:35 AM, Adam Steer <Adam.Steer@anonymised.com> wrote:

Hi all

Is there any movement toward supporting ‘point data’ in netCDF format for geoserver? The current netCDF plugin treats data as a raster source, but we are also looking at using netCDF to store ungridded point data.

Just an off the top of my head question, since I just hit a little conceptual wall with a task. From my point of view it would be super handy - but I realise it’s not (yet) a common use of netCDF files.

Thanks!

Adam

------------------------------------------------------------------------------
Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
Francisco, CA to explore cutting-edge tech and listen to tech luminaries
present their vision of the future. This family event has something for
everyone, including kids. Get more information and register today.
http://sdm.link/attshape
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Adam Steer
Earth systems data service specialist
National Computational Infrastructure
Leonard Huxley Building, Mills Road
The Australian National University
Acton ACT 2600 Australia

adam.steer@anonymised.com
+61 2 6125 1413
http://nci.org.au