Hi Clifford,
I have a couple of questions on your use case for some feedbacks:
-
which GeoServer version are you using? (did you already tried with the latest RC?)
-
which store are you using to configure your input data? Is it a NetCDF store OR an ImageMosaic one?
Please,
let us know.
On Tue, Jan 29, 2019 at 7:22 AM Clifford Harms <clifford.harms@anonymised.com> wrote:
I’ve run into a problem with the memory footprint using the netcdf-output plugin with n-dimensional datasets. Consider a WCS 2.0.1 request that wants multiple times and elevations in netcdf format. The WCS GetCoverage operation slices this request into 2D slices, and loads these slices into a GranuleStack, which allows the netcdf output module (and presumably other n-dimensional output formats in the future) to stitch them back together in the desired format.
The problem arises when the number of 2D slices are large, as they are completely held in memory. I’m trying to find a solution to this, to substantially increase the size of datasets that can be requested in netcdf format.
My initial stab was setting up a deferred read by implementing a quick GridCoverage2D wrapper, that basically encapsulated all of the GetCoverage work and only performs the read when the image data is accessed, while modifying netcdf-out to work with only one slice at a time. This isn’t working so well, because it is hard to separate the image from the rest of the non-pixel data related calls in the GridCoverage2D.
I was curious before I went further down this route if there is a more obvious solution then basically extending and heavily modifying GridCoverage2D in addition to changing the netcdf output encoder itself, or utilizing some type of file buffered Image implementation.
Thanks.
–
Clifford M. Harms
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel
–
Regards,
Daniele Romagnoli
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
Ing. Daniele Romagnoli
Senior Software Engineer
GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.