[Geoserver-users] Geoserver contour performance issues

GeoServer GeoServer User
1

Hi,

We have experienced performance problems when configuring an SLD to provide contours for a DEM that is displayed as an OpenLayers layer.
GeoServer (2.15.2) is running on Windows Server 2008 R2 with Intel® Xeon® Processor E5-2667 v2 (16 CPU cores) with 32GB of RAM. GeoServer is running on a separate Tomcat (9.0.22) instance, the max memory pool size is set to 16GB.

What we are experiencing is that having Openlayers draw contours dynamically really eats up the memory as we pan around drawing contours we are observing the memory usage increase and the CPU usage is spiking on all cores. Eventually the drawing of contours hangs and then we begin to get broken tiles grid. The used physical memory is at 90% even with this single user test. The final outcome is that the tomcat process is hanging completely and we can’t stop the service in a regular way, just by killing the process.

Any suggestions to work around this would be highly appreciated.

Thanks,

Tamas

2

I usually demo this to classes using the GB 50m terrain model and have no issues running it on a small laptop running Linux - what size of area are you using? what resolution is your DEM?

Ian

···

Ian Turton

3

Hi Ian,

do you have overviews in your DEM? Wondering if Tamas does too

Cheers
Andrea

···

Regards, Andrea Aime == GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

4

Hi Andrea,

The DEM layer is a raster with 2 meters grid cell size covering Oklahoma area. The DEM has been separated into a tileset of 3.25 minute square GeoTiffs in Geographic Coordinate System WGS 1984 (EPSG: 4326). The tileset is processed by the Image mosaicking plugin. Each tile contains a single band with Float32 datatype and the following overviews: 1739x1739, 870x870, 435x435, 218x218, 109x109, 55x55

Attached the SLD definition.

Thanks,

Tamas

Andrea Aime <andrea.aime@anonymised.com> ezt írta (időpont: 2019. okt. 23., Sze, 18:28):

Hi Ian,

do you have overviews in your DEM? Wondering if Tamas does too

Cheers
Andrea

On Wed, Oct 23, 2019 at 6:21 PM Ian Turton <ijturton@anonymised.com> wrote:

I usually demo this to classes using the GB 50m terrain model and have no issues running it on a small laptop running Linux - what size of area are you using? what resolution is your DEM?

Ian

On Wed, 23 Oct 2019 at 16:34, Tamas Szekeres <szekerest@anonymised.com> wrote:

Hi,

We have experienced performance problems when configuring an SLD to provide contours for a DEM that is displayed as an OpenLayers layer.
GeoServer (2.15.2) is running on Windows Server 2008 R2 with Intel® Xeon® Processor E5-2667 v2 (16 CPU cores) with 32GB of RAM. GeoServer is running on a separate Tomcat (9.0.22) instance, the max memory pool size is set to 16GB.

What we are experiencing is that having Openlayers draw contours dynamically really eats up the memory as we pan around drawing contours we are observing the memory usage increase and the CPU usage is spiking on all cores. Eventually the drawing of contours hangs and then we begin to get broken tiles grid. The used physical memory is at 90% even with this single user test. The final outcome is that the tomcat process is hanging completely and we can’t stop the service in a regular way, just by killing the process.

Any suggestions to work around this would be highly appreciated.

Thanks,

Tamas

Geoserver-users mailing list

Please make sure you read the following two resources before posting to this list:

If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer

Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

Ian Turton

Geoserver-users mailing list

Please make sure you read the following two resources before posting to this list:

If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer

Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

Regards, Andrea Aime == GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

contours.sld (5.96 KB)

5

Hi Tamas,
two ideas about the slowness:

  • Could it be that the mosaic has to read a lot of files to compose the view (it should be reading only the files intersecting the view)? I did not take the time to do the math of what happens at 1:25k, but it does not seem likely… just I’m not sure.
  • The interval between contour lines seems to be very small (60cm?), maybe it’s just very costly to extract them all?
  • If there are many contour lines, labeling them will also be pretty costly, did you try removing the text symbolizer and see if it gets any better?
  • What format is the DEM? Best source is GeoTiff with internal overviews, without using GDAL in the mix
    I’d be curious to see a screenshot. But yeah, generally speaking, if nothing of the above works, it might need a profiling session to see where the time is spent. I share Ian’s experience that we don’t see significant performance issues with contouring

Cheers
Andrea

···

Regards, Andrea Aime == GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.

6

I also wanted to see if there was any leak in action, so tried with what I have locally, a global SRTM900, and applied
a simplified version of your style on it (attached). The DEM is not the greatest, it’s low vertical res and has large flat areas where the contouring does
not work well visually, but for the sake of the test I went over Himalaya where I got maps like this one:

srtm.png

I’ve run a quick load test using apache bench (ab) with the above map as a sample request, 16 threads, 1000 requests, run it a few times, while using the style
editor preview to pan around, did not experience slowdowns or lockups, it’s slower during the load test of course, but goes back to snappy response once
the background load stops

Cheers
Andrea

srtm-contour.sld (3.72 KB)

···

Regards, Andrea Aime == GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.