[Geoserver-users] Performance issue with extreme zoom

GeoServer GeoServer User
1

Hello everyone,

I have some issues with my geoserver instance. I am working with geoserver 2.8.2, with the GRIB and INSPIRE plugins. The GRIB files I serve are not that big (30 files, ~2Mo each).

When an user starts requesting a map with an extreme zoom, Geoserver is not able to render the map : A process runs during more than one hour, without any result. These requests accumulate and the whole server can not satisfy any request anymore.

Here is a example of a box that causes this problem :
BBOX=52.373962891801554,3.2711379635382203,52.37471041281445,3.2718854845511154

I kept the maximum rendering time to 120 seconds in WMS options, but it does not seem to have an impact.

Does someone have an idea to fix this problem ?
The amount of data I have is quite small at the moment, and the fact that one user is able to absorb the whole server load with a few requests is worrisome.

Thank You.

Joffrey

2

Hi Joffrey,
a couple of questions to get some more background info on that.
Which OS?
Are the input GRIB file in WGS84 or are them into some different CRS and being reprojected as part of the request?
What is the native resolution of your samples and what is the resolution you are requesting to make the request never end?

Please, let us know.
Cheers,
Daniele

···

On Tue, Jun 14, 2016 at 3:17 PM, Joffrey Schmitz <jschmitz@anonymised.com> wrote:

Hello everyone,

I have some issues with my geoserver instance. I am working with geoserver 2.8.2, with the GRIB and INSPIRE plugins. The GRIB files I serve are not that big (30 files, ~2Mo each).

When an user starts requesting a map with an extreme zoom, Geoserver is not able to render the map : A process runs during more than one hour, without any result. These requests accumulate and the whole server can not satisfy any request anymore.

Here is a example of a box that causes this problem :
BBOX=52.373962891801554,3.2711379635382203,52.37471041281445,3.2718854845511154

I kept the maximum rendering time to 120 seconds in WMS options, but it does not seem to have an impact.

Does someone have an idea to fix this problem ?
The amount of data I have is quite small at the moment, and the fact that one user is able to absorb the whole server load with a few requests is worrisome.

Thank You.

Joffrey

What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

3

Additional note:
in the past months, we have fixed an issue with a processing operation which resulted in heavy loading when dealing with reprojection and big oversampling.
If that’s your case, you may consider trying a nightly 2.8.x or wait for a 2.8.4 which will contain that fix.

The problem was: https://osgeo-org.atlassian.net/browse/GEOT-5391

Please, let us know.
Cheers,
Daniele

···

On Tue, Jun 14, 2016 at 4:09 PM, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Hi Joffrey,
a couple of questions to get some more background info on that.
Which OS?
Are the input GRIB file in WGS84 or are them into some different CRS and being reprojected as part of the request?
What is the native resolution of your samples and what is the resolution you are requesting to make the request never end?

Please, let us know.
Cheers,
Daniele

–

On Tue, Jun 14, 2016 at 3:17 PM, Joffrey Schmitz <jschmitz@anonymised.com> wrote:

Hello everyone,

I have some issues with my geoserver instance. I am working with geoserver 2.8.2, with the GRIB and INSPIRE plugins. The GRIB files I serve are not that big (30 files, ~2Mo each).

When an user starts requesting a map with an extreme zoom, Geoserver is not able to render the map : A process runs during more than one hour, without any result. These requests accumulate and the whole server can not satisfy any request anymore.

Here is a example of a box that causes this problem :
BBOX=52.373962891801554,3.2711379635382203,52.37471041281445,3.2718854845511154

I kept the maximum rendering time to 120 seconds in WMS options, but it does not seem to have an impact.

Does someone have an idea to fix this problem ?
The amount of data I have is quite small at the moment, and the fact that one user is able to absorb the whole server load with a few requests is worrisome.

Thank You.

Joffrey

What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

4

Hi Daniele,

Here is the informations you requested :

  • Our instance of Geoserver runs on CentOS release 6.5 (Final)

  • The native SRS is this one :
    GEOGCS[“WGS 84”,
    DATUM[“World Geodetic System 1984”,
    SPHEROID[“WGS 84”, 6378137.0, 298.257223563, AUTHORITY[“EPSG”,“7030”]],
    AUTHORITY[“EPSG”,“6326”]],
    PRIMEM[“Greenwich”, 0.0, AUTHORITY[“EPSG”,“8901”]],
    UNIT[“degree”, 0.017453292519943295],
    AXIS[“Geodetic longitude”, EAST],
    AXIS[“Geodetic latitude”, NORTH],
    AUTHORITY[“EPSG”,“4326”]]
    and the CRS requested by the user is the same : CRS=EPSG:4326

The original GRIB file has the following properties :
Ni = 177;
Nj = 177;

latitudeOfFirstGridPointInDegrees = 47.397;
longitudeOfFirstGridPointInDegrees = -0.115;

latitudeOfLastGridPointInDegrees = 53.623;
longitudeOfLastGridPointInDegrees = 9.222;

jDirectionIncrementInDegrees = 0.035;
iDirectionIncrementInDegrees = 0.053;

The following BBOX makes the request never ends :
BBOX=52.373962891801554,3.2711379635382203,52.37471041281445,3.2718854845511154
BBOX=47.97552463980568,2.941473886397377,47.97552466575646,2.9414739123481577

That kind of boxes is extreme… It is a big zoom on one cell of the raster data.

Thank you for your answer.

Joffrey

···

De: “Daniele Romagnoli” daniele.romagnoli@anonymised.com
À: “Joffrey Schmitz” jschmitz@anonymised.com
Cc: geoserver-users@lists.sourceforge.net
Envoyé: Mardi 14 Juin 2016 16:32:42
Objet: Re: [Geoserver-users] Performance issue with extreme zoom

Additional note:
in the past months, we have fixed an issue with a processing operation which resulted in heavy loading when dealing with reprojection and big oversampling.
If that’s your case, you may consider trying a nightly 2.8.x or wait for a 2.8.4 which will contain that fix.

The problem was: https://osgeo-org.atlassian.net/browse/GEOT-5391

Please, let us know.
Cheers,
Daniele

On Tue, Jun 14, 2016 at 4:09 PM, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Hi Joffrey,
a couple of questions to get some more background info on that.
Which OS?
Are the input GRIB file in WGS84 or are them into some different CRS and being reprojected as part of the request?
What is the native resolution of your samples and what is the resolution you are requesting to make the request never end?

Please, let us know.
Cheers,
Daniele

On Tue, Jun 14, 2016 at 3:17 PM, Joffrey Schmitz <jschmitz@anonymised.com> wrote:

Hello everyone,

I have some issues with my geoserver instance. I am working with geoserver 2.8.2, with the GRIB and INSPIRE plugins. The GRIB files I serve are not that big (30 files, ~2Mo each).

When an user starts requesting a map with an extreme zoom, Geoserver is not able to render the map : A process runs during more than one hour, without any result. These requests accumulate and the whole server can not satisfy any request anymore.

Here is a example of a box that causes this problem :
BBOX=52.373962891801554,3.2711379635382203,52.37471041281445,3.2718854845511154

I kept the maximum rendering time to 120 seconds in WMS options, but it does not seem to have an impact.

Does someone have an idea to fix this problem ?
The amount of data I have is quite small at the moment, and the fact that one user is able to absorb the whole server load with a few requests is worrisome.

Thank You.

Joffrey

What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

5

Hi Daniele,

I read the log more carrefully and there was indeed a reprojection with the request.

I switched to a nightly build Geoserver 2.8.X, and that type of request seems to be correctly handled now.

Thank you for your help !

Joffrey

···

De: “Daniele Romagnoli” <daniele.romagnoli@anonymised.com…1107…>
À: “Joffrey Schmitz” jschmitz@anonymised.com
Cc: geoserver-users@lists.sourceforge.net
Envoyé: Mardi 14 Juin 2016 16:32:42
Objet: Re: [Geoserver-users] Performance issue with extreme zoom

Additional note:
in the past months, we have fixed an issue with a processing operation which resulted in heavy loading when dealing with reprojection and big oversampling.
If that’s your case, you may consider trying a nightly 2.8.x or wait for a 2.8.4 which will contain that fix.

The problem was: https://osgeo-org.atlassian.net/browse/GEOT-5391

Please, let us know.
Cheers,
Daniele

On Tue, Jun 14, 2016 at 4:09 PM, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Hi Joffrey,
a couple of questions to get some more background info on that.
Which OS?
Are the input GRIB file in WGS84 or are them into some different CRS and being reprojected as part of the request?
What is the native resolution of your samples and what is the resolution you are requesting to make the request never end?

Please, let us know.
Cheers,
Daniele

On Tue, Jun 14, 2016 at 3:17 PM, Joffrey Schmitz <jschmitz@anonymised.com80…> wrote:

Hello everyone,

I have some issues with my geoserver instance. I am working with geoserver 2.8.2, with the GRIB and INSPIRE plugins. The GRIB files I serve are not that big (30 files, ~2Mo each).

When an user starts requesting a map with an extreme zoom, Geoserver is not able to render the map : A process runs during more than one hour, without any result. These requests accumulate and the whole server can not satisfy any request anymore.

Here is a example of a box that causes this problem :
BBOX=52.373962891801554,3.2711379635382203,52.37471041281445,3.2718854845511154

I kept the maximum rendering time to 120 seconds in WMS options, but it does not seem to have an impact.

Does someone have an idea to fix this problem ?
The amount of data I have is quite small at the moment, and the fact that one user is able to absorb the whole server load with a few requests is worrisome.

Thank You.

Joffrey

What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.