[Geoserver-users] ImageMosaic responding to WMS requests very slowly

Hi List,
I’ve just noticed that a couple of my layers are taking a super long time to load. They’re both ImageMosaics and I haven’t touched either of them in months (December and July 2013!). Last time I used them they were nice and fast. But now even a basic WMS request like:

http://example.com/gs/wms?LAYERS=Historical_Maps%3Acs_imageMosiac_1_500&STYLES=&FORMAT=image%2Fjpeg&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A27700&BBOX=402877.23766699,231785.68975,468010.72433301,320242.83875&WIDTH=377&HEIGHT=512

Takes almost a minute to run!

The only thing that has changed in the intervening period is upgrading GeoServer. It’s now 2.5 (previously it was 2.3.x and then 2.4.x).

There’s nothing obvious (to me) in the logs at DEBUG level to indicate what the problem is.

The complete log (Geotools_debug) is attached, but everything only takes a fraction of a second except the last part:

2014-04-15 14:59:32,173 DEBUG [org.geotools.image] - Encoding input image to write out as JPEG.
2014-04-15 14:59:32,176 DEBUG [org.geotools.image] - Getting a JPEG writer and configuring it.
2014-04-15 14:59:32,177 DEBUG [org.geotools.image] - Writing out…
2014-04-15 **15:00:21,**695 DEBUG [org.geotools.image] - Writing out… Done!
2014-04-15 15:00:21,696 INFO [org.geoserver.flow] - Running requests: 0, processing through flow controllers: 0

Any thoughts what’s going on?
Has anything changed in 2.5 or recent 2.4.s that would induce this?

Cheers,
Jonathan

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

geoserver-slow_request.zip (4.2 KB)

On Tue, Apr 15, 2014 at 5:11 PM, Jonathan Moules <
jonathanmoules@anonymised.com> wrote:

Hi List,
I've just noticed that a couple of my layers are taking a super long time
to load. They're both ImageMosaics and I haven't touched either of them in
months (December and July 2013!). Last time I used them they were nice and
fast. But now even a basic WMS request like:

http://example.com/gs/wms?LAYERS=Historical_Maps%3Acs_imageMosiac_1_500&STYLES=&FORMAT=image%2Fjpeg&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A27700&BBOX=402877.23766699,231785.68975,468010.72433301,320242.83875&WIDTH=377&HEIGHT=512

Takes almost a minute to run!

The only thing that has changed in the intervening period is upgrading
GeoServer. It's now 2.5 (previously it was 2.3.x and then 2.4.x).

There's nothing obvious (to me) in the logs at DEBUG level to indicate
what the problem is.

Nope indeed not. But now aware of performance regressions in mosaic either.
How is your mosaic configured? Did you disable imageio reads in the layer
panel?
Where is the index stored?

Cheers
Andrea

--

Meet us at GEO Business 2014! in London! Visit http://goo.gl/fES3aK
for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

Hi Andrea,
I downgraded the server to 2.4.3 - the issue went away - nice and fast responses.

I’ve now upgraded to 2.4.6 and the issue came back - the layers are slow again.

So something between those versions induces a significant slowdown.

To try and answer your questions:

  • The mosaics are just standard affairs. Irregularly shaped tif files (inner pyramids and tiles) that GeoServer automatically processed.
  • The index is stored in a shapefile (created by GeoServer) stored with the imageMosaic data.
  • I’m not sure about imageio reads - where’s the config for them? I can’t see anything in the store.

Inline images 1

Hopefully that narrows what can have caused it.
I’ve opened a JIRA for it too - http://jira.codehaus.org/browse/GEOS-6453
Regards,
Jonathan

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

···

On 15 April 2014 17:54, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Tue, Apr 15, 2014 at 5:11 PM, Jonathan Moules <jonathanmoules@…4942…> wrote:

Hi List,
I’ve just noticed that a couple of my layers are taking a super long time to load. They’re both ImageMosaics and I haven’t touched either of them in months (December and July 2013!). Last time I used them they were nice and fast. But now even a basic WMS request like:

http://example.com/gs/wms?LAYERS=Historical_Maps%3Acs_imageMosiac_1_500&STYLES=&FORMAT=image%2Fjpeg&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&SRS=EPSG%3A27700&BBOX=402877.23766699,231785.68975,468010.72433301,320242.83875&WIDTH=377&HEIGHT=512

Takes almost a minute to run!

The only thing that has changed in the intervening period is upgrading GeoServer. It’s now 2.5 (previously it was 2.3.x and then 2.4.x).

There’s nothing obvious (to me) in the logs at DEBUG level to indicate what the problem is.

Nope indeed not. But now aware of performance regressions in mosaic either.
How is your mosaic configured? Did you disable imageio reads in the layer panel?
Where is the index stored?

Cheers
Andrea

==
Meet us at GEO Business 2014! in London! Visit http://goo.gl/fES3aK
for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it