[Geoserver-users] ImageMosaic out of memory issue

GeoServer GeoServer User
1

Hello All,

I've been troubleshooting a Java heap space error with temporal ImageMosaic datastores. We originally followed the tutorials here (http://docs.geoserver.org/latest/en/user/tutorials/imagemosaic_timeseries/imagemosaic_timeseries.html) to setup a temporally enabled raster data store. After that we designed a system which would download new imagery and update the underlying DB table. The system works as expected until a request for an invalid timestamp is made. It appears that the GeoServer/GeoTools code begins to loop over each image in the directory loading it into memory. When we only had 10-15 images in the directory this was unnoticeable, however now that our collection has grown to 1500+ images it quickly runs us out of heap space.

The code in question appears to be in ContentFeatureSource.java. In the accepts(Query, FeatureVisitor, ProgressListener) method I found the following comment:
"//subclass could not handle, resort to manually walkign through"
This comment is just above the while loop that iterates over all the imagery in the directory which makes me wonder if this is the intended behavior.

Has anyone else experienced this issue? Am I configuring something incorrectly? I realize the simple solution is to not make invalid temporal requests, but I don't control the external clients and this seems to be a pretty big flaw in my opinion. No external entity should be able to take down my server with a simple request.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

2

Kevin,
first of all I would suggest to set USE_JAI_IMAGEREAD to true anyhow as far as I remember the ImageMosaic may work as following:The search is performed filtering over the DB without opening rasters at all, then the ImageMosaic may iterate over the selected granules using the ContentFeatureSource but if no time is matching in the db the content source should be empty and a blank image is produced. Could you provide the query you are using and the relevant piece of getcapabilities?
Cheers,
Carlo

···

2013/10/14 Weiss, Kevin <kweiss01@anonymised.com>

Hello All,

I’ve been troubleshooting a Java heap space error with temporal ImageMosaic datastores. We originally followed the tutorials here (http://docs.geoserver.org/latest/en/user/tutorials/imagemosaic_timeseries/imagemosaic_timeseries.html) to setup a temporally enabled raster data store. After that we designed a system which would download new imagery and update the underlying DB table. The system works as expected until a request for an invalid timestamp is made. It appears that the GeoServer/GeoTools code begins to loop over each image in the directory loading it into memory. When we only had 10-15 images in the directory this was unnoticeable, however now that our collection has grown to 1500+ images it quickly runs us out of heap space.

The code in question appears to be in ContentFeatureSource.java. In the accepts(Query, FeatureVisitor, ProgressListener) method I found the following comment:
“//subclass could not handle, resort to manually walkign through”
This comment is just above the while loop that iterates over all the imagery in the directory which makes me wonder if this is the intended behavior.

Has anyone else experienced this issue? Am I configuring something incorrectly? I realize the simple solution is to not make invalid temporal requests, but I don’t control the external clients and this seems to be a pretty big flaw in my opinion. No external entity should be able to take down my server with a simple request.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60134071&iu=/4140/ostg.clktrk

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Dott. Carlo Cancellieri
@cancellieric
Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
mobile: +39 3371094494
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

3

Carlo,
Thanks for the advice. We had already enabled USE_JAI_IMAGEREAD and installed native JAI (something I should have mentioned). Attached is a getCapabilities snippet of the layer in question and here is an example URL which causes Tomcat to spiral out of memory:
http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=application/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box. As far as I can tell, JDBCFeatureStore attempts to "handleVisitor" which fails due to the requested time not being present in the DB. Processing returns to ContentFeatureSource which then gets a FeatureReader based solely on the query (which as noted above does not include the requested time filter). We then enter a while loop iterating over each feature returned from the query and creating a FutureTask to load each image. Once here the web request hangs while GeoServer loads each image only to result in an OutOfMemory error.

FYI, we're running GeoServer 2.3.0 in Tomcat 7.0.42.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: geo.ccancellieri@anonymised.com [geo.ccancellieri@anonymised.com] on behalf of carlo cancellieri [carlo.cancellieri@anonymised.com]
Sent: Tuesday, October 15, 2013 3:54 AM
To: Weiss, Kevin
Cc: geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Kevin,
first of all I would suggest to set USE_JAI_IMAGEREAD to true anyhow as far as I remember the ImageMosaic may work as following:
The search is performed filtering over the DB without opening rasters at all, then the ImageMosaic may iterate over the selected granules using the ContentFeatureSource but if no time is matching in the db the content source should be empty and a blank image is produced. Could you provide the query you are using and the relevant piece of getcapabilities?
Cheers,
Carlo

2013/10/14 Weiss, Kevin <kweiss01@anonymised.com<mailto:kweiss01@anonymised.com>>
Hello All,

I've been troubleshooting a Java heap space error with temporal ImageMosaic datastores. We originally followed the tutorials here (http://docs.geoserver.org/latest/en/user/tutorials/imagemosaic_timeseries/imagemosaic_timeseries.html) to setup a temporally enabled raster data store. After that we designed a system which would download new imagery and update the underlying DB table. The system works as expected until a request for an invalid timestamp is made. It appears that the GeoServer/GeoTools code begins to loop over each image in the directory loading it into memory. When we only had 10-15 images in the directory this was unnoticeable, however now that our collection has grown to 1500+ images it quickly runs us out of heap space.

The code in question appears to be in ContentFeatureSource.java. In the accepts(Query, FeatureVisitor, ProgressListener) method I found the following comment:
"//subclass could not handle, resort to manually walkign through"
This comment is just above the while loop that iterates over all the imagery in the directory which makes me wonder if this is the intended behavior.

Has anyone else experienced this issue? Am I configuring something incorrectly? I realize the simple solution is to not make invalid temporal requests, but I don't control the external clients and this seems to be a pretty big flaw in my opinion. No external entity should be able to take down my server with a simple request.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services
------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60134071&iu=/4140/ostg.clktrk
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net<mailto:Geoserver-users@anonymised.comrge.net>
https://lists.sourceforge.net/lists/listinfo/geoserver-users

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Dott. Carlo Cancellieri
@cancellieric
Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313<tel:%2B39%200584%20962313>
mobile: +39 3371094494<tel:%2B39%203371094494>
fax: +39 0584 1660272<tel:%2B39%200584%201660272>

http://www.geo-solutions.it/&gt;
http://twitter.com/geosolutions_it

-------------------------------------------------------

4

Whoops,
I typed all that up and forgot to attach the getCapabilities snippet.

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: geo.ccancellieri@anonymised.com [geo.ccancellieri@anonymised.com] on behalf of carlo cancellieri [carlo.cancellieri@anonymised.com]
Sent: Tuesday, October 15, 2013 3:54 AM
To: Weiss, Kevin
Cc: geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Kevin,
first of all I would suggest to set USE_JAI_IMAGEREAD to true anyhow as far as I remember the ImageMosaic may work as following:
The search is performed filtering over the DB without opening rasters at all, then the ImageMosaic may iterate over the selected granules using the ContentFeatureSource but if no time is matching in the db the content source should be empty and a blank image is produced. Could you provide the query you are using and the relevant piece of getcapabilities?
Cheers,
Carlo

2013/10/14 Weiss, Kevin <kweiss01@anonymised.com<mailto:kweiss01@anonymised.com>>
Hello All,

I've been troubleshooting a Java heap space error with temporal ImageMosaic datastores. We originally followed the tutorials here (http://docs.geoserver.org/latest/en/user/tutorials/imagemosaic_timeseries/imagemosaic_timeseries.html) to setup a temporally enabled raster data store. After that we designed a system which would download new imagery and update the underlying DB table. The system works as expected until a request for an invalid timestamp is made. It appears that the GeoServer/GeoTools code begins to loop over each image in the directory loading it into memory. When we only had 10-15 images in the directory this was unnoticeable, however now that our collection has grown to 1500+ images it quickly runs us out of heap space.

The code in question appears to be in ContentFeatureSource.java. In the accepts(Query, FeatureVisitor, ProgressListener) method I found the following comment:
"//subclass could not handle, resort to manually walkign through"
This comment is just above the while loop that iterates over all the imagery in the directory which makes me wonder if this is the intended behavior.

Has anyone else experienced this issue? Am I configuring something incorrectly? I realize the simple solution is to not make invalid temporal requests, but I don't control the external clients and this seems to be a pretty big flaw in my opinion. No external entity should be able to take down my server with a simple request.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services
------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60134071&iu=/4140/ostg.clktrk
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net<mailto:Geoserver-users@anonymised.comrge.net>
https://lists.sourceforge.net/lists/listinfo/geoserver-users

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Dott. Carlo Cancellieri
@cancellieric
Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313<tel:%2B39%200584%20962313>
mobile: +39 3371094494<tel:%2B39%203371094494>
fax: +39 0584 1660272<tel:%2B39%200584%201660272>

http://www.geo-solutions.it/&gt;
http://twitter.com/geosolutions_it

-------------------------------------------------------

GetCapabilitiesSnippet.txt (29 KB)

5

Kevin,

just looking for options:
Do you have the chance to test this mosaic on geoserver 2.4.0 (Backup your datadir!!!) ? There are many improvements on the ImageMosaic side.

···

Carlo

–

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Dott. Carlo Cancellieri
@cancellieric
Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
mobile: +39 3371094494
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

6

On Tue, Oct 15, 2013 at 4:11 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Carlo,
Thanks for the advice. We had already enabled USE_JAI_IMAGEREAD and
installed native JAI (something I should have mentioned). Attached is a
getCapabilities snippet of the layer in question and here is an example URL
which causes Tomcat to spiral out of memory:

http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=application/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and
FeatureVisitor objects being passed into ContentFeatureSource.accepts().
The visitor object contains the time, but the query object only appears to
specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That's
not automatic, has to be done manually, if not done, the time parameter
will be ignored.

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more
information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

7

Andrea,
Yes time was enabled on the layer. The layer works as expected when processing requests for times that exist in the system. It's only when a "rogue" request comes in that doesn't match any times stored in the DB that the OOM errors occur.

Carlo,
I'll test with 2.4.0 and report back shortly.

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: andrea.aime@anonymised.com [andrea.aime@anonymised.com] on behalf of Andrea Aime [andrea.aime@anonymised.com]
Sent: Tuesday, October 15, 2013 9:28 AM
To: Weiss, Kevin
Cc: carlo cancellieri; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

On Tue, Oct 15, 2013 at 4:11 PM, Weiss, Kevin <kweiss01@anonymised.com<mailto:kweiss01@anonymised.com>> wrote:
Carlo,
Thanks for the advice. We had already enabled USE_JAI_IMAGEREAD and installed native JAI (something I should have mentioned). Attached is a getCapabilities snippet of the layer in question and here is an example URL which causes Tomcat to spiral out of memory:
http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=application/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That's not automatic, has to be done manually, if not done, the time parameter will be ignored.

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

8

Ciao Kevin,
this is actually strange. I don't see how a "bad" request could be so
problematic.

Thinking, I would do this to troubleshoot (hold on for a second on the
temptation to upgrade :slight_smile: ), raise the log level to verbose, make a
"bad" request and get the log file.
This way we can say what the imagemosaic is doing.

Please, send also the xml config for that mosaic from the geoserver
data dir so that we can inspect how the mosaic is configured.
Eventually send also the config file for the mosaic itself that are
located inside the mosaic directory (e.g the xxx.properties files).

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Oct 15, 2013 at 4:36 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Andrea,
Yes time was enabled on the layer. The layer works as expected when processing requests for times that exist in the system. It's only when a "rogue" request comes in that doesn't match any times stored in the DB that the OOM errors occur.

Carlo,
I'll test with 2.4.0 and report back shortly.

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: andrea.aime@anonymised.com [andrea.aime@anonymised.com] on behalf of Andrea Aime [andrea.aime@anonymised.com]
Sent: Tuesday, October 15, 2013 9:28 AM
To: Weiss, Kevin
Cc: carlo cancellieri; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

On Tue, Oct 15, 2013 at 4:11 PM, Weiss, Kevin <kweiss01@anonymised.com<mailto:kweiss01@anonymised.com>> wrote:
Carlo,
Thanks for the advice. We had already enabled USE_JAI_IMAGEREAD and installed native JAI (something I should have mentioned). Attached is a getCapabilities snippet of the layer in question and here is an example URL which causes Tomcat to spiral out of memory:
http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=application/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That's not automatic, has to be done manually, if not done, the time parameter will be ignored.

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

9

Simone,
Attached are the requested files. I toggled GeoServer into verbose logging and made a single "bad" request. I included all configuration files relevant to the layer in question (CoverageStore, Store, Layer, properties). Let me know if you need any more data. Thanks for your help on this.

Carlo,
I briefly attempted an upgrade to 2.4.0, but there appear to be some incompatibilities with my layer definitions as GeoServer wasn't very happy when it came up. I couldn't even get a "good" request for my Satellite layer to work. Rather than spend more time looking into that I reverted back to 2.3.0 to gather the logs Simone requested.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: simboss1@anonymised.com [simboss1@anonymised.com] on behalf of Simone Giannecchini [simone.giannecchini@anonymised.com]
Sent: Tuesday, October 15, 2013 9:46 AM
To: Weiss, Kevin
Cc: Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao Kevin,
this is actually strange. I don't see how a "bad" request could be so
problematic.

Thinking, I would do this to troubleshoot (hold on for a second on the
temptation to upgrade :slight_smile: ), raise the log level to verbose, make a
"bad" request and get the log file.
This way we can say what the imagemosaic is doing.

Please, send also the xml config for that mosaic from the geoserver
data dir so that we can inspect how the mosaic is configured.
Eventually send also the config file for the mosaic itself that are
located inside the mosaic directory (e.g the xxx.properties files).

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Oct 15, 2013 at 4:36 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Andrea,
Yes time was enabled on the layer. The layer works as expected when processing requests for times that exist in the system. It's only when a "rogue" request comes in that doesn't match any times stored in the DB that the OOM errors occur.

Carlo,
I'll test with 2.4.0 and report back shortly.

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: andrea.aime@anonymised.com [andrea.aime@anonymised.com] on behalf of Andrea Aime [andrea.aime@anonymised.com]
Sent: Tuesday, October 15, 2013 9:28 AM
To: Weiss, Kevin
Cc: carlo cancellieri; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

On Tue, Oct 15, 2013 at 4:11 PM, Weiss, Kevin <kweiss01@anonymised.com<mailto:kweiss01@anonymised.com>> wrote:
Carlo,
Thanks for the advice. We had already enabled USE_JAI_IMAGEREAD and installed native JAI (something I should have mentioned). Attached is a getCapabilities snippet of the layer in question and here is an example URL which causes Tomcat to spiral out of memory:
http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=application/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That's not automatic, has to be done manually, if not done, the time parameter will be ignored.

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

GeoServer-Data.zip (132 KB)

10

Dear Kevin,
I confirm this is a bug on 2.3.x. The same thing should not happen on
2.4.x and master.

I have opened a JIRA (http://jira.codehaus.org/browse/GEOT-4599) and
fixed it right away on 2.3.x. This means you will need to either
update your GeoServer installation to a 2.3.x nightly (which should be
safe) or replace manually the imagemosaic jar.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Oct 15, 2013 at 6:00 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Simone,
Attached are the requested files. I toggled GeoServer into verbose logging and made a single "bad" request. I included all configuration files relevant to the layer in question (CoverageStore, Store, Layer, properties). Let me know if you need any more data. Thanks for your help on this.

Carlo,
I briefly attempted an upgrade to 2.4.0, but there appear to be some incompatibilities with my layer definitions as GeoServer wasn't very happy when it came up. I couldn't even get a "good" request for my Satellite layer to work. Rather than spend more time looking into that I reverted back to 2.3.0 to gather the logs Simone requested.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: simboss1@anonymised.com [simboss1@anonymised.com] on behalf of Simone Giannecchini [simone.giannecchini@anonymised.com]
Sent: Tuesday, October 15, 2013 9:46 AM
To: Weiss, Kevin
Cc: Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao Kevin,
this is actually strange. I don't see how a "bad" request could be so
problematic.

Thinking, I would do this to troubleshoot (hold on for a second on the
temptation to upgrade :slight_smile: ), raise the log level to verbose, make a
"bad" request and get the log file.
This way we can say what the imagemosaic is doing.

Please, send also the xml config for that mosaic from the geoserver
data dir so that we can inspect how the mosaic is configured.
Eventually send also the config file for the mosaic itself that are
located inside the mosaic directory (e.g the xxx.properties files).

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Oct 15, 2013 at 4:36 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Andrea,
Yes time was enabled on the layer. The layer works as expected when processing requests for times that exist in the system. It's only when a "rogue" request comes in that doesn't match any times stored in the DB that the OOM errors occur.

Carlo,
I'll test with 2.4.0 and report back shortly.

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: andrea.aime@anonymised.com [andrea.aime@anonymised.com] on behalf of Andrea Aime [andrea.aime@anonymised.com]
Sent: Tuesday, October 15, 2013 9:28 AM
To: Weiss, Kevin
Cc: carlo cancellieri; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

On Tue, Oct 15, 2013 at 4:11 PM, Weiss, Kevin <kweiss01@anonymised.com<mailto:kweiss01@anonymised.com>> wrote:
Carlo,
Thanks for the advice. We had already enabled USE_JAI_IMAGEREAD and installed native JAI (something I should have mentioned). Attached is a getCapabilities snippet of the layer in question and here is an example URL which causes Tomcat to spiral out of memory:
http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=application/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That's not automatic, has to be done manually, if not done, the time parameter will be ignored.

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

11

Ciao kevin,
you might want to replace the imagemosaic jar with the one attached.
It should solve the issue.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Thu, Oct 17, 2013 at 9:16 AM, Simone Giannecchini
<simone.giannecchini@anonymised.com> wrote:

Dear Kevin,
I confirm this is a bug on 2.3.x. The same thing should not happen on
2.4.x and master.

I have opened a JIRA (http://jira.codehaus.org/browse/GEOT-4599) and
fixed it right away on 2.3.x. This means you will need to either
update your GeoServer installation to a 2.3.x nightly (which should be
safe) or replace manually the imagemosaic jar.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Oct 15, 2013 at 6:00 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Simone,
Attached are the requested files. I toggled GeoServer into verbose logging and made a single "bad" request. I included all configuration files relevant to the layer in question (CoverageStore, Store, Layer, properties). Let me know if you need any more data. Thanks for your help on this.

Carlo,
I briefly attempted an upgrade to 2.4.0, but there appear to be some incompatibilities with my layer definitions as GeoServer wasn't very happy when it came up. I couldn't even get a "good" request for my Satellite layer to work. Rather than spend more time looking into that I reverted back to 2.3.0 to gather the logs Simone requested.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: simboss1@anonymised.com [simboss1@anonymised.com] on behalf of Simone Giannecchini [simone.giannecchini@anonymised.com]
Sent: Tuesday, October 15, 2013 9:46 AM
To: Weiss, Kevin
Cc: Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao Kevin,
this is actually strange. I don't see how a "bad" request could be so
problematic.

Thinking, I would do this to troubleshoot (hold on for a second on the
temptation to upgrade :slight_smile: ), raise the log level to verbose, make a
"bad" request and get the log file.
This way we can say what the imagemosaic is doing.

Please, send also the xml config for that mosaic from the geoserver
data dir so that we can inspect how the mosaic is configured.
Eventually send also the config file for the mosaic itself that are
located inside the mosaic directory (e.g the xxx.properties files).

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Oct 15, 2013 at 4:36 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Andrea,
Yes time was enabled on the layer. The layer works as expected when processing requests for times that exist in the system. It's only when a "rogue" request comes in that doesn't match any times stored in the DB that the OOM errors occur.

Carlo,
I'll test with 2.4.0 and report back shortly.

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: andrea.aime@anonymised.com [andrea.aime@anonymised.com] on behalf of Andrea Aime [andrea.aime@anonymised.com]
Sent: Tuesday, October 15, 2013 9:28 AM
To: Weiss, Kevin
Cc: carlo cancellieri; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

On Tue, Oct 15, 2013 at 4:11 PM, Weiss, Kevin <kweiss01@anonymised.com<mailto:kweiss01@anonymised.com>> wrote:
Carlo,
Thanks for the advice. We had already enabled USE_JAI_IMAGEREAD and installed native JAI (something I should have mentioned). Attached is a getCapabilities snippet of the layer in question and here is an example URL which causes Tomcat to spiral out of memory:
http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-180.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=application/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That's not automatic, has to be done manually, if not done, the time parameter will be ignored.

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from
the latest Intel processors and coprocessors. See abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

gt-imagemosaic-9-SNAPSHOT.jar (226 KB)

12

Simone,
Based on initial tests your updated jar did indeed fix the looping imagemosaic problem. "Bad" time requests return a blank image quickly and do not cause the memory to expand out of control. The only issue is that it doesn't work with GeoServer 2.3.0. I was able to upgrade a local install to 2.3.5 for testing, but we'll need to decide how we want to upgrade in production. As you said, 2.4.0 should just work out of the box, but it has proven incompatible with our layers which work in 2.3.0. Whereas 2.3.5 would require us to patch in the upgraded jar after installation.

Anyway, that's our problem to discuss and resolve. Thanks for all the help!

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kevin.weiss@anonymised.com

-----Original Message-----
From: simboss1@anonymised.com [mailto:simboss1@anonymised.com] On Behalf Of Simone Giannecchini
Sent: Thursday, October 17, 2013 2:37 AM
To: Simone Giannecchini
Cc: Weiss, Kevin; Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao kevin,
you might want to replace the imagemosaic jar with the one attached.
It should solve the issue.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Thu, Oct 17, 2013 at 9:16 AM, Simone Giannecchini <simone.giannecchini@anonymised.com..1107...> wrote:

Dear Kevin,
I confirm this is a bug on 2.3.x. The same thing should not happen on
2.4.x and master.

I have opened a JIRA (http://jira.codehaus.org/browse/GEOT-4599) and
fixed it right away on 2.3.x. This means you will need to either
update your GeoServer installation to a 2.3.x nightly (which should be
safe) or replace manually the imagemosaic jar.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Oct 15, 2013 at 6:00 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Simone,
Attached are the requested files. I toggled GeoServer into verbose logging and made a single "bad" request. I included all configuration files relevant to the layer in question (CoverageStore, Store, Layer, properties). Let me know if you need any more data. Thanks for your help on this.

Carlo,
I briefly attempted an upgrade to 2.4.0, but there appear to be some incompatibilities with my layer definitions as GeoServer wasn't very happy when it came up. I couldn't even get a "good" request for my Satellite layer to work. Rather than spend more time looking into that I reverted back to 2.3.0 to gather the logs Simone requested.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: simboss1@anonymised.com [simboss1@anonymised.com] on behalf of Simone
Giannecchini [simone.giannecchini@anonymised.com]
Sent: Tuesday, October 15, 2013 9:46 AM
To: Weiss, Kevin
Cc: Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao Kevin,
this is actually strange. I don't see how a "bad" request could be so
problematic.

Thinking, I would do this to troubleshoot (hold on for a second on
the temptation to upgrade :slight_smile: ), raise the log level to verbose, make
a "bad" request and get the log file.
This way we can say what the imagemosaic is doing.

Please, send also the xml config for that mosaic from the geoserver
data dir so that we can inspect how the mosaic is configured.
Eventually send also the config file for the mosaic itself that are
located inside the mosaic directory (e.g the xxx.properties files).

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Oct 15, 2013 at 4:36 PM, Weiss, Kevin <kweiss01@anonymised.com> wrote:

Andrea,
Yes time was enabled on the layer. The layer works as expected when processing requests for times that exist in the system. It's only when a "rogue" request comes in that doesn't match any times stored in the DB that the OOM errors occur.

Carlo,
I'll test with 2.4.0 and report back shortly.

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com
________________________________________
From: andrea.aime@anonymised.com [andrea.aime@anonymised.com] on behalf of
Andrea Aime [andrea.aime@anonymised.com]
Sent: Tuesday, October 15, 2013 9:28 AM
To: Weiss, Kevin
Cc: carlo cancellieri; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

On Tue, Oct 15, 2013 at 4:11 PM, Weiss, Kevin <kweiss01@anonymised.com<mailto:kweiss01@anonymised.com>> wrote:
Carlo,
Thanks for the advice. We had already enabled USE_JAI_IMAGEREAD and installed native JAI (something I should have mentioned). Attached is a getCapabilities snippet of the layer in question and here is an example URL which causes Tomcat to spiral out of memory:
http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.
1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-18
0.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=app
lication/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That's not automatic, has to be done manually, if not done, the time parameter will be ignored.

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

--------------------------------------------------------------------
---------- October Webinars: Code for Performance Free Intel
webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the
most from the latest Intel processors and coprocessors. See
abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg
.clktrk _______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

13

Ciao Kevin,
in the shortt erm I would update to 2.3.5 and I would use a bit more time to go to 2.4, where if you’ll find issues we can fix them.

About patching, I am (very) keen to re-establish a build server for2.3.x that will create nightl out of 2.3.x series. I’ll keep you posted.

Simone.

Il giorno sabato 19 ottobre 2013, Weiss, Kevin ha scritto:

Simone,
Based on initial tests your updated jar did indeed fix the looping imagemosaic problem. “Bad” time requests return a blank image quickly and do not cause the memory to expand out of control. The only issue is that it doesn’t work with GeoServer 2.3.0. I was able to upgrade a local install to 2.3.5 for testing, but we’ll need to decide how we want to upgrade in production. As you said, 2.4.0 should just work out of the box, but it has proven incompatible with our layers which work in 2.3.0. Whereas 2.3.5 would require us to patch in the upgraded jar after installation.

Anyway, that’s our problem to discuss and resolve. Thanks for all the help!

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kevin.weiss@anonymised.com

-----Original Message-----
From: simboss1@anonymised.com [mailto:simboss1@anonymised.com] On Behalf Of Simone Giannecchini
Sent: Thursday, October 17, 2013 2:37 AM
To: Simone Giannecchini
Cc: Weiss, Kevin; Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao kevin,
you might want to replace the imagemosaic jar with the one attached.
It should solve the issue.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Thu, Oct 17, 2013 at 9:16 AM, Simone Giannecchini simone.giannecchini@anonymised.com wrote:

Dear Kevin,
I confirm this is a bug on 2.3.x. The same thing should not happen on
2.4.x and master.

I have opened a JIRA (http://jira.codehaus.org/browse/GEOT-4599) and
fixed it right away on 2.3.x. This means you will need to either
update your GeoServer installation to a 2.3.x nightly (which should be
safe) or replace manually the imagemosaic jar.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Tue, Oct 15, 2013 at 6:00 PM, Weiss, Kevin <kweiss01@anonymised.com…> wrote:

Simone,
Attached are the requested files. I toggled GeoServer into verbose logging and made a single “bad” request. I included all configuration files relevant to the layer in question (CoverageStore, Store, Layer, properties). Let me know if you need any more data. Thanks for your help on this.

Carlo,
I briefly attempted an upgrade to 2.4.0, but there appear to be some incompatibilities with my layer definitions as GeoServer wasn’t very happy when it came up. I couldn’t even get a “good” request for my Satellite layer to work. Rather than spend more time looking into that I reverted back to 2.3.0 to gather the logs Simone requested.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com

From: simboss1@anonymised.com [simboss1@anonymised.com] on behalf of Simone
Giannecchini [simone.giannecchini@anonymised.com]
Sent: Tuesday, October 15, 2013 9:46 AM
To: Weiss, Kevin
Cc: Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao Kevin,
this is actually strange. I don’t see how a “bad” request could be so
problematic>>> http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.

1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-18
0.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=app
lication/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That’s not automatic, has to be done manually, if not done, the time parameter will be ignored.

Cheers
Andrea

–

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---------- October Webinars: Code for Performance Free Intel
webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the
most from the latest Intel processors and coprocessors. See
abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg
.clktrk _______________________________________________
Geoserver-users mailing list
Geoserver-users@anonymised.comrceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–
Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

14

Ciao Kevin,
in the shortt erm I would update to 2.3.5 and I would use a bit more time to go to 2.4, where if you’ll find issues we can fix them.

About patching, I am (very) keen to re-establish a build server for2.3.x that will create nightl out of 2.3.x series. I’ll keep you posted.

Simone.

Il giorno sabato 19 ottobre 2013, Weiss, Kevin ha scritto:

Simone,
Based on initial tests your updated jar did indeed fix the looping imagemosaic problem. “Bad” time requests return a blank image quickly and do not cause the memory to expand out of control. The only issue is that it doesn’t work with GeoServer 2.3.0. I was able to upgrade a local install to 2.3.5 for testing, but we’ll need to decide how we want to upgrade in production. As you said, 2.4.0 should just work out of the box, but it has proven incompatible with our layers which work in 2.3.0. Whereas 2.3.5 would require us to patch in the upgraded jar after installation.

Anyway, that’s our problem to discuss and resolve. Thanks for all the help!

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kevin.weiss@anonymised.com

-----Original Message-----
From: simboss1@anonymised.com [mailto:simboss1@anonymised.com] On Behalf Of Simone Giannecchini
Sent: Thursday, October 17, 2013 2:37 AM
To: Simone Giannecchini
Cc: Weiss, Kevin; Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao kevin,
you might want to replace the imagemosaic jar with the one attached.
It should solve the issue.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Thu, Oct 17, 2013 at 9:16 AM, Simone Giannecchini simone.giannecchini@anonymised.com wrote:

Dear Kevin,
I confirm this is a bug on 2.3.x. The same thing should not happen on
2.4.x and master.

I have opened a JIRA (http://jira.codehaus.org/browse/GEOT-4599) and
fixed it right away on 2.3.x. This means you will need to either
update your GeoServer installation to a 2.3.x nightly (which should be
safe) or replace manually the imagemosaic jar.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Tue, Oct 15, 2013 at 6:00 PM, Weiss, Kevin <kweiss01@anonymised.com…> wrote:

Simone,
Attached are the requested files. I toggled GeoServer into verbose logging and made a single “bad” request. I included all configuration files relevant to the layer in question (CoverageStore, Store, Layer, properties). Let me know if you need any more data. Thanks for your help on this.

Carlo,
I briefly attempted an upgrade to 2.4.0, but there appear to be some incompatibilities with my layer definitions as GeoServer wasn’t very happy when it came up. I couldn’t even get a “good” request for my Satellite layer to work. Rather than spend more time looking into that I reverted back to 2.3.0 to gather the logs Simone requested.

Thanks,

Kevin M. Weiss
Software Engineer
HARRIS IT Services

1408 Fort Crook Road South
Bellevue, NE 68005
kweiss01@anonymised.com

From: simboss1@anonymised.com [simboss1@anonymised.com] on behalf of Simone
Giannecchini [simone.giannecchini@anonymised.com]
Sent: Tuesday, October 15, 2013 9:46 AM
To: Weiss, Kevin
Cc: Andrea Aime; geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] ImageMosaic out of memory issue

Ciao Kevin,
this is actually strange. I don’t see how a “bad” request could be so
problematic>>> http://localhost:8080/geoserver/Satellite/wms?service=WMS&version=1.

1.0&request=GetMap&layers=Satellite:GOES-East_NA_IR&styles=&bbox=-18
0.0,-90.0,180.0,90.0&width=660&height=330&srs=EPSG:404000&format=app
lication/openlayers&time=2013-10-14T19:45:51Z

Using eclipse as a remote debugger I can examine the Query and FeatureVisitor objects being passed into ContentFeatureSource.accepts(). The visitor object contains the time, but the query object only appears to specify the layer name and a bounding box.

Was time enabled i the dimensions tab of the layer configuration? That’s not automatic, has to be done manually, if not done, the time parameter will be ignored.

Cheers
Andrea

–

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---------- October Webinars: Code for Performance Free Intel
webinars can help you accelerate application performance.
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the
most from the latest Intel processors and coprocessors. See
abstracts and register >
http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg
.clktrk _______________________________________________
Geoserver-users mailing list
Geoserver-users@anonymised.comrceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–
Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it