[Geoserver-users] ImageMosaic problems

GeoServer GeoServer User
1

Hi List,
I’m trying to use an ImageMosaic and I’m getting some really odd behaviour.

  • The Mosiac is made of GeoTiffs (inner tiled and overviews) which GeoServer can serve fine as regular files.
  • There are currently 8 items totalling 11GB (the other 20GB are still processing). These items all have different shapes and sizes, but none overlap and they’re all part of one grid.
    -I have the “Background Values” set to -9999 for nodata (it had a black background before this).

What happens:
If I make a WMS request using the OpenLayers viewer, nothing happens client side. Server side it’s using a bunch of CPU power, and the last item in the log is:
2013-05-16 18:16:15,302 DEBUG [org.geotools.image] - Writing out…
It just never writes. There are no error/warn events.

If I set it up as a TMS, and try to pre-seed, it takes forever to generate any tiles.
Also, when it does generate tiles, the raster-nodata areas (as compared to the no-raster no-data areas) have a light grey colour to them.
If I tell integrated GWC to “kill” the seeding tasks, it claims to, but they keep using up my CPU anyway.

Using 2.3.1

AllowMultithreading = true
use_jai_imageread = false
maxallowtiles = -1

The configuration and shapefile were autogenerated and haven’t been tweaked.

Can anyone advise? I did have a different ImageMosaic working yesterday with no problems, but that was a much smaller, simpler dataset.
Thanks,
Jonathan

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

2

On Thu, May 16, 2013 at 7:29 PM, Jonathan Moules <
jonathanmoules@anonymised.com> wrote:

Hi List,
I'm trying to use an ImageMosaic and I'm getting some really odd behaviour.
- The Mosiac is made of GeoTiffs (inner tiled and overviews) which
GeoServer can serve fine as regular files.
- There are currently 8 items totalling 11GB (the other 20GB are still
processing). These items all have different shapes and sizes, but none
overlap and they're all part of one grid.
    -I have the "Background Values" set to -9999 for nodata (it had a
black background before this).

A common case is either:
* not having the overviews
* having files with different native resolutions (check them with gdalinfo)
* having files with different overviews, or at least one with none

Cheers
Andrea

--

GeoServer training in Milan, 6th & 7th June 2013! Visit
http://geoserver.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

3

Hi Andrea.
I created them all with the same gdal code and the same levels of overviews:
i.e.:

gdal_translate -of GTiff -co “TILED=YES” -co “BIGTIFF=YES” -co “COMPRESS=JPEG” -co “JPEG_QUALITY=50” -co “BLOCKXSIZE=512” -co “BLOCKYSIZE=512” -a_srs “EPSG:27700” SP24_Colour.tif f:/tiled/SP24_Colour.tif

gdaladdo -r average f:/tiled/SP24_Colour.tif 2 4 8 16 32 64 128 256

So they all have overviews and they all have the same SRS (27700).

However, because the rasters are all of different sizes, their overviews are also of different sizes, even though they go down same the number of levels.

So for example:

Files: SK00_Colour.tif
Size is 48000, 8000

…

Band 1 Block=512x512 Type=Byte, ColorInterp=Red
Overviews: 24000x4000, 12000x2000, 6000x1000, 3000x500, 1500x250, 750x125, 375x63, 188x32
Band 2 Block=512x512 Type=Byte, ColorInterp=Green
Overviews: 24000x4000, 12000x2000, 6000x1000, 3000x500, 1500x250, 750x125, 375x63, 188x32
Band 3 Block=512x512 Type=Byte, ColorInterp=Blue
Overviews: 24000x4000, 12000x2000, 6000x1000, 3000x500, 1500x250, 750x125, 375x63, 188x32

···

Hi List,
I’m trying to use an ImageMosaic and I’m getting some really odd behaviour.

  • The Mosiac is made of GeoTiffs (inner tiled and overviews) which GeoServer can serve fine as regular files.
  • There are currently 8 items totalling 11GB (the other 20GB are still processing). These items all have different shapes and sizes, but none overlap and they’re all part of one grid.
    -I have the “Background Values” set to -9999 for nodata (it had a black background before this).

A common case is either:

  • not having the overviews
  • having files with different native resolutions (check them with gdalinfo)
  • having files with different overviews, or at least one with none

Cheers
Andrea

–

==
GeoServer training in Milan, 6th & 7th June 2013! Visit http://geoserver.geo-solutions.it for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it