[Geoserver-users] JNDI datasource for ImageMosiac

[Michael_Romero]

Hi all,

I see in the docs (http://docs.geoserver.org/latest/en/user/tutorials/imagemosaic-jdbc/imagemosaic-jdbc_tutorial.html) that you can use a JNDI datasource for the ImageMosiac JDBC plugin. Is it possible to use a JNDI datasource in the datastore.properties of the regular ImageMosiac plugin? Or, at the very least, can you encrypt the DB password?

Thanks,

Michael Romero
Software Engineer
Forward Slope, Inc.

[Russ]

I have a set of 100 tiles (UK Ordnance Survey data).

I have created an image pyramid, created a store and added a layer.

When I view it, via GeoServer preview, it all looks fine until I stat to zoom in. At a certain zoom level (The scale reads 1:87k) some of the tiles get drawn as white.
So tiles are there at 1:174k, not there at 1:87k and back again at 1:44k

When I look in the logs (catalina.out) I see the many lines with a line saying;

…

Caused by: java.lang.IllegalArgumentException: All source images must have the same number of bands.
…

The source images all seem to have the same number of bands (1) and I do the following to create the pyramid

#!/bin/bash

echo -n Working on
pwd
mkdir out
for file in ls *tif
do
echo -n Working on $file
gdal_translate -of GTiff -co “TILED=YES” -co “COMPRESS=DEFLATE” -co “BLOCKXSIZE=512” -co “BLOCKYSIZE=512” -a_srs “EPSG:27700” $file out/$file
done
mv out/* .
rm -fr out
for file in ls *tif
do
echo -n Working on $file
gdaladdo -clean $file
gdaladdo -r average $file 1 2 4 8 16 32 64 128
done

Followed by

#!/bin/bash
export thedir=pwd
export thedir=basename $thedir
echo $thedir
mkdir pyramid
ls *tif > …/tiles$thedir.txt
gdal_retile.py -v -levels 9 -ps 2048 2048 -co ‘TILED=YES’ -co ‘BLOCKXSIZE=512’ -co ‘BLOCKYSIZE=512’ -s_srs EPSG:27700 -targetDir pyramid --optfile …/tiles$thedir.txt

I can post more of the log if required.
I am hazarding a guess it is something to do with the version of Java. Do I need to go back to 1.6.*

GeoServer 2.3.5
Tomcat 7.0.35
OpenSuse x64

JVM Version Oracle Corporation: 1.7.0_40 (OpenJDK 64-Bit Server VM)

Native JAI true
Native JAI ImageIO true

[Andrea_Aime4]

On Thu, Aug 29, 2013 at 8:54 AM, Russell Hore <russ@anonymised.com> wrote:

I have a set of 100 tiles (UK Ordnance Survey data).

I have created an image pyramid, created a store and added a layer.

When I view it, via GeoServer preview, it all looks fine until I stat to
zoom in. At a certain zoom level (The scale reads 1:87k) some of the tiles
get drawn as white.
So tiles are there at 1:174k, not there at 1:87k and back again at 1:44k

When I look in the logs (catalina.out) I see the many lines with a line
saying;

...
Caused by: java.lang.IllegalArgumentException: All source images must have
the same number of bands.

Given this error, it seems the images in your mosaic are not uniform, the
image mosaic cannot
deal with them right now unless they have a minimum amount of shared
structure.
Originally it was everything, same overviews, same projection and so on,
over time some of the
limits were removed, but I believe you still need to have them all with the
same band structure
e.g., all RGB, all gray, all paletted... maybe if there is a mix of
paletted and RGB one can force
the RGB expansion in the property file, not sure though, Simone, cc'ed,
should know more

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more
information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

[Simone_Giannecchini3]

Ciao Russell,
the suggestion from Andrea might be correct, although I see you do addo with average interpolation (hence I don’t think you have paletted images).

It would be help out to have the following:

-1- the mosaic.properties for the incriminated level
-2- the output of the gdalinfo on one of the files for this level
-3- a longer portion of the log that shows exactly from where this error is thrown.

···

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Thu, Aug 29, 2013 at 8:54 AM, Russell Hore <russ@anonymised.com> wrote:

I have a set of 100 tiles (UK Ordnance Survey data).

I have created an image pyramid, created a store and added a layer.

When I view it, via GeoServer preview, it all looks fine until I stat to zoom in. At a certain zoom level (The scale reads 1:87k) some of the tiles get drawn as white.
So tiles are there at 1:174k, not there at 1:87k and back again at 1:44k

When I look in the logs (catalina.out) I see the many lines with a line saying;

…

Caused by: java.lang.IllegalArgumentException: All source images must have the same number of bands.
…

The source images all seem to have the same number of bands (1) and I do the following to create the pyramid

#!/bin/bash

echo -n Working on
pwd
mkdir out
for file in ls *tif
do
echo -n Working on $file
gdal_translate -of GTiff -co “TILED=YES” -co “COMPRESS=DEFLATE” -co “BLOCKXSIZE=512” -co “BLOCKYSIZE=512” -a_srs “EPSG:27700” $file out/$file
done
mv out/* .
rm -fr out
for file in ls *tif
do
echo -n Working on $file
gdaladdo -clean $file
gdaladdo -r average $file 1 2 4 8 16 32 64 128
done

Followed by

#!/bin/bash
export thedir=pwd
export thedir=basename $thedir
echo $thedir
mkdir pyramid
ls *tif > …/tiles$thedir.txt
gdal_retile.py -v -levels 9 -ps 2048 2048 -co ‘TILED=YES’ -co ‘BLOCKXSIZE=512’ -co ‘BLOCKYSIZE=512’ -s_srs EPSG:27700 -targetDir pyramid --optfile …/tiles$thedir.txt

I can post more of the log if required.
I am hazarding a guess it is something to do with the version of Java. Do I need to go back to 1.6.*

GeoServer 2.3.5
Tomcat 7.0.35
OpenSuse x64

JVM Version Oracle Corporation: 1.7.0_40 (OpenJDK 64-Bit Server VM)

Native JAI true
Native JAI ImageIO true

---

Learn the latest–Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk

---

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

[Simone_Giannecchini3]

Ciao Michael,
as far as ImageMosaic is concerned, something like the following will
allow you to use a JNDI Postgis source for storing the index:

#################
# JNDI specific #
#dbtype=
SPI=org.geotools.data.postgis.PostgisNGJNDIDataStoreFactory
#String
# JNDI data source
# Default "java:comp/env/"+"jdbc/mydatabase"
jndiReferenceName=name

#Boolean
# perform only primary filter on bbox
# Default Boolean.TRUE
Loose\ bbox=true

#Boolean
# use prepared statements
#Default Boolean.FALSE
preparedStatements=false

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Thu, Aug 29, 2013 at 4:08 AM, Michael Romero
<mromero@anonymised.com> wrote:

Hi all,

I see in the docs
(http://docs.geoserver.org/latest/en/user/tutorials/imagemosaic-jdbc/imagemosaic-jdbc_tutorial.html)
that you can use a JNDI datasource for the ImageMosiac JDBC plugin. Is
it possible to use a JNDI datasource in the datastore.properties of the
regular ImageMosiac plugin? Or, at the very least, can you encrypt the
DB password?

Thanks,

Michael Romero
Software Engineer
Forward Slope, Inc.

------------------------------------------------------------------------------
Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

[Russ]

Hi Simone,

For information, gdalinfo on one of the original images, before I create the pyramid gives the following lines, and lots more, but I see the ‘Palette’ on the end

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette

Overviews: 4000x4000, 2000x2000, 1000x1000, 500x500, 250x250, 125x125, 63x63, 32x32
Color Table (RGB with 256 entries)

1. There is no mosaic.properties but the pyramid.properties is

#Automatically generated
#Thu Aug 29 07:48:00 BST 2013
Name=pyramid
Levels=2.5,2.5 5.0,5.0 10.0,10.0 20.0,20.0 40.0,40.0 80.0,80.0 160.0,160.0 320.0,320.0 640.0,640.0 1280.0,1280.0
LevelsNum=10
Envelope2D=300000.0,200000.0 400000.0,300000.0
LevelsDirs=0 1 2 3 4 5 6 7 8 9

2. On one of the ‘pyramid’ images I get;

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette
Color Table (RGB with 256 entries)

The log is over 3600 lines long.
I have put it on my server at http://russ-hore.co.uk/geoserver.log

Thanks for looking into this

Russ

···

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Thu, Aug 29, 2013 at 8:54 AM, Russell Hore <russ@anonymised.com> wrote:

I have a set of 100 tiles (UK Ordnance Survey data).

I have created an image pyramid, created a store and added a layer.

When I view it, via GeoServer preview, it all looks fine until I stat to zoom in. At a certain zoom level (The scale reads 1:87k) some of the tiles get drawn as white.
So tiles are there at 1:174k, not there at 1:87k and back again at 1:44k

When I look in the logs (catalina.out) I see the many lines with a line saying;

…

Caused by: java.lang.IllegalArgumentException: All source images must have the same number of bands.
…

The source images all seem to have the same number of bands (1) and I do the following to create the pyramid

#!/bin/bash

echo -n Working on
pwd
mkdir out
for file in ls *tif
do
echo -n Working on $file
gdal_translate -of GTiff -co “TILED=YES” -co “COMPRESS=DEFLATE” -co “BLOCKXSIZE=512” -co “BLOCKYSIZE=512” -a_srs “EPSG:27700” $file out/$file
done
mv out/* .
rm -fr out
for file in ls *tif
do
echo -n Working on $file
gdaladdo -clean $file
gdaladdo -r average $file 1 2 4 8 16 32 64 128
done

Followed by

#!/bin/bash
export thedir=pwd
export thedir=basename $thedir
echo $thedir
mkdir pyramid
ls *tif > …/tiles$thedir.txt
gdal_retile.py -v -levels 9 -ps 2048 2048 -co ‘TILED=YES’ -co ‘BLOCKXSIZE=512’ -co ‘BLOCKYSIZE=512’ -s_srs EPSG:27700 -targetDir pyramid --optfile …/tiles$thedir.txt

I can post more of the log if required.
I am hazarding a guess it is something to do with the version of Java. Do I need to go back to 1.6.*

GeoServer 2.3.5
Tomcat 7.0.35
OpenSuse x64

JVM Version Oracle Corporation: 1.7.0_40 (OpenJDK 64-Bit Server VM)

Native JAI true
Native JAI ImageIO true

---

Learn the latest–Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk

---

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

[Simone_Giannecchini3]

Ciao Russel,
please, read below…

···

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Fri, Aug 30, 2013 at 6:02 PM, Russell Hore <russ@anonymised.com> wrote:

Hi Simone,

For information, gdalinfo on one of the original images, before I create the pyramid gives the following lines, and lots more, but I see the ‘Palette’ on the end

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette

Overviews: 4000x4000, 2000x2000, 1000x1000, 500x500, 250x250, 125x125, 63x63, 32x32
Color Table (RGB with 256 entries)

1. There is no mosaic.properties but the pyramid.properties is

#Automatically generated
#Thu Aug 29 07:48:00 BST 2013
Name=pyramid
Levels=2.5,2.5 5.0,5.0 10.0,10.0 20.0,20.0 40.0,40.0 80.0,80.0 160.0,160.0 320.0,320.0 640.0,640.0 1280.0,1280.0
LevelsNum=10
Envelope2D=300000.0,200000.0 400000.0,300000.0
LevelsDirs=0 1 2 3 4 5 6 7 8 9

There is inside each subdirectory. I would need to one for the level that fails.

2. On one of the ‘pyramid’ images I get;

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette
Color Table (RGB with 256 entries)

The log is over 3600 lines long.
I have put it on my server at http://russ-hore.co.uk/geoserver.log

Yeah, it looks like we are mixing somehow paletted images with RGB images.
You might want to try this quickly. Find the mosaic properties file doe the level that fails and make sure
there is a line that says.
ExpandToRGB=true

(check this link for more info http://docs.geoserver.org/latest/en/user/tutorials/image_mosaic_plugin/imagemosaic.html#configuration-file)

You might want to check that all your images are coherent that is, we are not mixing paletted imagery with RGB imagery. The parameter above would force paletted imagery
to be expanded to RGB prior to mosaicking and might fix the issue right away.

Thanks for looking into this

Russ

On 30 Aug 2013, at 16:41, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Russell,
the suggestion from Andrea might be correct, although I see you do addo with average interpolation (hence I don’t think you have paletted images).

It would be help out to have the following:

-1- the mosaic.properties for the incriminated level
-2- the output of the gdalinfo on one of the files for this level
-3- a longer portion of the log that shows exactly from where this error is thrown.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Thu, Aug 29, 2013 at 8:54 AM, Russell Hore <russ@anonymised.com> wrote:

I have a set of 100 tiles (UK Ordnance Survey data).

I have created an image pyramid, created a store and added a layer.

When I view it, via GeoServer preview, it all looks fine until I stat to zoom in. At a certain zoom level (The scale reads 1:87k) some of the tiles get drawn as white.
So tiles are there at 1:174k, not there at 1:87k and back again at 1:44k

When I look in the logs (catalina.out) I see the many lines with a line saying;

…

Caused by: java.lang.IllegalArgumentException: All source images must have the same number of bands.
…

The source images all seem to have the same number of bands (1) and I do the following to create the pyramid

#!/bin/bash

echo -n Working on
pwd
mkdir out
for file in ls *tif
do
echo -n Working on $file
gdal_translate -of GTiff -co “TILED=YES” -co “COMPRESS=DEFLATE” -co “BLOCKXSIZE=512” -co “BLOCKYSIZE=512” -a_srs “EPSG:27700” $file out/$file
done
mv out/* .
rm -fr out
for file in ls *tif
do
echo -n Working on $file
gdaladdo -clean $file
gdaladdo -r average $file 1 2 4 8 16 32 64 128
done

Followed by

#!/bin/bash
export thedir=pwd
export thedir=basename $thedir
echo $thedir
mkdir pyramid
ls *tif > …/tiles$thedir.txt
gdal_retile.py -v -levels 9 -ps 2048 2048 -co ‘TILED=YES’ -co ‘BLOCKXSIZE=512’ -co ‘BLOCKYSIZE=512’ -s_srs EPSG:27700 -targetDir pyramid --optfile …/tiles$thedir.txt

I can post more of the log if required.
I am hazarding a guess it is something to do with the version of Java. Do I need to go back to 1.6.*

GeoServer 2.3.5
Tomcat 7.0.35
OpenSuse x64

JVM Version Oracle Corporation: 1.7.0_40 (OpenJDK 64-Bit Server VM)

Native JAI true
Native JAI ImageIO true

---

Learn the latest–Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk

---

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

[Russ]

Looking in geoserver.log the error seems to occur on file so00_1_5.tif

gdalinfo on that file gives the following;

Driver: GTiff/GeoTIFF
Files: so00_1_5.tif
Size is 1808, 2048
Coordinate System is:
PROJCS[“OSGB 1936 / British National Grid”,
GEOGCS[“OSGB 1936”,
DATUM[“OSGB_1936”,
SPHEROID[“Airy 1830”,6377563.396,299.3249646000044,
AUTHORITY[“EPSG”,“7001”]],
TOWGS84[446.448,-125.157,542.06,0.15,0.247,0.842,-20.489],
AUTHORITY[“EPSG”,“6277”]],
PRIMEM[“Greenwich”,0],
UNIT[“degree”,0.0174532925199433],
AUTHORITY[“EPSG”,“4277”]],
PROJECTION[“Transverse_Mercator”],
PARAMETER[“latitude_of_origin”,49],
PARAMETER[“central_meridian”,-2],
PARAMETER[“scale_factor”,0.9996012717],
PARAMETER[“false_easting”,400000],
PARAMETER[“false_northing”,-100000],
UNIT[“metre”,1,
AUTHORITY[“EPSG”,“9001”]],
AUTHORITY[“EPSG”,“27700”]]
Origin = (381920.000000000000000,300000.000000000000000)
Pixel Size = (10.000000000000000,-10.000000000000000)
Metadata:
AREA_OR_POINT=Area
Image Structure Metadata:
INTERLEAVE=BAND
Corner Coordinates:
Upper Left ( 381920.000, 300000.000) ( 2d16’ 1.04"W, 52d35’49.69"N)
Lower Left ( 381920.000, 279520.000) ( 2d15’57.03"W, 52d24’46.81"N)
Upper Right ( 400000.000, 300000.000) ( 2d 0’ 0.00"W, 52d35’50.77"N)
Lower Right ( 400000.000, 279520.000) ( 2d 0’ 0.00"W, 52d24’47.89"N)
Center ( 390960.000, 289760.000) ( 2d 7’59.52"W, 52d30’19.06"N)
Band 1 Block=512x512 Type=Byte, ColorInterp=Palette
Color Table (RGB with 256 entries)
0: 89,72,73,255
1: 122,104,105,255
2: 153,136,137,255
3: 230,89,104,255
4: 218,9,56,255
….

Russ

···

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Fri, Aug 30, 2013 at 6:02 PM, Russell Hore <russ@anonymised.com> wrote:

Hi Simone,

For information, gdalinfo on one of the original images, before I create the pyramid gives the following lines, and lots more, but I see the ‘Palette’ on the end

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette

Overviews: 4000x4000, 2000x2000, 1000x1000, 500x500, 250x250, 125x125, 63x63, 32x32
Color Table (RGB with 256 entries)

1. There is no mosaic.properties but the pyramid.properties is

#Automatically generated
#Thu Aug 29 07:48:00 BST 2013
Name=pyramid
Levels=2.5,2.5 5.0,5.0 10.0,10.0 20.0,20.0 40.0,40.0 80.0,80.0 160.0,160.0 320.0,320.0 640.0,640.0 1280.0,1280.0
LevelsNum=10
Envelope2D=300000.0,200000.0 400000.0,300000.0
LevelsDirs=0 1 2 3 4 5 6 7 8 9

There is inside each subdirectory. I would need to one for the level that fails.

2. On one of the ‘pyramid’ images I get;

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette
Color Table (RGB with 256 entries)

The log is over 3600 lines long.
I have put it on my server at http://russ-hore.co.uk/geoserver.log

Yeah, it looks like we are mixing somehow paletted images with RGB images.
You might want to try this quickly. Find the mosaic properties file doe the level that fails and make sure
there is a line that says.
ExpandToRGB=true

(check this link for more info http://docs.geoserver.org/latest/en/user/tutorials/image_mosaic_plugin/imagemosaic.html#configuration-file)

You might want to check that all your images are coherent that is, we are not mixing paletted imagery with RGB imagery. The parameter above would force paletted imagery
to be expanded to RGB prior to mosaicking and might fix the issue right away.

Thanks for looking into this

Russ

On 30 Aug 2013, at 16:41, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Russell,
the suggestion from Andrea might be correct, although I see you do addo with average interpolation (hence I don’t think you have paletted images).

It would be help out to have the following:

-1- the mosaic.properties for the incriminated level
-2- the output of the gdalinfo on one of the files for this level
-3- a longer portion of the log that shows exactly from where this error is thrown.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Thu, Aug 29, 2013 at 8:54 AM, Russell Hore <russ@anonymised.com> wrote:

I have a set of 100 tiles (UK Ordnance Survey data).

I have created an image pyramid, created a store and added a layer.

When I view it, via GeoServer preview, it all looks fine until I stat to zoom in. At a certain zoom level (The scale reads 1:87k) some of the tiles get drawn as white.
So tiles are there at 1:174k, not there at 1:87k and back again at 1:44k

When I look in the logs (catalina.out) I see the many lines with a line saying;

…

Caused by: java.lang.IllegalArgumentException: All source images must have the same number of bands.
…

The source images all seem to have the same number of bands (1) and I do the following to create the pyramid

#!/bin/bash

echo -n Working on
pwd
mkdir out
for file in ls *tif
do
echo -n Working on $file
gdal_translate -of GTiff -co “TILED=YES” -co “COMPRESS=DEFLATE” -co “BLOCKXSIZE=512” -co “BLOCKYSIZE=512” -a_srs “EPSG:27700” $file out/$file
done
mv out/* .
rm -fr out
for file in ls *tif
do
echo -n Working on $file
gdaladdo -clean $file
gdaladdo -r average $file 1 2 4 8 16 32 64 128
done

Followed by

#!/bin/bash
export thedir=pwd
export thedir=basename $thedir
echo $thedir
mkdir pyramid
ls *tif > …/tiles$thedir.txt
gdal_retile.py -v -levels 9 -ps 2048 2048 -co ‘TILED=YES’ -co ‘BLOCKXSIZE=512’ -co ‘BLOCKYSIZE=512’ -s_srs EPSG:27700 -targetDir pyramid --optfile …/tiles$thedir.txt

I can post more of the log if required.
I am hazarding a guess it is something to do with the version of Java. Do I need to go back to 1.6.*

GeoServer 2.3.5
Tomcat 7.0.35
OpenSuse x64

JVM Version Oracle Corporation: 1.7.0_40 (OpenJDK 64-Bit Server VM)

Native JAI true
Native JAI ImageIO true

---

Learn the latest–Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk

---

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

[Simone_Giannecchini3]

Ciao Russell,
did you try setting the parameter I suggested?

That said, you have to check if the other images in the same mosaic have a similar color model.
It might be worth to isolate 2/3 samples to reproduce the issue in case we don’t manage to find a fix.

···

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Sat, Aug 31, 2013 at 2:53 PM, Russell Hore <russ@anonymised.com> wrote:

Looking in geoserver.log the error seems to occur on file so00_1_5.tif

gdalinfo on that file gives the following;

Driver: GTiff/GeoTIFF
Files: so00_1_5.tif
Size is 1808, 2048
Coordinate System is:
PROJCS[“OSGB 1936 / British National Grid”,
GEOGCS[“OSGB 1936”,
DATUM[“OSGB_1936”,
SPHEROID[“Airy 1830”,6377563.396,299.3249646000044,
AUTHORITY[“EPSG”,“7001”]],
TOWGS84[446.448,-125.157,542.06,0.15,0.247,0.842,-20.489],
AUTHORITY[“EPSG”,“6277”]],
PRIMEM[“Greenwich”,0],
UNIT[“degree”,0.0174532925199433],
AUTHORITY[“EPSG”,“4277”]],
PROJECTION[“Transverse_Mercator”],
PARAMETER[“latitude_of_origin”,49],
PARAMETER[“central_meridian”,-2],
PARAMETER[“scale_factor”,0.9996012717],
PARAMETER[“false_easting”,400000],
PARAMETER[“false_northing”,-100000],
UNIT[“metre”,1,
AUTHORITY[“EPSG”,“9001”]],
AUTHORITY[“EPSG”,“27700”]]
Origin = (381920.000000000000000,300000.000000000000000)
Pixel Size = (10.000000000000000,-10.000000000000000)
Metadata:
AREA_OR_POINT=Area
Image Structure Metadata:
INTERLEAVE=BAND
Corner Coordinates:
Upper Left ( 381920.000, 300000.000) ( 2d16’ 1.04"W, 52d35’49.69"N)
Lower Left ( 381920.000, 279520.000) ( 2d15’57.03"W, 52d24’46.81"N)
Upper Right ( 400000.000, 300000.000) ( 2d 0’ 0.00"W, 52d35’50.77"N)
Lower Right ( 400000.000, 279520.000) ( 2d 0’ 0.00"W, 52d24’47.89"N)
Center ( 390960.000, 289760.000) ( 2d 7’59.52"W, 52d30’19.06"N)

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette
Color Table (RGB with 256 entries)

0: 89,72,73,255
1: 122,104,105,255
2: 153,136,137,255
3: 230,89,104,255
4: 218,9,56,255
….

Russ

On 30 Aug 2013, at 18:43, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Russel,
please, read below…

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Fri, Aug 30, 2013 at 6:02 PM, Russell Hore <russ@anonymised.com> wrote:

Hi Simone,

For information, gdalinfo on one of the original images, before I create the pyramid gives the following lines, and lots more, but I see the ‘Palette’ on the end

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette

Overviews: 4000x4000, 2000x2000, 1000x1000, 500x500, 250x250, 125x125, 63x63, 32x32
Color Table (RGB with 256 entries)

1. There is no mosaic.properties but the pyramid.properties is

#Automatically generated
#Thu Aug 29 07:48:00 BST 2013
Name=pyramid
Levels=2.5,2.5 5.0,5.0 10.0,10.0 20.0,20.0 40.0,40.0 80.0,80.0 160.0,160.0 320.0,320.0 640.0,640.0 1280.0,1280.0
LevelsNum=10
Envelope2D=300000.0,200000.0 400000.0,300000.0
LevelsDirs=0 1 2 3 4 5 6 7 8 9

There is inside each subdirectory. I would need to one for the level that fails.

2. On one of the ‘pyramid’ images I get;

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette
Color Table (RGB with 256 entries)

The log is over 3600 lines long.
I have put it on my server at http://russ-hore.co.uk/geoserver.log

Yeah, it looks like we are mixing somehow paletted images with RGB images.
You might want to try this quickly. Find the mosaic properties file doe the level that fails and make sure
there is a line that says.
ExpandToRGB=true

(check this link for more info http://docs.geoserver.org/latest/en/user/tutorials/image_mosaic_plugin/imagemosaic.html#configuration-file)

You might want to check that all your images are coherent that is, we are not mixing paletted imagery with RGB imagery. The parameter above would force paletted imagery
to be expanded to RGB prior to mosaicking and might fix the issue right away.

Thanks for looking into this

Russ

On 30 Aug 2013, at 16:41, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Russell,
the suggestion from Andrea might be correct, although I see you do addo with average interpolation (hence I don’t think you have paletted images).

It would be help out to have the following:

-1- the mosaic.properties for the incriminated level
-2- the output of the gdalinfo on one of the files for this level
-3- a longer portion of the log that shows exactly from where this error is thrown.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Thu, Aug 29, 2013 at 8:54 AM, Russell Hore <russ@anonymised.com> wrote:

I have a set of 100 tiles (UK Ordnance Survey data).

I have created an image pyramid, created a store and added a layer.

When I view it, via GeoServer preview, it all looks fine until I stat to zoom in. At a certain zoom level (The scale reads 1:87k) some of the tiles get drawn as white.
So tiles are there at 1:174k, not there at 1:87k and back again at 1:44k

When I look in the logs (catalina.out) I see the many lines with a line saying;

…

Caused by: java.lang.IllegalArgumentException: All source images must have the same number of bands.
…

The source images all seem to have the same number of bands (1) and I do the following to create the pyramid

#!/bin/bash

echo -n Working on
pwd
mkdir out
for file in ls *tif
do
echo -n Working on $file
gdal_translate -of GTiff -co “TILED=YES” -co “COMPRESS=DEFLATE” -co “BLOCKXSIZE=512” -co “BLOCKYSIZE=512” -a_srs “EPSG:27700” $file out/$file
done
mv out/* .
rm -fr out
for file in ls *tif
do
echo -n Working on $file
gdaladdo -clean $file
gdaladdo -r average $file 1 2 4 8 16 32 64 128
done

Followed by

#!/bin/bash
export thedir=pwd
export thedir=basename $thedir
echo $thedir
mkdir pyramid
ls *tif > …/tiles$thedir.txt
gdal_retile.py -v -levels 9 -ps 2048 2048 -co ‘TILED=YES’ -co ‘BLOCKXSIZE=512’ -co ‘BLOCKYSIZE=512’ -s_srs EPSG:27700 -targetDir pyramid --optfile …/tiles$thedir.txt

I can post more of the log if required.
I am hazarding a guess it is something to do with the version of Java. Do I need to go back to 1.6.*

GeoServer 2.3.5
Tomcat 7.0.35
OpenSuse x64

JVM Version Oracle Corporation: 1.7.0_40 (OpenJDK 64-Bit Server VM)

Native JAI true
Native JAI ImageIO true

---

Learn the latest–Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk

---

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

[Russ]

Sorry it has taken so long to reply.

It turned out it was my Antivirus software. Kaspersky 2013 on a Mac. Switched it off and all works fine, updated to the latest version and it all works fine with it switched on.

Thanks for your help.

Russ

···

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Sat, Aug 31, 2013 at 2:53 PM, Russell Hore <russ@anonymised.com> wrote:

Looking in geoserver.log the error seems to occur on file so00_1_5.tif

gdalinfo on that file gives the following;

Driver: GTiff/GeoTIFF
Files: so00_1_5.tif
Size is 1808, 2048
Coordinate System is:
PROJCS[“OSGB 1936 / British National Grid”,
GEOGCS[“OSGB 1936”,
DATUM[“OSGB_1936”,
SPHEROID[“Airy 1830”,6377563.396,299.3249646000044,
AUTHORITY[“EPSG”,“7001”]],
TOWGS84[446.448,-125.157,542.06,0.15,0.247,0.842,-20.489],
AUTHORITY[“EPSG”,“6277”]],
PRIMEM[“Greenwich”,0],
UNIT[“degree”,0.0174532925199433],
AUTHORITY[“EPSG”,“4277”]],
PROJECTION[“Transverse_Mercator”],
PARAMETER[“latitude_of_origin”,49],
PARAMETER[“central_meridian”,-2],
PARAMETER[“scale_factor”,0.9996012717],
PARAMETER[“false_easting”,400000],
PARAMETER[“false_northing”,-100000],
UNIT[“metre”,1,
AUTHORITY[“EPSG”,“9001”]],
AUTHORITY[“EPSG”,“27700”]]
Origin = (381920.000000000000000,300000.000000000000000)
Pixel Size = (10.000000000000000,-10.000000000000000)
Metadata:
AREA_OR_POINT=Area
Image Structure Metadata:
INTERLEAVE=BAND
Corner Coordinates:
Upper Left ( 381920.000, 300000.000) ( 2d16’ 1.04"W, 52d35’49.69"N)
Lower Left ( 381920.000, 279520.000) ( 2d15’57.03"W, 52d24’46.81"N)
Upper Right ( 400000.000, 300000.000) ( 2d 0’ 0.00"W, 52d35’50.77"N)
Lower Right ( 400000.000, 279520.000) ( 2d 0’ 0.00"W, 52d24’47.89"N)
Center ( 390960.000, 289760.000) ( 2d 7’59.52"W, 52d30’19.06"N)

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette
Color Table (RGB with 256 entries)

0: 89,72,73,255
1: 122,104,105,255
2: 153,136,137,255
3: 230,89,104,255
4: 218,9,56,255
….

Russ

On 30 Aug 2013, at 18:43, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Russel,
please, read below…

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Fri, Aug 30, 2013 at 6:02 PM, Russell Hore <russ@anonymised.com> wrote:

Hi Simone,

For information, gdalinfo on one of the original images, before I create the pyramid gives the following lines, and lots more, but I see the ‘Palette’ on the end

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette

Overviews: 4000x4000, 2000x2000, 1000x1000, 500x500, 250x250, 125x125, 63x63, 32x32
Color Table (RGB with 256 entries)

1. There is no mosaic.properties but the pyramid.properties is

#Automatically generated
#Thu Aug 29 07:48:00 BST 2013
Name=pyramid
Levels=2.5,2.5 5.0,5.0 10.0,10.0 20.0,20.0 40.0,40.0 80.0,80.0 160.0,160.0 320.0,320.0 640.0,640.0 1280.0,1280.0
LevelsNum=10
Envelope2D=300000.0,200000.0 400000.0,300000.0
LevelsDirs=0 1 2 3 4 5 6 7 8 9

There is inside each subdirectory. I would need to one for the level that fails.

2. On one of the ‘pyramid’ images I get;

Band 1 Block=512x512 Type=Byte, ColorInterp=Palette
Color Table (RGB with 256 entries)

The log is over 3600 lines long.
I have put it on my server at http://russ-hore.co.uk/geoserver.log

Yeah, it looks like we are mixing somehow paletted images with RGB images.
You might want to try this quickly. Find the mosaic properties file doe the level that fails and make sure
there is a line that says.
ExpandToRGB=true

(check this link for more info http://docs.geoserver.org/latest/en/user/tutorials/image_mosaic_plugin/imagemosaic.html#configuration-file)

You might want to check that all your images are coherent that is, we are not mixing paletted imagery with RGB imagery. The parameter above would force paletted imagery
to be expanded to RGB prior to mosaicking and might fix the issue right away.

Thanks for looking into this

Russ

On 30 Aug 2013, at 16:41, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Russell,
the suggestion from Andrea might be correct, although I see you do addo with average interpolation (hence I don’t think you have paletted images).

It would be help out to have the following:

-1- the mosaic.properties for the incriminated level
-2- the output of the gdalinfo on one of the files for this level
-3- a longer portion of the log that shows exactly from where this error is thrown.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

---

On Thu, Aug 29, 2013 at 8:54 AM, Russell Hore <russ@anonymised.com> wrote:

I have a set of 100 tiles (UK Ordnance Survey data).

I have created an image pyramid, created a store and added a layer.

When I view it, via GeoServer preview, it all looks fine until I stat to zoom in. At a certain zoom level (The scale reads 1:87k) some of the tiles get drawn as white.
So tiles are there at 1:174k, not there at 1:87k and back again at 1:44k

When I look in the logs (catalina.out) I see the many lines with a line saying;

…

Caused by: java.lang.IllegalArgumentException: All source images must have the same number of bands.
…

The source images all seem to have the same number of bands (1) and I do the following to create the pyramid

#!/bin/bash

echo -n Working on
pwd
mkdir out
for file in ls *tif
do
echo -n Working on $file
gdal_translate -of GTiff -co “TILED=YES” -co “COMPRESS=DEFLATE” -co “BLOCKXSIZE=512” -co “BLOCKYSIZE=512” -a_srs “EPSG:27700” $file out/$file
done
mv out/* .
rm -fr out
for file in ls *tif
do
echo -n Working on $file
gdaladdo -clean $file
gdaladdo -r average $file 1 2 4 8 16 32 64 128
done

Followed by

#!/bin/bash
export thedir=pwd
export thedir=basename $thedir
echo $thedir
mkdir pyramid
ls *tif > …/tiles$thedir.txt
gdal_retile.py -v -levels 9 -ps 2048 2048 -co ‘TILED=YES’ -co ‘BLOCKXSIZE=512’ -co ‘BLOCKYSIZE=512’ -s_srs EPSG:27700 -targetDir pyramid --optfile …/tiles$thedir.txt

I can post more of the log if required.
I am hazarding a guess it is something to do with the version of Java. Do I need to go back to 1.6.*

GeoServer 2.3.5
Tomcat 7.0.35
OpenSuse x64

JVM Version Oracle Corporation: 1.7.0_40 (OpenJDK 64-Bit Server VM)

Native JAI true
Native JAI ImageIO true

---

Learn the latest–Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk

---

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users