[Geoserver-users] Image Pyramid problems

I’m running GeoServer 2.3.4 under JBoss (not my choice) and I’m seeing an issue creatign an image pyramid - the log file says:

09:31:49,822 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/
existstrue
isFilefalse
canRead:true
canWritetrue
canExecutetrue
isHidden:false
lastModified1375775551000

09:31:49,827 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/250k/
existsfalse
isFilefalse
canRead:false
canWritefalse
canExecutefalse
isHidden:false
lastModified0

09:31:49,832 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/0
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/4
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/1
09:31:49,834 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/3
09:31:49,841 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/2
09:31:49,842 INFO [org.geoserver.web] (http–172.30.2.1-8080-1) Getting list of coverages for saved store /apps/data/250k: java.lang.RuntimeException: Could not list layers for this store, an error occurred retrieving them: This plugin accepts only File, URL and String pointing to a file
at org.geoserver.web.data.layer.NewLayerPageProvider.getItemsInternal(NewLayerPageProvider.java:123) [web-core-2.3.4.jar:2.3.4]

while ls on the filesystem says:

[root@anonymised.com 250k]# ls -ld /apps/data/
drwxr-xr-x 3 root root 4096 Aug 6 08:44 /apps/data/
[root@anonymised.com… 250k]# ls -ld /apps/data/250k/
drwxr-xr-x 7 jboss jboss 20480 Aug 6 08:52 /apps/data/250k/
[root@anonymised.com 250k]# ls -ld /apps/data/250k/0
drwxr-xr-x 2 jboss jboss 20480 Aug 6 09:21 /apps/data/250k/0
[root@anonymised.com 250k]#

So the logging seems backwards as the server should be running as jboss (and if not is running as root).

Any one got any ideas?

Cheers

Ian


Ian Turton

On Tue, Aug 6, 2013 at 10:40 AM, Ian Turton <ijturton@anonymised.com> wrote:

I'm running GeoServer 2.3.4 under JBoss (not my choice) and I'm seeing an
issue creatign an image pyramid - the log file says:

09:31:49,822 INFO [org.geotools.gce.imagepyramid]
(http--172.30.2.1-8080-1) Checking file:/app
s/data/
existstrue
isFilefalse
canRead:true
canWritetrue
canExecutetrue
isHidden:false
lastModified1375775551000

09:31:49,827 INFO [org.geotools.gce.imagepyramid]
(http--172.30.2.1-8080-1) Checking file:/app
s/data/250k/
existsfalse
isFilefalse
canRead:false
canWritefalse
canExecutefalse
isHidden:false
lastModified0

09:31:49,832 INFO [org.geotools.gce.imagepyramid]
(http--172.30.2.1-8080-1) Unable to build mosaic for the
directory:/apps/data/250k/0
09:31:49,833 INFO [org.geotools.gce.imagepyramid]
(http--172.30.2.1-8080-1) Unable to build mosaic for the
directory:/apps/data/250k/4
09:31:49,833 INFO [org.geotools.gce.imagepyramid]
(http--172.30.2.1-8080-1) Unable to build mosaic for the
directory:/apps/data/250k/1
09:31:49,834 INFO [org.geotools.gce.imagepyramid]
(http--172.30.2.1-8080-1) Unable to build mosaic for the
directory:/apps/data/250k/3
09:31:49,841 INFO [org.geotools.gce.imagepyramid]
(http--172.30.2.1-8080-1) Unable to build mosaic for the
directory:/apps/data/250k/2
09:31:49,842 INFO [org.geoserver.web] (http--172.30.2.1-8080-1) Getting
list of coverages for saved store /apps/data/250k:
java.lang.RuntimeException: Could not list layers for this store, an error
occurred retrieving them: This plugin accepts only File, URL and String
pointing to a file
        at
org.geoserver.web.data.layer.NewLayerPageProvider.getItemsInternal(NewLayerPageProvider.java:123)
[web-core-2.3.4.jar:2.3.4]

Which root directory did you give to the pyramid store? It's normal that
it's checking the root directory for files, as gdal_retile puts tiles there
too,
but I'd be surprised if it's checking the parent of the folder you gave it.

That said, the true errors are reported for the directories that should
contain the data, it seems it's not able to generate a mosaic there, not
sure
why. You can try to put the logging level to "geotools developer logging"
and see if anything more interesting pops up

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more
information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

I’ve moved it within the geoserver data dir now (incase there was some sort of wierd chroot issue) so I set the root dir as file:coverages/250k. Nothing in the log leaps out at me but I’ve attached it.

Ian

server.log (16.2 KB)

···

On 6 August 2013 10:07, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Tue, Aug 6, 2013 at 10:40 AM, Ian Turton <ijturton@anonymised.com> wrote:


Ian Turton

I’m running GeoServer 2.3.4 under JBoss (not my choice) and I’m seeing an issue creatign an image pyramid - the log file says:

09:31:49,822 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/
existstrue
isFilefalse
canRead:true
canWritetrue
canExecutetrue
isHidden:false
lastModified1375775551000

09:31:49,827 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/250k/
existsfalse
isFilefalse
canRead:false
canWritefalse
canExecutefalse
isHidden:false
lastModified0

09:31:49,832 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/0
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/4
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/1
09:31:49,834 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/3
09:31:49,841 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/2
09:31:49,842 INFO [org.geoserver.web] (http–172.30.2.1-8080-1) Getting list of coverages for saved store /apps/data/250k: java.lang.RuntimeException: Could not list layers for this store, an error occurred retrieving them: This plugin accepts only File, URL and String pointing to a file
at org.geoserver.web.data.layer.NewLayerPageProvider.getItemsInternal(NewLayerPageProvider.java:123) [web-core-2.3.4.jar:2.3.4]

Which root directory did you give to the pyramid store? It’s normal that it’s checking the root directory for files, as gdal_retile puts tiles there too,
but I’d be surprised if it’s checking the parent of the folder you gave it.

That said, the true errors are reported for the directories that should contain the data, it seems it’s not able to generate a mosaic there, not sure
why. You can try to put the logging level to “geotools developer logging” and see if anything more interesting pops up

Cheers
Andrea

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


I have had the similar error message, (Using Tomcat under Linux), when the permissions on the directories are not ‘open’ enough.

Russ

···

I’m running GeoServer 2.3.4 under JBoss (not my choice) and I’m seeing an issue creatign an image pyramid - the log file says:

09:31:49,822 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/
existstrue
isFilefalse
canRead:true
canWritetrue
canExecutetrue
isHidden:false
lastModified1375775551000

09:31:49,827 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/250k/
existsfalse
isFilefalse
canRead:false
canWritefalse
canExecutefalse
isHidden:false
lastModified0

09:31:49,832 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/0
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/4
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/1
09:31:49,834 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/3
09:31:49,841 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/2
09:31:49,842 INFO [org.geoserver.web] (http–172.30.2.1-8080-1) Getting list of coverages for saved store /apps/data/250k: java.lang.RuntimeException: Could not list layers for this store, an error occurred retrieving them: This plugin accepts only File, URL and String pointing to a file
at org.geoserver.web.data.layer.NewLayerPageProvider.getItemsInternal(NewLayerPageProvider.java:123) [web-core-2.3.4.jar:2.3.4]

Which root directory did you give to the pyramid store? It’s normal that it’s checking the root directory for files, as gdal_retile puts tiles there too,
but I’d be surprised if it’s checking the parent of the folder you gave it.

That said, the true errors are reported for the directories that should contain the data, it seems it’s not able to generate a mosaic there, not sure
why. You can try to put the logging level to “geotools developer logging” and see if anything more interesting pops up

Cheers
Andrea

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


But jboss seems to have rwx permissions on the whole tree (i.e. I did chown -R jboss:jboss data/)

Ian

···

On 6 August 2013 10:17, Russell Hore <russ@anonymised.com> wrote:

I have had the similar error message, (Using Tomcat under Linux), when the permissions on the directories are not ‘open’ enough.

Russ

On 6 Aug 2013, at 10:07, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Tue, Aug 6, 2013 at 10:40 AM, Ian Turton <ijturton@anonymised.com> wrote:


Get your SQL database under version control now!
Version control is standard for application code, but databases havent
caught up. So what steps can you take to put your SQL databases under
version control? Why should you start doing it? Read more to find out.
http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


Ian Turton

I’m running GeoServer 2.3.4 under JBoss (not my choice) and I’m seeing an issue creatign an image pyramid - the log file says:

09:31:49,822 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/
existstrue
isFilefalse
canRead:true
canWritetrue
canExecutetrue
isHidden:false
lastModified1375775551000

09:31:49,827 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/250k/
existsfalse
isFilefalse
canRead:false
canWritefalse
canExecutefalse
isHidden:false
lastModified0

09:31:49,832 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/0
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/4
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/1
09:31:49,834 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/3
09:31:49,841 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/2
09:31:49,842 INFO [org.geoserver.web] (http–172.30.2.1-8080-1) Getting list of coverages for saved store /apps/data/250k: java.lang.RuntimeException: Could not list layers for this store, an error occurred retrieving them: This plugin accepts only File, URL and String pointing to a file
at org.geoserver.web.data.layer.NewLayerPageProvider.getItemsInternal(NewLayerPageProvider.java:123) [web-core-2.3.4.jar:2.3.4]

Which root directory did you give to the pyramid store? It’s normal that it’s checking the root directory for files, as gdal_retile puts tiles there too,
but I’d be surprised if it’s checking the parent of the folder you gave it.

That said, the true errors are reported for the directories that should contain the data, it seems it’s not able to generate a mosaic there, not sure
why. You can try to put the logging level to “geotools developer logging” and see if anything more interesting pops up

Cheers
Andrea

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


Just to add some more information - this seems to be a JBoss specific issue as I can run up 2.3.4 in jetty and all works fine. I can then switch back to JBoss and use the same data directory with no issues either so I suspect is it is a permissions issue. I’m going to punt this to the JBOss experts here and let them bang their heads on it for a while - if we do find an answer I’ll make sure to document it here and on the wiki.

Ian

···

On 6 August 2013 10:19, Ian Turton <ijturton@anonymised.com> wrote:

But jboss seems to have rwx permissions on the whole tree (i.e. I did chown -R jboss:jboss data/)

Ian


Ian Turton

On 6 August 2013 10:17, Russell Hore <russ@…4690…> wrote:

I have had the similar error message, (Using Tomcat under Linux), when the permissions on the directories are not ‘open’ enough.

Russ

On 6 Aug 2013, at 10:07, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Tue, Aug 6, 2013 at 10:40 AM, Ian Turton <ijturton@anonymised.com> wrote:


Get your SQL database under version control now!
Version control is standard for application code, but databases havent
caught up. So what steps can you take to put your SQL databases under
version control? Why should you start doing it? Read more to find out.
http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


Ian Turton

I’m running GeoServer 2.3.4 under JBoss (not my choice) and I’m seeing an issue creatign an image pyramid - the log file says:

09:31:49,822 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/
existstrue
isFilefalse
canRead:true
canWritetrue
canExecutetrue
isHidden:false
lastModified1375775551000

09:31:49,827 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Checking file:/app
s/data/250k/
existsfalse
isFilefalse
canRead:false
canWritefalse
canExecutefalse
isHidden:false
lastModified0

09:31:49,832 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/0
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/4
09:31:49,833 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/1
09:31:49,834 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/3
09:31:49,841 INFO [org.geotools.gce.imagepyramid] (http–172.30.2.1-8080-1) Unable to build mosaic for the directory:/apps/data/250k/2
09:31:49,842 INFO [org.geoserver.web] (http–172.30.2.1-8080-1) Getting list of coverages for saved store /apps/data/250k: java.lang.RuntimeException: Could not list layers for this store, an error occurred retrieving them: This plugin accepts only File, URL and String pointing to a file
at org.geoserver.web.data.layer.NewLayerPageProvider.getItemsInternal(NewLayerPageProvider.java:123) [web-core-2.3.4.jar:2.3.4]

Which root directory did you give to the pyramid store? It’s normal that it’s checking the root directory for files, as gdal_retile puts tiles there too,
but I’d be surprised if it’s checking the parent of the folder you gave it.

That said, the true errors are reported for the directories that should contain the data, it seems it’s not able to generate a mosaic there, not sure
why. You can try to put the logging level to “geotools developer logging” and see if anything more interesting pops up

Cheers
Andrea

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Thu, Aug 8, 2013 at 4:19 PM, Ian Turton <ijturton@anonymised.com> wrote:

Just to add some more information - this seems to be a JBoss specific
issue as I can run up 2.3.4 in jetty and all works fine. I can then switch
back to JBoss and use the same data directory with no issues either so I
suspect is it is a permissions issue. I'm going to punt this to the JBOss
experts here and let them bang their heads on it for a while - if we do
find an answer I'll make sure to document it here and on the wiki.

Sounds like a good plan, thanks for following up on this

Cheers
Andrea

--

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more
information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------