[Geoserver-users] Loading a folder of tfw and tif files

GeoServer GeoServer User
1

I’m trying to load a set of 15m ad 5m imagery. I successfully load a single tfw and tif file, but I have a folder structure of over 500 sets of the two files. I’ve looked through the documentation a couple of times and even tried searching the geosolutions training docs. I just can’t find how to add a collection of files as apposed to a single file. Do I need to build a DB of the files and then add the DB reference? If I’ve missed the documentation that describes how to do this then please let me know.

TIA, Scott

2

Are you trying to make a single layer that has all of those images put together? If so, you probably want to start at http://docs.geoserver.org/latest/en/user/data/raster/imagemosaic/index.html

If you want to create a lot of layers (one per file) then you probably want to use some kind of automation, like the REST API:

http://docs.geoserver.org/stable/en/user/rest/api/index.html

HTH

Brad

From: Haynes, Scott R scott.r.haynes@anonymised.com
Sent: Tuesday, 10 July 2018 9:55 PM
To: Geoserver-users@lists.sourceforge.net
Subject: [Geoserver-users] Loading a folder of tfw and tif files

I’m trying to load a set of 15m ad 5m imagery. I successfully load a single tfw and tif file, but I have a folder structure of over 500 sets of the two files. I’ve looked through the documentation a couple of times and even tried searching the geosolutions training docs. I just can’t find how to add a collection of files as apposed to a single file. Do I need to build a DB of the files and then add the DB reference? If I’ve missed the documentation that describes how to do this then please let me know.

TIA, Scott

3

I need to server out the data to Cesium, so the single layer option would be in the intended use. I’ve seen several mentions of using the follow imagery provider in Cesium along with geoserver. I just can’t find any reference on how to add the data to geoserver. ImageMosaic does seem like the best option.

https://cesiumjs.org/Cesium/Build/Documentation/WebMapServiceImageryProvider.html?classFilter=web

After trying to load the data into the ImageMosaic, I get the following error(in the process a dbf, fix, prj, properties, shp, shx files are created. There’s also a sample_image.dat file):

org.apache.wicket.WicketRuntimeException: Method onRequest of interface org.apache.wicket.behavior.IBehaviorListener targeted at org.apache.wicket.ajax.markup.html.AjaxLink$1@anonymised.com.8958… on component [AjaxLink [Component id = link]] threw an exception

at org.apache.wicket.RequestListenerInterface.internalInvoke(RequestListenerInterface.java:268)

at org.apache.wicket.RequestListenerInterface.invoke(RequestListenerInterface.java:241)

at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.invokeListener(ListenerInterfaceRequestHandler.java:248)

at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.respond(ListenerInterfaceRequestHandler.java:234)

at org.apache.wicket.request.cycle.RequestCycle$HandlerExecutor.respond(RequestCycle.java:895)

at org.apache.wicket.request.RequestHandlerStack.execute(RequestHandlerStack.java:64)

at org.apache.wicket.request.cycle.RequestCycle.execute(RequestCycle.java:265)

at org.apache.wicket.request.cycle.RequestCycle.processRequest(RequestCycle.java:222)

at org.apache.wicket.request.cycle.RequestCycle.processRequestAndDetach(RequestCycle.java:293)

at org.apache.wicket.protocol.http.WicketFilter.processRequestCycle(WicketFilter.java:261)

at org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:203)

at org.apache.wicket.protocol.http.WicketServlet.doGet(WicketServlet.java:137)

I’ve tried just adding a subset of the imagery(just the 5m data, and even a single folder of the 5m and get the same results)

I’m checking through the imageMosaic documentation now, but if anyone has any ideas. The properties and prj file seem to have some definitions that aren’t correct, but I’m really not sure what the values should be.

Scott

hawaii.prj (160 Bytes)

hawaii.properties (396 Bytes)

···

From: bradh@anonymised.com bradh@anonymised.com
Sent: Tuesday, July 10, 2018 8:00 AM
To: Haynes, Scott R (US) scott.r.haynes@anonymised.com; Geoserver-users@lists.sourceforge.net
Subject: EXTERNAL: RE: [Geoserver-users] Loading a folder of tfw and tif files

Are you trying to make a single layer that has all of those images put together? If so, you probably want to start at http://docs.geoserver.org/latest/en/user/data/raster/imagemosaic/index.html

If you want to create a lot of layers (one per file) then you probably want to use some kind of automation, like the REST API:

http://docs.geoserver.org/stable/en/user/rest/api/index.html

HTH

Brad

From: Haynes, Scott R <scott.r.haynes@anonymised.com>
Sent: Tuesday, 10 July 2018 9:55 PM
To: Geoserver-users@lists.sourceforge.net
Subject: [Geoserver-users] Loading a folder of tfw and tif files

I’m trying to load a set of 15m ad 5m imagery. I successfully load a single tfw and tif file, but I have a folder structure of over 500 sets of the two files. I’ve looked through the documentation a couple of times and even tried searching the geosolutions training docs. I just can’t find how to add a collection of files as apposed to a single file. Do I need to build a DB of the files and then add the DB reference? If I’ve missed the documentation that describes how to do this then please let me know.

TIA, Scott

4

If your images do not have a correct projection associated with them then image mosaic will fail. I added a fix over the weekend so if you try again with a nightly build it may work now.

Ian

On Tue, 10 Jul 2018, 15:14 Haynes, Scott R, <scott.r.haynes@anonymised.com> wrote:

I need to server out the data to Cesium, so the single layer option would be in the intended use. I’ve seen several mentions of using the follow imagery provider in Cesium along with geoserver. I just can’t find any reference on how to add the data to geoserver. ImageMosaic does seem like the best option.

https://cesiumjs.org/Cesium/Build/Documentation/WebMapServiceImageryProvider.html?classFilter=web

After trying to load the data into the ImageMosaic, I get the following error(in the process a dbf, fix, prj, properties, shp, shx files are created. There’s also a sample_image.dat file):

org.apache.wicket.WicketRuntimeException: Method onRequest of interface org.apache.wicket.behavior.IBehaviorListener targeted at org.apache.wicket.ajax.markup.html.AjaxLink$1@anonymised.com.8958… on component [AjaxLink [Component id = link]] threw an exception

at org.apache.wicket.RequestListenerInterface.internalInvoke(RequestListenerInterface.java:268)

at org.apache.wicket.RequestListenerInterface.invoke(RequestListenerInterface.java:241)

at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.invokeListener(ListenerInterfaceRequestHandler.java:248)

at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.respond(ListenerInterfaceRequestHandler.java:234)

at org.apache.wicket.request.cycle.RequestCycle$HandlerExecutor.respond(RequestCycle.java:895)

at org.apache.wicket.request.RequestHandlerStack.execute(RequestHandlerStack.java:64)

at org.apache.wicket.request.cycle.RequestCycle.execute(RequestCycle.java:265)

at org.apache.wicket.request.cycle.RequestCycle.processRequest(RequestCycle.java:222)

at org.apache.wicket.request.cycle.RequestCycle.processRequestAndDetach(RequestCycle.java:293)

at org.apache.wicket.protocol.http.WicketFilter.processRequestCycle(WicketFilter.java:261)

at org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:203)

at org.apache.wicket.protocol.http.WicketServlet.doGet(WicketServlet.java:137)

I’ve tried just adding a subset of the imagery(just the 5m data, and even a single folder of the 5m and get the same results)

I’m checking through the imageMosaic documentation now, but if anyone has any ideas. The properties and prj file seem to have some definitions that aren’t correct, but I’m really not sure what the values should be.

Scott

From: bradh@anonymised.com <bradh@anonymised.com>
Sent: Tuesday, July 10, 2018 8:00 AM
To: Haynes, Scott R (US) <scott.r.haynes@anonymised.com>; Geoserver-users@lists.sourceforge.net
Subject: EXTERNAL: RE: [Geoserver-users] Loading a folder of tfw and tif files

Are you trying to make a single layer that has all of those images put together? If so, you probably want to start at http://docs.geoserver.org/latest/en/user/data/raster/imagemosaic/index.html

If you want to create a lot of layers (one per file) then you probably want to use some kind of automation, like the REST API:

http://docs.geoserver.org/stable/en/user/rest/api/index.html

HTH

Brad

From: Haynes, Scott R <scott.r.haynes@anonymised.com>
Sent: Tuesday, 10 July 2018 9:55 PM
To: Geoserver-users@lists.sourceforge.net
Subject: [Geoserver-users] Loading a folder of tfw and tif files

I’m trying to load a set of 15m ad 5m imagery. I successfully load a single tfw and tif file, but I have a folder structure of over 500 sets of the two files. I’ve looked through the documentation a couple of times and even tried searching the geosolutions training docs. I just can’t find how to add a collection of files as apposed to a single file. Do I need to build a DB of the files and then add the DB reference? If I’ve missed the documentation that describes how to do this then please let me know.

TIA, Scott

Check out the vibrant tech community on one of the world’s most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot_______________________________________________
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this list:

If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer

Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

5

These data files have been used in several other applications(data servers) without any issues. I’m guessing that our severely locked down machines for security has something to do with this error. What builds the dbf, fix, prj, properties, shp, and shx files? If PostgreSQL and/or PostGIS get involved with the creation of the files, then that might be the problem. I was just try to check my PostgreSQL installation, and that seems ok. The PostGIS integration doesn’t appear correct though. I’m unable to follow these instructions:

https://www.gpsfiledepot.com/tutorials/installing-and-setting-up-postgresql-with-postgis/

Scott

···

If your images do not have a correct projection associated with them then image mosaic will fail. I added a fix over the weekend so if you try again with a nightly build it may work now.

Ian

On Tue, 10 Jul 2018, 15:14 Haynes, Scott R, <scott.r.haynes@…1456…> wrote:

I need to server out the data to Cesium, so the single layer option would be in the intended use. I’ve seen several mentions of using the follow imagery provider in Cesium along with geoserver. I just can’t find any reference on how to add the data to geoserver. ImageMosaic does seem like the best option.

https://cesiumjs.org/Cesium/Build/Documentation/WebMapServiceImageryProvider.html?classFilter=web

After trying to load the data into the ImageMosaic, I get the following error(in the process a dbf, fix, prj, properties, shp, shx files are created. There’s also a sample_image.dat file):

org.apache.wicket.WicketRuntimeException: Method onRequest of interface org.apache.wicket.behavior.IBehaviorListener targeted at org.apache.wicket.ajax.markup.html.AjaxLink$1@…8958… on component [AjaxLink [Component id = link]] threw an exception

at org.apache.wicket.RequestListenerInterface.internalInvoke(RequestListenerInterface.java:268)

at org.apache.wicket.RequestListenerInterface.invoke(RequestListenerInterface.java:241)

at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.invokeListener(ListenerInterfaceRequestHandler.java:248)

at org.apache.wicket.core.request.handler.ListenerInterfaceRequestHandler.respond(ListenerInterfaceRequestHandler.java:234)

at org.apache.wicket.request.cycle.RequestCycle$HandlerExecutor.respond(RequestCycle.java:895)

at org.apache.wicket.request.RequestHandlerStack.execute(RequestHandlerStack.java:64)

at org.apache.wicket.request.cycle.RequestCycle.execute(RequestCycle.java:265)

at org.apache.wicket.request.cycle.RequestCycle.processRequest(RequestCycle.java:222)

at org.apache.wicket.request.cycle.RequestCycle.processRequestAndDetach(RequestCycle.java:293)

at org.apache.wicket.protocol.http.WicketFilter.processRequestCycle(WicketFilter.java:261)

at org.apache.wicket.protocol.http.WicketFilter.processRequest(WicketFilter.java:203)

at org.apache.wicket.protocol.http.WicketServlet.doGet(WicketServlet.java:137)

I’ve tried just adding a subset of the imagery(just the 5m data, and even a single folder of the 5m and get the same results)

I’m checking through the imageMosaic documentation now, but if anyone has any ideas. The properties and prj file seem to have some definitions that aren’t correct, but I’m really not sure what the values should be.

Scott

From: bradh@…7296… <bradh@…7296…>
Sent: Tuesday, July 10, 2018 8:00 AM
To: Haynes, Scott R (US) <scott.r.haynes@…1456…>; Geoserver-users@lists.sourceforge.net
Subject: EXTERNAL: RE: [Geoserver-users] Loading a folder of tfw and tif files

Are you trying to make a single layer that has all of those images put together? If so, you probably want to start at http://docs.geoserver.org/latest/en/user/data/raster/imagemosaic/index.html

If you want to create a lot of layers (one per file) then you probably want to use some kind of automation, like the REST API:

http://docs.geoserver.org/stable/en/user/rest/api/index.html

HTH

Brad

From: Haynes, Scott R <scott.r.haynes@…1456…>
Sent: Tuesday, 10 July 2018 9:55 PM
To: Geoserver-users@lists.sourceforge.net
Subject: [Geoserver-users] Loading a folder of tfw and tif files

I’m trying to load a set of 15m ad 5m imagery. I successfully load a single tfw and tif file, but I have a folder structure of over 500 sets of the two files. I’ve looked through the documentation a couple of times and even tried searching the geosolutions training docs. I just can’t find how to add a collection of files as apposed to a single file. Do I need to build a DB of the files and then add the DB reference? If I’ve missed the documentation that describes how to do this then please let me know.

TIA, Scott

Check out the vibrant tech community on one of the world’s most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot_______________________________________________
Geoserver-users mailing list

Please make sure you read the following two resources before posting to this list:

If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer

Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

6

I would have suggested reading the documentation first.

From: Haynes, Scott R scott.r.haynes@anonymised.com
Sent: Wednesday, 11 July 2018 12:12 AM
To: Geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] EXTERNAL: RE: Loading a folder of tfw and tif files

I need to server out the data to Cesium, so the single layer option would be in the intended use. I’ve seen several mentions of using the follow imagery provider in Cesium along with geoserver. I just can’t find any reference on how to add the data to geoserver. ImageMosaic does seem like the best option.

….

I’m checking through the imageMosaic documentation now, but if anyone has any ideas.

7

Ciao Scott,
two things:

-1- you need to send a larger portion of the log as this is showing the topmost report which is usually not the most interesting

  • the imagemosaic scans a directory and create a single layer that should mosaic whatever is found in this directory (this is a simplification, but you get the point). By default the mosaic builds an index by creating a shapefile in the directory where it has been pointed to hence we need write permission to do that
···

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts!
Visit http://goo.gl/it488V for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.

This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.