[Geoserver-users] .mbtiles layer preview generates error

GeoServer GeoServer User
1

Greetings - I’m running GeoServer 2.7, and have to date successfully downloaded an .mbtiles version of a raster file via Layer Preview only once—which suggests that all .mbtiles extensions are correctly installed, but something else is going on. In all other cases I get a 502 error (after one minute), which I assume is some form of timeout in this case.

When I look at the log file, it appears that GeoServer is generating a series of 256x256 tiles, and the process simply takes too long to complete prior to timeout (one log download included 324 instances, taking place over two minutes). Is the problem simply that it is taking GeoServer too long to generate the .mbtiles file, and if so, what do you recommend? (I did e.g. purge GeoServer memory first via Server Status panel.)

Btw, if you’re interested why we are doing this, we’re looking for a workaround for TileMill (no longer supported) to export layers in .mbtiles format for upload to Fulcrum survey app as offline base layers.

Regards,

Jim P.

2

It is an interesting problem, kind of a limitation of these OGC HTTP protocols I guess.

I wonder if we could generate the export via a WPS process (which provides the idea of a long running process and “later” retrieval).

···

On 4 September 2015 at 14:46, Jim Proctor <jproctor@anonymised.com> wrote:

Greetings - I’m running GeoServer 2.7, and have to date successfully downloaded an .mbtiles version of a raster file via Layer Preview only once—which suggests that all .mbtiles extensions are correctly installed, but something else is going on. In all other cases I get a 502 error (after one minute), which I assume is some form of timeout in this case.

When I look at the log file, it appears that GeoServer is generating a series of 256x256 tiles, and the process simply takes too long to complete prior to timeout (one log download included 324 instances, taking place over two minutes). Is the problem simply that it is taking GeoServer too long to generate the .mbtiles file, and if so, what do you recommend? (I did e.g. purge GeoServer memory first via Server Status panel.)

Btw, if you’re interested why we are doing this, we’re looking for a workaround for TileMill (no longer supported) to export layers in .mbtiles format for upload to Fulcrum survey app as offline base layers.

Regards,

Jim P.

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–
Jody Garnett

3

On Sat, Sep 5, 2015 at 1:24 AM, Jody Garnett <jody.garnett@anonymised.com> wrote:

It is an interesting problem, kind of a limitation of these OGC HTTP
protocols I guess.

I wonder if we could generate the export via a WPS process (which provides
the idea of a long running process and "later" retrieval).

The module actually already contains a WPS process, see here:
https://github.com/geoserver/geoserver/blob/master/src/community/mbtiles/src/main/java/applicationContext.xml

Some docs here:
http://docs.geoserver.org/stable/en/user/community/mbtiles/output.html

Not sure how good is it, after all, like all community modules, they are
not officially supported, but in order
to download a large mbtile, I'd definitely use the WPS process with an
asynch WPS call

Cheers
Andrea

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

-------------------------------------------------------

4

Thanks for the research Andrea.

Jim can you try the WPS process and report back? This is the kind of example that is handy for our user manual.

···

On 5 September 2015 at 12:34, Andrea Aime <andrea.aime@anonymised.com> wrote:

–
Jody Garnett

On Sat, Sep 5, 2015 at 1:24 AM, Jody Garnett <jody.garnett@anonymised.com> wrote:

It is an interesting problem, kind of a limitation of these OGC HTTP protocols I guess.

I wonder if we could generate the export via a WPS process (which provides the idea of a long running process and “later” retrieval).

The module actually already contains a WPS process, see here:
https://github.com/geoserver/geoserver/blob/master/src/community/mbtiles/src/main/java/applicationContext.xml

Some docs here:
http://docs.geoserver.org/stable/en/user/community/mbtiles/output.html

Not sure how good is it, after all, like all community modules, they are not officially supported, but in order
to download a large mbtile, I’d definitely use the WPS process with an asynch WPS call

Cheers
Andrea

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

5

Thank you! So, I went to Demos > WPS Request Builder, and selected the process gs:MBTiles. Required inputs from documentation below are layername and format; it is possible I entered them incorrectly, but upon execution I received the following:

gs:MBTilesMBTilesMBTiles ProcessProcess failed during execution java.lang.NoSuchMethodError: org.geoserver.wps.resource.WPSResourceManager.getOutputResource(Ljava/lang/String;Ljava/lang/String;)Lorg/geoserver/platform/resource/Resource; org.geoserver.wps.resource.WPSResourceManager.getOutputResource(Ljava/lang/String;Ljava/lang/String;)Lorg/geoserver/platform/resource/Resource;

To confirm: (a) should layername include store:layer as in typical WMS call?; and (b) should format equal mbtiles, or application/x-sqlite3,as in mbtiles Layer Preview call? (The process generates the same error above no matter how I complete these fields.)

Regards,

Jim P.

···

On 5 September 2015 at 12:34, Andrea Aime <andrea.aime@anonymised.com> wrote:

–
Jody Garnett

On Sat, Sep 5, 2015 at 1:24 AM, Jody Garnett <jody.garnett@anonymised.com> wrote:

It is an interesting problem, kind of a limitation of these OGC HTTP protocols I guess.

I wonder if we could generate the export via a WPS process (which provides the idea of a long running process and “later” retrieval).

The module actually already contains a WPS process, see here:
https://github.com/geoserver/geoserver/blob/master/src/community/mbtiles/src/main/java/applicationContext.xml

Some docs here:
http://docs.geoserver.org/stable/en/user/community/mbtiles/output.html

Not sure how good is it, after all, like all community modules, they are not officially supported, but in order
to download a large mbtile, I’d definitely use the WPS process with an asynch WPS call

Cheers
Andrea

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

6

On Sun, Sep 6, 2015 at 1:28 AM, Jim Proctor <jproctor@anonymised.com> wrote:

Thank you! So, I went to Demos > WPS Request Builder, and selected the
process gs:MBTiles. Required inputs from documentation below
<http://docs.geoserver.org/stable/en/user/community/mbtiles/output.html&gt; are
layername and format; it is possible I entered them incorrectly, but upon
execution I received the following:

gs:MBTilesMBTilesMBTiles ProcessProcess failed during execution
java.lang.NoSuchMethodError:
org.geoserver.wps.resource.WPSResourceManager.getOutputResource(Ljava/lang/String;Ljava/lang/String;)Lorg/geoserver/platform/resource/Resource;
org.geoserver.wps.resource.WPSResourceManager.getOutputResource(Ljava/lang/String;Ljava/lang/String;)Lorg/geoserver/platform/resource/Resource;

To confirm: (a) should layername include store:layer as in typical WMS
call?; and (b) should format equal mbtiles, or application/x-sqlite3,as in
mbtiles Layer Preview call? (The process generates the same error above no
matter how I complete these fields.)

With that error like that, you likely mixed in the plugin for a different
GeoServer version, e.g.,
a 2.7.x plugin with a 2.5.x release, or something like that.

Cheers
Andrea

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

-------------------------------------------------------

7

This is an OpenGeoSuite build, so there may be issues with that, but under WEB-INF > lib I see the file gs-mbtiles-2.7-SNAPSHOT.jar, which matches my version of GeoServer. Are there other plugin files I should verify? Would appreciate clarification on other questions below as well.

Regards,

Jim P.

···

On Sun, Sep 6, 2015 at 1:28 AM, Jim Proctor <jproctor@anonymised.com> wrote:

Thank you! So, I went to Demos > WPS Request Builder, and selected the process gs:MBTiles. Required inputs from documentation below are layername and format; it is possible I entered them incorrectly, but upon execution I received the following:

gs:MBTilesMBTilesMBTiles ProcessProcess failed during execution java.lang.NoSuchMethodError: org.geoserver.wps.resource.WPSResourceManager.getOutputResource(Ljava/lang/String;Ljava/lang/String;)Lorg/geoserver/platform/resource/Resource; org.geoserver.wps.resource.WPSResourceManager.getOutputResource(Ljava/lang/String;Ljava/lang/String;)Lorg/geoserver/platform/resource/Resource;

To confirm: (a) should layername include store:layer as in typical WMS call?; and (b) should format equal mbtiles, or application/x-sqlite3,as in mbtiles Layer Preview call? (The process generates the same error above no matter how I complete these fields.)

With that error like that, you likely mixed in the plugin for a different GeoServer version, e.g.,
a 2.7.x plugin with a 2.5.x release, or something like that.

Cheers
Andrea

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

8

On Sun, Sep 6, 2015 at 6:47 PM, Jim Proctor <jproctor@anonymised.com> wrote:

This is an OpenGeoSuite build, so there may be issues with that, but under
WEB-INF > lib I see the file gs-mbtiles-2.7-SNAPSHOT.jar, which matches my
version of GeoServer. Are there other plugin files I should verify? Would
appreciate clarification on other questions below as well.

The OpenGeoSuite afaik uses its own fork of GeoServer, tagged
independently, not sure if and how modified, but
there is little chance it will line up with any official GeoServer build.

Long story short, you'll have to contact your vendor directly

Cheers
Andrea

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

-------------------------------------------------------