[Geoserver-users] Publishing pyramid to geoserver

tog · November 19, 2013, 5:00pm

Dear all

I want to publish programmatically a pyramid to geoserver. Once zipped the file is about 11GB.

For that I am using httpclient in groovy using the following code:

method = new PutMethod(“http://myhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid?coverageName=129images”)

requestEntity = new FileRequestEntity(new File(localUri), “application/zip”)

method.setRequestEntity(requestEntity)

status = client.executeMethod(method)

this hangs. No message!

When I try using curl locally, I got this message:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip” --data-binary @/mnt/tmp/pyramids.zip http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

I was suspecting that curl was trying to load the 11GB file (which is a bad idea) therefore I tried this:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip” --header “Transfer-Encoding: chunked” --data-binary @/mnt/tmp/pyramids.zip http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

but get the same error.

Is there something I should do differently ?

Best Regards

Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

Lorenzo_Natali · November 19, 2013, 10:33pm

Hi,
Curl goes out of memory because it tries to load all the file in memory.

I didn’ t tested it, but you can try to use the -T option ( this allows to do this transfer in streaming.

Check the man page of curl for details .

Lorenzo

Il 19/nov/2013 18:07 “tog” <guillaume.alleon@anonymised.com> ha scritto:

Dear all

I want to publish programmatically a pyramid to geoserver. Once zipped the file is about 11GB.

For that I am using httpclient in groovy using the following code:

method = new PutMethod(“http://myhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid?coverageName=129images”)

requestEntity = new FileRequestEntity(new File(localUri), “application/zip”)

method.setRequestEntity(requestEntity)

status = client.executeMethod(method)

this hangs. No message!

When I try using curl locally, I got this message:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip” --data-binary @/mnt/tmp/pyramids.zip http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

I was suspecting that curl was trying to load the 11GB file (which is a bad idea) therefore I tried this:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip” --header “Transfer-Encoding: chunked” --data-binary @/mnt/tmp/pyramids.zip http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

but get the same error.

Is there something I should do differently ?

Best Regards

Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Simone_Giannecchini3 · November 20, 2013, 12:25am

Ciao Guillame.
is it a requirement to upload a 11gb to the server?
The best option would be to place the file somewhere where it is
reachable and then use the "external" method
which does not perform an upload.

Check the REST docs for this.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

On Tue, Nov 19, 2013 at 5:00 PM, tog <guillaume.alleon@anonymised.com> wrote:

Dear all

I want to publish programmatically a pyramid to geoserver. Once zipped the
file is about 11GB.

For that I am using httpclient in groovy using the following code:

method = new
PutMethod("http://myhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid?coverageName=129images"\)

            requestEntity = new FileRequestEntity(new File(localUri),
"application/zip")

            method.setRequestEntity(requestEntity)

            status = client.executeMethod(method)

this hangs. No message!

When I try using curl locally, I got this message:

curl -u admin:geoserver -v -XPUT -H "Content-type: application/zip"
--data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try 'curl --help' or 'curl --manual' for more information

I was suspecting that curl was trying to load the 11GB file (which is a bad
idea) therefore I tried this:

curl -u admin:geoserver -v -XPUT -H "Content-type: application/zip" --header
"Transfer-Encoding: chunked" --data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try 'curl --help' or 'curl --manual' for more information

but get the same error.

Is there something I should do differently ?

Best Regards

Guillaume

--
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

tog · November 20, 2013, 12:36am

Hi Simone

Thanks for the answer.
Yep I need to transfer my mosaic to the server

I was indeed contemplating 2 options:

option1: upload the file to the server using REST api …/file.imagepyramid

option2: as you suggest in 2 phases:

upload the file on an accessible filesystem
use the REST api that will use the local zip file
delete the uploaded file

I thought option 1 was simpler (for info an scp just take 6mn).
Any idea/explaination why option 1 is not that good ?

Regards
Guillaume

···

On Wed, Nov 20, 2013 at 8:25 AM, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Guillame.
is it a requirement to upload a 11gb to the server?
The best option would be to place the file somewhere where it is
reachable and then use the “external” method
which does not perform an upload.

Check the REST docs for this.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Tue, Nov 19, 2013 at 5:00 PM, tog <guillaume.alleon@anonymised.com> wrote:

Dear all

I want to publish programmatically a pyramid to geoserver. Once zipped the
file is about 11GB.

For that I am using httpclient in groovy using the following code:

method = new
PutMethod(“http://myhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid?coverageName=129images”)

requestEntity = new FileRequestEntity(new File(localUri),
“application/zip”)

method.setRequestEntity(requestEntity)

status = client.executeMethod(method)

this hangs. No message!

When I try using curl locally, I got this message:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip”
–data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

I was suspecting that curl was trying to load the 11GB file (which is a bad
idea) therefore I tried this:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip” --header
“Transfer-Encoding: chunked” --data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

but get the same error.

Is there something I should do differently ?

Best Regards

Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

tog · November 20, 2013, 3:38am

Update:

Apparently even though the POST does not return on the client side … the pyramid gets published.
Nevertheless the log shows the following. Any comment ?

Guillaume

2013-11-20 03:19:12,830 ERROR [geoserver.rest] - No such workspace: 6c6cfbfc

2013-11-20 03:19:12,830 ERROR [geoserver.rest] -

org.geoserver.rest.RestletException

at org.geoserver.catalog.rest.WorkspaceFinder.findTarget(WorkspaceFinder.java:33)

at org.restlet.Finder.handle(Finder.java:268)

at org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:37)

at org.restlet.Filter.doHandle(Filter.java:105)

at org.restlet.Filter.handle(Filter.java:134)

at org.restlet.Router.handle(Router.java:444)

at org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:204)

at com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)

at org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:86)

at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)

at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)

at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)

at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)

at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)

at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:27)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:74)

at org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:45)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:49)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:109)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)

at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:53)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:82)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)

at org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:52)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)

at org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:134)

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:75)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:47)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:43)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:168)

at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:233)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)

at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)

at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)

at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)

at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)

at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)

at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)

at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)

at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)

at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)

at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:744)

2013-11-20 03:19:12,934 INFO [catalog.rest] - POST workspace 6c6cfbfc

2013-11-20 03:19:12,950 INFO [org.geoserver] - Loaded store ‘QL’, enabled

2013-11-20 03:19:12,954 INFO [catalog.rest] - POST coverage store QL

2013-11-20 03:19:12,988 INFO [catalog.rest] - PUT file, mimetype: application/zip

2013-11-20 03:28:19,682 INFO [catalog.rest] - Using existing coverage store: QL

2013-11-20 03:29:51,913 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/vnd.google-earth.kmz xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/vnd.google-earth.kmz’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.kmz’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/png; mode=8bit’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.openlayers’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.text/html’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.atom’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/atom xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/svg’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/svg xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,917 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,917 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:52,162 WARN [imagemosaic.catalog] - This granule catalog was not properly dispose as it still points to:ServiceInfo

description=Features from ShapefileDataStore

2013-11-20 03:30:01,276 INFO [geoserver.wms] -

Request: getServiceInfo

2013-11-20 03:30:01,329 INFO [geoserver.wms] -

···

On Wed, Nov 20, 2013 at 8:36 AM, tog <guillaume.alleon@anonymised.com> wrote:

Hi Simone

Thanks for the answer.
Yep I need to transfer my mosaic to the server

I was indeed contemplating 2 options:

option1: upload the file to the server using REST api …/file.imagepyramid

option2: as you suggest in 2 phases:

upload the file on an accessible filesystem

use the REST api that will use the local zip file

delete the uploaded file

I thought option 1 was simpler (for info an scp just take 6mn).
Any idea/explaination why option 1 is not that good ?

Regards
Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

On Wed, Nov 20, 2013 at 8:25 AM, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Guillame.
is it a requirement to upload a 11gb to the server?
The best option would be to place the file somewhere where it is
reachable and then use the “external” method
which does not perform an upload.

Check the REST docs for this.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Tue, Nov 19, 2013 at 5:00 PM, tog <guillaume.alleon@anonymised.com> wrote:

Dear all

I want to publish programmatically a pyramid to geoserver. Once zipped the
file is about 11GB.

For that I am using httpclient in groovy using the following code:

method = new
PutMethod(“http://myhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid?coverageName=129images”)

requestEntity = new FileRequestEntity(new File(localUri),
“application/zip”)

method.setRequestEntity(requestEntity)

status = client.executeMethod(method)

this hangs. No message!

When I try using curl locally, I got this message:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip”
–data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

I was suspecting that curl was trying to load the 11GB file (which is a bad
idea) therefore I tried this:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip” --header
“Transfer-Encoding: chunked” --data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

but get the same error.

Is there something I should do differently ?

Best Regards

Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

Lorenzo_Natali · November 20, 2013, 10:16am

Hi,
about CURL:
Curl goes out of memory because it tries to load all the file in memory.
I didn’ t tested it, but you can try to use the -T option ( this allows to do this transfer in streaming)
Check the man page of curl for details .

About Alternative solutions:
Using the 2nd option you have a better control of the upload phase, and you can also think to transfer files chunked (I think that scp is better for this kind of transfers) .

Furthermore big files like the one you’re are using needs to be sent and saved in streaming, so the problems you encountered using curl can recur even server side.
Using dedicated systems to transfer big files is better in general.

You can use the PUT method of the ReST interface for smaller files.

About the error:
POST is allowed only for xml, not for file transfer (see http://docs.geoserver.org/stable/en/user/rest/api/index.html ).
If you were using the POST method in that way, the error seems like the request is not well formed (No such workspace: 6c6cfbfc) . Anyway I couldn’t see the original request.

Lorenzo

···

2013/11/20 tog <guillaume.alleon@anonymised.com>

Update:

Apparently even though the POST does not return on the client side … the pyramid gets published.
Nevertheless the log shows the following. Any comment ?

Guillaume

2013-11-20 03:19:12,830 ERROR [geoserver.rest] - No such workspace: 6c6cfbfc

2013-11-20 03:19:12,830 ERROR [geoserver.rest] -

org.geoserver.rest.RestletException

at org.geoserver.catalog.rest.WorkspaceFinder.findTarget(WorkspaceFinder.java:33)

at org.restlet.Finder.handle(Finder.java:268)

at org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:37)

at org.restlet.Filter.doHandle(Filter.java:105)

at org.restlet.Filter.handle(Filter.java:134)

at org.restlet.Router.handle(Router.java:444)

at org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:204)

at com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)

at org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:86)

at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)

at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)

at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)

at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)

at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)

at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:27)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:74)

at org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:45)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:49)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:109)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)

at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:53)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:82)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)

at org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:52)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)

at org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:134)

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:75)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:47)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:43)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:168)

at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:233)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)

at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)

at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)

at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)

at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)

at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)

at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)

at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)

at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)

at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)

at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:744)

2013-11-20 03:19:12,934 INFO [catalog.rest] - POST workspace 6c6cfbfc

2013-11-20 03:19:12,950 INFO [org.geoserver] - Loaded store ‘QL’, enabled

2013-11-20 03:19:12,954 INFO [catalog.rest] - POST coverage store QL

2013-11-20 03:19:12,988 INFO [catalog.rest] - PUT file, mimetype: application/zip

2013-11-20 03:28:19,682 INFO [catalog.rest] - Using existing coverage store: QL

2013-11-20 03:29:51,913 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/vnd.google-earth.kmz xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/vnd.google-earth.kmz’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.kmz’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/png; mode=8bit’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.openlayers’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.text/html’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.atom’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/atom xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/svg’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/svg xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,917 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,917 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:52,162 WARN [imagemosaic.catalog] - This granule catalog was not properly dispose as it still points to:ServiceInfo

description=Features from ShapefileDataStore

2013-11-20 03:30:01,276 INFO [geoserver.wms] -

Request: getServiceInfo

2013-11-20 03:30:01,329 INFO [geoserver.wms] -

Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Regards,
Lorenzo Natali

==

Dott. Ing. Lorenzo Natali
@lorenzonatali
Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Wed, Nov 20, 2013 at 8:36 AM, tog <guillaume.alleon@anonymised.com> wrote:

Hi Simone

Thanks for the answer.
Yep I need to transfer my mosaic to the server

I was indeed contemplating 2 options:

option1: upload the file to the server using REST api …/file.imagepyramid

option2: as you suggest in 2 phases:

upload the file on an accessible filesystem

use the REST api that will use the local zip file

delete the uploaded file

I thought option 1 was simpler (for info an scp just take 6mn).
Any idea/explaination why option 1 is not that good ?

Regards
Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

On Wed, Nov 20, 2013 at 8:25 AM, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Guillame.
is it a requirement to upload a 11gb to the server?
The best option would be to place the file somewhere where it is
reachable and then use the “external” method
which does not perform an upload.

Check the REST docs for this.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Tue, Nov 19, 2013 at 5:00 PM, tog <guillaume.alleon@anonymised.com> wrote:

Dear all

I want to publish programmatically a pyramid to geoserver. Once zipped the
file is about 11GB.

For that I am using httpclient in groovy using the following code:

method = new
PutMethod(“http://myhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid?coverageName=129images”)

requestEntity = new FileRequestEntity(new File(localUri),
“application/zip”)

method.setRequestEntity(requestEntity)

status = client.executeMethod(method)

this hangs. No message!

When I try using curl locally, I got this message:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip”
–data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

I was suspecting that curl was trying to load the 11GB file (which is a bad
idea) therefore I tried this:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip” --header
“Transfer-Encoding: chunked” --data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

but get the same error.

Is there something I should do differently ?

Best Regards

Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

tog · November 20, 2013, 11:26am

Hi Lorenzo

Thanks for the answer.

Well actually curl is not really an option I used it in a command line when my http client hanged in order to check if I could get more info on what was happening.

The POST error you have seen results from a request we do to check if a workspace exists. If we get a 404 it means we need to create the workspace. There might be a better way to do that

Actually the PUT method using httpclient works and the pyramid gets published.

method = new PutMethod(“${scheme}://${host}:${port}/geoserver/rest/workspaces/${workspace}/coveragestores/${prefix}/${uploadMethod}.imagepyramid?coverageName=${prefix}”)requestEntity = new FileRequestEntity(new File(localUri), “application/zip”)
method.setRequestEntity(requestEntity)
status = client.executeMethod(method)

Apparently the code is blocked in the last statement ( client.executeMethod(method) ) - at least this is what jdb says.
How could I see that everything went well on the server side and that geoserver sent back a status ?

Working in the cloud I am a bit reluctant in opening too much port so currently instead of putting in place a new server that will receive the zip file, we are investigating if we could not have a WPS taking care of that.

Actually we have in mind of implementing 2 WPS:

one will receive the level 0 tif files of my future pyramid
the second one will call gdal_retile / gdaladdo

Any comments welcome.

Regards
Guillaume

···

On Wed, Nov 20, 2013 at 3:46 PM, Lorenzo Natali <lorenzo.natali@anonymised.com> wrote:

Hi,
about CURL:

Curl goes out of memory because it tries to load all the file in memory.

I didn’ t tested it, but you can try to use the -T option ( this allows to do this transfer in streaming)
Check the man page of curl for details .

About Alternative solutions:
Using the 2nd option you have a better control of the upload phase, and you can also think to transfer files chunked (I think that scp is better for this kind of transfers) .

Furthermore big files like the one you’re are using needs to be sent and saved in streaming, so the problems you encountered using curl can recur even server side.
Using dedicated systems to transfer big files is better in general.

You can use the PUT method of the ReST interface for smaller files.

About the error:
POST is allowed only for xml, not for file transfer (see http://docs.geoserver.org/stable/en/user/rest/api/index.html ).
If you were using the POST method in that way, the error seems like the request is not well formed (No such workspace: 6c6cfbfc) . Anyway I couldn’t see the original request.

Lorenzo

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

2013/11/20 tog <guillaume.alleon@anonymised.com>

Update:

Apparently even though the POST does not return on the client side … the pyramid gets published.
Nevertheless the log shows the following. Any comment ?

Guillaume

2013-11-20 03:19:12,830 ERROR [geoserver.rest] - No such workspace: 6c6cfbfc

2013-11-20 03:19:12,830 ERROR [geoserver.rest] -

org.geoserver.rest.RestletException

at org.geoserver.catalog.rest.WorkspaceFinder.findTarget(WorkspaceFinder.java:33)

at org.restlet.Finder.handle(Finder.java:268)

at org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:37)

at org.restlet.Filter.doHandle(Filter.java:105)

at org.restlet.Filter.handle(Filter.java:134)

at org.restlet.Router.handle(Router.java:444)

at org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:204)

at com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)

at org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:86)

at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)

at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)

at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)

at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)

at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)

at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:27)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:74)

at org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:45)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:49)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:109)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)

at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:53)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:82)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:68)

at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)

at org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:52)

at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:72)

at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:91)

at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)

at org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:134)

at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)

at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:75)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:47)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:43)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:168)

at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:233)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)

at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)

at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)

at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)

at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)

at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927)

at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)

at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)

at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987)

at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579)

at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:307)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:744)

2013-11-20 03:19:12,934 INFO [catalog.rest] - POST workspace 6c6cfbfc

2013-11-20 03:19:12,950 INFO [org.geoserver] - Loaded store ‘QL’, enabled

2013-11-20 03:19:12,954 INFO [catalog.rest] - POST coverage store QL

2013-11-20 03:19:12,988 INFO [catalog.rest] - PUT file, mimetype: application/zip

2013-11-20 03:28:19,682 INFO [catalog.rest] - Using existing coverage store: QL

2013-11-20 03:29:51,913 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/vnd.google-earth.kmz xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/vnd.google-earth.kmz’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.kmz’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/png; mode=8bit’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.openlayers’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.text/html’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.atom’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/atom xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.application/xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/svg’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,914 WARN [geoserver.web] - Unable to find property: ‘format.wms.image/svg xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,915 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.KML’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,916 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,917 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/vnd.google-earth.kml xml’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:51,917 WARN [geoserver.web] - Unable to find property: ‘format.wfs.application/json’ for component: [class=org.geoserver.web.demo.MapPreviewPage]

2013-11-20 03:29:52,162 WARN [imagemosaic.catalog] - This granule catalog was not properly dispose as it still points to:ServiceInfo

description=Features from ShapefileDataStore

2013-11-20 03:30:01,276 INFO [geoserver.wms] -

Request: getServiceInfo

2013-11-20 03:30:01,329 INFO [geoserver.wms] -

Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Regards,
Lorenzo Natali

==

Dott. Ing. Lorenzo Natali
@lorenzonatali
Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Wed, Nov 20, 2013 at 8:36 AM, tog <guillaume.alleon@anonymised.com> wrote:

Hi Simone

Thanks for the answer.
Yep I need to transfer my mosaic to the server

I was indeed contemplating 2 options:

option1: upload the file to the server using REST api …/file.imagepyramid

option2: as you suggest in 2 phases:

upload the file on an accessible filesystem

use the REST api that will use the local zip file

delete the uploaded file

I thought option 1 was simpler (for info an scp just take 6mn).
Any idea/explaination why option 1 is not that good ?

Regards
Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

On Wed, Nov 20, 2013 at 8:25 AM, Simone Giannecchini <simone.giannecchini@anonymised.com> wrote:

Ciao Guillame.
is it a requirement to upload a 11gb to the server?
The best option would be to place the file somewhere where it is
reachable and then use the “external” method
which does not perform an upload.

Check the REST docs for this.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

On Tue, Nov 19, 2013 at 5:00 PM, tog <guillaume.alleon@anonymised.com> wrote:

Dear all

I want to publish programmatically a pyramid to geoserver. Once zipped the
file is about 11GB.

For that I am using httpclient in groovy using the following code:

method = new
PutMethod(“http://myhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid?coverageName=129images”)

requestEntity = new FileRequestEntity(new File(localUri),
“application/zip”)

method.setRequestEntity(requestEntity)

status = client.executeMethod(method)

this hangs. No message!

When I try using curl locally, I got this message:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip”
–data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

I was suspecting that curl was trying to load the 11GB file (which is a bad
idea) therefore I tried this:

curl -u admin:geoserver -v -XPUT -H “Content-type: application/zip” --header
“Transfer-Encoding: chunked” --data-binary @/mnt/tmp/pyramids.zip
http://localhost:8080/geoserver/rest/workspaces/pf/coveragestores/129images/file.imagepyramid

curl: option --data-binary: out of memory

curl: try ‘curl --help’ or ‘curl --manual’ for more information

but get the same error.

Is there something I should do differently ?

Best Regards

Guillaume

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

–
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net

[Geoserver-users] Publishing pyramid to geoserver

Regards, Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Regards, Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Regards, Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

–

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Regards, Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

–

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Regards, Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.

Regards,
Simone Giannecchini

Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.