[Geoserver-devel] Caused by: org.hsqldb.HsqlException: connection exception: closed

Stefan_A_Tzeggai · June 8, 2016, 11:09am

Hi everybody,

I run Geoserver 2.8.3 on Oracle Java 1.8.0_91 on Ubuntu Server 14.04

It happens every few days/weeks that Geoserver stops working correctly! The webinterface is still working, but creating layers with REST and requesting WMS failes.

Redeploying just geoserver.war (by removing and reinserting it into /var/lib/tomcat7/webapps) makes everything work again.

Below is the full stacktrace.

I found these two links that might be related:

http://stackoverflow.com/questions/11967361/executequery-in-multiple-threads-closes-hsqldb-database-connection

https://sourceforge.net/p/geoserver/mailman/message/35051494/

I observed this on a production system running for 17 days with more than 3000 layers created via REST. From the logfile I can see that once the problem occurs, all following WMS requests fail, also on layers created earlier.

How can I help to solve this?

Greetings from Bolsena
Steve

[GC pause (G1 Evacuation Pause) (young) 18G->10G(25G), 0.1781596 secs]
07 Jun 15:55:02 WARN [org.geoserver] - Error decode epsg code: EPSG:31467
org.opengis.referencing.FactoryException: Database failure while creating a 'CoordinateReferenceSystem' object for code "EPSG:31467".
  at org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
  at org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
  at org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
  at org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
  at org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
  at org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
  at org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
  at org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
  at org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
  at org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
  at org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
  at org.geotools.referencing.CRS.decode(CRS.java:520)
  at org.geotools.referencing.CRS.decode(CRS.java:448)
  at org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1217)
  at com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
  at com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
  at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
  at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
  at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
  at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
  at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
  at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
  at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
  at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
  at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
  at org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1725)
  at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
  at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
  at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
  at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
  at com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
  at com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
  at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
  at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
  at com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
  at org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:594)
  at org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:755)
  at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:377)
  at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:226)
  at org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
  at org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:210)
  at org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
  at org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
  at org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
  at org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
  at org.restlet.Finder.handle(Finder.java:296)
  at org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
  at org.restlet.Filter.doHandle(Filter.java:105)
  at org.restlet.Filter.handle(Filter.java:134)
  at org.restlet.Router.handle(Router.java:444)
  at org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
  at com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
  at org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
  at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
  at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
  at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
  at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
  at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
  at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
  at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
  at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
  at org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
  at org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
  at org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
  at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
  at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
  at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
  at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
  at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
  at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
  at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
  at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
  at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
  at org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
  at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
  at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)
  at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
  at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
  at org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:83)
  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
  at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
  at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
  at org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
  at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
  at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
  at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
  at org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:135)
  at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
  at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
  at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
  at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
  at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
  at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
  at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
  at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
  at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
  at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
  at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
  at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
  at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
  at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLNonTransientConnectionException: connection exception: closed
  at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
  at org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
  at org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown Source)
  at org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)
  ... 136 more
Caused by: org.hsqldb.HsqlException: connection exception: closed
  at org.hsqldb.error.Error.error(Unknown Source)
  at org.hsqldb.Session.execute(Unknown Source)
  ... 139 more

Andrea_Aime4 · June 9, 2016, 5:50pm

Ciao Stefan,
long time no see!

Hum… we haven’t seen this issue pop up in a while… just to verify,
are you sure nothing wiped out the hsql db file from the file system?
It would be found in the java temp directory, under Geotools and then
some other dirs with the espg name and version (don’t have a sample
handy right here, right now)

Cheers
Andrea

···

On Wed, Jun 8, 2016 at 1:09 PM, Stefan Tzeggai <tzeggai@anonymised.com> wrote:

Hi everybody,

I run Geoserver 2.8.3 on Oracle Java 1.8.0_91 on Ubuntu Server 14.04

It happens every few days/weeks that Geoserver stops working correctly!
The webinterface is still working, but creating layers with REST and
requesting WMS failes.

Redeploying just geoserver.war (by removing and reinserting it into
/var/lib/tomcat7/webapps) makes everything work again.

Below is the full stacktrace.

I found these two links that might be related:

http://stackoverflow.com/questions/11967361/executequery-in-multiple-threads-closes-hsqldb-database-connection

https://sourceforge.net/p/geoserver/mailman/message/35051494/

I observed this on a production system running for 17 days with more
than 3000 layers created via REST. From the logfile I can see that once
the problem occurs, all following WMS requests fail, also on layers
created earlier.

How can I help to solve this?

Greetings from Bolsena
Steve

[GC pause (G1 Evacuation Pause) (young) 18G->10G(25G), 0.1781596 secs]
07 Jun 15:55:02 WARN [org.geoserver] - Error decode epsg code: EPSG:31467
org.opengis.referencing.FactoryException: Database failure while
creating a ‘CoordinateReferenceSystem’ object for code “EPSG:31467”.
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
at
org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
at
org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
at
org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
at
org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
at
org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
at
org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
at org.geotools.referencing.CRS.decode(CRS.java:520)
at org.geotools.referencing.CRS.decode(CRS.java:448)
at
org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1217)
at
com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
at
com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
at
org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1725)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
at
com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
at com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
at
org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:594)
at org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:755)
at
org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:377)
at
org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:226)
at
org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
at org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:210)
at
org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
at org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
at
org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
at
org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
at org.restlet.Finder.handle(Finder.java:296)
at
org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
at org.restlet.Filter.doHandle(Filter.java:105)
at org.restlet.Filter.handle(Filter.java:134)
at org.restlet.Router.handle(Router.java:444)
at org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
at
com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
at
org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
at
org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
at
org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
at
org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
at
org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
at
org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:83)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
at
org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
at
org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:135)
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLNonTransientConnectionException: connection
exception: closed
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
at org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown Source)
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)
… 136 more
Caused by: org.hsqldb.HsqlException: connection exception: closed
at org.hsqldb.error.Error.error(Unknown Source)
at org.hsqldb.error.Error.error(Unknown Source)
at org.hsqldb.Session.execute(Unknown Source)
… 139 more

What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-devel mailing list
Geoserver-devel@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313

fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

Stefan_A_Tzeggai · June 10, 2016, 8:35am

Hi Andrea

I am pretty sure they were not deleted because the hsql db files have a creation date from May 21st, the date of the last reboot (/tmp is wiped on reboot)

/tmp/tomcat7-tomcat7-tmp/Geotools/Databases/HSQL/v8.6.0.0 # ll
-rw-r--r-- 1 tomcat7 tomcat7 0 May 21 21:00 EPSG_creation_marker.txt
-rw-r--r-- 1 tomcat7 tomcat7 16777216 May 21 21:00 EPSG.data
-rw-r--r-- 1 tomcat7 tomcat7 114 May 21 21:00 EPSG.properties
-rw-r--r-- 1 tomcat7 tomcat7 18320 May 21 21:00 EPSG.script

Many greetings,
Steve

On 06/09/2016 07:50 PM, Andrea Aime wrote:

Ciao Stefan,
long time no see!

Hum... we haven't seen this issue pop up in a while... just to verify,
are you sure nothing wiped out the hsql db file from the file system?
It would be found in the java temp directory, under Geotools and then
some other dirs with the espg name and version (don't have a sample
handy right here, right now)

Cheers
Andrea

On Wed, Jun 8, 2016 at 1:09 PM, Stefan Tzeggai <tzeggai@anonymised.com
<mailto:tzeggai@anonymised.com>> wrote:

    Hi everybody,

    I run Geoserver 2.8.3 on Oracle Java 1.8.0_91 on Ubuntu Server 14.04

    It happens every few days/weeks that Geoserver stops working correctly!
    The webinterface is still working, but creating layers with REST and
    requesting WMS failes.

    Redeploying just geoserver.war (by removing and reinserting it into
    /var/lib/tomcat7/webapps) makes everything work again.

    Below is the full stacktrace.

    I found these two links that might be related:

    http://stackoverflow.com/questions/11967361/executequery-in-multiple-threads-closes-hsqldb-database-connection

    https://sourceforge.net/p/geoserver/mailman/message/35051494/

    I observed this on a production system running for 17 days with more
    than 3000 layers created via REST. From the logfile I can see that once
    the problem occurs, all following WMS requests fail, also on layers
    created earlier.

    How can I help to solve this?

    Greetings from Bolsena
    Steve

    [GC pause (G1 Evacuation Pause) (young) 18G->10G(25G), 0.1781596 secs]
    07 Jun 15:55:02 WARN [org.geoserver] - Error decode epsg code:
    EPSG:31467
    org.opengis.referencing.FactoryException: Database failure while
    creating a 'CoordinateReferenceSystem' object for code "EPSG:31467".
             at
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
             at
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
             at
    org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
             at
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
             at
    org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
             at
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
             at
    org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
             at
    org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
             at
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
             at
    org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
             at
    org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
             at org.geotools.referencing.CRS.decode(CRS.java:520)
             at org.geotools.referencing.CRS.decode(CRS.java:448)
             at
    org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1217)
             at
    com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
             at
    com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
             at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
             at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
             at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
             at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
             at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
             at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
             at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
             at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
             at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
             at
    org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1725)
             at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
             at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
             at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
             at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
             at
    com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
             at
    com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
             at
    com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
             at
    com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
             at com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
             at
    org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:594)
             at
    org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:755)
             at
    org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:377)
             at
    org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:226)
             at
    org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
             at
    org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:210)
             at
    org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
             at
    org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
             at
    org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
             at
    org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
             at org.restlet.Finder.handle(Finder.java:296)
             at
    org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
             at org.restlet.Filter.doHandle(Filter.java:105)
             at org.restlet.Filter.handle(Filter.java:134)
             at org.restlet.Router.handle(Router.java:444)
             at
    org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
             at
    com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
             at
    org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
             at
    org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
             at
    org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
             at
    org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
             at
    org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
             at
    org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
             at
    org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
             at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
             at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
             at
    org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
             at
    org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
             at
    org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
             at
    org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
             at
    org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
             at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
             at
    org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
             at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
             at
    org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
             at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
             at
    org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
             at
    org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:83)
             at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
             at
    org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
             at
    org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
             at
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
             at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
             at
    org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
             at
    org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:135)
             at
    org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
             at
    org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
             at
    org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
             at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
             at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
             at
    org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
             at
    org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
             at
    org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
             at
    org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
             at
    org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
             at
    org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
             at
    org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
             at
    org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
             at
    org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
             at
    org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
             at
    org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
             at
    java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
             at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
             at
    org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
             at java.lang.Thread.run(Thread.java:745)
    Caused by: java.sql.SQLNonTransientConnectionException: connection
    exception: closed
             at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
             at
    org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
             at
    org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown Source)
             at
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)
             ... 136 more
    Caused by: org.hsqldb.HsqlException: connection exception: closed
             at org.hsqldb.error.Error.error(Unknown Source)
             at org.hsqldb.Session.execute(Unknown Source)
             ... 139 more

    ------------------------------------------------------------------------------
    What NetFlow Analyzer can do for you? Monitors network bandwidth and
    traffic
    patterns at an interface-level. Reveals which users, apps, and
    protocols are
    consuming the most bandwidth. Provides multi-vendor support for NetFlow,
    J-Flow, sFlow and other flows. Make informed decisions using capacity
    planning reports.
    https://ad.doubleclick.net/ddm/clk/305295220;132659582;e
    _______________________________________________
    Geoserver-devel mailing list
    Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>
    https://lists.sourceforge.net/lists/listinfo/geoserver-devel

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio
stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti,
copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento
contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data
Protection Code).Any use not in accord with its purpose, any disclosure,
reproduction, copying, distribution, or either dissemination, either
whole or partial, is strictly forbidden except previous formal approval
of the named addressee(s). If you are not the intended recipient, please
contact immediately the sender by telephone, fax or e-mail and delete
the information in this message that has been received in error. The
sender does not give any warranty or accept liability as the content,
accuracy or completeness of sent messages and accepts no responsibility
for changes made after they were sent or for other risks which arise as
a result of e-mail transmission, viruses, etc.

-------------------------------------------------------

Andrea_Aime4 · June 10, 2016, 10:55am

Hi Stefan,
in that case… I have no idea sorry

Cheers
Andrea

···

On Fri, Jun 10, 2016 at 10:35 AM, Stefan Tzeggai <tzeggai@anonymised.com> wrote:

Hi Andrea

I am pretty sure they were not deleted because the hsql db files have a
creation date from May 21st, the date of the last reboot (/tmp is wiped
on reboot)

/tmp/tomcat7-tomcat7-tmp/Geotools/Databases/HSQL/v8.6.0.0 # ll
-rw-r–r-- 1 tomcat7 tomcat7 0 May 21 21:00 EPSG_creation_marker.txt
-rw-r–r-- 1 tomcat7 tomcat7 16777216 May 21 21:00 EPSG.data
-rw-r–r-- 1 tomcat7 tomcat7 114 May 21 21:00 EPSG.properties
-rw-r–r-- 1 tomcat7 tomcat7 18320 May 21 21:00 EPSG.script

Many greetings,
Steve

On 06/09/2016 07:50 PM, Andrea Aime wrote:

Ciao Stefan,
long time no see!

Hum… we haven’t seen this issue pop up in a while… just to verify,
are you sure nothing wiped out the hsql db file from the file system?
It would be found in the java temp directory, under Geotools and then
some other dirs with the espg name and version (don’t have a sample
handy right here, right now)

Cheers
Andrea

On Wed, Jun 8, 2016 at 1:09 PM, Stefan Tzeggai <tzeggai@anonymised.com

mailto:[tzeggai@anonymised.com](mailto:tzeggai@anonymised.com2514...)> wrote:

Hi everybody,

I run Geoserver 2.8.3 on Oracle Java 1.8.0_91 on Ubuntu Server 14.04

It happens every few days/weeks that Geoserver stops working correctly!
The webinterface is still working, but creating layers with REST and
requesting WMS failes.

Redeploying just geoserver.war (by removing and reinserting it into
/var/lib/tomcat7/webapps) makes everything work again.

Below is the full stacktrace.

I found these two links that might be related:

http://stackoverflow.com/questions/11967361/executequery-in-multiple-threads-closes-hsqldb-database-connection

https://sourceforge.net/p/geoserver/mailman/message/35051494/

I observed this on a production system running for 17 days with more
than 3000 layers created via REST. From the logfile I can see that once
the problem occurs, all following WMS requests fail, also on layers
created earlier.

How can I help to solve this?

Greetings from Bolsena
Steve

[GC pause (G1 Evacuation Pause) (young) 18G->10G(25G), 0.1781596 secs]
07 Jun 15:55:02 WARN [org.geoserver] - Error decode epsg code:
EPSG:31467
org.opengis.referencing.FactoryException: Database failure while
creating a ‘CoordinateReferenceSystem’ object for code “EPSG:31467”.
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
at
org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
at
org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
at
org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
at
org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
at
org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
at
org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
at org.geotools.referencing.CRS.decode(CRS.java:520)
at org.geotools.referencing.CRS.decode(CRS.java:448)
at
org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1217)
at
com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
at
com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
at
org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1725)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
at
com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
at
com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
at
com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
at com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
at
org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:594)
at
org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:755)
at
org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:377)
at
org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:226)
at
org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
at
org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:210)
at
org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
at
org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
at
org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
at
org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
at org.restlet.Finder.handle(Finder.java:296)
at
org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
at org.restlet.Filter.doHandle(Filter.java:105)
at org.restlet.Filter.handle(Filter.java:134)
at org.restlet.Router.handle(Router.java:444)
at
org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
at
com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
at
org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
at
org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
at
org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
at
org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
at
org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
at
org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:83)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
at
org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
at
org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:135)
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLNonTransientConnectionException: connection
exception: closed
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at
org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
at
org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown Source)
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)
… 136 more
Caused by: org.hsqldb.HsqlException: connection exception: closed
at org.hsqldb.error.Error.error(Unknown Source)
at org.hsqldb.error.Error.error(Unknown Source)
at org.hsqldb.Session.execute(Unknown Source)
… 139 more

What NetFlow Analyzer can do for you? Monitors network bandwidth and
traffic
patterns at an interface-level. Reveals which users, apps, and
protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports.
https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net

mailto:[Geoserver-devel@lists.sourceforge.net](mailto:Geoserver-devel@lists.sourceforge.net)
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

–

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio
stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti,
copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento
contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data
Protection Code).Any use not in accord with its purpose, any disclosure,
reproduction, copying, distribution, or either dissemination, either
whole or partial, is strictly forbidden except previous formal approval
of the named addressee(s). If you are not the intended recipient, please
contact immediately the sender by telephone, fax or e-mail and delete
the information in this message that has been received in error. The
sender does not give any warranty or accept liability as the content,
accuracy or completeness of sent messages and accepts no responsibility
for changes made after they were sent or for other risks which arise as
a result of e-mail transmission, viruses, etc.

What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-devel mailing list
Geoserver-devel@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313

fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

Stefan_A_Tzeggai · October 9, 2016, 3:49pm

Hi again

I just wanted to report that I still get the error every few days with GeoServer 2.9.1. It seems to happen when there is a lot of parallel REST layer creation/reloading is going on.

Because Geoserver does not recover from this error, I will for now start monitoring the logfile and redeploy Geoserver automatically.

Just wanted to post the 2.9.1 stacktrace, maybe someone will be happy to find it:

Greetings,
Steve

06 Oct 10:42:33 WARN [org.geoserver] - Error decode epsg code: EPSG:31467
org.opengis.referencing.FactoryException: Database failure while creating a 'CoordinateReferenceSystem' object for code "EPSG:31467".
          at org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
          at org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
          at org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
          at org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
          at org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
          at org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
          at org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
          at org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
          at org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
          at org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
          at org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
          at org.geotools.referencing.CRS.decode(CRS.java:520)
          at org.geotools.referencing.CRS.decode(CRS.java:448)
          at org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1221)
          at com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
          at com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
          at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
          at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
          at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
          at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
          at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
          at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
          at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
          at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
          at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
          at org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1729)
          at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
          at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
          at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
          at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
          at com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
          at com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
          at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
          at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
          at com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
          at org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:597)
          at org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:764)
          at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:374)
          at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:223)
          at org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
          at org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:207)
          at org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
          at org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
          at org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
          at org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
          at org.restlet.Finder.handle(Finder.java:296)
          at org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
          at org.restlet.Filter.doHandle(Filter.java:105)
          at org.restlet.Filter.handle(Filter.java:134)
          at org.restlet.Router.handle(Router.java:444)
          at org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
          at com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
          at org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
          at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:147)
          at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:50)
          at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:959)
          at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:893)
          at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:968)
          at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:870)
          at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
          at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:844)
          at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
          at org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
          at org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
          at org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:316)
          at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
          at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:126)
          at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:90)
          at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
          at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
          at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
          at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
          at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
          at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
          at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
          at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
          at org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
          at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
          at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
          at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:213)
          at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
          at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
          at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
          at org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:84)
          at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
          at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
          at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:91)
          at org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
          at org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
          at org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
          at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
          at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:213)
          at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:176)
          at org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:152)
          at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
          at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:121)
          at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
          at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
          at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
          at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
          at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
          at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
          at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
          at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
          at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
          at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
          at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
          at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
          at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
          at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
          at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
          at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
          at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLNonTransientConnectionException: connection exception: closed
          at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
          at org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
          at org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown Source)
          at org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)
          ... 139 more
Caused by: org.hsqldb.HsqlException: connection exception: closed
          at org.hsqldb.error.Error.error(Unknown Source)
          at org.hsqldb.Session.execute(Unknown Source)
          ... 142 more

On 06/10/2016 12:55 PM, Andrea Aime wrote:

Hi Stefan,
in that case... I have no idea sorry

Cheers
Andrea

On Fri, Jun 10, 2016 at 10:35 AM, Stefan Tzeggai <tzeggai@anonymised.com
<mailto:tzeggai@anonymised.com>> wrote:

    Hi Andrea

    I am pretty sure they were not deleted because the hsql db files have a
    creation date from May 21st, the date of the last reboot (/tmp is wiped
    on reboot)

    /tmp/tomcat7-tomcat7-tmp/Geotools/Databases/HSQL/v8.6.0.0 # ll
    -rw-r--r-- 1 tomcat7 tomcat7 0 May 21 21:00
    EPSG_creation_marker.txt
    -rw-r--r-- 1 tomcat7 tomcat7 16777216 May 21 21:00 EPSG.data
    -rw-r--r-- 1 tomcat7 tomcat7 114 May 21 21:00 EPSG.properties
    -rw-r--r-- 1 tomcat7 tomcat7 18320 May 21 21:00 EPSG.script

    Many greetings,
    Steve

    On 06/09/2016 07:50 PM, Andrea Aime wrote:
    > Ciao Stefan,
    > long time no see!
    >
    > Hum... we haven't seen this issue pop up in a while... just to verify,
    > are you sure nothing wiped out the hsql db file from the file system?
    > It would be found in the java temp directory, under Geotools and then
    > some other dirs with the espg name and version (don't have a sample
    > handy right here, right now)
    >
    > Cheers
    > Andrea
    >
    > On Wed, Jun 8, 2016 at 1:09 PM, Stefan Tzeggai <tzeggai@anonymised.com <mailto:tzeggai@anonymised.com>
    > <mailto:tzeggai@anonymised.com>> wrote:
    >
    > Hi everybody,
    >
    > I run Geoserver 2.8.3 on Oracle Java 1.8.0_91 on Ubuntu Server
    14.04
    >
    > It happens every few days/weeks that Geoserver stops working
    correctly!
    > The webinterface is still working, but creating layers with
    REST and
    > requesting WMS failes.
    >
    > Redeploying just geoserver.war (by removing and reinserting it
    into
    > /var/lib/tomcat7/webapps) makes everything work again.
    >
    > Below is the full stacktrace.
    >
    > I found these two links that might be related:
    >
     http://stackoverflow.com/questions/11967361/executequery-in-multiple-threads-closes-hsqldb-database-connection
    >
    > https://sourceforge.net/p/geoserver/mailman/message/35051494/
    >
    > I observed this on a production system running for 17 days
    with more
    > than 3000 layers created via REST. From the logfile I can see
    that once
    > the problem occurs, all following WMS requests fail, also on
    layers
    > created earlier.
    >
    > How can I help to solve this?
    >
    > Greetings from Bolsena
    > Steve
    >
    > [GC pause (G1 Evacuation Pause) (young) 18G->10G(25G),
    0.1781596 secs]
    > 07 Jun 15:55:02 WARN [org.geoserver] - Error decode epsg code:
    > EPSG:31467
    > org.opengis.referencing.FactoryException: Database failure while
    > creating a 'CoordinateReferenceSystem' object for code
    "EPSG:31467".
    > at
    >
     org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
    > at
    >
     org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
    > at
    >
     org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
    > at
    >
     org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
    > at
    >
     org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
    > at
    >
     org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
    > at
    >
     org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
    > at
    >
     org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
    > at
    >
     org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
    > at
    >
     org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
    > at
    >
     org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
    > at org.geotools.referencing.CRS.decode(CRS.java:520)
    > at org.geotools.referencing.CRS.decode(CRS.java:448)
    > at
    >
     org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1217)
    > at
    >
     com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
    > at
    >
     com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
    > at
    >
     com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
    > at
    >
     com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
    > at
    >
     com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
    > at
    >
     com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
    > at
    >
     com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
    > at
    >
     com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
    > at
    >
     com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
    > at
    >
     com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
    > at
    >
     com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
    > at
    >
     org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1725)
    > at
    >
     com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
    > at
    >
     com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
    > at
    >
     com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
    > at
    >
     com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
    > at
    >
     com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
    > at
    >
     com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
    > at
    > com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
    > at
    > com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
    > at
    com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
    > at
    >
     org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:594)
    > at
    >
     org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:755)
    > at
    >
     org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:377)
    > at
    >
     org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:226)
    > at
    >
     org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
    > at
    >
     org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:210)
    > at
    >
     org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
    > at
    >
     org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
    > at
    >
     org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
    > at
    >
     org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
    > at org.restlet.Finder.handle(Finder.java:296)
    > at
    >
     org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
    > at org.restlet.Filter.doHandle(Filter.java:105)
    > at org.restlet.Filter.handle(Filter.java:134)
    > at org.restlet.Router.handle(Router.java:444)
    > at
    >
     org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
    > at
    >
     com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
    > at
    >
     org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
    > at
    >
     org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
    > at
    >
     org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
    > at
    >
     org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
    > at
    >
     org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
    > at
    >
     org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
    > at
    >
     org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
    > at
    javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
    > at
    javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
    > at
    >
     org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
    > at
    >
     org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
    > at
    >
     org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
    > at
    >
     org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
    > at
    >
     org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
    > at
    >
     org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
    > at
    >
     org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
    > at
    >
     org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > at
    >
     org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
    > at
    >
     org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
    > at
    >
     org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
    > at
    >
     org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:83)
    > at
    >
     org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
    > at
    >
     org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
    > at
    >
     org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
    > at
    >
     org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
    > at
    >
     org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > at
    >
     org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
    > at
    >
     org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:135)
    > at
    >
     org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
    > at
    >
     org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    > org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
    > at
    >
     org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > at
    >
     org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > at
    >
     org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
    > at
    >
     org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
    > at
    >
     org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
    > at
    >
     org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
    > at
    >
     org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
    > at
    >
     org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
    > at
    >
     org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
    > at
    >
     org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
    > at
    >
     org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
    > at
    >
     org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
    > at
    >
     org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
    > at
    >
     java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    > at
    >
     java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    > at
    >
     org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
    > at java.lang.Thread.run(Thread.java:745)
    > Caused by: java.sql.SQLNonTransientConnectionException: connection
    > exception: closed
    > at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
    > at
    > org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
    > at
    > org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown Source)
    > at
    >
     org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)
    > ... 136 more
    > Caused by: org.hsqldb.HsqlException: connection exception: closed
    > at org.hsqldb.error.Error.error(Unknown Source)
    > at org.hsqldb.Session.execute(Unknown Source)
    > ... 139 more
    >
     ------------------------------------------------------------------------------
    > What NetFlow Analyzer can do for you? Monitors network
    bandwidth and
    > traffic
    > patterns at an interface-level. Reveals which users, apps, and
    > protocols are
    > consuming the most bandwidth. Provides multi-vendor support
    for NetFlow,
    > J-Flow, sFlow and other flows. Make informed decisions using
    capacity
    > planning reports.
    > https://ad.doubleclick.net/ddm/clk/305295220;132659582;e
    > _______________________________________________
    > Geoserver-devel mailing list
    > Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>
    > <mailto:Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>>
    > https://lists.sourceforge.net/lists/listinfo/geoserver-devel
    >
    > --
    > ==
    > GeoServer Professional Services from the experts! Visit
    > http://goo.gl/it488V for more information.
    > ==
    >
    > Ing. Andrea Aime
    > @geowolf
    > Technical Lead
    >
    > GeoSolutions S.A.S.
    > Via di Montramito 3/A
    > 55054 Massarosa (LU)
    > phone: +39 0584 962313 <tel:%2B39%200584%20962313>
    > fax: +39 0584 1660272 <tel:%2B39%200584%201660272>
    > mob: +39 339 8844549 <tel:%2B39%20%20339%208844549>
    >
    > http://www.geo-solutions.it
    > http://twitter.com/geosolutions_it
    >
    > *AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*
    >
    > Le informazioni contenute in questo messaggio di posta elettronica e/o
    > nel/i file/s allegato/i sono da considerarsi strettamente
    riservate. Il
    > loro utilizzo è consentito esclusivamente al destinatario del
    messaggio,
    > per le finalità indicate nel messaggio stesso. Qualora riceviate
    questo
    > messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
    > darcene notizia via e-mail e di procedere alla distruzione del
    messaggio
    > stesso, cancellandolo dal Vostro sistema. Conservare il messaggio
    > stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti,
    > copiarlo, od utilizzarlo per finalità diverse, costituisce
    comportamento
    > contrario ai principi dettati dal D.Lgs. 196/2003.
    >
    > The information in this message and/or attachments, is intended solely
    > for the attention and use of the named addressee(s) and may be
    > confidential or proprietary in nature or covered by the provisions of
    > privacy act (Legislative Decree June, 30 2003, no.196 - Italy's
    New Data
    > Protection Code).Any use not in accord with its purpose, any
    disclosure,
    > reproduction, copying, distribution, or either dissemination, either
    > whole or partial, is strictly forbidden except previous formal
    approval
    > of the named addressee(s). If you are not the intended recipient,
    please
    > contact immediately the sender by telephone, fax or e-mail and delete
    > the information in this message that has been received in error. The
    > sender does not give any warranty or accept liability as the content,
    > accuracy or completeness of sent messages and accepts no
    responsibility
    > for changes made after they were sent or for other risks which
    arise as
    > a result of e-mail transmission, viruses, etc.
    >
    > -------------------------------------------------------

    ------------------------------------------------------------------------------
    What NetFlow Analyzer can do for you? Monitors network bandwidth and
    traffic
    patterns at an interface-level. Reveals which users, apps, and
    protocols are
    consuming the most bandwidth. Provides multi-vendor support for NetFlow,
    J-Flow, sFlow and other flows. Make informed decisions using capacity
    planning reports.
    https://ad.doubleclick.net/ddm/clk/305295220;132659582;e
    _______________________________________________
    Geoserver-devel mailing list
    Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>
    https://lists.sourceforge.net/lists/listinfo/geoserver-devel

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio
stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti,
copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento
contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data
Protection Code).Any use not in accord with its purpose, any disclosure,
reproduction, copying, distribution, or either dissemination, either
whole or partial, is strictly forbidden except previous formal approval
of the named addressee(s). If you are not the intended recipient, please
contact immediately the sender by telephone, fax or e-mail and delete
the information in this message that has been received in error. The
sender does not give any warranty or accept liability as the content,
accuracy or completeness of sent messages and accepts no responsibility
for changes made after they were sent or for other risks which arise as
a result of e-mail transmission, viruses, etc.

-------------------------------------------------------

Andrea_Aime4 · October 9, 2016, 6:33pm

Hi Stefan,
it seems there is something uncommon in your environment… I know we are monitoring
several systems in production, both linux and windows, and none of my colleagues have
reported a similar issue.

Btw, you might want to upgrade soon to a 2.9.2, stay tuned for the release announcement.

Cheers
Andrea

···

On Sun, Oct 9, 2016 at 5:49 PM, Stefan Tzeggai <tzeggai@anonymised.com> wrote:

Hi again

I just wanted to report that I still get the error every few days with
GeoServer 2.9.1. It seems to happen when there is a lot of parallel REST
layer creation/reloading is going on.

Because Geoserver does not recover from this error, I will for now start
monitoring the logfile and redeploy Geoserver automatically.

Just wanted to post the 2.9.1 stacktrace, maybe someone will be happy to
find it:

Greetings,
Steve

06 Oct 10:42:33 WARN [org.geoserver] - Error decode epsg code: EPSG:31467
org.opengis.referencing.FactoryException: Database failure while
creating a ‘CoordinateReferenceSystem’ object for code “EPSG:31467”.
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
at
org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
at
org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
at
org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
at
org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
at
org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
at
org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
at
org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
at org.geotools.referencing.CRS.decode(CRS.java:520)
at org.geotools.referencing.CRS.decode(CRS.java:448)
at
org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1221)
at
com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
at
com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
at
org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1729)
at
com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
at
com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
at
com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
at com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
at
org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:597)
at
org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:764)
at
org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:374)
at
org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:223)
at
org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
at
org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:207)
at
org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
at
org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
at
org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
at
org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
at org.restlet.Finder.handle(Finder.java:296)
at
org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
at org.restlet.Filter.doHandle(Filter.java:105)
at org.restlet.Filter.handle(Filter.java:134)
at org.restlet.Router.handle(Router.java:444)
at
org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
at
com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
at
org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
at
org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:147)
at
org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:50)
at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:959)
at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:893)
at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:968)
at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:870)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:844)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
at
org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
at
org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
at
org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at

org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:316)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:126)
at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:90)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
at
org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:213)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:84)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:91)
at
org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
at
org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
at
org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
at
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:213)
at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:176)
at
org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:152)
at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)

at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at

org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:121)
at
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLNonTransientConnectionException: connection
exception: closed
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown
Source)
at org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown
Source)
at
org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)

… 139 more
Caused by: org.hsqldb.HsqlException: connection exception: closed
at org.hsqldb.error.Error.error(Unknown Source)
at org.hsqldb.error.Error.error(Unknown Source)
at org.hsqldb.Session.execute(Unknown Source)
… 142 more

On 06/10/2016 12:55 PM, Andrea Aime wrote:

Hi Stefan,
in that case… I have no idea sorry

Cheers
Andrea

On Fri, Jun 10, 2016 at 10:35 AM, Stefan Tzeggai <tzeggai@anonymised.com

mailto:[tzeggai@anonymised.com](mailto:tzeggai@anonymised.com2514...)> wrote:

Hi Andrea

I am pretty sure they were not deleted because the hsql db files have a
creation date from May 21st, the date of the last reboot (/tmp is wiped
on reboot)

/tmp/tomcat7-tomcat7-tmp/Geotools/Databases/HSQL/v8.6.0.0 # ll
-rw-r–r-- 1 tomcat7 tomcat7 0 May 21 21:00
EPSG_creation_marker.txt
-rw-r–r-- 1 tomcat7 tomcat7 16777216 May 21 21:00 EPSG.data
-rw-r–r-- 1 tomcat7 tomcat7 114 May 21 21:00 EPSG.properties
-rw-r–r-- 1 tomcat7 tomcat7 18320 May 21 21:00 EPSG.script

Many greetings,
Steve

On 06/09/2016 07:50 PM, Andrea Aime wrote:

Ciao Stefan,
long time no see!

Hum… we haven’t seen this issue pop up in a while… just to verify,
are you sure nothing wiped out the hsql db file from the file system?
It would be found in the java temp directory, under Geotools and then
some other dirs with the espg name and version (don’t have a sample
handy right here, right now)

Cheers
Andrea

On Wed, Jun 8, 2016 at 1:09 PM, Stefan Tzeggai <tzeggai@anonymised.com mailto:[tzeggai@anonymised.com](mailto:tzeggai@anonymised.com)

<mailto:tzeggai@anonymised.com mailto:[tzeggai@anonymised.com](mailto:tzeggai@anonymised.com)>> wrote:

Hi everybody,

I run Geoserver 2.8.3 on Oracle Java 1.8.0_91 on Ubuntu Server
14.04

It happens every few days/weeks that Geoserver stops working
correctly!
The webinterface is still working, but creating layers with
REST and
requesting WMS failes.

Redeploying just geoserver.war (by removing and reinserting it
into
/var/lib/tomcat7/webapps) makes everything work again.

Below is the full stacktrace.

I found these two links that might be related:

http://stackoverflow.com/questions/11967361/executequery-in-multiple-threads-closes-hsqldb-database-connection

https://sourceforge.net/p/geoserver/mailman/message/35051494/

I observed this on a production system running for 17 days
with more
than 3000 layers created via REST. From the logfile I can see
that once
the problem occurs, all following WMS requests fail, also on
layers
created earlier.

How can I help to solve this?

Greetings from Bolsena
Steve

[GC pause (G1 Evacuation Pause) (young) 18G->10G(25G),
0.1781596 secs]
07 Jun 15:55:02 WARN [org.geoserver] - Error decode epsg code:
EPSG:31467
org.opengis.referencing.FactoryException: Database failure while
creating a ‘CoordinateReferenceSystem’ object for code
“EPSG:31467”.
at

org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)

at

org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)

at

org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)

at

org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)

at

org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)

at

org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)

at

org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)

at

org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)

at

org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)

at

org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)

at

org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)

at org.geotools.referencing.CRS.decode(CRS.java:520)
at org.geotools.referencing.CRS.decode(CRS.java:448)
at

org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1217)

at

com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)

at

com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)

at

com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)

at

com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)

at

com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)

at

com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)

at

com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)

at

com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)

at

com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)

at

com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)

at

com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)

at

org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1725)

at

com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)

at

com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)

at

com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)

at

com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)

at

com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)

at

com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)

at
com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
at
com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
at
com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
at

org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:594)

at

org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:755)

at

org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:377)

at

org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:226)

at

org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)

at

org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:210)

at

org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)

at

org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)

at

org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)

at

org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)

at org.restlet.Finder.handle(Finder.java:296)
at

org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)

at org.restlet.Filter.doHandle(Filter.java:105)
at org.restlet.Filter.handle(Filter.java:134)
at org.restlet.Router.handle(Router.java:444)
at

org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)

at

com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)

at

org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)

at

org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)

at

org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)

at

org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)

at

org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)

at

org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)

at

org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)

at
javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
at
javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)

at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)

at

org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)

at

org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)

at

org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)

at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)

at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)

at

org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)

at

org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)

at

org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)

at

org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)

at

org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)

at

org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at

org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)

at

org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)

at

org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)

at

org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)

at

org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at

org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)

at

org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at

org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)

at

org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)

at

org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)

at

org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)

at

org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:83)

at

org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at

org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)

at

org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)

at

org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)

at

org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)

at

org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)

at

org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)

at

org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)

at

org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:135)

at

org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)

at

org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)

at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)

at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at
org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)

at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)

at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)

at

org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)

at

org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

at

org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

at

org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)

at

org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)

at

org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)

at

org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)

at

org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)

at

org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)

at

org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)

at

org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)

at

org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)

at

org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)

at

org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)

at

java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at

java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at

org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)

at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLNonTransientConnectionException: connection
exception: closed
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
at
org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
at
org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown Source)
at

org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)

… 136 more
Caused by: org.hsqldb.HsqlException: connection exception: closed
at org.hsqldb.error.Error.error(Unknown Source)
at org.hsqldb.error.Error.error(Unknown Source)
at org.hsqldb.Session.execute(Unknown Source)
… 139 more

What NetFlow Analyzer can do for you? Monitors network
bandwidth and
traffic
patterns at an interface-level. Reveals which users, apps, and
protocols are
consuming the most bandwidth. Provides multi-vendor support
for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using
capacity
planning reports.
https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-devel mailing list
Geoserver-devel@anonymised.comsourceforge.net
mailto:[Geoserver-devel@anonymised.comsourceforge.net](mailto:Geoserver-devel@anonymised.comsourceforge.net)

<mailto:Geoserver-devel@anonymised.com…sourceforge.net
mailto:[Geoserver-devel@anonymised.comsourceforge.net](mailto:Geoserver-devel@lists.sourceforge.net)>
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

–

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313 tel:%2B39%200584%20962313
fax: +39 0584 1660272 tel:%2B39%200584%201660272
mob: +39 339 8844549 tel:%2B39%20%20339%208844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente
riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del
messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate
questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del
messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio
stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti,
copiarlo, od utilizzarlo per finalità diverse, costituisce
comportamento
contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s
New Data
Protection Code).Any use not in accord with its purpose, any
disclosure,
reproduction, copying, distribution, or either dissemination, either
whole or partial, is strictly forbidden except previous formal
approval
of the named addressee(s). If you are not the intended recipient,
please
contact immediately the sender by telephone, fax or e-mail and delete
the information in this message that has been received in error. The
sender does not give any warranty or accept liability as the content,
accuracy or completeness of sent messages and accepts no
responsibility
for changes made after they were sent or for other risks which
arise as
a result of e-mail transmission, viruses, etc.

What NetFlow Analyzer can do for you? Monitors network bandwidth and
traffic
patterns at an interface-level. Reveals which users, apps, and
protocols are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports.
https://ad.doubleclick.net/ddm/clk/305295220;132659582;e

Geoserver-devel mailing list
Geoserver-devel@anonymised.comsourceforge.net
mailto:[Geoserver-devel@anonymised.comsourceforge.net](mailto:Geoserver-devel@anonymised.comsourceforge.net)
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

–

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio
stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti,
copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento
contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data
Protection Code).Any use not in accord with its purpose, any disclosure,
reproduction, copying, distribution, or either dissemination, either
whole or partial, is strictly forbidden except previous formal approval
of the named addressee(s). If you are not the intended recipient, please
contact immediately the sender by telephone, fax or e-mail and delete
the information in this message that has been received in error. The
sender does not give any warranty or accept liability as the content,
accuracy or completeness of sent messages and accepts no responsibility
for changes made after they were sent or for other risks which arise as
a result of e-mail transmission, viruses, etc.

Check out the vibrant tech community on one of the world’s most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@anonymised.com.366…sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313

fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

Stefan_A_Tzeggai · October 12, 2016, 2:18pm

Hi Andrea

So, you say I do something strange/wrong... So, you are right

I developed this application with GeoServerRESTPublisher java client.
When I developed it, I had some troubles, and in trial-and-error I added a reload()-call after creating each layer.

The JavaDoc didn't sound too bad: "Reload the target geoserver configuration"

http://demo.geo-solutions.it/share/github/gsman/apidocs/it/geosolutions/geoserver/rest/GeoServerRESTPublisher.html#reload()

But.. as one can read more clearly here: http://docs.geoserver.org/stable/en/user/rest/api/reload.html
there should never be a need to call reload() unless you fiddle with the files - which I never do.

So.. when the production system grows towards 1000 layers, reload() seems to iterate over all of them. And if you issue 10 reload() commands in parallel as I did, things seem to break, as seen in my problem report.

I removed all calls to GeoServerRESTPublisher.reload() a few days ago and for now everything is running smooth and I guess that my problem is solved.

Maybe it would be an improvement to GS to synchronize the REST reload() calls.

Thanks a lot,
Steve

On 10/09/2016 08:33 PM, Andrea Aime wrote:

Hi Stefan,
it seems there is something uncommon in your environment... I know we
are monitoring
several systems in production, both linux and windows, and none of my
colleagues have
reported a similar issue.

Btw, you might want to upgrade soon to a 2.9.2, stay tuned for the
release announcement.

Cheers
Andrea

On Sun, Oct 9, 2016 at 5:49 PM, Stefan Tzeggai <tzeggai@anonymised.com
<mailto:tzeggai@anonymised.com>> wrote:

    Hi again

    I just wanted to report that I still get the error every few days with
    GeoServer 2.9.1. It seems to happen when there is a lot of parallel REST
    layer creation/reloading is going on.

    Because Geoserver does not recover from this error, I will for now start
    monitoring the logfile and redeploy Geoserver automatically.

    Just wanted to post the 2.9.1 stacktrace, maybe someone will be happy to
    find it:

    Greetings,
    Steve

    06 Oct 10:42:33 WARN [org.geoserver] - Error decode epsg code:
    EPSG:31467
    org.opengis.referencing.FactoryException: Database failure while
    creating a 'CoordinateReferenceSystem' object for code "EPSG:31467".
              at
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
              at
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
              at
    org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
              at
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
              at
    org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
              at
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
              at
    org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
              at
    org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
              at
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:802)
              at
    org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
              at
    org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
              at org.geotools.referencing.CRS.decode(CRS.java:520)
              at org.geotools.referencing.CRS.decode(CRS.java:448)
              at
    org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1221)
              at
    com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
              at
    com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
              at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
              at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
              at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
              at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
              at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
              at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
              at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
              at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
              at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
              at
    org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1729)
              at
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
              at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
              at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
              at
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
              at
    com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
              at
    com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
              at
    com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
              at
    com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
              at com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
              at
    org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:597)
              at
    org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:764)
              at
    org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:374)
              at
    org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:223)
              at
    org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
              at
    org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:207)
              at
    org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
              at
    org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
              at
    org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
              at
    org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
              at org.restlet.Finder.handle(Finder.java:296)
              at
    org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
              at org.restlet.Filter.doHandle(Filter.java:105)
              at org.restlet.Filter.handle(Filter.java:134)
              at org.restlet.Router.handle(Router.java:444)
              at
    org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
              at
    com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
              at
    org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
              at
    org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:147)
              at
    org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:50)
              at
    org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:959)
              at
    org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:893)
              at
    org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:968)
              at
    org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:870)
              at
    javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
              at
    org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:844)
              at
    javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
              at
    org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
              at
    org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
              at
    org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:316)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
              at
    org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:126)
              at
    org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:90)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
              at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
              at
    org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
              at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
              at
    org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
              at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
              at
    org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:213)
              at
    org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
              at
    org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:84)
              at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
              at
    org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:91)
              at
    org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
              at
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
              at
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
              at
    org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:213)
              at
    org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:176)
              at
    org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:152)
              at
    org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
              at
    org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:121)
              at
    org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
              at
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
              at
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
              at
    org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
              at
    org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
              at
    org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
              at
    org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
              at
    org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
              at
    org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
              at
    org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
              at
    org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
              at
    org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
              at
    org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
              at
    org.apache.tomcat.util.net
    <http://org.apache.tomcat.util.net>.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
              at
    java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
              at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
              at
    org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
              at java.lang.Thread.run(Thread.java:745)
    Caused by: java.sql.SQLNonTransientConnectionException: connection
    exception: closed
              at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
              at org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown
    Source)
              at org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown
    Source)
              at
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)
              ... 139 more
    Caused by: org.hsqldb.HsqlException: connection exception: closed
              at org.hsqldb.error.Error.error(Unknown Source)
              at org.hsqldb.Session.execute(Unknown Source)
              ... 142 more

    On 06/10/2016 12:55 PM, Andrea Aime wrote:
    > Hi Stefan,
    > in that case... I have no idea sorry
    >
    > Cheers
    > Andrea
    >
    > On Fri, Jun 10, 2016 at 10:35 AM, Stefan Tzeggai <tzeggai@anonymised.com. <mailto:tzeggai@anonymised.com>
    > <mailto:tzeggai@anonymised.com>> wrote:
    >
    > Hi Andrea
    >
    > I am pretty sure they were not deleted because the hsql db
    files have a
    > creation date from May 21st, the date of the last reboot (/tmp
    is wiped
    > on reboot)
    >
    > /tmp/tomcat7-tomcat7-tmp/Geotools/Databases/HSQL/v8.6.0.0 # ll
    > -rw-r--r-- 1 tomcat7 tomcat7 0 May 21 21:00
    > EPSG_creation_marker.txt
    > -rw-r--r-- 1 tomcat7 tomcat7 16777216 May 21 21:00 EPSG.data
    > -rw-r--r-- 1 tomcat7 tomcat7 114 May 21 21:00 EPSG.properties
    > -rw-r--r-- 1 tomcat7 tomcat7 18320 May 21 21:00 EPSG.script
    >
    > Many greetings,
    > Steve
    >
    > On 06/09/2016 07:50 PM, Andrea Aime wrote:
    > > Ciao Stefan,
    > > long time no see!
    > >
    > > Hum... we haven't seen this issue pop up in a while... just
    to verify,
    > > are you sure nothing wiped out the hsql db file from the
    file system?
    > > It would be found in the java temp directory, under Geotools
    and then
    > > some other dirs with the espg name and version (don't have a
    sample
    > > handy right here, right now)
    > >
    > > Cheers
    > > Andrea
    > >
    > > On Wed, Jun 8, 2016 at 1:09 PM, Stefan Tzeggai
    <tzeggai@anonymised.com <mailto:tzeggai@anonymised.com>
    <mailto:tzeggai@anonymised.com>
    > > <mailto:tzeggai@anonymised.com
    <mailto:tzeggai@anonymised.com>>> wrote:
    > >
    > > Hi everybody,
    > >
    > > I run Geoserver 2.8.3 on Oracle Java 1.8.0_91 on Ubuntu
    Server
    > 14.04
    > >
    > > It happens every few days/weeks that Geoserver stops working
    > correctly!
    > > The webinterface is still working, but creating layers with
    > REST and
    > > requesting WMS failes.
    > >
    > > Redeploying just geoserver.war (by removing and
    reinserting it
    > into
    > > /var/lib/tomcat7/webapps) makes everything work again.
    > >
    > > Below is the full stacktrace.
    > >
    > > I found these two links that might be related:
    > >
    >
    http://stackoverflow.com/questions/11967361/executequery-in-multiple-threads-closes-hsqldb-database-connection
    <http://stackoverflow.com/questions/11967361/executequery-in-multiple-threads-closes-hsqldb-database-connection>
    > >
     https://sourceforge.net/p/geoserver/mailman/message/35051494/
    <https://sourceforge.net/p/geoserver/mailman/message/35051494/>
    > >
    > > I observed this on a production system running for 17 days
    > with more
    > > than 3000 layers created via REST. From the logfile I
    can see
    > that once
    > > the problem occurs, all following WMS requests fail, also on
    > layers
    > > created earlier.
    > >
    > > How can I help to solve this?
    > >
    > > Greetings from Bolsena
    > > Steve
    > >
    > > [GC pause (G1 Evacuation Pause) (young) 18G->10G(25G),
    > 0.1781596 secs]
    > > 07 Jun 15:55:02 WARN [org.geoserver] - Error decode epsg
    code:
    > > EPSG:31467
    > > org.opengis.referencing.FactoryException: Database
    failure while
    > > creating a 'CoordinateReferenceSystem' object for code
    > "EPSG:31467".
    > > at
    > >
    >
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.databaseFailure(DirectEpsgFactory.java:3061)
    > > at
    > >
    >
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:2099)
    > > at
    > >
    >
    org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
    > > at
    > >
    >
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
    > > at
    > >
    >
    org.geotools.referencing.factory.BufferedAuthorityFactory.createCoordinateReferenceSystem(BufferedAuthorityFactory.java:783)
    > > at
    > >
    >
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
    > > at
    > >
    >
    org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:640)
    > > at
    > >
    >
    org.geotools.referencing.factory.FallbackAuthorityFactory.createCoordinateReferenceSystem(FallbackAuthorityFactory.java:644)
    > > at
    > >
    >
    org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
    > > at
    > >
    >
    org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
    > > at
    > >
    >
    org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
    > > at
    org.geotools.referencing.CRS.decode(CRS.java:520)
    > > at
    org.geotools.referencing.CRS.decode(CRS.java:448)
    > > at
    > >
    >
    org.geoserver.config.util.XStreamPersister$SRSConverter.fromString(XStreamPersister.java:1217)
    > > at
    > >
    >
    com.thoughtworks.xstream.converters.SingleValueConverterWrapper.fromString(SingleValueConverterWrapper.java:41)
    > > at
    > >
    >
    com.thoughtworks.xstream.converters.SingleValueConverterWrapper.unmarshal(SingleValueConverterWrapper.java:49)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
    > > at
    > >
    >
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
    > > at
    > >
    >
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
    > > at
    > >
    >
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
    > > at
    > >
    >
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:474)
    > > at
    > >
    >
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:406)
    > > at
    > >
    >
    org.geoserver.config.util.XStreamPersister$ResourceInfoConverter.doUnmarshal(XStreamPersister.java:1725)
    > > at
    > >
    >
    com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
    > > at
    > >
    >
    com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
    > > at
    > >
     com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1185)
    > > at
    > >
     com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1169)
    > > at
    > com.thoughtworks.xstream.XStream.fromXML(XStream.java:1049)
    > > at
    > >
    >
    org.geoserver.config.util.XStreamPersister.load(XStreamPersister.java:594)
    > > at
    > >
    >
    org.geoserver.config.GeoServerLoader.depersist(GeoServerLoader.java:755)
    > > at
    > >
    >
    org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:377)
    > > at
    > >
    >
    org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:226)
    > > at
    > >
    >
    org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36)
    > > at
    > >
    >
    org.geoserver.config.GeoServerLoader.reload(GeoServerLoader.java:210)
    > > at
    > >
    >
    org.geoserver.config.GeoServerLoaderProxy.reload(GeoServerLoaderProxy.java:66)
    > > at
    > >
    >
    org.geoserver.config.impl.GeoServerImpl.reload(GeoServerImpl.java:452)
    > > at
    > >
    >
    org.geoserver.catalog.rest.CatalogReloader.reloadCatalog(CatalogReloader.java:76)
    > > at
    > >
    >
    org.geoserver.catalog.rest.CatalogReloader$1.handlePost(CatalogReloader.java:56)
    > > at org.restlet.Finder.handle(Finder.java:296)
    > > at
    > >
    >
    org.geoserver.rest.BeanDelegatingRestlet.handle(BeanDelegatingRestlet.java:38)
    > > at org.restlet.Filter.doHandle(Filter.java:105)
    > > at org.restlet.Filter.handle(Filter.java:134)
    > > at org.restlet.Router.handle(Router.java:444)
    > > at
    > >
    >
    org.geoserver.rest.RESTDispatcher$1.handle(RESTDispatcher.java:205)
    > > at
    > >
    >
    com.noelios.restlet.ext.servlet.ServletConverter.service(ServletConverter.java:129)
    > > at
    > >
    >
    org.geoserver.rest.RESTDispatcher.handleRequestInternal(RESTDispatcher.java:87)
    > > at
    > >
    >
    org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
    > > at
    > >
    >
    org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
    > > at
    > >
    >
    org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
    > > at
    > >
    >
    org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
    > > at
    > >
    >
    org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
    > > at
    > >
    >
    org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789)
    > > at
    > javax.servlet.http.HttpServlet.service(HttpServlet.java:650)
    > > at
    > javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:28)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:75)
    > > at
    > >
    >
    org.geoserver.wms.animate.AnimatorFilter.doFilter(AnimatorFilter.java:71)
    > > at
    > >
    >
    org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:71)
    > > at
    > >
    >
    org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:46)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:50)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:311)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
    > > at
    > >
    >
    org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:116)
    > > at
    > >
    >
    org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
    > > at
    > >
    >
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
    > > at
    > >
    >
    org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
    > > at
    > >
    >
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerAnonymousAuthenticationFilter.doFilter(GeoServerAnonymousAuthenticationFilter.java:54)
    > > at
    > >
    >
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
    > > at
    > >
    >
    org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerBasicAuthenticationFilter.doFilter(GeoServerBasicAuthenticationFilter.java:83)
    > > at
    > >
    >
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:69)
    > > at
    > >
    >
    org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerSecurityContextPersistenceFilter$1.doFilter(GeoServerSecurityContextPersistenceFilter.java:53)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter$NestedFilterChain.doFilter(GeoServerCompositeFilter.java:73)
    > > at
    > >
    >
    org.geoserver.security.filter.GeoServerCompositeFilter.doFilter(GeoServerCompositeFilter.java:92)
    > > at
    > >
    >
    org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:323)
    > > at
    > >
    >
    org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:173)
    > > at
    > >
    >
    org.geoserver.security.GeoServerSecurityFilterChainProxy.doFilter(GeoServerSecurityFilterChainProxy.java:135)
    > > at
    > >
    >
    org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
    > > at
    > >
    >
    org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.geoserver.filters.LoggingFilter.doFilter(LoggingFilter.java:87)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
     org.geoserver.filters.GZIPFilter.doFilter(GZIPFilter.java:48)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.geoserver.filters.SessionDebugFilter.doFilter(SessionDebugFilter.java:48)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.geoserver.filters.FlushSafeFilter.doFilter(FlushSafeFilter.java:44)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)
    > > at
    > >
    >
    org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
    > > at
    > >
    >
    org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
    > > at
    > >
    >
    org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
    > > at
    > >
    >
    org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
    > > at
    > >
    >
    org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
    > > at
    > >
    >
    org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
    > > at
    > >
    >
    org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
    > > at
    > >
    >
    org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957)
    > > at
    > >
    >
    org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
    > > at
    > >
    >
    org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423)
    > > at
    > >
    >
    org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1079)
    > > at
    > >
    >
    org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620)
    > > at
    > >
    > org.apache.tomcat.util.net
    <http://org.apache.tomcat.util.net>.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
    > > at
    > >
    >
    java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    > > at
    > >
    >
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    > > at
    > >
    >
    org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
    > > at java.lang.Thread.run(Thread.java:745)
    > > Caused by: java.sql.SQLNonTransientConnectionException:
    connection
    > > exception: closed
    > > at
    org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
    > > at
    org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
    > > at
    > >
     org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
    > > at
    > >
     org.hsqldb.jdbc.JDBCPreparedStatement.executeQuery(Unknown Source)
    > > at
    > >
    >
    org.geotools.referencing.factory.epsg.DirectEpsgFactory.createCoordinateReferenceSystem(DirectEpsgFactory.java:1956)
    > > ... 136 more
    > > Caused by: org.hsqldb.HsqlException: connection
    exception: closed
    > > at org.hsqldb.error.Error.error(Unknown Source)
    > > at org.hsqldb.Session.execute(Unknown Source)
    > > ... 139 more
    > >
    >
    ------------------------------------------------------------------------------
    > > What NetFlow Analyzer can do for you? Monitors network
    > bandwidth and
    > > traffic
    > > patterns at an interface-level. Reveals which users,
    apps, and
    > > protocols are
    > > consuming the most bandwidth. Provides multi-vendor support
    > for NetFlow,
    > > J-Flow, sFlow and other flows. Make informed decisions using
    > capacity
    > > planning reports.
    > > https://ad.doubleclick.net/ddm/clk/305295220;132659582;e
    <https://ad.doubleclick.net/ddm/clk/305295220;132659582;e>
    > > _______________________________________________
    > > Geoserver-devel mailing list
    > > Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>
    > <mailto:Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>>
    > > <mailto:Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>
    > <mailto:Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>>>
    > > https://lists.sourceforge.net/lists/listinfo/geoserver-devel
    <https://lists.sourceforge.net/lists/listinfo/geoserver-devel>
    > >
    > > --
    > > ==
    > > GeoServer Professional Services from the experts! Visit
    > > http://goo.gl/it488V for more information.
    > > ==
    > >
    > > Ing. Andrea Aime
    > > @geowolf
    > > Technical Lead
    > >
    > > GeoSolutions S.A.S.
    > > Via di Montramito 3/A
    > > 55054 Massarosa (LU)
    > > phone: +39 0584 962313 <tel:%2B39%200584%20962313>
    > > fax: +39 0584 1660272 <tel:%2B39%200584%201660272>
    > > mob: +39 339 8844549 <tel:%2B39%20%20339%208844549>
    > >
    > > http://www.geo-solutions.it
    > > http://twitter.com/geosolutions_it
    <http://twitter.com/geosolutions_it>
    > >
    > > *AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*
    > >
    > > Le informazioni contenute in questo messaggio di posta
    elettronica e/o
    > > nel/i file/s allegato/i sono da considerarsi strettamente
    > riservate. Il
    > > loro utilizzo è consentito esclusivamente al destinatario del
    > messaggio,
    > > per le finalità indicate nel messaggio stesso. Qualora riceviate
    > questo
    > > messaggio senza esserne il destinatario, Vi preghiamo
    cortesemente di
    > > darcene notizia via e-mail e di procedere alla distruzione del
    > messaggio
    > > stesso, cancellandolo dal Vostro sistema. Conservare il
    messaggio
    > > stesso, divulgarlo anche in parte, distribuirlo ad altri
    soggetti,
    > > copiarlo, od utilizzarlo per finalità diverse, costituisce
    > comportamento
    > > contrario ai principi dettati dal D.Lgs. 196/2003.
    > >
    > > The information in this message and/or attachments, is
    intended solely
    > > for the attention and use of the named addressee(s) and may be
    > > confidential or proprietary in nature or covered by the
    provisions of
    > > privacy act (Legislative Decree June, 30 2003, no.196 - Italy's
    > New Data
    > > Protection Code).Any use not in accord with its purpose, any
    > disclosure,
    > > reproduction, copying, distribution, or either
    dissemination, either
    > > whole or partial, is strictly forbidden except previous formal
    > approval
    > > of the named addressee(s). If you are not the intended
    recipient,
    > please
    > > contact immediately the sender by telephone, fax or e-mail
    and delete
    > > the information in this message that has been received in
    error. The
    > > sender does not give any warranty or accept liability as the
    content,
    > > accuracy or completeness of sent messages and accepts no
    > responsibility
    > > for changes made after they were sent or for other risks which
    > arise as
    > > a result of e-mail transmission, viruses, etc.
    > >
    > > -------------------------------------------------------
    >
     ------------------------------------------------------------------------------
    > What NetFlow Analyzer can do for you? Monitors network
    bandwidth and
    > traffic
    > patterns at an interface-level. Reveals which users, apps, and
    > protocols are
    > consuming the most bandwidth. Provides multi-vendor support
    for NetFlow,
    > J-Flow, sFlow and other flows. Make informed decisions using
    capacity
    > planning reports.
    > https://ad.doubleclick.net/ddm/clk/305295220;132659582;e
    <https://ad.doubleclick.net/ddm/clk/305295220;132659582;e>
    > _______________________________________________
    > Geoserver-devel mailing list
    > Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>
    > <mailto:Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>>
    > https://lists.sourceforge.net/lists/listinfo/geoserver-devel
    <https://lists.sourceforge.net/lists/listinfo/geoserver-devel>
    >
    > --
    > ==
    > GeoServer Professional Services from the experts! Visit
    > http://goo.gl/it488V for more information.
    > ==
    >
    > Ing. Andrea Aime
    > @geowolf
    > Technical Lead
    >
    > GeoSolutions S.A.S.
    > Via di Montramito 3/A
    > 55054 Massarosa (LU)
    > phone: +39 0584 962313
    > fax: +39 0584 1660272
    > mob: +39 339 8844549
    >
    > http://www.geo-solutions.it
    > http://twitter.com/geosolutions_it
    <http://twitter.com/geosolutions_it>
    >
    > *AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*
    >
    > Le informazioni contenute in questo messaggio di posta elettronica e/o
    > nel/i file/s allegato/i sono da considerarsi strettamente
    riservate. Il
    > loro utilizzo è consentito esclusivamente al destinatario del
    messaggio,
    > per le finalità indicate nel messaggio stesso. Qualora riceviate
    questo
    > messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
    > darcene notizia via e-mail e di procedere alla distruzione del
    messaggio
    > stesso, cancellandolo dal Vostro sistema. Conservare il messaggio
    > stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti,
    > copiarlo, od utilizzarlo per finalità diverse, costituisce
    comportamento
    > contrario ai principi dettati dal D.Lgs. 196/2003.
    >
    > The information in this message and/or attachments, is intended solely
    > for the attention and use of the named addressee(s) and may be
    > confidential or proprietary in nature or covered by the provisions of
    > privacy act (Legislative Decree June, 30 2003, no.196 - Italy's
    New Data
    > Protection Code).Any use not in accord with its purpose, any
    disclosure,
    > reproduction, copying, distribution, or either dissemination, either
    > whole or partial, is strictly forbidden except previous formal
    approval
    > of the named addressee(s). If you are not the intended recipient,
    please
    > contact immediately the sender by telephone, fax or e-mail and delete
    > the information in this message that has been received in error. The
    > sender does not give any warranty or accept liability as the content,
    > accuracy or completeness of sent messages and accepts no
    responsibility
    > for changes made after they were sent or for other risks which
    arise as
    > a result of e-mail transmission, viruses, etc.
    >
    > -------------------------------------------------------

    ------------------------------------------------------------------------------
    Check out the vibrant tech community on one of the world's most
    engaging tech sites, SlashDot.org! http://sdm.link/slashdot
    _______________________________________________
    Geoserver-devel mailing list
    Geoserver-devel@lists.sourceforge.net
    <mailto:Geoserver-devel@lists.sourceforge.net>
    https://lists.sourceforge.net/lists/listinfo/geoserver-devel
    <https://lists.sourceforge.net/lists/listinfo/geoserver-devel>

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio
stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti,
copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento
contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely
for the attention and use of the named addressee(s) and may be
confidential or proprietary in nature or covered by the provisions of
privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data
Protection Code).Any use not in accord with its purpose, any disclosure,
reproduction, copying, distribution, or either dissemination, either
whole or partial, is strictly forbidden except previous formal approval
of the named addressee(s). If you are not the intended recipient, please
contact immediately the sender by telephone, fax or e-mail and delete
the information in this message that has been received in error. The
sender does not give any warranty or accept liability as the content,
accuracy or completeness of sent messages and accepts no responsibility
for changes made after they were sent or for other risks which arise as
a result of e-mail transmission, viruses, etc.

-------------------------------------------------------

[Geoserver-devel] Caused by: org.hsqldb.HsqlException: connection exception: closed

== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

--

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

–

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

--

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

–

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

–

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

--

GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.