[Geoserver-devel] wfs cite test failures on master

GeoServer GeoServer Developer
1

With the build back we have some cite test failures on WFS.

Last working test on master:

First broken test on master:

Between those two tests we have:

99c8df43e044a4ec30570dabf9272fdc01b4ea24 Merge pull request #2118 from tbarsballe/netcdf-out-fixup e8663e832241f72de186f843aa8f40f92d67bf15 Migrate MultiDimDataStore to ContentDataStore c69fa92b39c563db120a2a0413d868586a7304a0 Merge pull request #2116 from aaime/parallel_catalog_load d4bb0f8caa49c80cab9ed4ee469c5bffdedc4f0e Adding EO metadata templates bdb599e52e0dc214233d6cbd8b50110367dbbc7f [GEOS-7915] Can not display table based pages in Turkish locale 50461e0eee15dd107281aa40265ce7a5c308e68f GSIP-155 follow up: parallelizing catalog loading on the IO side faaa08176c4ada11baf316ba6fa13d61e1e0cd5a Merge pull request #2115 from aaime/gwc_memory_catalog c7fd3a2bab20da83ead80c78103ceebfc2698392 DefaultTileLayerCatalog to mimick the GS own default catalog and keep everything in memory 3d9396a70ffd5a8cd026d2d3c87b81a94dba32b6 Merge pull request #2065 from dvntucker/geos_7937 da457521c5bbf9621e179e7041f260e1801d3870 [GEOS-7937] - Change resource pool to explicitly check URL string fore file-ness fdc360699235a832c1111215b5b4a7a8b353dc86 Remove errant resource file in GeoGig plugin 1aa19b4558c03c3ad3baaa55a755ed80b3e2896b Add missing LZ4 library to GeoGig assembly XML 25881f291526610f4506e34f8b1dedadcd937964 Merge pull request #2076 from thinknirmal/master 9d212d859e23c6ddd486437a06557e2a5676d3f1 Merge pull request #2092 from lavoiej/memory-usage-info c851665551a65c66205cd217cbb4086d069098f4 Merge pull request #2085 from tbarsballe/license 4ef1c02afd3b313e7866c147c7e0aa8c68d02320 Merge pull request #2102 from tbarsballe/GEOS-7900 56d9d09a286df7cf47a9e16c97e6c65b70091f2f Organize imports for geogig plugin 4fd4808aa546da56ed1d7641ea13ea8cc9365ceb Moving metadata payloads out of the main tables 30e785da4de58d7e3134b5b448b1482f11923673 Allow more parallelization during load by using a concurrent structure b1ecec1737ce0f18f5fdac4d6100d8463c382d32 Merge pull request #2106 from aaime/gwc_init_parallel2

fdaea0193866c9a2efd6b7f6bbffb63165661578 Strawman implementation of the opensearch service

Further checking the logs shows a start up failure:

2017-02-20 22:11:09.348:WARN:oejw.WebAppContext:main: Failed startup of context o.e.j.w.WebAppContext@anonymised.com{/geoserver,file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/,STARTING}{/geoserver} org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘wcsURLMapping’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-wcs-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘catalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘localWorkspaceCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘advertisedCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘advertisedCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘secureCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘accessRulesDao’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationSecurityContext.xml]: Cannot resolve reference to bean ‘rawCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘rawCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Initialization of bean failed; nested exception is java.lang.RuntimeException: java.lang.NullPointerException

…

To repeat: catalog → localWorkspaceCatalog → advertisedCatalog → secureCatalog → accessRulesDao → rawCatalog

…

Watching this untangle to the end:

Caused by: java.lang.NullPointerException at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:488) at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:387) at org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36) at org.geoserver.config.GeoServerLoader.postProcessBeforeInitialization(GeoServerLoader.java:258) at org.geoserver.config.GeoServerLoaderProxy.postProcessBeforeInitialization(GeoServerLoaderProxy.java:59)

The working tests do not have these startup problems :slight_smile:

···

Jody Garnett

2

I also see a number of MalformedURLExceptions in the logs of the failing cite tests:

Fatal Error: Error in call to extension function {public org.w3c.dom.NodeList com.occamlab.te.TECore.request(org.w3c.dom.Document,java.lang.String) throws java.lang.Throwable}: Exception in extension function java.net.MalformedURLException: no protocol: ?service=WFS&version=1.0.0&request=GetCapabilities; SystemID: file:/var/lib/jenkins/workspace/geoserver-cite/tools/target/work/~2Fvar~2Flib~2Fjenkins~2Fworkspace~2Fgeoserver-cite~2Ftools~2Fengine~2Fscripts~2Fwfs-1.0.0~2Fctl~2Fwfs.xml/wfs$test1.0.0-basic-getcapabilities-get-1.test; Line#: 45; Column#: -1
     [exec] Feb 20, 2017 11:24:46 PM com.occamlab.te.TECore executeTest
     [exec] SEVERE: SaxonApiException

On the subject of the cite tests, I cannot seem to find the run.sh script responsible for initiating these tests in version control anywhere. Unless someone can point me to its location, I would like to add it. (geoserver/geoserver seems like the most appropriate repo, perhaps in the build directory?)

Torben

···

On Mon, Feb 20, 2017 at 3:14 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

With the build back we have some cite test failures on WFS.

Last working test on master:

First broken test on master:

Between those two tests we have:

99c8df43e044a4ec30570dabf9272fdc01b4ea24 Merge pull request #2118 from tbarsballe/netcdf-out-fixup e8663e832241f72de186f843aa8f40f92d67bf15 Migrate MultiDimDataStore to ContentDataStore c69fa92b39c563db120a2a0413d868586a7304a0 Merge pull request #2116 from aaime/parallel_catalog_load d4bb0f8caa49c80cab9ed4ee469c5bffdedc4f0e Adding EO metadata templates bdb599e52e0dc214233d6cbd8b50110367dbbc7f [GEOS-7915] Can not display table based pages in Turkish locale 50461e0eee15dd107281aa40265ce7a5c308e68f GSIP-155 follow up: parallelizing catalog loading on the IO side faaa08176c4ada11baf316ba6fa13d61e1e0cd5a Merge pull request #2115 from aaime/gwc_memory_catalog c7fd3a2bab20da83ead80c78103ceebfc2698392 DefaultTileLayerCatalog to mimick the GS own default catalog and keep everything in memory 3d9396a70ffd5a8cd026d2d3c87b81a94dba32b6 Merge pull request #2065 from dvntucker/geos_7937 da457521c5bbf9621e179e7041f260e1801d3870 [GEOS-7937] - Change resource pool to explicitly check URL string fore file-ness fdc360699235a832c1111215b5b4a7a8b353dc86 Remove errant resource file in GeoGig plugin 1aa19b4558c03c3ad3baaa55a755ed80b3e2896b Add missing LZ4 library to GeoGig assembly XML 25881f291526610f4506e34f8b1dedadcd937964 Merge pull request #2076 from thinknirmal/master 9d212d859e23c6ddd486437a06557e2a5676d3f1 Merge pull request #2092 from lavoiej/memory-usage-info c851665551a65c66205cd217cbb4086d069098f4 Merge pull request #2085 from tbarsballe/license 4ef1c02afd3b313e7866c147c7e0aa8c68d02320 Merge pull request #2102 from tbarsballe/GEOS-7900 56d9d09a286df7cf47a9e16c97e6c65b70091f2f Organize imports for geogig plugin 4fd4808aa546da56ed1d7641ea13ea8cc9365ceb Moving metadata payloads out of the main tables 30e785da4de58d7e3134b5b448b1482f11923673 Allow more parallelization during load by using a concurrent structure b1ecec1737ce0f18f5fdac4d6100d8463c382d32 Merge pull request #2106 from aaime/gwc_init_parallel2

fdaea0193866c9a2efd6b7f6bbffb63165661578 Strawman implementation of the opensearch service

Further checking the logs shows a start up failure:

2017-02-20 22:11:09.348:WARN:oejw.WebAppContext:main: Failed startup of context o.e.j.w.WebAppContext@anonymised.com{/geoserver,file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/,STARTING}{/geoserver} org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘wcsURLMapping’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-wcs-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘catalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘localWorkspaceCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘advertisedCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘advertisedCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘secureCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘accessRulesDao’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationSecurityContext.xml]: Cannot resolve reference to bean ‘rawCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘rawCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Initialization of bean failed; nested exception is java.lang.RuntimeException: java.lang.NullPointerException

…

To repeat: catalog → localWorkspaceCatalog → advertisedCatalog → secureCatalog → accessRulesDao → rawCatalog

…

Watching this untangle to the end:

Caused by: java.lang.NullPointerException at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:488) at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:387) at org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36) at org.geoserver.config.GeoServerLoader.postProcessBeforeInitialization(GeoServerLoader.java:258) at org.geoserver.config.GeoServerLoaderProxy.postProcessBeforeInitialization(GeoServerLoaderProxy.java:59)

The working tests do not have these startup problems :slight_smile:

–

Jody Garnett

Check out the vibrant tech community on one of the world’s most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@anonymised.com.366…sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

3

Hey
Had a quick,keep looking, it’s my fault, fails during catalog loading. The cite data dirs are ancient, probably miss the default ws configuration.
Will fix ASAP.

Cheers
Andrea

···

Il 21 Feb 2017 00:59, “Torben Barsballe” <tbarsballe@anonymised.com.> ha scritto:

I also see a number of MalformedURLExceptions in the logs of the failing cite tests:

Fatal Error: Error in call to extension function {public org.w3c.dom.NodeList com.occamlab.te.TECore.request(org.w3c.dom.Document,java.lang.String) throws java.lang.Throwable}: Exception in extension function [java.net](http://java.net).MalformedURLException: no protocol: ?service=WFS&version=1.0.0&request=GetCapabilities; SystemID: file:/var/lib/jenkins/workspace/geoserver-cite/tools/target/work/~2Fvar~2Flib~2Fjenkins~2Fworkspace~2Fgeoserver-cite~2Ftools~2Fengine~2Fscripts~2Fwfs-1.0.0~2Fctl~2Fwfs.xml/wfs$test1.0.0-basic-getcapabilities-get-1.test; Line#: 45; Column#: -1
     [exec] Feb 20, 2017 11:24:46 PM com.occamlab.te.TECore executeTest
     [exec] SEVERE: SaxonApiException

On the subject of the cite tests, I cannot seem to find the run.sh script responsible for initiating these tests in version control anywhere. Unless someone can point me to its location, I would like to add it. (geoserver/geoserver seems like the most appropriate repo, perhaps in the build directory?)

Torben

Check out the vibrant tech community on one of the world’s most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@anonymised.com.366…sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

On Mon, Feb 20, 2017 at 3:14 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

With the build back we have some cite test failures on WFS.

Last working test on master:

First broken test on master:

Between those two tests we have:

99c8df43e044a4ec30570dabf9272fdc01b4ea24 Merge pull request #2118 from tbarsballe/netcdf-out-fixup e8663e832241f72de186f843aa8f40f92d67bf15 Migrate MultiDimDataStore to ContentDataStore c69fa92b39c563db120a2a0413d868586a7304a0 Merge pull request #2116 from aaime/parallel_catalog_load d4bb0f8caa49c80cab9ed4ee469c5bffdedc4f0e Adding EO metadata templates bdb599e52e0dc214233d6cbd8b50110367dbbc7f [GEOS-7915] Can not display table based pages in Turkish locale 50461e0eee15dd107281aa40265ce7a5c308e68f GSIP-155 follow up: parallelizing catalog loading on the IO side faaa08176c4ada11baf316ba6fa13d61e1e0cd5a Merge pull request #2115 from aaime/gwc_memory_catalog c7fd3a2bab20da83ead80c78103ceebfc2698392 DefaultTileLayerCatalog to mimick the GS own default catalog and keep everything in memory 3d9396a70ffd5a8cd026d2d3c87b81a94dba32b6 Merge pull request #2065 from dvntucker/geos_7937 da457521c5bbf9621e179e7041f260e1801d3870 [GEOS-7937] - Change resource pool to explicitly check URL string fore file-ness fdc360699235a832c1111215b5b4a7a8b353dc86 Remove errant resource file in GeoGig plugin 1aa19b4558c03c3ad3baaa55a755ed80b3e2896b Add missing LZ4 library to GeoGig assembly XML 25881f291526610f4506e34f8b1dedadcd937964 Merge pull request #2076 from thinknirmal/master 9d212d859e23c6ddd486437a06557e2a5676d3f1 Merge pull request #2092 from lavoiej/memory-usage-info c851665551a65c66205cd217cbb4086d069098f4 Merge pull request #2085 from tbarsballe/license 4ef1c02afd3b313e7866c147c7e0aa8c68d02320 Merge pull request #2102 from tbarsballe/GEOS-7900 56d9d09a286df7cf47a9e16c97e6c65b70091f2f Organize imports for geogig plugin 4fd4808aa546da56ed1d7641ea13ea8cc9365ceb Moving metadata payloads out of the main tables 30e785da4de58d7e3134b5b448b1482f11923673 Allow more parallelization during load by using a concurrent structure b1ecec1737ce0f18f5fdac4d6100d8463c382d32 Merge pull request #2106 from aaime/gwc_init_parallel2

fdaea0193866c9a2efd6b7f6bbffb63165661578 Strawman implementation of the opensearch service

Further checking the logs shows a start up failure:

2017-02-20 22:11:09.348:WARN:oejw.WebAppContext:main: Failed startup of context o.e.j.w.WebAppContext@anonymised.com{/geoserver,file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/,STARTING}{/geoserver} org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘wcsURLMapping’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-wcs-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘catalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘localWorkspaceCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘advertisedCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘advertisedCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘secureCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘accessRulesDao’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationSecurityContext.xml]: Cannot resolve reference to bean ‘rawCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘rawCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Initialization of bean failed; nested exception is java.lang.RuntimeException: java.lang.NullPointerException

…

To repeat: catalog → localWorkspaceCatalog → advertisedCatalog → secureCatalog → accessRulesDao → rawCatalog

…

Watching this untangle to the end:

Caused by: java.lang.NullPointerException at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:488) at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:387) at org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36) at org.geoserver.config.GeoServerLoader.postProcessBeforeInitialization(GeoServerLoader.java:258) at org.geoserver.config.GeoServerLoaderProxy.postProcessBeforeInitialization(GeoServerLoaderProxy.java:59)

The working tests do not have these startup problems :slight_smile:

–

Jody Garnett

Check out the vibrant tech community on one of the world’s most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@anonymised.comrge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

4

Fixed

Cheers
Andrea

···

On Tue, Feb 21, 2017 at 7:19 AM, Andrea Aime <andrea.aime@anonymised.com> wrote:

Hey
Had a quick,keep looking, it’s my fault, fails during catalog loading. The cite data dirs are ancient, probably miss the default ws configuration.
Will fix ASAP.

Cheers

Andrea

–

Il 21 Feb 2017 00:59, “Torben Barsballe” <tbarsballe@anonymised.com> ha scritto:

I also see a number of MalformedURLExceptions in the logs of the failing cite tests:

Fatal Error: Error in call to extension function {public org.w3c.dom.NodeList com.occamlab.te.TECore.request(org.w3c.dom.Document,java.lang.String) throws java.lang.Throwable}: Exception in extension function [java.net](http://java.net).MalformedURLException: no protocol: ?service=WFS&version=1.0.0&request=GetCapabilities; SystemID: file:/var/lib/jenkins/workspace/geoserver-cite/tools/target/work/~2Fvar~2Flib~2Fjenkins~2Fworkspace~2Fgeoserver-cite~2Ftools~2Fengine~2Fscripts~2Fwfs-1.0.0~2Fctl~2Fwfs.xml/wfs$test1.0.0-basic-getcapabilities-get-1.test; Line#: 45; Column#: -1
     [exec] Feb 20, 2017 11:24:46 PM com.occamlab.te.TECore executeTest
     [exec] SEVERE: SaxonApiException

On the subject of the cite tests, I cannot seem to find the run.sh script responsible for initiating these tests in version control anywhere. Unless someone can point me to its location, I would like to add it. (geoserver/geoserver seems like the most appropriate repo, perhaps in the build directory?)

Torben

Check out the vibrant tech community on one of the world’s most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@anonymised.comrge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

On Mon, Feb 20, 2017 at 3:14 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

With the build back we have some cite test failures on WFS.

Last working test on master:

First broken test on master:

Between those two tests we have:

99c8df43e044a4ec30570dabf9272fdc01b4ea24 Merge pull request #2118 from tbarsballe/netcdf-out-fixup e8663e832241f72de186f843aa8f40f92d67bf15 Migrate MultiDimDataStore to ContentDataStore c69fa92b39c563db120a2a0413d868586a7304a0 Merge pull request #2116 from aaime/parallel_catalog_load d4bb0f8caa49c80cab9ed4ee469c5bffdedc4f0e Adding EO metadata templates bdb599e52e0dc214233d6cbd8b50110367dbbc7f [GEOS-7915] Can not display table based pages in Turkish locale 50461e0eee15dd107281aa40265ce7a5c308e68f GSIP-155 follow up: parallelizing catalog loading on the IO side faaa08176c4ada11baf316ba6fa13d61e1e0cd5a Merge pull request #2115 from aaime/gwc_memory_catalog c7fd3a2bab20da83ead80c78103ceebfc2698392 DefaultTileLayerCatalog to mimick the GS own default catalog and keep everything in memory 3d9396a70ffd5a8cd026d2d3c87b81a94dba32b6 Merge pull request #2065 from dvntucker/geos_7937 da457521c5bbf9621e179e7041f260e1801d3870 [GEOS-7937] - Change resource pool to explicitly check URL string fore file-ness fdc360699235a832c1111215b5b4a7a8b353dc86 Remove errant resource file in GeoGig plugin 1aa19b4558c03c3ad3baaa55a755ed80b3e2896b Add missing LZ4 library to GeoGig assembly XML 25881f291526610f4506e34f8b1dedadcd937964 Merge pull request #2076 from thinknirmal/master 9d212d859e23c6ddd486437a06557e2a5676d3f1 Merge pull request #2092 from lavoiej/memory-usage-info c851665551a65c66205cd217cbb4086d069098f4 Merge pull request #2085 from tbarsballe/license 4ef1c02afd3b313e7866c147c7e0aa8c68d02320 Merge pull request #2102 from tbarsballe/GEOS-7900 56d9d09a286df7cf47a9e16c97e6c65b70091f2f Organize imports for geogig plugin 4fd4808aa546da56ed1d7641ea13ea8cc9365ceb Moving metadata payloads out of the main tables 30e785da4de58d7e3134b5b448b1482f11923673 Allow more parallelization during load by using a concurrent structure b1ecec1737ce0f18f5fdac4d6100d8463c382d32 Merge pull request #2106 from aaime/gwc_init_parallel2

fdaea0193866c9a2efd6b7f6bbffb63165661578 Strawman implementation of the opensearch service

Further checking the logs shows a start up failure:

2017-02-20 22:11:09.348:WARN:oejw.WebAppContext:main: Failed startup of context o.e.j.w.WebAppContext@anonymised.com{/geoserver,file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/,STARTING}{/geoserver} org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘wcsURLMapping’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-wcs-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘catalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘localWorkspaceCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘advertisedCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘advertisedCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘secureCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘accessRulesDao’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationSecurityContext.xml]: Cannot resolve reference to bean ‘rawCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘rawCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Initialization of bean failed; nested exception is java.lang.RuntimeException: java.lang.NullPointerException

…

To repeat: catalog → localWorkspaceCatalog → advertisedCatalog → secureCatalog → accessRulesDao → rawCatalog

…

Watching this untangle to the end:

Caused by: java.lang.NullPointerException at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:488) at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:387) at org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36) at org.geoserver.config.GeoServerLoader.postProcessBeforeInitialization(GeoServerLoader.java:258) at org.geoserver.config.GeoServerLoaderProxy.postProcessBeforeInitialization(GeoServerLoaderProxy.java:59)

The working tests do not have these startup problems :slight_smile:

–

Jody Garnett

Check out the vibrant tech community on one of the world’s most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@anonymised.comrge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313

fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

5

What was actually missing - in case upgrades in the wild run into the problem?

Like was cite so old it was missing the “default” setting?

···

On Tue, Feb 21, 2017 at 7:19 AM, Andrea Aime <andrea.aime@anonymised.com> wrote:

Hey
Had a quick,keep looking, it’s my fault, fails during catalog loading. The cite data dirs are ancient, probably miss the default ws configuration.
Will fix ASAP.

Cheers

Andrea

Il 21 Feb 2017 00:59, “Torben Barsballe” <tbarsballe@anonymised.com> ha scritto:

I also see a number of MalformedURLExceptions in the logs of the failing cite tests:

Fatal Error: Error in call to extension function {public org.w3c.dom.NodeList com.occamlab.te.TECore.request(org.w3c.dom.Document,java.lang.String) throws java.lang.Throwable}: Exception in extension function [java.net](http://java.net).MalformedURLException: no protocol: ?service=WFS&version=1.0.0&request=GetCapabilities; SystemID: file:/var/lib/jenkins/workspace/geoserver-cite/tools/target/work/~2Fvar~2Flib~2Fjenkins~2Fworkspace~2Fgeoserver-cite~2Ftools~2Fengine~2Fscripts~2Fwfs-1.0.0~2Fctl~2Fwfs.xml/wfs$test1.0.0-basic-getcapabilities-get-1.test; Line#: 45; Column#: -1
     [exec] Feb 20, 2017 11:24:46 PM com.occamlab.te.TECore executeTest
     [exec] SEVERE: SaxonApiException

On the subject of the cite tests, I cannot seem to find the run.sh script responsible for initiating these tests in version control anywhere. Unless someone can point me to its location, I would like to add it. (geoserver/geoserver seems like the most appropriate repo, perhaps in the build directory?)

Torben

Check out the vibrant tech community on one of the world’s most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

On Mon, Feb 20, 2017 at 3:14 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

With the build back we have some cite test failures on WFS.

Last working test on master:

First broken test on master:

Between those two tests we have:

99c8df43e044a4ec30570dabf9272fdc01b4ea24 Merge pull request #2118 from tbarsballe/netcdf-out-fixup e8663e832241f72de186f843aa8f40f92d67bf15 Migrate MultiDimDataStore to ContentDataStore c69fa92b39c563db120a2a0413d868586a7304a0 Merge pull request #2116 from aaime/parallel_catalog_load d4bb0f8caa49c80cab9ed4ee469c5bffdedc4f0e Adding EO metadata templates bdb599e52e0dc214233d6cbd8b50110367dbbc7f [GEOS-7915] Can not display table based pages in Turkish locale 50461e0eee15dd107281aa40265ce7a5c308e68f GSIP-155 follow up: parallelizing catalog loading on the IO side faaa08176c4ada11baf316ba6fa13d61e1e0cd5a Merge pull request #2115 from aaime/gwc_memory_catalog c7fd3a2bab20da83ead80c78103ceebfc2698392 DefaultTileLayerCatalog to mimick the GS own default catalog and keep everything in memory 3d9396a70ffd5a8cd026d2d3c87b81a94dba32b6 Merge pull request #2065 from dvntucker/geos_7937 da457521c5bbf9621e179e7041f260e1801d3870 [GEOS-7937] - Change resource pool to explicitly check URL string fore file-ness fdc360699235a832c1111215b5b4a7a8b353dc86 Remove errant resource file in GeoGig plugin 1aa19b4558c03c3ad3baaa55a755ed80b3e2896b Add missing LZ4 library to GeoGig assembly XML 25881f291526610f4506e34f8b1dedadcd937964 Merge pull request #2076 from thinknirmal/master 9d212d859e23c6ddd486437a06557e2a5676d3f1 Merge pull request #2092 from lavoiej/memory-usage-info c851665551a65c66205cd217cbb4086d069098f4 Merge pull request #2085 from tbarsballe/license 4ef1c02afd3b313e7866c147c7e0aa8c68d02320 Merge pull request #2102 from tbarsballe/GEOS-7900 56d9d09a286df7cf47a9e16c97e6c65b70091f2f Organize imports for geogig plugin 4fd4808aa546da56ed1d7641ea13ea8cc9365ceb Moving metadata payloads out of the main tables 30e785da4de58d7e3134b5b448b1482f11923673 Allow more parallelization during load by using a concurrent structure b1ecec1737ce0f18f5fdac4d6100d8463c382d32 Merge pull request #2106 from aaime/gwc_init_parallel2

fdaea0193866c9a2efd6b7f6bbffb63165661578 Strawman implementation of the opensearch service

Further checking the logs shows a start up failure:

2017-02-20 22:11:09.348:WARN:oejw.WebAppContext:main: Failed startup of context o.e.j.w.WebAppContext@anonymised.com{/geoserver,file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/,STARTING}{/geoserver} org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘wcsURLMapping’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-wcs-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘catalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘localWorkspaceCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘advertisedCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘advertisedCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Cannot resolve reference to bean ‘secureCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘accessRulesDao’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationSecurityContext.xml]: Cannot resolve reference to bean ‘rawCatalog’ while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name ‘rawCatalog’ defined in URL [jar:file:/var/lib/jenkins/workspace/geoserver-cite/geoserver/geoserver-2.11-SNAPSHOT/webapps/geoserver/WEB-INF/lib/gs-main-2.11-SNAPSHOT.jar!/applicationContext.xml]: Initialization of bean failed; nested exception is java.lang.RuntimeException: java.lang.NullPointerException

…

To repeat: catalog → localWorkspaceCatalog → advertisedCatalog → secureCatalog → accessRulesDao → rawCatalog

…

Watching this untangle to the end:

Caused by: java.lang.NullPointerException at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:488) at org.geoserver.config.GeoServerLoader.readCatalog(GeoServerLoader.java:387) at org.geoserver.config.DefaultGeoServerLoader.loadCatalog(DefaultGeoServerLoader.java:36) at org.geoserver.config.GeoServerLoader.postProcessBeforeInitialization(GeoServerLoader.java:258) at org.geoserver.config.GeoServerLoaderProxy.postProcessBeforeInitialization(GeoServerLoaderProxy.java:59)

The working tests do not have these startup problems :slight_smile:

–

Jody Garnett

Check out the vibrant tech community on one of the world’s most
engaging tech sites, SlashDot.org! http://sdm.link/slashdot

Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313

fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

6

On Tue, Feb 21, 2017 at 6:00 PM, Jody Garnett <jody.garnett@anonymised.com>
wrote:

What was actually missing - in case upgrades in the wild run into the
problem?

The default.xml indicator:

https://github.com/geoserver/geoserver/blob/master/data/release/workspaces/default.xml

But I did not add it in the CITE tests, changed the code so that it works
also without like the old code did.
So there should not be a need for upgrade instructions

Cheers
Andrea

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

-------------------------------------------------------

7

Thanks Andrea, cite tests have passed and I am kicking off the release process with the following revisions:

version = 2.11-SNAPSHOT

git revision = ff37acf9c5512ee99ea3e6efa0fb16bd5c747371

git branch = origin/master

build date = 21-Feb-2017 10:41

geotools version = 17-SNAPSHOT

geotools revision = 1dd53ef2f2234a98752283f405149f3e7bfc4d3b

geowebcache version = 1.11-SNAPSHOT

geowebcache revision = f21c277474fcde708d2102e6efea6ea94633e7a4/f21c2

I am trying to think what we would like to highlight in this release announcement:

  • faster startup (obviously)

  • new extensions

  • “Opaque container” (we can link to docs)

  • layer group security, we can provide an example

Anything else we should be on the look out for?

···

On 21 February 2017 at 09:04, Andrea Aime <andrea.aime@anonymised.com> wrote:

–
Jody Garnett

On Tue, Feb 21, 2017 at 6:00 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

What was actually missing - in case upgrades in the wild run into the problem?

The default.xml indicator:

https://github.com/geoserver/geoserver/blob/master/data/release/workspaces/default.xml

But I did not add it in the CITE tests, changed the code so that it works also without like the old code did.
So there should not be a need for upgrade instructions

Cheers

Andrea

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313

fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.