[Geoserver-devel] WCS 1.1.1 Heisenbug on 2.9.x

GeoServer GeoServer Developer
1

I’ve been running into an odd test failure in the gs-wcs1_1 module. When I run this test, I get the following exception in testDeferredLoading(org.geoserver.wcs.GetCoverageTest):

org.vfny.geoserver.wcs.WcsException: org.geotools.data.DataSourceException: Unable to create this mosaic
at org.geoserver.wcs.DefaultWebCoverageService111.getCoverage(DefaultWebCoverageService111.java:565)
at org.geoserver.wcs.AbstractGetCoverageTest.executeGetCoverageKvp(AbstractGetCoverageTest.java:67)
at org.geoserver.wcs.GetCoverageTest.testDeferredLoading(GetCoverageTest.java:620)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
Caused by: org.geotools.data.DataSourceException: Unable to create this mosaic
at org.geotools.gce.imagemosaic.RasterLayerResponse.prepareResponse(RasterLayerResponse.java:1348)
at org.geotools.gce.imagemosaic.RasterLayerResponse.processRequest(RasterLayerResponse.java:1228)
at org.geotools.gce.imagemosaic.RasterLayerResponse.createResponse(RasterLayerResponse.java:1194)
at org.geotools.gce.imagemosaic.RasterManager.read(RasterManager.java:1157)
at org.geotools.gce.imagemosaic.ImageMosaicReader.read(ImageMosaicReader.java:894)
at org.geotools.gce.imagemosaic.ImageMosaicReader.read(ImageMosaicReader.java:873)
at org.geotools.gce.imagemosaic.ImageMosaicReader.read(ImageMosaicReader.java:807)
at org.geoserver.catalog.CoverageDimensionCustomizerReader.read(CoverageDimensionCustomizerReader.java:243)
at org.geoserver.catalog.CoverageDimensionCustomizerReader.read(CoverageDimensionCustomizerReader.java:233)
at org.geoserver.wcs.DefaultWebCoverageService111.getCoverage(DefaultWebCoverageService111.java:358)
… 36 more
Caused by: java.io.IOException: java.lang.NullPointerException
at org.geotools.gce.imagemosaic.RasterLayerResponse$GranuleCollector.collectGranules(RasterLayerResponse.java:516)
at org.geotools.gce.imagemosaic.RasterLayerResponse$GranuleCollector.access$2400(RasterLayerResponse.java:332)
at org.geotools.gce.imagemosaic.RasterLayerResponse$MosaicProducer.produce(RasterLayerResponse.java:1072)
at org.geotools.gce.imagemosaic.RasterLayerResponse$MosaicProducer.access$3100(RasterLayerResponse.java:882)
at org.geotools.gce.imagemosaic.RasterLayerResponse.prepareResponse(RasterLayerResponse.java:1296)
… 45 more
Caused by: java.lang.NullPointerException
at org.geotools.gce.imagemosaic.RasterLayerResponse$GranuleCollector.collectGranules(RasterLayerResponse.java:476)

I get this failure if I run the tests using maven or in eclipse while in debug mode. If I run the tests normally in eclipse, they pass without error.

I’ve had a few other people with similar environments run these tests, and none of them were able to reproduce my issue.

From what I can tell, when the test failure occurs, the RasterLayerResponse$GranualCollector is using a PlanarImage with a null colorModel, which causes the NPE when we try and get the alpha from the colorModel.

Does anyone have an idea why I am getting this failure (and more importantly, why no one else is?)

Thanks,

Torben

2

On Thu, Sep 29, 2016 at 9:23 PM, Torben Barsballe <
tbarsballe@anonymised.com> wrote:

Caused by: java.io.IOException: java.lang.NullPointerException
    at org.geotools.gce.imagemosaic.RasterLayerResponse$GranuleCollector.
collectGranules(RasterLayerResponse.java:516)
    at org.geotools.gce.imagemosaic.RasterLayerResponse$
GranuleCollector.access$2400(RasterLayerResponse.java:332)
    at org.geotools.gce.imagemosaic.RasterLayerResponse$
MosaicProducer.produce(RasterLayerResponse.java:1072)
    at org.geotools.gce.imagemosaic.RasterLayerResponse$
MosaicProducer.access$3100(RasterLayerResponse.java:882)
    at org.geotools.gce.imagemosaic.RasterLayerResponse.prepareResponse(
RasterLayerResponse.java:1296)
    ... 45 more
Caused by: java.lang.NullPointerException
    at org.geotools.gce.imagemosaic.RasterLayerResponse$GranuleCollector.
collectGranules(RasterLayerResponse.java:476)

I get this failure if I run the tests using maven or in eclipse while in
debug mode. If I run the tests normally in eclipse, they pass without error.
I've had a few other people with similar environments run these tests, and
none of them were able to reproduce my issue.

From what I can tell, when the test failure occurs, the
RasterLayerResponse$GranualCollector is using a PlanarImage with a null
colorModel, which causes the NPE when we try and get the alpha from the
colorModel.

An image with a null color model is indeed really weird, I cannot remember
stumbling into one so far.

Does anyone have an idea why I am getting this failure (and more

importantly, why no one else is?)

Could it be related to the usage of some native JAI installation that you
might not be aware of?

Cheers
Andrea

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

-------------------------------------------------------

3

I shouldn’t have any lingering native JAI causing issues (that has definately been a problem for me in the past, but I though I had cleared up all the isses), but it is certaintly a possibility.

Torben

···

On Fri, Sep 30, 2016 at 1:52 AM, Andrea Aime <andrea.aime@anonymised.com> wrote:

On Thu, Sep 29, 2016 at 9:23 PM, Torben Barsballe <tbarsballe@anonymised.com> wrote:

Caused by: java.io.IOException: java.lang.NullPointerException

at org.geotools.gce.imagemosaic.RasterLayerResponse$GranuleCollector.collectGranules(RasterLayerResponse.java:516)
at org.geotools.gce.imagemosaic.RasterLayerResponse$GranuleCollector.access$2400(RasterLayerResponse.java:332)
at org.geotools.gce.imagemosaic.RasterLayerResponse$MosaicProducer.produce(RasterLayerResponse.java:1072)
at org.geotools.gce.imagemosaic.RasterLayerResponse$MosaicProducer.access$3100(RasterLayerResponse.java:882)
at org.geotools.gce.imagemosaic.RasterLayerResponse.prepareResponse(RasterLayerResponse.java:1296)
… 45 more
Caused by: java.lang.NullPointerException
at org.geotools.gce.imagemosaic.RasterLayerResponse$GranuleCollector.collectGranules(RasterLayerResponse.java:476)

I get this failure if I run the tests using maven or in eclipse while in debug mode. If I run the tests normally in eclipse, they pass without error.

I’ve had a few other people with similar environments run these tests, and none of them were able to reproduce my issue.

From what I can tell, when the test failure occurs, the RasterLayerResponse$GranualCollector is using a PlanarImage with a null colorModel, which causes the NPE when we try and get the alpha from the colorModel.

An image with a null color model is indeed really weird, I cannot remember stumbling into one so far.

Does anyone have an idea why I am getting this failure (and more importantly, why no one else is?)

Could it be related to the usage of some native JAI installation that you might not be aware of?

Cheers
Andrea

–

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
phone: +39 0584 962313

fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.