[Geoserver-devel] App-Schema online tests

Hi Ben

In yesterday’s meeting, we discussed running automated app-schema tests. For now, lets run them against the same databases used for the geotools online database tests.

You said you have a simple command that can run the app-schema tests in Jenkins? Do you have access to the ares Jenkins? If so, the database connection parameters for oracle and postgis can be found in the build configuration of the “geotool-master-online” job. Otherwise, do you want to send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the “spatial companion” component needed for the 3d tests - I’ll see what I can do about getting that installed.

Torben

Ben - is this the spatial companion library we need?

Thanks,

Torben

···

On Wed, Apr 15, 2015 at 9:54 AM, Torben Barsballe <tbarsballe@…3839…> wrote:

Hi Ben

In yesterday’s meeting, we discussed running automated app-schema tests. For now, lets run them against the same databases used for the geotools online database tests.

You said you have a simple command that can run the app-schema tests in Jenkins? Do you have access to the ares Jenkins? If so, the database connection parameters for oracle and postgis can be found in the build configuration of the “geotool-master-online” job. Otherwise, do you want to send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the “spatial companion” component needed for the 3d tests - I’ll see what I can do about getting that installed.

Torben

Torben,

I have web access to ares Jenkins, but it would be great if you could set up the Jenkins build (perhaps called "geoserver-master-app-schema"?) as this would confirm that the instructions work, and we would then have more people who know about it. :slight_smile:

I am happy to help debug any problems.

The instructions are here:
http://docs.geoserver.org/latest/en/developer/programming-guide/app-schema/index.html

To configure the fixtures we need to install postgis.properties and oracle.properties in ~/.geoserver and we hope ones identical to those in ~/.geotools will work (where ~ is the home directory of the build slave). You may need to add dbtype of postgis or oracle.

The build procedure is:

cd src/extension/app-schema

mvn -nsu -Djava.awt.headless=true -Dtest.maxHeapSize=1024m -Dtest.maxPermSize=128m -Papp-schema-online-test clean test

You could trigger this by the completion of geoserver-master.

If using postgis 2.1 you also need to create two functions in the database:

-- missing functions required for refdataset sql but removed in postgis 2.1
create or replace function public.ndims(g geometry)
returns smallint as $$
begin
     return public.st_ndims(g);
end;
$$ language plpgsql immutable strict;
create or replace function public.srid(g geometry)
returns integer as $$
begin
     return public.st_srid(g);
end;
$$ language plpgsql immutable strict;

3D test support on PostGIS requires PostGIS 2 and an insert to add SRID 4979 (see the app-schema test guide).

3D support on Oracle requires SC40. Your link below is correct; in the manual you will find this deep link to the software buried in the instructions (see 3D section at the end).
http://www.spatialdbadvisor.com/files/SC4O.zip

You will likely need Rini's instructions to get SC4O to build (wsrv5 is a host name):
https://www.seegrid.csiro.au/wiki/Infosrvices/AppSchemaTestDatabase

I have copied Niels who implemented a lot of 3D functionality and tests. I am not blaming him, just identifying him as a possible alternative resource. :slight_smile:

Phew! That is just about it. The fact that I am writing this email suggests that this section of the developer guide needs work; once you are happy with the new Jenkins job, you are best positioned to update the documentation, so please submit a pull request!

More resources:

Workaround for running without Oracle:
https://jira.codehaus.org/browse/GEOS-6883

Reference data set:
https://www.seegrid.csiro.au/wiki/Infosrvices/DataReferenceSet

CSIRO build slave documentation:
https://www.seegrid.csiro.au/wiki/Infosrvices/JenkinsGeoserverMasterTechnicalNotes

Kind regards,
Ben.

On 16/04/15 05:36, Torben Barsballe wrote:

Ben - is this
<http://spatialdbadvisor.com/oracle_spatial_tips_tricks/280/announcing-the-spatial-companion-for-oracle-sc4o&gt;
the spatial companion library we need?

Thanks,
Torben

On Wed, Apr 15, 2015 at 9:54 AM, Torben Barsballe <
tbarsballe@anonymised.com> wrote:

Hi Ben

In yesterday's meeting, we discussed running automated app-schema tests.
For now, lets run them against the same databases used for the geotools
online database tests.

You said you have a simple command that can run the app-schema tests in
Jenkins? Do you have access to the ares Jenkins? If so, the database
connection parameters for oracle and postgis can be found in the build
configuration of the "geotool-master-online" job. Otherwise, do you want to
send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the "spatial companion"
component needed for the 3d tests - I'll see what I can do about getting
that installed.

Torben

--
Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz>
New Zealand

As part of getting these tests working, I am upgrading the geoserver oracle dependancies to Oracle 12 / ojdbc7. Pull request here: https://github.com/geoserver/geoserver/pull/1021

Note that GeoTools has already been updated to use ojdbc7.

Torben

···

On Wed, Apr 15, 2015 at 2:09 PM, Ben Caradoc-Davies <ben@anonymised.com> wrote:

Torben,

I have web access to ares Jenkins, but it would be great if you could set up the Jenkins build (perhaps called “geoserver-master-app-schema”?) as this would confirm that the instructions work, and we would then have more people who know about it. :slight_smile:

I am happy to help debug any problems.

The instructions are here:
http://docs.geoserver.org/latest/en/developer/programming-guide/app-schema/index.html

To configure the fixtures we need to install postgis.properties and oracle.properties in ~/.geoserver and we hope ones identical to those in ~/.geotools will work (where ~ is the home directory of the build slave). You may need to add dbtype of postgis or oracle.

The build procedure is:

cd src/extension/app-schema

mvn -nsu -Djava.awt.headless=true -Dtest.maxHeapSize=1024m -Dtest.maxPermSize=128m -Papp-schema-online-test clean test

You could trigger this by the completion of geoserver-master.

If using postgis 2.1 you also need to create two functions in the database:

– missing functions required for refdataset sql but removed in postgis 2.1
create or replace function public.ndims(g geometry)
returns smallint as $$
begin
return public.st_ndims(g);
end;
$$ language plpgsql immutable strict;
create or replace function public.srid(g geometry)
returns integer as $$
begin
return public.st_srid(g);
end;
$$ language plpgsql immutable strict;

3D test support on PostGIS requires PostGIS 2 and an insert to add SRID 4979 (see the app-schema test guide).

3D support on Oracle requires SC40. Your link below is correct; in the manual you will find this deep link to the software buried in the instructions (see 3D section at the end).
http://www.spatialdbadvisor.com/files/SC4O.zip

You will likely need Rini’s instructions to get SC4O to build (wsrv5 is a host name):
https://www.seegrid.csiro.au/wiki/Infosrvices/AppSchemaTestDatabase

I have copied Niels who implemented a lot of 3D functionality and tests. I am not blaming him, just identifying him as a possible alternative resource. :slight_smile:

Phew! That is just about it. The fact that I am writing this email suggests that this section of the developer guide needs work; once you are happy with the new Jenkins job, you are best positioned to update the documentation, so please submit a pull request!

More resources:

Workaround for running without Oracle:
https://jira.codehaus.org/browse/GEOS-6883

Reference data set:
https://www.seegrid.csiro.au/wiki/Infosrvices/DataReferenceSet

CSIRO build slave documentation:
https://www.seegrid.csiro.au/wiki/Infosrvices/JenkinsGeoserverMasterTechnicalNotes

Kind regards,
Ben.

On 16/04/15 05:36, Torben Barsballe wrote:

Ben - is this
<http://spatialdbadvisor.com/oracle_spatial_tips_tricks/280/announcing-the-spatial-companion-for-oracle-sc4o>

the spatial companion library we need?

Thanks,
Torben

On Wed, Apr 15, 2015 at 9:54 AM, Torben Barsballe <
tbarsballe@anonymised.com39…> wrote:

Hi Ben

In yesterday’s meeting, we discussed running automated app-schema tests.
For now, lets run them against the same databases used for the geotools
online database tests.

You said you have a simple command that can run the app-schema tests in
Jenkins? Do you have access to the ares Jenkins? If so, the database
connection parameters for oracle and postgis can be found in the build
configuration of the “geotool-master-online” job. Otherwise, do you want to
send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the “spatial companion”
component needed for the 3d tests - I’ll see what I can do about getting
that installed.

Torben


Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz>
New Zealand

Initial feedback is we should manage those versions in the dependencyManagement section.

···

On 21 April 2015 at 15:09, Torben Barsballe <tbarsballe@anonymised.com> wrote:

As part of getting these tests working, I am upgrading the geoserver oracle dependancies to Oracle 12 / ojdbc7. Pull request here: https://github.com/geoserver/geoserver/pull/1021

Note that GeoTools has already been updated to use ojdbc7.

Torben


BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF


Geoserver-devel mailing list
Geoserver-devel@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel


Jody Garnett

On Wed, Apr 15, 2015 at 2:09 PM, Ben Caradoc-Davies <ben@anonymised.com> wrote:

Torben,

I have web access to ares Jenkins, but it would be great if you could set up the Jenkins build (perhaps called “geoserver-master-app-schema”?) as this would confirm that the instructions work, and we would then have more people who know about it. :slight_smile:

I am happy to help debug any problems.

The instructions are here:
http://docs.geoserver.org/latest/en/developer/programming-guide/app-schema/index.html

To configure the fixtures we need to install postgis.properties and oracle.properties in ~/.geoserver and we hope ones identical to those in ~/.geotools will work (where ~ is the home directory of the build slave). You may need to add dbtype of postgis or oracle.

The build procedure is:

cd src/extension/app-schema

mvn -nsu -Djava.awt.headless=true -Dtest.maxHeapSize=1024m -Dtest.maxPermSize=128m -Papp-schema-online-test clean test

You could trigger this by the completion of geoserver-master.

If using postgis 2.1 you also need to create two functions in the database:

– missing functions required for refdataset sql but removed in postgis 2.1
create or replace function public.ndims(g geometry)
returns smallint as $$
begin
return public.st_ndims(g);
end;
$$ language plpgsql immutable strict;
create or replace function public.srid(g geometry)
returns integer as $$
begin
return public.st_srid(g);
end;
$$ language plpgsql immutable strict;

3D test support on PostGIS requires PostGIS 2 and an insert to add SRID 4979 (see the app-schema test guide).

3D support on Oracle requires SC40. Your link below is correct; in the manual you will find this deep link to the software buried in the instructions (see 3D section at the end).
http://www.spatialdbadvisor.com/files/SC4O.zip

You will likely need Rini’s instructions to get SC4O to build (wsrv5 is a host name):
https://www.seegrid.csiro.au/wiki/Infosrvices/AppSchemaTestDatabase

I have copied Niels who implemented a lot of 3D functionality and tests. I am not blaming him, just identifying him as a possible alternative resource. :slight_smile:

Phew! That is just about it. The fact that I am writing this email suggests that this section of the developer guide needs work; once you are happy with the new Jenkins job, you are best positioned to update the documentation, so please submit a pull request!

More resources:

Workaround for running without Oracle:
https://jira.codehaus.org/browse/GEOS-6883

Reference data set:
https://www.seegrid.csiro.au/wiki/Infosrvices/DataReferenceSet

CSIRO build slave documentation:
https://www.seegrid.csiro.au/wiki/Infosrvices/JenkinsGeoserverMasterTechnicalNotes

Kind regards,
Ben.

On 16/04/15 05:36, Torben Barsballe wrote:

Ben - is this
<http://spatialdbadvisor.com/oracle_spatial_tips_tricks/280/announcing-the-spatial-companion-for-oracle-sc4o>

the spatial companion library we need?

Thanks,
Torben

On Wed, Apr 15, 2015 at 9:54 AM, Torben Barsballe <
tbarsballe@anonymised.com39…> wrote:

Hi Ben

In yesterday’s meeting, we discussed running automated app-schema tests.
For now, lets run them against the same databases used for the geotools
online database tests.

You said you have a simple command that can run the app-schema tests in
Jenkins? Do you have access to the ares Jenkins? If so, the database
connection parameters for oracle and postgis can be found in the build
configuration of the “geotool-master-online” job. Otherwise, do you want to
send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the “spatial companion”
component needed for the 3d tests - I’ll see what I can do about getting
that installed.

Torben


Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz>
New Zealand

Updated to use dependencyManagement for version.

Merged to master

AppSchema tests are running now. Currently tracking down a permissions issue with Oracle. PostGIS and Oracle 3D support is still pending.

Torben

···

On Tue, Apr 21, 2015 at 3:48 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

Initial feedback is we should manage those versions in the dependencyManagement section.


Jody Garnett

On 21 April 2015 at 15:09, Torben Barsballe <tbarsballe@anonymised.com> wrote:

As part of getting these tests working, I am upgrading the geoserver oracle dependancies to Oracle 12 / ojdbc7. Pull request here: https://github.com/geoserver/geoserver/pull/1021

Note that GeoTools has already been updated to use ojdbc7.

Torben


BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF


Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

On Wed, Apr 15, 2015 at 2:09 PM, Ben Caradoc-Davies <ben@anonymised.com> wrote:

Torben,

I have web access to ares Jenkins, but it would be great if you could set up the Jenkins build (perhaps called “geoserver-master-app-schema”?) as this would confirm that the instructions work, and we would then have more people who know about it. :slight_smile:

I am happy to help debug any problems.

The instructions are here:
http://docs.geoserver.org/latest/en/developer/programming-guide/app-schema/index.html

To configure the fixtures we need to install postgis.properties and oracle.properties in ~/.geoserver and we hope ones identical to those in ~/.geotools will work (where ~ is the home directory of the build slave). You may need to add dbtype of postgis or oracle.

The build procedure is:

cd src/extension/app-schema

mvn -nsu -Djava.awt.headless=true -Dtest.maxHeapSize=1024m -Dtest.maxPermSize=128m -Papp-schema-online-test clean test

You could trigger this by the completion of geoserver-master.

If using postgis 2.1 you also need to create two functions in the database:

– missing functions required for refdataset sql but removed in postgis 2.1
create or replace function public.ndims(g geometry)
returns smallint as $$
begin
return public.st_ndims(g);
end;
$$ language plpgsql immutable strict;
create or replace function public.srid(g geometry)
returns integer as $$
begin
return public.st_srid(g);
end;
$$ language plpgsql immutable strict;

3D test support on PostGIS requires PostGIS 2 and an insert to add SRID 4979 (see the app-schema test guide).

3D support on Oracle requires SC40. Your link below is correct; in the manual you will find this deep link to the software buried in the instructions (see 3D section at the end).
http://www.spatialdbadvisor.com/files/SC4O.zip

You will likely need Rini’s instructions to get SC4O to build (wsrv5 is a host name):
https://www.seegrid.csiro.au/wiki/Infosrvices/AppSchemaTestDatabase

I have copied Niels who implemented a lot of 3D functionality and tests. I am not blaming him, just identifying him as a possible alternative resource. :slight_smile:

Phew! That is just about it. The fact that I am writing this email suggests that this section of the developer guide needs work; once you are happy with the new Jenkins job, you are best positioned to update the documentation, so please submit a pull request!

More resources:

Workaround for running without Oracle:
https://jira.codehaus.org/browse/GEOS-6883

Reference data set:
https://www.seegrid.csiro.au/wiki/Infosrvices/DataReferenceSet

CSIRO build slave documentation:
https://www.seegrid.csiro.au/wiki/Infosrvices/JenkinsGeoserverMasterTechnicalNotes

Kind regards,
Ben.

On 16/04/15 05:36, Torben Barsballe wrote:

Ben - is this
<http://spatialdbadvisor.com/oracle_spatial_tips_tricks/280/announcing-the-spatial-companion-for-oracle-sc4o>

the spatial companion library we need?

Thanks,
Torben

On Wed, Apr 15, 2015 at 9:54 AM, Torben Barsballe <
tbarsballe@anonymised.com39…> wrote:

Hi Ben

In yesterday’s meeting, we discussed running automated app-schema tests.
For now, lets run them against the same databases used for the geotools
online database tests.

You said you have a simple command that can run the app-schema tests in
Jenkins? Do you have access to the ares Jenkins? If so, the database
connection parameters for oracle and postgis can be found in the build
configuration of the “geotool-master-online” job. Otherwise, do you want to
send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the “spatial companion”
component needed for the 3d tests - I’ll see what I can do about getting
that installed.

Torben


Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz>
New Zealand

Thanks Torben that is great news.

···

On 22 April 2015 at 15:47, Torben Barsballe <tbarsballe@anonymised.com> wrote:

Updated to use dependencyManagement for version.

Merged to master

AppSchema tests are running now. Currently tracking down a permissions issue with Oracle. PostGIS and Oracle 3D support is still pending.

Torben


Jody Garnett

On Tue, Apr 21, 2015 at 3:48 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

Initial feedback is we should manage those versions in the dependencyManagement section.


Jody Garnett

On 21 April 2015 at 15:09, Torben Barsballe <tbarsballe@anonymised.com> wrote:

As part of getting these tests working, I am upgrading the geoserver oracle dependancies to Oracle 12 / ojdbc7. Pull request here: https://github.com/geoserver/geoserver/pull/1021

Note that GeoTools has already been updated to use ojdbc7.

Torben


BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF


Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

On Wed, Apr 15, 2015 at 2:09 PM, Ben Caradoc-Davies <ben@anonymised.com> wrote:

Torben,

I have web access to ares Jenkins, but it would be great if you could set up the Jenkins build (perhaps called “geoserver-master-app-schema”?) as this would confirm that the instructions work, and we would then have more people who know about it. :slight_smile:

I am happy to help debug any problems.

The instructions are here:
http://docs.geoserver.org/latest/en/developer/programming-guide/app-schema/index.html

To configure the fixtures we need to install postgis.properties and oracle.properties in ~/.geoserver and we hope ones identical to those in ~/.geotools will work (where ~ is the home directory of the build slave). You may need to add dbtype of postgis or oracle.

The build procedure is:

cd src/extension/app-schema

mvn -nsu -Djava.awt.headless=true -Dtest.maxHeapSize=1024m -Dtest.maxPermSize=128m -Papp-schema-online-test clean test

You could trigger this by the completion of geoserver-master.

If using postgis 2.1 you also need to create two functions in the database:

– missing functions required for refdataset sql but removed in postgis 2.1
create or replace function public.ndims(g geometry)
returns smallint as $$
begin
return public.st_ndims(g);
end;
$$ language plpgsql immutable strict;
create or replace function public.srid(g geometry)
returns integer as $$
begin
return public.st_srid(g);
end;
$$ language plpgsql immutable strict;

3D test support on PostGIS requires PostGIS 2 and an insert to add SRID 4979 (see the app-schema test guide).

3D support on Oracle requires SC40. Your link below is correct; in the manual you will find this deep link to the software buried in the instructions (see 3D section at the end).
http://www.spatialdbadvisor.com/files/SC4O.zip

You will likely need Rini’s instructions to get SC4O to build (wsrv5 is a host name):
https://www.seegrid.csiro.au/wiki/Infosrvices/AppSchemaTestDatabase

I have copied Niels who implemented a lot of 3D functionality and tests. I am not blaming him, just identifying him as a possible alternative resource. :slight_smile:

Phew! That is just about it. The fact that I am writing this email suggests that this section of the developer guide needs work; once you are happy with the new Jenkins job, you are best positioned to update the documentation, so please submit a pull request!

More resources:

Workaround for running without Oracle:
https://jira.codehaus.org/browse/GEOS-6883

Reference data set:
https://www.seegrid.csiro.au/wiki/Infosrvices/DataReferenceSet

CSIRO build slave documentation:
https://www.seegrid.csiro.au/wiki/Infosrvices/JenkinsGeoserverMasterTechnicalNotes

Kind regards,
Ben.

On 16/04/15 05:36, Torben Barsballe wrote:

Ben - is this
<http://spatialdbadvisor.com/oracle_spatial_tips_tricks/280/announcing-the-spatial-companion-for-oracle-sc4o>

the spatial companion library we need?

Thanks,
Torben

On Wed, Apr 15, 2015 at 9:54 AM, Torben Barsballe <
tbarsballe@anonymised.com39…> wrote:

Hi Ben

In yesterday’s meeting, we discussed running automated app-schema tests.
For now, lets run them against the same databases used for the geotools
online database tests.

You said you have a simple command that can run the app-schema tests in
Jenkins? Do you have access to the ares Jenkins? If so, the database
connection parameters for oracle and postgis can be found in the build
configuration of the “geotool-master-online” job. Otherwise, do you want to
send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the “spatial companion”
component needed for the 3d tests - I’ll see what I can do about getting
that installed.

Torben


Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz>
New Zealand

Update: Oracle permissions should be fixed. PostGIS 3D support added. Oracle 3D support is still pending.

I have ran into an error where Oracle test data (Oracle_Data_ref_set.sql) is expecting the TESTTBS tablespace to exist. Howver, this tablespace is not created anywhere in the sql script, or elsewhere in the app-schema tests. It is also not mentioned in any of the app-schema instructions (as far as I can see). Is this someting that should be set up when setting up the test databases (in which case I can add it to the documentation), or should this be done in the app schema test code (and if so, where - in the test set up or in the actual Oracle_Data_ref_set.sql file)?

We also seem to be getting an excessive number of errors for the postgis tests, suggesting that something is still not set up correctly.

Thanks,

Torben

···

On Wed, Apr 22, 2015 at 3:48 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

Thanks Torben that is great news.


Jody Garnett

On 22 April 2015 at 15:47, Torben Barsballe <tbarsballe@anonymised.com> wrote:

Updated to use dependencyManagement for version.

Merged to master

AppSchema tests are running now. Currently tracking down a permissions issue with Oracle. PostGIS and Oracle 3D support is still pending.

Torben

On Tue, Apr 21, 2015 at 3:48 PM, Jody Garnett <jody.garnett@anonymised.com> wrote:

Initial feedback is we should manage those versions in the dependencyManagement section.


Jody Garnett

On 21 April 2015 at 15:09, Torben Barsballe <tbarsballe@anonymised.com> wrote:

As part of getting these tests working, I am upgrading the geoserver oracle dependancies to Oracle 12 / ojdbc7. Pull request here: https://github.com/geoserver/geoserver/pull/1021

Note that GeoTools has already been updated to use ojdbc7.

Torben


BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF


Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

On Wed, Apr 15, 2015 at 2:09 PM, Ben Caradoc-Davies <ben@anonymised.com> wrote:

Torben,

I have web access to ares Jenkins, but it would be great if you could set up the Jenkins build (perhaps called “geoserver-master-app-schema”?) as this would confirm that the instructions work, and we would then have more people who know about it. :slight_smile:

I am happy to help debug any problems.

The instructions are here:
http://docs.geoserver.org/latest/en/developer/programming-guide/app-schema/index.html

To configure the fixtures we need to install postgis.properties and oracle.properties in ~/.geoserver and we hope ones identical to those in ~/.geotools will work (where ~ is the home directory of the build slave). You may need to add dbtype of postgis or oracle.

The build procedure is:

cd src/extension/app-schema

mvn -nsu -Djava.awt.headless=true -Dtest.maxHeapSize=1024m -Dtest.maxPermSize=128m -Papp-schema-online-test clean test

You could trigger this by the completion of geoserver-master.

If using postgis 2.1 you also need to create two functions in the database:

– missing functions required for refdataset sql but removed in postgis 2.1
create or replace function public.ndims(g geometry)
returns smallint as $$
begin
return public.st_ndims(g);
end;
$$ language plpgsql immutable strict;
create or replace function public.srid(g geometry)
returns integer as $$
begin
return public.st_srid(g);
end;
$$ language plpgsql immutable strict;

3D test support on PostGIS requires PostGIS 2 and an insert to add SRID 4979 (see the app-schema test guide).

3D support on Oracle requires SC40. Your link below is correct; in the manual you will find this deep link to the software buried in the instructions (see 3D section at the end).
http://www.spatialdbadvisor.com/files/SC4O.zip

You will likely need Rini’s instructions to get SC4O to build (wsrv5 is a host name):
https://www.seegrid.csiro.au/wiki/Infosrvices/AppSchemaTestDatabase

I have copied Niels who implemented a lot of 3D functionality and tests. I am not blaming him, just identifying him as a possible alternative resource. :slight_smile:

Phew! That is just about it. The fact that I am writing this email suggests that this section of the developer guide needs work; once you are happy with the new Jenkins job, you are best positioned to update the documentation, so please submit a pull request!

More resources:

Workaround for running without Oracle:
https://jira.codehaus.org/browse/GEOS-6883

Reference data set:
https://www.seegrid.csiro.au/wiki/Infosrvices/DataReferenceSet

CSIRO build slave documentation:
https://www.seegrid.csiro.au/wiki/Infosrvices/JenkinsGeoserverMasterTechnicalNotes

Kind regards,
Ben.

On 16/04/15 05:36, Torben Barsballe wrote:

Ben - is this
<http://spatialdbadvisor.com/oracle_spatial_tips_tricks/280/announcing-the-spatial-companion-for-oracle-sc4o>

the spatial companion library we need?

Thanks,
Torben

On Wed, Apr 15, 2015 at 9:54 AM, Torben Barsballe <
tbarsballe@anonymised.com39…> wrote:

Hi Ben

In yesterday’s meeting, we discussed running automated app-schema tests.
For now, lets run them against the same databases used for the geotools
online database tests.

You said you have a simple command that can run the app-schema tests in
Jenkins? Do you have access to the ares Jenkins? If so, the database
connection parameters for oracle and postgis can be found in the build
configuration of the “geotool-master-online” job. Otherwise, do you want to
send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the “spatial companion”
component needed for the 3d tests - I’ll see what I can do about getting
that installed.

Torben


Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz>
New Zealand

Torben,

I could not find anything that might create the Oracle TESTTBS tablespace. It appears to be an undocumented requirement, perhaps a result of the database creation practices used by the corporate DBA team at the originating organisation (IIRC this was a dedicated test server). It might also be an artifact of Oracle tools.

Victor, do you remember having to request the creation of TESTTBS tablespace for Oracle reference data set tests? Or was it just there?

Torben, please try creating the TESTTBS tablespace manually. If this works, we need to either update the documentation or the SQL.

I can confirm that the app-schema-postgis-test tests are also failing. The root causes of the failures are concealed because many failures are occurring in xmlunit.

- Please add -DquietTests=false to the maven command line to search for evidence. This will stop GeoServerBaseTestSupport from silencing loggers, which it does by default (quietTests is set to true in the top-level pom).

- You might also find something in app-schema-postgis-test/target/surefire-tests that is not included in the Jenkins output.

- Are you able to run the tests in Eclipse against the same database? This might give you console output that surefire does not capture.

Kind regards,
Ben.

On 24/04/15 08:48, Torben Barsballe wrote:

Update: Oracle permissions should be fixed. PostGIS 3D support added.
Oracle 3D support is still pending.

I have ran into an error where Oracle test data (Oracle_Data_ref_set.sql)
is expecting the TESTTBS tablespace to exist. Howver, this tablespace is
not created anywhere in the sql script, or elsewhere in the app-schema
tests. It is also not mentioned in any of the app-schema instructions (as
far as I can see). Is this someting that should be set up when setting up
the test databases (in which case I can add it to the documentation), or
should this be done in the app schema test code (and if so, where - in the
test set up or in the actual Oracle_Data_ref_set.sql file)?

We also seem to be getting an excessive number of errors for the postgis
tests, suggesting that something is still not set up correctly.

Thanks,
Torben

On Wed, Apr 22, 2015 at 3:48 PM, Jody Garnett <jody.garnett@anonymised.com>
wrote:

Thanks Torben that is great news.

--
Jody Garnett

On 22 April 2015 at 15:47, Torben Barsballe <tbarsballe@anonymised.com>
wrote:

Updated to use dependencyManagement for version.
Merged to master
AppSchema tests are running now. Currently tracking down a permissions
issue with Oracle. PostGIS and Oracle 3D support is still pending.

Torben

On Tue, Apr 21, 2015 at 3:48 PM, Jody Garnett <jody.garnett@anonymised.com>
wrote:

Initial feedback is we should manage those versions in the
dependencyManagement section.

--
Jody Garnett

On 21 April 2015 at 15:09, Torben Barsballe <tbarsballe@anonymised.com

wrote:

As part of getting these tests working, I am upgrading the geoserver
oracle dependancies to Oracle 12 / ojdbc7. Pull request here:
https://github.com/geoserver/geoserver/pull/1021

Note that GeoTools has already been updated to use ojdbc7.

Torben

On Wed, Apr 15, 2015 at 2:09 PM, Ben Caradoc-Davies <ben@anonymised.com>
wrote:

Torben,

I have web access to ares Jenkins, but it would be great if you could
set up the Jenkins build (perhaps called "geoserver-master-app-schema"?) as
this would confirm that the instructions work, and we would then have more
people who know about it. :slight_smile:

I am happy to help debug any problems.

The instructions are here:

http://docs.geoserver.org/latest/en/developer/programming-guide/app-schema/index.html

To configure the fixtures we need to install postgis.properties and
oracle.properties in ~/.geoserver and we hope ones identical to those in
~/.geotools will work (where ~ is the home directory of the build slave).
You may need to add dbtype of postgis or oracle.

The build procedure is:

cd src/extension/app-schema

mvn -nsu -Djava.awt.headless=true -Dtest.maxHeapSize=1024m
-Dtest.maxPermSize=128m -Papp-schema-online-test clean test

You could trigger this by the completion of geoserver-master.

If using postgis 2.1 you also need to create two functions in the
database:

-- missing functions required for refdataset sql but removed in
postgis 2.1
create or replace function public.ndims(g geometry)
returns smallint as $$
begin
     return public.st_ndims(g);
end;
$$ language plpgsql immutable strict;
create or replace function public.srid(g geometry)
returns integer as $$
begin
     return public.st_srid(g);
end;
$$ language plpgsql immutable strict;

3D test support on PostGIS requires PostGIS 2 and an insert to add
SRID 4979 (see the app-schema test guide).

3D support on Oracle requires SC40. Your link below is correct; in the
manual you will find this deep link to the software buried in the
instructions (see 3D section at the end).
http://www.spatialdbadvisor.com/files/SC4O.zip

You will likely need Rini's instructions to get SC4O to build (wsrv5
is a host name):
https://www.seegrid.csiro.au/wiki/Infosrvices/AppSchemaTestDatabase

I have copied Niels who implemented a lot of 3D functionality and
tests. I am not blaming him, just identifying him as a possible alternative
resource. :slight_smile:

Phew! That is just about it. The fact that I am writing this email
suggests that this section of the developer guide needs work; once you are
happy with the new Jenkins job, you are best positioned to update the
documentation, so please submit a pull request!

More resources:

Workaround for running without Oracle:
https://jira.codehaus.org/browse/GEOS-6883

Reference data set:
https://www.seegrid.csiro.au/wiki/Infosrvices/DataReferenceSet

CSIRO build slave documentation:

https://www.seegrid.csiro.au/wiki/Infosrvices/JenkinsGeoserverMasterTechnicalNotes

Kind regards,
Ben.

On 16/04/15 05:36, Torben Barsballe wrote:

Ben - is this
<
http://spatialdbadvisor.com/oracle_spatial_tips_tricks/280/announcing-the-spatial-companion-for-oracle-sc4o

the spatial companion library we need?

Thanks,
Torben

On Wed, Apr 15, 2015 at 9:54 AM, Torben Barsballe <
tbarsballe@anonymised.com> wrote:

  Hi Ben

In yesterday's meeting, we discussed running automated app-schema
tests.
For now, lets run them against the same databases used for the
geotools
online database tests.

You said you have a simple command that can run the app-schema tests
in
Jenkins? Do you have access to the ares Jenkins? If so, the database
connection parameters for oracle and postgis can be found in the
build
configuration of the "geotool-master-online" job. Otherwise, do you
want to
send me the command, and I can set it up in Jenkins.

I am fairly sure the Oracle DB does not have the "spatial companion"
component needed for the 3d tests - I'll see what I can do about
getting
that installed.

Torben

--
Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz>
New Zealand

------------------------------------------------------------------------------
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live
exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

--
Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz/&gt;
New Zealand

I took a look the actuall test script (Oracle_Data_ref_set.sql) extracted from the test data jar, and it references the TESTTBS tablespace frequently, without ever creating it, so it seems like an undocumented requirement. I’ll try and get that tablespace added to the Oracle DB.

I’ve added -DquietTests=false to the mvn command. Based on the test failures it look like data is missing somewhere, but I can’t see any log messages suggesting why this might be occuring.

···
  • Are you able to run the tests in Eclipse against the same database? This might give you console output that surefire does not capture.

No, the test databases are firewalled to be accessible from ares only. I have very limited access to them.

Torben

Aha!

Oh, this sucks horribly, but the good news is that I had a peek into the Jenkins pre-build script and I can reproduce the failures locally against my own database and I think I have fixed them for you:

(1) For both database types, both "password" and "passwd" are required. I have added "passwd" which was missing. Yes, different fixtures look for different keys (*thunch* (sound of forehead hitting keyboard)), so having only one will cause only some to fail. Similar brain damage can be found in GeoTools. The documentation, while appearing to contain a bizarre duplication, is in fact correct!

(2) Postgis tests appear to *require* dbtype=postgisng, and do not work with dbtype=postgis or this key not present, which is also curious. Probably a dodgy assumption somewhere, or need for consistency with mapping files which contain this alternative name (connection pooling, perhaps?). I have added dbtype=postgis to the Jenkins pre-build script. This second bizarre detail in the documentation is also correct!

I have applied these two changes to Jenkins and have kicked the build. Fingers crossed.

Kind regards,
Ben.

On 24/04/15 10:35, Torben Barsballe wrote:

I took a look the actuall test script (Oracle_Data_ref_set.sql) extracted
from the test data jar, and it references the TESTTBS tablespace
frequently, without ever creating it, so it seems like an undocumented
requirement. I'll try and get that tablespace added to the Oracle DB.

I've added -DquietTests=false to the mvn command. Based on the test
failures it look like data is missing somewhere, but I can't see any log
messages suggesting why this might be occuring.

- Are you able to run the tests in Eclipse against the same database? This
might give you console output that surefire does not capture.

No, the test databases are firewalled to be accessible from ares only. I

have very limited access to them.

Torben

--
Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz/&gt;
New Zealand

Correction: I added dbtype=postgisng (the one works for me locally).

On 24/04/15 11:15, Ben Caradoc-Davies wrote:

I have added dbtype=postgis to the Jenkins pre-build script.

--
Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz/&gt;
New Zealand

Torben,

app-schema-postgis-test passed on Jenkins. I had a quick look and I think the only remaining failures are for Oracle (app-schema-oracle-test and Oracle reference data set tests in app-schema-test). [Correction: I added dbtype=postgisng (the one works for me locally).]

I will be very interested to see what happens when TESTTBS is added to Oracle. I also see this, which might be a problem with SC4O (permissions?):
java.sql.SQLSyntaxErrorException: ORA-00904: "ARES"."SC4O"."ST_GEOMFROMEWKT": invalid identifier

Kind regards,
Ben.

On 24/04/15 11:15, Ben Caradoc-Davies wrote:

Aha!

Oh, this sucks horribly, but the good news is that I had a peek into the
Jenkins pre-build script and I can reproduce the failures locally
against my own database and I think I have fixed them for you:

(1) For both database types, both "password" and "passwd" are required.
I have added "passwd" which was missing. Yes, different fixtures look
for different keys (*thunch* (sound of forehead hitting keyboard)), so
having only one will cause only some to fail. Similar brain damage can
be found in GeoTools. The documentation, while appearing to contain a
bizarre duplication, is in fact correct!

(2) Postgis tests appear to *require* dbtype=postgisng, and do not work
with dbtype=postgis or this key not present, which is also curious.
Probably a dodgy assumption somewhere, or need for consistency with
mapping files which contain this alternative name (connection pooling,
perhaps?). I have added dbtype=postgis to the Jenkins pre-build script.
This second bizarre detail in the documentation is also correct!

I have applied these two changes to Jenkins and have kicked the build.
Fingers crossed.

Kind regards,
Ben.

On 24/04/15 10:35, Torben Barsballe wrote:

I took a look the actuall test script (Oracle_Data_ref_set.sql) extracted
from the test data jar, and it references the TESTTBS tablespace
frequently, without ever creating it, so it seems like an undocumented
requirement. I'll try and get that tablespace added to the Oracle DB.

I've added -DquietTests=false to the mvn command. Based on the test
failures it look like data is missing somewhere, but I can't see any log
messages suggesting why this might be occuring.

- Are you able to run the tests in Eclipse against the same database? This
might give you console output that surefire does not capture.

No, the test databases are firewalled to be accessible from ares only. I

have very limited access to them.

Torben

--
Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz/&gt;
New Zealand

Excellent, good to know we are making progress.
When I go through and update the documentation, I’ll make these points a bit more clear, rather than just showing up as an example.

SC4O hasn’t been added yet, so I think that is why you are seeing that error.

Torben

···

On Thu, Apr 23, 2015 at 4:15 PM, Ben Caradoc-Davies <ben@anonymised.com> wrote:

Aha!

Oh, this sucks horribly, but the good news is that I had a peek into the Jenkins pre-build script and I can reproduce the failures locally against my own database and I think I have fixed them for you:

(1) For both database types, both “password” and “passwd” are required. I have added “passwd” which was missing. Yes, different fixtures look for different keys (thunch (sound of forehead hitting keyboard)), so having only one will cause only some to fail. Similar brain damage can be found in GeoTools. The documentation, while appearing to contain a bizarre duplication, is in fact correct!

(2) Postgis tests appear to require dbtype=postgisng, and do not work with dbtype=postgis or this key not present, which is also curious. Probably a dodgy assumption somewhere, or need for consistency with mapping files which contain this alternative name (connection pooling, perhaps?). I have added dbtype=postgis to the Jenkins pre-build script. This second bizarre detail in the documentation is also correct!

I have applied these two changes to Jenkins and have kicked the build. Fingers crossed.

Kind regards,
Ben.

On 24/04/15 10:35, Torben Barsballe wrote:

I took a look the actuall test script (Oracle_Data_ref_set.sql) extracted
from the test data jar, and it references the TESTTBS tablespace
frequently, without ever creating it, so it seems like an undocumented
requirement. I’ll try and get that tablespace added to the Oracle DB.

I’ve added -DquietTests=false to the mvn command. Based on the test
failures it look like data is missing somewhere, but I can’t see any log
messages suggesting why this might be occuring.

  • Are you able to run the tests in Eclipse against the same database? This
    might give you console output that surefire does not capture.

No, the test databases are firewalled to be accessible from ares only. I

have very limited access to them.

Torben


Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz/>
New Zealand

On 24/04/15 11:50, Torben Barsballe wrote:

Excellent, good to know we are making progress.
When I go through and update the documentation, I'll make these points a
bit more clear, rather than just showing up as an example.

That would be much appreciated.

SC4O hasn't been added yet, so I think that is why you are seeing that
error.

My understanding was that the absence of SC4O should cause these tests to be skipped rather than fail; perhaps this behaviour has degraded over time? A buglet to be recorded. In any case, installation of SC4O is expected to fix this.

Thank you for your perseverance.

Kind regards,

--
Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz/&gt;
New Zealand

Hello Torben,

Sorry for my late response. Picking up after a holiday.
The oracle online tests are not so straight-forward to set up.
  Can I be of any assistance or have you sorted it out in the meantime?

Regards
Niels

On 24-04-15 01:50, Torben Barsballe wrote:

Excellent, good to know we are making progress.
When I go through and update the documentation, I'll make these points a bit more clear, rather than just showing up as an example.

SC4O hasn't been added yet, so I think that is why you are seeing that error.

Torben

On Thu, Apr 23, 2015 at 4:15 PM, Ben Caradoc-Davies <ben@anonymised.com <mailto:ben@anonymised.com>> wrote:

    Aha!

    Oh, this sucks horribly, but the good news is that I had a peek
    into the Jenkins pre-build script and I can reproduce the failures
    locally against my own database and I think I have fixed them for you:

    (1) For both database types, both "password" and "passwd" are
    required. I have added "passwd" which was missing. Yes, different
    fixtures look for different keys (*thunch* (sound of forehead
    hitting keyboard)), so having only one will cause only some to
    fail. Similar brain damage can be found in GeoTools. The
    documentation, while appearing to contain a bizarre duplication,
    is in fact correct!

    (2) Postgis tests appear to *require* dbtype=postgisng, and do not
    work with dbtype=postgis or this key not present, which is also
    curious. Probably a dodgy assumption somewhere, or need for
    consistency with mapping files which contain this alternative name
    (connection pooling, perhaps?). I have added dbtype=postgis to the
    Jenkins pre-build script. This second bizarre detail in the
    documentation is also correct!

    I have applied these two changes to Jenkins and have kicked the
    build. Fingers crossed.

    Kind regards,
    Ben.

    On 24/04/15 10:35, Torben Barsballe wrote:

        I took a look the actuall test script
        (Oracle_Data_ref_set.sql) extracted
        from the test data jar, and it references the TESTTBS tablespace
        frequently, without ever creating it, so it seems like an
        undocumented
        requirement. I'll try and get that tablespace added to the
        Oracle DB.

        I've added -DquietTests=false to the mvn command. Based on the
        test
        failures it look like data is missing somewhere, but I can't
        see any log
        messages suggesting why this might be occuring.

            - Are you able to run the tests in Eclipse against the
            same database? This
            might give you console output that surefire does not capture.

            No, the test databases are firewalled to be accessible
            from ares only. I

        have very limited access to them.

        Torben

    -- Ben Caradoc-Davies <ben@anonymised.com <mailto:ben@anonymised.com>>
    Director
    Transient Software Limited <http://transient.nz/&gt;
    New Zealand

------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y

_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Hi Neils

Oracle tests are going fine so far, there has been a bit of a delay since the DBA who manages the Oracle DB we are using has been out for the last couple weeks.

The only real question I had was about the TESTTBS tablespace - based on the errors we are getting from the app-schema tests it looks like this is an undocumented requirement? Was this tablespace maybe included by default in an earlier version of oracle?

Thanks,

Torben

···

On Tue, May 12, 2015 at 5:15 AM, Niels Charlier <niels@anonymised.com> wrote:

Hello Torben,

Sorry for my late response. Picking up after a holiday.
The oracle online tests are not so straight-forward to set up.
Can I be of any assistance or have you sorted it out in the meantime?

Regards
Niels

On 24-04-15 01:50, Torben Barsballe wrote:

Excellent, good to know we are making progress.
When I go through and update the documentation, I’ll make these points a bit more clear, rather than just showing up as an example.

SC4O hasn’t been added yet, so I think that is why you are seeing that error.

Torben

------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
[http://ad.doubleclick.net/ddm/clk/290420510;117567292;y](http://ad.doubleclick.net/ddm/clk/290420510;117567292;y)
_______________________________________________
Geoserver-devel mailing list
[Geoserver-devel@lists.sourceforge.net](mailto:Geoserver-devel@lists.sourceforge.net)
[https://lists.sourceforge.net/lists/listinfo/geoserver-devel](https://lists.sourceforge.net/lists/listinfo/geoserver-devel)

On Thu, Apr 23, 2015 at 4:15 PM, Ben Caradoc-Davies <ben@anonymised.com> wrote:

Aha!

Oh, this sucks horribly, but the good news is that I had a peek into the Jenkins pre-build script and I can reproduce the failures locally against my own database and I think I have fixed them for you:

(1) For both database types, both “password” and “passwd” are required. I have added “passwd” which was missing. Yes, different fixtures look for different keys (thunch (sound of forehead hitting keyboard)), so having only one will cause only some to fail. Similar brain damage can be found in GeoTools. The documentation, while appearing to contain a bizarre duplication, is in fact correct!

(2) Postgis tests appear to require dbtype=postgisng, and do not work with dbtype=postgis or this key not present, which is also curious. Probably a dodgy assumption somewhere, or need for consistency with mapping files which contain this alternative name (connection pooling, perhaps?). I have added dbtype=postgis to the Jenkins pre-build script. This second bizarre detail in the documentation is also correct!

I have applied these two changes to Jenkins and have kicked the build. Fingers crossed.

Kind regards,
Ben.

On 24/04/15 10:35, Torben Barsballe wrote:

I took a look the actuall test script (Oracle_Data_ref_set.sql) extracted
from the test data jar, and it references the TESTTBS tablespace
frequently, without ever creating it, so it seems like an undocumented
requirement. I’ll try and get that tablespace added to the Oracle DB.

I’ve added -DquietTests=false to the mvn command. Based on the test
failures it look like data is missing somewhere, but I can’t see any log
messages suggesting why this might be occuring.

  • Are you able to run the tests in Eclipse against the same database? This
    might give you console output that surefire does not capture.

No, the test databases are firewalled to be accessible from ares only. I

have very limited access to them.

Torben


Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz/>
New Zealand

We are again trying to get 3D Geometry support on the Oracle test database.

Consequently, I have re-enabled the oracle test fixture and the Oracle integration test on ares, so expect a few more build failure messages on the mailing list. FOr oracle, we appear to be getting a couple of legitimate test failures, plus a few related to 3D geometry support that should be fixed once we get this working.

···

On Tue, May 12, 2015 at 8:50 AM, Torben Barsballe <tbarsballe@anonymised.com> wrote:

Hi Neils

Oracle tests are going fine so far, there has been a bit of a delay since the DBA who manages the Oracle DB we are using has been out for the last couple weeks.

The only real question I had was about the TESTTBS tablespace - based on the errors we are getting from the app-schema tests it looks like this is an undocumented requirement? Was this tablespace maybe included by default in an earlier version of oracle?

Thanks,

Torben

On Tue, May 12, 2015 at 5:15 AM, Niels Charlier <niels@anonymised.com> wrote:

Hello Torben,

Sorry for my late response. Picking up after a holiday.
The oracle online tests are not so straight-forward to set up.
Can I be of any assistance or have you sorted it out in the meantime?

Regards
Niels

On 24-04-15 01:50, Torben Barsballe wrote:

Excellent, good to know we are making progress.
When I go through and update the documentation, I’ll make these points a bit more clear, rather than just showing up as an example.

SC4O hasn’t been added yet, so I think that is why you are seeing that error.

Torben

------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
[http://ad.doubleclick.net/ddm/clk/290420510;117567292;y](http://ad.doubleclick.net/ddm/clk/290420510;117567292;y)
_______________________________________________
Geoserver-devel mailing list
[Geoserver-devel@lists.sourceforge.net](mailto:Geoserver-devel@lists.sourceforge.net)
[https://lists.sourceforge.net/lists/listinfo/geoserver-devel](https://lists.sourceforge.net/lists/listinfo/geoserver-devel)

On Thu, Apr 23, 2015 at 4:15 PM, Ben Caradoc-Davies <ben@anonymised.com> wrote:

Aha!

Oh, this sucks horribly, but the good news is that I had a peek into the Jenkins pre-build script and I can reproduce the failures locally against my own database and I think I have fixed them for you:

(1) For both database types, both “password” and “passwd” are required. I have added “passwd” which was missing. Yes, different fixtures look for different keys (thunch (sound of forehead hitting keyboard)), so having only one will cause only some to fail. Similar brain damage can be found in GeoTools. The documentation, while appearing to contain a bizarre duplication, is in fact correct!

(2) Postgis tests appear to require dbtype=postgisng, and do not work with dbtype=postgis or this key not present, which is also curious. Probably a dodgy assumption somewhere, or need for consistency with mapping files which contain this alternative name (connection pooling, perhaps?). I have added dbtype=postgis to the Jenkins pre-build script. This second bizarre detail in the documentation is also correct!

I have applied these two changes to Jenkins and have kicked the build. Fingers crossed.

Kind regards,
Ben.

On 24/04/15 10:35, Torben Barsballe wrote:

I took a look the actuall test script (Oracle_Data_ref_set.sql) extracted
from the test data jar, and it references the TESTTBS tablespace
frequently, without ever creating it, so it seems like an undocumented
requirement. I’ll try and get that tablespace added to the Oracle DB.

I’ve added -DquietTests=false to the mvn command. Based on the test
failures it look like data is missing somewhere, but I can’t see any log
messages suggesting why this might be occuring.

  • Are you able to run the tests in Eclipse against the same database? This
    might give you console output that surefire does not capture.

No, the test databases are firewalled to be accessible from ares only. I

have very limited access to them.

Torben


Ben Caradoc-Davies <ben@anonymised.com>
Director
Transient Software Limited <http://transient.nz/>
New Zealand

Hi Torben,

Let me know which errors remain after you set up the 3D support.

Regards
Niels

On 24-03-16 21:56, Torben Barsballe wrote:

We are again trying to get 3D Geometry support on the Oracle test database.

Consequently, I have re-enabled the oracle test fixture and the Oracle integration test on ares, so expect a few more build failure messages on the mailing list. FOr oracle, we appear to be getting a couple of legitimate test failures, plus a few related to 3D geometry support that should be fixed once we get this working.

[INFO] ------------------------------------------------------------------------
[INFO] Building Application Schema Integration Online Test with Oracle Database 2.9-SNAPSHOT
[INFO] ------------------------------------------------------------------------
...

Results :

Failed tests: testQueryBboxLongLat(org.geoserver.test.BBoxFilterTest): expected:<[0]> but was:<>
   testQueryBboxLongLatURN(org.geoserver.test.BBoxFilterTest): expected:<[0]> but was:<>
   testQueryBboxLatLongEPSGCode(org.geoserver.test.BBoxFilterTest): expected:<[0]> but was:<>

Tests in error:
   testBbox1(org.geoserver.test.BBox3DTest): java.sql.SQLSyntaxErrorException: ORA-00904: "ARES"."SC4O"."ST_GEOMFROMEWKT": invalid identifier(..)
   testBbox2(org.geoserver.test.BBox3DTest): java.sql.SQLSyntaxErrorException: ORA-00904: "ARES"."SC4O"."ST_GEOMFROMEWKT": invalid identifier(..)
   testBboxPost(org.geoserver.test.BBox3DTest): java.sql.SQLSyntaxErrorException: ORA-00904: "ARES"."SC4O"."ST_GEOMFROMEWKT": invalid identifier(..)
   testReprojection(org.geoserver.test.Reprojection3DTest): java.sql.SQLSyntaxErrorException: ORA-00904: "ARES"."SC4O"."ST_GEOMFROMEWKT": invalid identifier(..)

Tests run: 169, Failures: 3, Errors: 4, Skipped: 0

On Tue, May 12, 2015 at 8:50 AM, Torben Barsballe <tbarsballe@anonymised.com <mailto:tbarsballe@anonymised.com>> wrote:

    Hi Neils

    Oracle tests are going fine so far, there has been a bit of a
    delay since the DBA who manages the Oracle DB we are using has
    been out for the last couple weeks.

    The only real question I had was about the TESTTBS tablespace -
    based on the errors we are getting from the app-schema tests it
    looks like this is an undocumented requirement? Was this
    tablespace maybe included by default in an earlier version of oracle?

    Thanks,

    Torben

    On Tue, May 12, 2015 at 5:15 AM, Niels Charlier <niels@anonymised.com
    <mailto:niels@anonymised.com>> wrote:

        Hello Torben,

        Sorry for my late response. Picking up after a holiday.
        The oracle online tests are not so straight-forward to set up.
         Can I be of any assistance or have you sorted it out in the
        meantime?

        Regards
        Niels

        On 24-04-15 01:50, Torben Barsballe wrote:

        Excellent, good to know we are making progress.
        When I go through and update the documentation, I'll make
        these points a bit more clear, rather than just showing up as
        an example.

        SC4O hasn't been added yet, so I think that is why you are
        seeing that error.

        Torben

        On Thu, Apr 23, 2015 at 4:15 PM, Ben Caradoc-Davies
        <ben@anonymised.com <mailto:ben@anonymised.com>> wrote:

            Aha!

            Oh, this sucks horribly, but the good news is that I had
            a peek into the Jenkins pre-build script and I can
            reproduce the failures locally against my own database
            and I think I have fixed them for you:

            (1) For both database types, both "password" and "passwd"
            are required. I have added "passwd" which was missing.
            Yes, different fixtures look for different keys (*thunch*
            (sound of forehead hitting keyboard)), so having only one
            will cause only some to fail. Similar brain damage can be
            found in GeoTools. The documentation, while appearing to
            contain a bizarre duplication, is in fact correct!

            (2) Postgis tests appear to *require* dbtype=postgisng,
            and do not work with dbtype=postgis or this key not
            present, which is also curious. Probably a dodgy
            assumption somewhere, or need for consistency with
            mapping files which contain this alternative name
            (connection pooling, perhaps?). I have added
            dbtype=postgis to the Jenkins pre-build script. This
            second bizarre detail in the documentation is also correct!

            I have applied these two changes to Jenkins and have
            kicked the build. Fingers crossed.

            Kind regards,
            Ben.

            On 24/04/15 10:35, Torben Barsballe wrote:

                I took a look the actuall test script
                (Oracle_Data_ref_set.sql) extracted
                from the test data jar, and it references the TESTTBS
                tablespace
                frequently, without ever creating it, so it seems
                like an undocumented
                requirement. I'll try and get that tablespace added
                to the Oracle DB.

                I've added -DquietTests=false to the mvn command.
                Based on the test
                failures it look like data is missing somewhere, but
                I can't see any log
                messages suggesting why this might be occuring.

                    - Are you able to run the tests in Eclipse
                    against the same database? This
                    might give you console output that surefire does
                    not capture.

                    No, the test databases are firewalled to be
                    accessible from ares only. I

                have very limited access to them.

                Torben

            -- Ben Caradoc-Davies <ben@anonymised.com
            <mailto:ben@anonymised.com>>
            Director
            Transient Software Limited <http://transient.nz/&gt;
            New Zealand

        ------------------------------------------------------------------------------
        One dashboard for servers and applications across Physical-Virtual-Cloud
        Widest out-of-the-box monitoring support with 50+ applications
        Performance metrics, stats and reports that give you Actionable Insights
        Deep dive visibility with transaction tracing using APM Insight.
        http://ad.doubleclick.net/ddm/clk/290420510;117567292;y

        _______________________________________________
        Geoserver-devel mailing list
        Geoserver-devel@lists.sourceforge.net
        <mailto:Geoserver-devel@lists.sourceforge.net>
        https://lists.sourceforge.net/lists/listinfo/geoserver-devel