[GeoNetwork-devel] enabling and configuration of CSW in svn trunk

GeoNetwork GeoNetwork Developer
1

Using svn trunk, CSW support is now disabled by default. How do I enable it?

Trying to do so in Admin/System configuration results in a JavaScript error when trying to save (using FF 3.0.8):

Unable to save the system configuration
Error: operation-aborted
Message: Cannot set all values
Class: OperationAbortedEx

Any suggestions or docs? Thanks

..Tom

2

Hello Tom,

2009/4/8 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:

Using svn trunk, CSW support is now disabled by default. How do I enable it?

Trying to do so in Admin/System configuration results in a JavaScript error when trying to save (using FF 3.0.8):

Could you have a look to Settings.ddf in gast/setup/db/ and check that
csw is enabled by default on install.
I can't reproduce the problem.
Then maybe cleanup your JS cache in your browser ?

Unable to save the system configuration
Error: operation-aborted
Message: Cannot set all values
Class: OperationAbortedEx

Any suggestions or docs? Thanks

p47 of Manual.pdf but will not help you I think.

HTH.
Francois

..Tom

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

3

Thanks Francois, in gast/setup/db/Settings.ddf:

120 1 csw
121 120 enable true

..does this mean it's enabled?

Note that I did svn up && ant, and that's it. Do I need to use GAST as well? Note that I don't want to affect existing metadata in my install.

I cleared my cache and got the same result (JavaScript popup error). As well, I tried directly against the CSW and get:

http://host/geonetwork/srv/en/csw?service=CSW&version=2.0.2&request=GetCapabilities

and get:

<?xml version="1.0" encoding="UTF-8"?>
<response>
  <info>CSW harvesting is disabled</info>
</response>

Any idea?

..Tom

-----Original Message-----
From: Francois-Xavier Prunayre [mailto:francois-xavier.prunayre@anonymised.com]
Sent: Wed 08-Apr-09 11:26
To: Kralidis,Tom [Ontario]
Cc: geonetwork-devel@lists.sourceforge.net
Subject: Re: [GeoNetwork-devel] enabling and configuration of CSW in svn trunk

Hello Tom,

2009/4/8 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:

Using svn trunk, CSW support is now disabled by default. How do I enable it?

Trying to do so in Admin/System configuration results in a JavaScript error when trying to save (using FF 3.0.8):

Could you have a look to Settings.ddf in gast/setup/db/ and check that
csw is enabled by default on install.
I can't reproduce the problem.
Then maybe cleanup your JS cache in your browser ?

Unable to save the system configuration
Error: operation-aborted
Message: Cannot set all values
Class: OperationAbortedEx

Any suggestions or docs? Thanks

p47 of Manual.pdf but will not help you I think.

HTH.
Francois

..Tom

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

4

2009/4/8 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:

Thanks Francois, in gast/setup/db/Settings.ddf:

120 1 csw
121 120 enable true

..does this mean it's enabled?

Note that I did svn up && ant, and that's it. Do I need to use GAST as well? Note that I don't want to affect existing metadata in my install.

Yep you have to add those new settings into your db.
You could use java -jar gast.jar -setup (It will clean & recreate your db)

I'm still working on the CSW harvester and will commit some more fixes soon.

I have to check the ticket you created on CSW last month and be sure
they will be fixed for comming RC.

Test and comments welcomed.

Cheers

Francois

I cleared my cache and got the same result (JavaScript popup error). As well, I tried directly against the CSW and get:
http://host/geonetwork/srv/en/csw?service=CSW&version=2.0.2&request=GetCapabilities

and get:

<?xml version="1.0" encoding="UTF-8"?>
<response>
<info>CSW harvesting is disabled</info>
</response>

Any idea?

..Tom

-----Original Message-----
From: Francois-Xavier Prunayre [mailto:francois-xavier.prunayre@anonymised.com]
Sent: Wed 08-Apr-09 11:26
To: Kralidis,Tom [Ontario]
Cc: geonetwork-devel@lists.sourceforge.net
Subject: Re: [GeoNetwork-devel] enabling and configuration of CSW in svn trunk

Hello Tom,

2009/4/8 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:

Using svn trunk, CSW support is now disabled by default. How do I enable it?

Trying to do so in Admin/System configuration results in a JavaScript error when trying to save (using FF 3.0.8):

Could you have a look to Settings.ddf in gast/setup/db/ and check that
csw is enabled by default on install.
I can't reproduce the problem.
Then maybe cleanup your JS cache in your browser ?

Unable to save the system configuration
Error: operation-aborted
Message: Cannot set all values
Class: OperationAbortedEx

Any suggestions or docs? Thanks

p47 of Manual.pdf but will not help you I think.

HTH.
Francois

..Tom

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

5

Francois: updating per below did the trick. Further issues:

- I still get the JavaScript popup error per below
- running CSW GetCapabilities now gives me:

<?xml version="1.0" encoding="UTF-8"?>
<ows:ExceptionReport xmlns:ows="http://www.opengis.net/ows&quot; version="1.0.0">
  <ows:Exception exceptionCode="NoApplicableCode">
    <ows:ExceptionText>Cannot load/process capabilities</ows:ExceptionText>
  </ows:Exception>
</ows:ExceptionReport>

-----Original Message-----
From: Francois-Xavier Prunayre
[mailto:francois-xavier.prunayre@anonymised.com]
Sent: Wednesday, 08 April 2009 12:05
To: Kralidis,Tom [Ontario]
Cc: geonetwork-devel@lists.sourceforge.net
Subject: Re: [GeoNetwork-devel] enabling and configuration of
CSW in svn trunk

2009/4/8 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:
> Thanks Francois, in gast/setup/db/Settings.ddf:
>
> 120 1 csw
> 121 120 enable true
>
> ..does this mean it's enabled?
>
> Note that I did svn up && ant, and that's it. Do I need to
use GAST as well? Note that I don't want to affect existing
metadata in my install.
Yep you have to add those new settings into your db.
You could use java -jar gast.jar -setup (It will clean &
recreate your db)

I'm still working on the CSW harvester and will commit some
more fixes soon.

I have to check the ticket you created on CSW last month and
be sure they will be fixed for comming RC.

Test and comments welcomed.

Cheers

Francois

> I cleared my cache and got the same result (JavaScript
popup error). As well, I tried directly against the CSW and get:
>
http://host/geonetwork/srv/en/csw?service=CSW&version=2.0.2&request=Ge
> tCapabilities
>
> and get:
>
> <?xml version="1.0" encoding="UTF-8"?> <response>
> <info>CSW harvesting is disabled</info> </response>
>
> Any idea?
>
> ..Tom
>
>
>
> -----Original Message-----
> From: Francois-Xavier Prunayre
> [mailto:francois-xavier.prunayre@anonymised.com]
> Sent: Wed 08-Apr-09 11:26
> To: Kralidis,Tom [Ontario]
> Cc: geonetwork-devel@lists.sourceforge.net
> Subject: Re: [GeoNetwork-devel] enabling and configuration
of CSW in
> svn trunk
>
> Hello Tom,
>
> 2009/4/8 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:
>>
>> Using svn trunk, CSW support is now disabled by default.

How do I enable it?

>>
>> Trying to do so in Admin/System configuration results in a
JavaScript error when trying to save (using FF 3.0.8):
>
> Could you have a look to Settings.ddf in gast/setup/db/ and
check that
> csw is enabled by default on install.
> I can't reproduce the problem.
> Then maybe cleanup your JS cache in your browser ?
>
>
>>
>> Unable to save the system configuration
>> Error: operation-aborted
>> Message: Cannot set all values
>> Class: OperationAbortedEx
>>
>> Any suggestions or docs? Thanks
> p47 of Manual.pdf but will not help you I think.
>
> HTH.
> Francois
>
>
>
>>
>> ..Tom
>>
>>
---------------------------------------------------------------------
>> ---------
>> This SF.net email is sponsored by:
>> High Quality Requirements in a Collaborative Environment.
>> Download a free trial of Rational Requirements Composer Now!
>> http://p.sf.net/sfu/www-ibm-com
>> _______________________________________________
>> GeoNetwork-devel mailing list
>> GeoNetwork-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
>> GeoNetwork OpenSource is maintained at
>> http://sourceforge.net/projects/geonetwork
>>
>
>

6

Using svn trunk and re-initing GN with GAST -setupdb, when I try a batch
upload of metadata, an error is thrown complaining about the metadata
being too long to insert.

Digging deeper (I'm using MySQL), I find that column Metadata.data is
now a text datatype. This used to be longtext. When I alter column
Metadata.data to longtext, and try to batch upload again, there are no
errors.

Can we ensure that Metadata.data is of type longtext for MySQL?

..Tom

7

Hi Tom,
Thanks for the report! I compared the sql scripts for MySQL with previous versions and found no differences for the Metadata.data column. The challenge now is to understand where this error actually comes from. I have no solution yet but will investigate a bit more.
Ciao,
Jeroen

On Apr 10, 2009, at 7:52 PM, Kralidis,Tom [Ontario] wrote:

Using svn trunk and re-initing GN with GAST -setupdb, when I try a batch
upload of metadata, an error is thrown complaining about the metadata
being too long to insert.

Digging deeper (I'm using MySQL), I find that column Metadata.data is
now a text datatype. This used to be longtext. When I alter column
Metadata.data to longtext, and try to batch upload again, there are no
errors.

Can we ensure that Metadata.data is of type longtext for MySQL?

..Tom

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

8

It would be good to create a migration SQL script to apply the changes to the database schema and do the necessary inserts in tables. Did anyone start with such script yet?
Jeroen

On Apr 8, 2009, at 6:05 PM, Francois-Xavier Prunayre wrote:

2009/4/8 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:

Thanks Francois, in gast/setup/db/Settings.ddf:

120 1 csw
121 120 enable true

..does this mean it's enabled?

Note that I did svn up && ant, and that's it. Do I need to use GAST as well? Note that I don't want to affect existing metadata in my install.

Yep you have to add those new settings into your db.
You could use java -jar gast.jar -setup (It will clean & recreate your db)

I'm still working on the CSW harvester and will commit some more fixes soon.

I have to check the ticket you created on CSW last month and be sure
they will be fixed for comming RC.

Test and comments welcomed.

Cheers

Francois

I cleared my cache and got the same result (JavaScript popup error). As well, I tried directly against the CSW and get:
http://host/geonetwork/srv/en/csw?service=CSW&version=2.0.2&request=GetCapabilities

and get:

<?xml version="1.0" encoding="UTF-8"?>
<response>
<info>CSW harvesting is disabled</info>
</response>

Any idea?

..Tom

-----Original Message-----
From: Francois-Xavier Prunayre [mailto:francois-xavier.prunayre@anonymised.com]
Sent: Wed 08-Apr-09 11:26
To: Kralidis,Tom [Ontario]
Cc: geonetwork-devel@lists.sourceforge.net
Subject: Re: [GeoNetwork-devel] enabling and configuration of CSW in svn trunk

Hello Tom,

2009/4/8 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:

Using svn trunk, CSW support is now disabled by default. How do I enable it?

Trying to do so in Admin/System configuration results in a JavaScript error when trying to save (using FF 3.0.8):

Could you have a look to Settings.ddf in gast/setup/db/ and check that
csw is enabled by default on install.
I can't reproduce the problem.
Then maybe cleanup your JS cache in your browser ?

Unable to save the system configuration
Error: operation-aborted
Message: Cannot set all values
Class: OperationAbortedEx

Any suggestions or docs? Thanks

p47 of Manual.pdf but will not help you I think.

HTH.
Francois

..Tom

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

9

Hi Tom,

2009/4/10 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:

Francois: updating per below did the trick. Further issues:

- I still get the JavaScript popup error per below
- running CSW GetCapabilities now gives me:

<?xml version="1.0" encoding="UTF-8"?>
<ows:ExceptionReport xmlns:ows="http://www.opengis.net/ows&quot; version="1.0.0">
<ows:Exception exceptionCode="NoApplicableCode">
<ows:ExceptionText>Cannot load/process capabilities</ows:ExceptionText>
</ows:Exception>
</ows:ExceptionReport>

I can't reprodruce the problem after a gast -setup. Could you post the
log file ?

Thanks.

Francois

10

Hello Jeroen,

2009/4/10 Ticheler Jeroen <jeroen.ticheler@anonymised.com>:

Hi Tom,
Thanks for the report! I compared the sql scripts for MySQL with
previous versions and found no differences for the Metadata.data
column. The challenge now is to understand where this error actually
comes from. I have no solution yet but will investigate a bit more.

Maybe the issue is that sometimes we're using Druid to update the sql
script and sometimes not :slight_smile:
I checked in database.druid and data types mapping for mysql is text
not longtext. I could do the update, if it's ok for you ?

Francois

Ciao,
Jeroen

On Apr 10, 2009, at 7:52 PM, Kralidis,Tom [Ontario] wrote:

Using svn trunk and re-initing GN with GAST -setupdb, when I try a
batch
upload of metadata, an error is thrown complaining about the metadata
being too long to insert.

Digging deeper (I'm using MySQL), I find that column Metadata.data is
now a text datatype. This used to be longtext. When I alter column
Metadata.data to longtext, and try to batch upload again, there are no
errors.

Can we ensure that Metadata.data is of type longtext for MySQL?

..Tom

11

-----Original Message-----
From: Francois-Xavier Prunayre
[mailto:francois-xavier.prunayre@anonymised.com]
Sent: Tuesday, 14 April 2009 02:31
To: Kralidis,Tom [Ontario]
Cc: geonetwork-devel@lists.sourceforge.net
Subject: Re: [GeoNetwork-devel] enabling and configuration of
CSW in svn trunk

Hi Tom,

2009/4/10 Kralidis,Tom [Ontario] <Tom.Kralidis@anonymised.com>:
>
> Francois: updating per below did the trick. Further issues:
>
> - I still get the JavaScript popup error per below
> - running CSW GetCapabilities now gives me:
>
> <?xml version="1.0" encoding="UTF-8"?> <ows:ExceptionReport
> xmlns:ows="http://www.opengis.net/ows&quot; version="1.0.0">
> <ows:Exception exceptionCode="NoApplicableCode">
> <ows:ExceptionText>Cannot load/process
> capabilities</ows:ExceptionText>
> </ows:Exception>
> </ows:ExceptionReport>
>

I can't reprodruce the problem after a gast -setup. Could you
post the log file ?

Here's what I get when invoking a http://host/geonetwork/srv/en/csw?service=CSW&version=2.0.2&request=GetCapabilities :

2009-04-14 08:16:37,395 INFO [jeeves.request] - ==========================================================
2009-04-14 08:16:37,395 INFO [jeeves.request] - HTML Request (from 199.212.19.130) : /geonetwork//srv/en/csw
2009-04-14 08:16:37,395 DEBUG [jeeves.request] - Method : GET
2009-04-14 08:16:37,396 DEBUG [jeeves.request] - Content type : null
2009-04-14 08:16:37,396 DEBUG [jeeves.request] - Accept : text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
2009-04-14 08:16:37,396 DEBUG [jeeves.request] - Session id is A294B7D1A1273DCF21BB54C58DFB8E32
2009-04-14 08:16:37,396 INFO [jeeves.service] - Dispatching : csw
2009-04-14 08:16:37,396 DEBUG [jeeves.service] - -> parameters are :
<request>
  <service>CSW</service>
  <request>GetCapabilities</request>
</request>
2009-04-14 08:16:37,398 INFO [jeeves.webapp.csw] - Received:
<request>
  <service>CSW</service>
  <request>GetCapabilities</request>
</request>
2009-04-14 08:16:37,399 DEBUG [jeeves.webapp.csw] - Adapted GET request is:
<csw:GetCapabilities xmlns:csw="http://www.opengis.net/cat/csw/2.0.2&quot; service="CSW" />
2009-04-14 08:16:37,399 INFO [jeeves.webapp.csw] - Dispatching operation : GetCapabilities
2009-04-14 08:16:37,401 ERROR [geonetwork.csw] - Cannot load/process capabilities
2009-04-14 08:16:37,402 ERROR [geonetwork.csw] - (C) StackTrace
java.lang.NullPointerException
        at org.fao.geonet.lib.ElementLib.substitute(ElementLib.java:148)
        at org.fao.geonet.lib.ElementLib.substitute(ElementLib.java:119)
        at org.fao.geonet.kernel.csw.services.GetCapabilities.substitute(GetCapabilities.java:244)
        at org.fao.geonet.kernel.csw.services.GetCapabilities.execute(GetCapabilities.java:90)
        at org.fao.geonet.kernel.csw.CatalogDispatcher.dispatchI(CatalogDispatcher.java:181)
        at org.fao.geonet.kernel.csw.CatalogDispatcher.dispatch(CatalogDispatcher.java:106)
        at org.fao.geonet.services.main.CswDispatcher.exec(CswDispatcher.java:77)
        at jeeves.server.dispatchers.ServiceInfo.execService(ServiceInfo.java:238)
        at jeeves.server.dispatchers.ServiceInfo.execServices(ServiceInfo.java:141)
        at jeeves.server.dispatchers.ServiceManager.dispatch(ServiceManager.java:377)
        at jeeves.server.JeevesEngine.dispatch(JeevesEngine.java:621)
        at jeeves.server.sources.http.JeevesServlet.execute(JeevesServlet.java:174)
        at jeeves.server.sources.http.JeevesServlet.doGet(JeevesServlet.java:89)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
        at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190)
        at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:283)
        at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:767)
        at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:697)
        at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)
        at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690)
        at java.lang.Thread.run(Unknown Source)

2009-04-14 08:16:37,403 INFO [jeeves.service] - -> dispatching to output for : csw
2009-04-14 08:16:37,403 INFO [jeeves.service] - -> writing xml for : csw
2009-04-14 08:16:37,403 DEBUG [jeeves.service] - Service xml is :
<ows:ExceptionReport xmlns:ows="http://www.opengis.net/ows&quot; version="1.0.0">
  <ows:Exception exceptionCode="NoApplicableCode">
    <ows:ExceptionText>Cannot load/process capabilities</ows:ExceptionText>
  </ows:Exception>
</ows:ExceptionReport>
2009-04-14 08:16:37,403 INFO [jeeves.service] - -> output ended for : csw
2009-04-14 08:16:37,403 INFO [jeeves.service] - -> dispatch ended for : csw

..Tom

12

Hi Fancois,
Sounds good to me.
Ciao,
Jeroen

On Apr 14, 2009, at 8:46 AM, Francois-Xavier Prunayre wrote:

Hello Jeroen,

2009/4/10 Ticheler Jeroen <jeroen.ticheler@anonymised.com>:

Hi Tom,
Thanks for the report! I compared the sql scripts for MySQL with
previous versions and found no differences for the Metadata.data
column. The challenge now is to understand where this error actually
comes from. I have no solution yet but will investigate a bit more.

Maybe the issue is that sometimes we're using Druid to update the sql
script and sometimes not :slight_smile:
I checked in database.druid and data types mapping for mysql is text
not longtext. I could do the update, if it's ok for you ?

Francois

Ciao,
Jeroen

On Apr 10, 2009, at 7:52 PM, Kralidis,Tom [Ontario] wrote:

Using svn trunk and re-initing GN with GAST -setupdb, when I try a
batch
upload of metadata, an error is thrown complaining about the metadata
being too long to insert.

Digging deeper (I'm using MySQL), I find that column Metadata.data is
now a text datatype. This used to be longtext. When I alter column
Metadata.data to longtext, and try to batch upload again, there are no
errors.

Can we ensure that Metadata.data is of type longtext for MySQL?

..Tom