[GeoNetwork-users] Harvest from ESRI portal

Dear all,

unfortunately I need to harvest some metadata from an ESRI geoportal, but I got some problem.

I'm using Geonetwork 2.10.3 on tomcat 6 in a Ubuntu 12.04 LTS.
I set the CSW harvest as follow:

service URL: http://name_server/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2

I also add a search criteria: AnyText = EGIP (that is a special keyword to retrieve only some metadata)

But I got the following error:
Error: Raised exception when searching:
                                                   Invalid parameter value: locator=PropertyName
                                                           
                                                Class: OperationAbortedEx
                                             
                                                Stack:
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute
                                             
                                                at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run
                                             
                                                at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run

Looking in the geonetwork log I found:
2014-10-23 10:48:58,097 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-23 10:48:58,206 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

I tried also to remove the search option, in this case I'm able to retrieve the metadata.
However I must use the search criteria.

Could someone help me?

Regards

Eugenio
                 

Hi Eugenio,

Harvesting from the open source geoportal server should work just fine. note that the Geoportal Server supports the Filter spec, not CQL.
If you can share the CSW URL, I can troubleshoot some

Here is a simple XML post app you can use with the Geoportal Server instance:
http://gptogc.esri.com/postXML/

cheers,

Marten
Product Manager Esri Geoportal Server

-----Original Message-----
From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Thursday, October 23, 2014 10:50 AM
To: Lista Geonetwork
Subject: [GeoNetwork-users] Harvest from ESRI portal

Dear all,

unfortunately I need to harvest some metadata from an ESRI geoportal, but I got some problem.

I'm using Geonetwork 2.10.3 on tomcat 6 in a Ubuntu 12.04 LTS.
I set the CSW harvest as follow:

service URL: http://name_server/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2

I also add a search criteria: AnyText = EGIP (that is a special keyword to retrieve only some metadata)

But I got the following error:
Error: Raised exception when searching:
                                                   Invalid parameter value: locator=PropertyName
                                                           
                                                Class: OperationAbortedEx
                                             
                                                Stack:
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute
                                             
                                                at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run
                                             
                                                at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run

Looking in the geonetwork log I found:
2014-10-23 10:48:58,097 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-23 10:48:58,206 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

I tried also to remove the search option, in this case I'm able to retrieve the metadata.
However I must use the search criteria.

Could someone help me?

Regards

Eugenio
                 
------------------------------------------------------------------------------
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Hi Marten,

the complete CSW URL is: http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2
and I must use the search criteria, I have to retrieve only the metadata containing 'EGIP' as keyword.

If you will be able to give me a workaround I will be very happy!

regards

Eugenio

From: mhogeweg@anonymised.com
To: frippe12573@anonymised.com; geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal
Date: Thu, 23 Oct 2014 10:07:34 +0000

Hi Eugenio,

Harvesting from the open source geoportal server should work just fine. note that the Geoportal Server supports the Filter spec, not CQL.
If you can share the CSW URL, I can troubleshoot some

Here is a simple XML post app you can use with the Geoportal Server instance:
http://gptogc.esri.com/postXML/

cheers,

Marten
Product Manager Esri Geoportal Server

-----Original Message-----
From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Thursday, October 23, 2014 10:50 AM
To: Lista Geonetwork
Subject: [GeoNetwork-users] Harvest from ESRI portal

Dear all,

unfortunately I need to harvest some metadata from an ESRI geoportal, but I got some problem.

I'm using Geonetwork 2.10.3 on tomcat 6 in a Ubuntu 12.04 LTS.
I set the CSW harvest as follow:

service URL: http://name_server/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2

I also add a search criteria: AnyText = EGIP (that is a special keyword to retrieve only some metadata)

But I got the following error:
Error: Raised exception when searching:
                                                   Invalid parameter value: locator=PropertyName
                                                           
                                                Class: OperationAbortedEx
                                             
                                                Stack:
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute
                                             
                                                at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run
                                             
                                                at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run

Looking in the geonetwork log I found:
2014-10-23 10:48:58,097 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-23 10:48:58,206 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

I tried also to remove the search option, in this case I'm able to retrieve the metadata.
However I must use the search criteria.

Could someone help me?

Regards

Eugenio
                 
------------------------------------------------------------------------------
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Try this GetRecords request on this service. It appears there are 3 items that match the filter.

<csw:GetRecords xmlns:csw="http://www.opengis.net/cat/csw/2.0.2&quot; xmlns:ogc="http://www.opengis.net/ogc&quot; xmlns:ows="http://www.opengis.net/ows&quot; version="2.0.2" resultType="RESULTS" service="csw" xmlns:dc="http://purl.org/dc/elements/1.1/&quot;&gt;
  <csw:Query typeNames="csw:Record">
    <csw:ElementSetName>summary</csw:ElementSetName>
    <csw:Constraint version="1.0.0">
      <ogc:Filter xmlns:ogc="http://www.opengis.net/ogc&quot;&gt;
          <ogc:PropertyIsLike wildCard="%" escapeChar="" singleChar="">
            <ogc:PropertyName>AnyText</ogc:PropertyName>
            <ogc:Literal>EGIP</ogc:Literal>
          </ogc:PropertyIsLike>
      </ogc:Filter>
    </csw:Constraint>
  </csw:Query>
</csw:GetRecords>

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Thursday, October 23, 2014 12:35 PM
To: Marten Hogeweg; Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal

Hi Marten,

the complete CSW URL is: http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2
and I must use the search criteria, I have to retrieve only the metadata containing 'EGIP' as keyword.

If you will be able to give me a workaround I will be very happy!

regards

Eugenio

From: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>
To: frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>; geonetwork-users@anonymised.comists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal
Date: Thu, 23 Oct 2014 10:07:34 +0000

Hi Eugenio,

Harvesting from the open source geoportal server should work just fine. note that the Geoportal Server supports the Filter spec, not CQL.
If you can share the CSW URL, I can troubleshoot some

Here is a simple XML post app you can use with the Geoportal Server instance:
http://gptogc.esri.com/postXML/

cheers,

Marten
Product Manager Esri Geoportal Server

-----Original Message-----
From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Thursday, October 23, 2014 10:50 AM
To: Lista Geonetwork
Subject: [GeoNetwork-users] Harvest from ESRI portal

Dear all,

unfortunately I need to harvest some metadata from an ESRI geoportal, but I got some problem.

I'm using Geonetwork 2.10.3 on tomcat 6 in a Ubuntu 12.04 LTS.
I set the CSW harvest as follow:

service URL: http://name_server/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2

I also add a search criteria: AnyText = EGIP (that is a special keyword to retrieve only some metadata)

But I got the following error:
Error: Raised exception when searching:
Invalid parameter value: locator=PropertyName

Class: OperationAbortedEx

Stack:

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest

at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest

at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process

at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest

at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute

at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run

at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run

Looking in the geonetwork log I found:
2014-10-23 10:48:58,097 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-23 10:48:58,206 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

I tried also to remove the search option, in this case I'm able to retrieve the metadata.
However I must use the search criteria.

Could someone help me?

Regards

Eugenio

------------------------------------------------------------------------------
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net<mailto:GeoNetwork-users@anonymised.comceforge.net>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Hi Marten,

you are right, I tested the CSW URL with getrecord request by using CSW plugin in QGIS,
actually I'm able to get the 3 records.

So I guess the problem is on the url passed to geonetwork,
what do you think about?

Any hints?

E.

From: mhogeweg@anonymised.com
To: frippe12573@anonymised.com; geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal
Date: Thu, 23 Oct 2014 13:04:22 +0000

Try this GetRecords request on this service. It appears there are 3 items that match the filter.

<csw:GetRecords xmlns:csw="http://www.opengis.net/cat/csw/2.0.2&quot; xmlns:ogc="http://www.opengis.net/ogc&quot; xmlns:ows="http://www.opengis.net/ows&quot; version="2.0.2"
resultType="RESULTS" service="csw" xmlns:dc="http://purl.org/dc/elements/1.1/&quot;&gt;
  <csw:Query typeNames="csw:Record">
    <csw:ElementSetName>summary</csw:ElementSetName>
    <csw:Constraint version="1.0.0">
      <ogc:Filter xmlns:ogc="http://www.opengis.net/ogc&quot;&gt;
          <ogc:PropertyIsLike wildCard="%" escapeChar="" singleChar="">
            <ogc:PropertyName>AnyText</ogc:PropertyName>
            <ogc:Literal>EGIP</ogc:Literal>
          </ogc:PropertyIsLike>
      </ogc:Filter>
    </csw:Constraint>
  </csw:Query>
</csw:GetRecords>

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]

Sent: Thursday, October 23, 2014 12:35 PM

To: Marten Hogeweg; Lista Geonetwork

Subject: RE: [GeoNetwork-users] Harvest from ESRI portal

Hi Marten,

the complete CSW URL is:
http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2

and I must use the search criteria, I have to retrieve only the metadata containing 'EGIP' as keyword.

If you will be able to give me a workaround I will be very happy!

regards

Eugenio

From:

mhogeweg@anonymised.com

To: frippe12573@anonymised.com;

geonetwork-users@lists.sourceforge.net

Subject: RE: [GeoNetwork-users] Harvest from ESRI portal

Date: Thu, 23 Oct 2014 10:07:34 +0000

Hi Eugenio,

Harvesting from the open source geoportal server should work just fine. note that the Geoportal Server supports the Filter spec, not CQL.

If you can share the CSW URL, I can troubleshoot some

Here is a simple XML post app you can use with the Geoportal Server instance:

http://gptogc.esri.com/postXML/

cheers,

Marten

Product Manager Esri Geoportal Server

-----Original Message-----

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]

Sent: Thursday, October 23, 2014 10:50 AM

To: Lista Geonetwork

Subject: [GeoNetwork-users] Harvest from ESRI portal

Dear all,

unfortunately I need to harvest some metadata from an ESRI geoportal, but I got some problem.

I'm using Geonetwork 2.10.3 on tomcat 6 in a Ubuntu 12.04 LTS.

I set the CSW harvest as follow:

service URL:

http://name_server/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2

I also add a search criteria: AnyText = EGIP (that is a special keyword to retrieve only some metadata)

But I got the following error:

Error: Raised exception when searching:

Invalid parameter value: locator=PropertyName

Class: OperationAbortedEx

Stack:

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest

at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest

at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process

at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest

at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute

at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run

at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run

Looking in the geonetwork log I found:

2014-10-23 10:48:58,097 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=

Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=

Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx

2014-10-23 10:48:58,206 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:

Invalid parameter value: locator=PropertyName

I tried also to remove the search option, in this case I'm able to retrieve the metadata.

However I must use the search criteria.

Could someone help me?

Regards

Eugenio

------------------------------------------------------------------------------

_______________________________________________

GeoNetwork-users mailing list

GeoNetwork-users@lists.sourceforge.net

https://lists.sourceforge.net/lists/listinfo/geonetwork-users

GeoNetwork OpenSource is maintained at

http://sourceforge.net/projects/geonetwork

Do you know from log files or fiddler or such what requests are actually sent to Geoportal Server?

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Thursday, October 23, 2014 5:45 PM
To: Marten Hogeweg; Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal

Hi Marten,

you are right, I tested the CSW URL with getrecord request by using CSW plugin in QGIS,
actually I'm able to get the 3 records.

So I guess the problem is on the url passed to geonetwork,
what do you think about?

Any hints?

E.
________________________________
From: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>
To: frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>; geonetwork-users@anonymised.comts.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal
Date: Thu, 23 Oct 2014 13:04:22 +0000
Try this GetRecords request on this service. It appears there are 3 items that match the filter.

<csw:GetRecords xmlns:csw="http://www.opengis.net/cat/csw/2.0.2&quot; xmlns:ogc="http://www.opengis.net/ogc&quot; xmlns:ows="http://www.opengis.net/ows&quot; version="2.0.2" resultType="RESULTS" service="csw" xmlns:dc="http://purl.org/dc/elements/1.1/&quot;&gt;
  <csw:Query typeNames="csw:Record">
    <csw:ElementSetName>summary</csw:ElementSetName>
    <csw:Constraint version="1.0.0">
      <ogc:Filter xmlns:ogc="http://www.opengis.net/ogc&quot;&gt;
          <ogc:PropertyIsLike wildCard="%" escapeChar="" singleChar="">
            <ogc:PropertyName>AnyText</ogc:PropertyName>
            <ogc:Literal>EGIP</ogc:Literal>
          </ogc:PropertyIsLike>
      </ogc:Filter>
    </csw:Constraint>
  </csw:Query>
</csw:GetRecords>

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Thursday, October 23, 2014 12:35 PM
To: Marten Hogeweg; Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal

Hi Marten,

the complete CSW URL is: http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2
and I must use the search criteria, I have to retrieve only the metadata containing 'EGIP' as keyword.

If you will be able to give me a workaround I will be very happy!

regards

Eugenio

From: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>
To: frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>; geonetwork-users@anonymised.comists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal
Date: Thu, 23 Oct 2014 10:07:34 +0000

Hi Eugenio,

Harvesting from the open source geoportal server should work just fine. note that the Geoportal Server supports the Filter spec, not CQL.
If you can share the CSW URL, I can troubleshoot some

Here is a simple XML post app you can use with the Geoportal Server instance:
http://gptogc.esri.com/postXML/

cheers,

Marten
Product Manager Esri Geoportal Server

-----Original Message-----
From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Thursday, October 23, 2014 10:50 AM
To: Lista Geonetwork
Subject: [GeoNetwork-users] Harvest from ESRI portal

Dear all,

unfortunately I need to harvest some metadata from an ESRI geoportal, but I got some problem.

I'm using Geonetwork 2.10.3 on tomcat 6 in a Ubuntu 12.04 LTS.
I set the CSW harvest as follow:

service URL: http://name_server/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2

I also add a search criteria: AnyText = EGIP (that is a special keyword to retrieve only some metadata)

But I got the following error:
Error: Raised exception when searching:
Invalid parameter value: locator=PropertyName

Class: OperationAbortedEx

Stack:

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search

at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest

at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest

at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process

at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest

at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute

at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run

at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run

Looking in the geonetwork log I found:
2014-10-23 10:48:58,097 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-23 10:48:58,205 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-23 10:48:58,206 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

I tried also to remove the search option, in this case I'm able to retrieve the metadata.
However I must use the search criteria.

Could someone help me?

Regards

Eugenio

------------------------------------------------------------------------------
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net<mailto:GeoNetwork-users@anonymised.comceforge.net>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Dear Marten,

this morning I started again with a fresh harvest connection toward esri geoportal server,

I set the CSW url as follow:

http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&SERVICE=CSW&acceptVERSION=2.0.2

and in the same time I run a tail on geonetwork log file,
here you can find the error:

http://paste.ubuntu.com/8651709/

From the log lines the problem seems to be related to a specific prefix in the name of the possible field that I can use as search criteria.

This error appear when I was trying to save the harvest settings with the AnyText = EGIP

As I said yesterday, if I remove the search criteria I got 103 records.
After that If I put again the keyword EGIP I got these lines in the log file:

2014-10-24 09:23:49,128 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..2)
2014-10-24 09:23:49,316 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Raised exception when searching:
Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Changing to CSW harvester to use POST
2014-10-24 09:23:49,318 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..21)
2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message=
Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

and these line in the geonetwork harvest history:

Error: Raised exception when searching:
                                                   Invalid parameter value: locator=PropertyName
                                                           
                                                Class: OperationAbortedEx
                                             
                                                Stack:
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute
                                             
                                                at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run
                                             
                                                at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run
Here the catilina.out log, which is quite similar with the geonetwork.log:

http://paste.ubuntu.com/8651845/

I wonder if my problem is not related to the csw URL, otherwise I don't know, where could be the problem.

Kind regards

E.
                 

Hi Eugenio,

Could it be the way that geoportal CSW is set up just for FILTER (rather than also for CQL_TEXT)?

A query using ConstraintLanguage=CQL_TEXT [below] retrieves an error message saying that CQL_TEXT isnt supported (and only "Filter" is supported);

http://gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&version=2.0.2&outputSchema=http%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd&namespace=xmlns(csw%3Dhttp%3A%2F%2Fwww.opengis.net%2Fcat%2Fcsw%2F2.0.2)%2Cxmlns(gmd%3Dhttp%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd)&constraintLanguage=CQL_TEXT&constraint_language_version=1.1.0&typeNames=csw%3ARecord&resultType=results&constraint=AnyText+=+'egim'

and this is confirmed by the GetCapabilities response.

And yes, this returns a statement of 105 records:
http://gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&acceptVersions=2.0.2

But this retrieved an error:
gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&version=2.0.2&outputSchema=http%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd&namespace=xmlns(csw%3Dhttp%3A%2F%2Fwww.opengis.net%2Fcat%2Fcsw%2F2.0.2)%2Cxmlns(gmd%3Dhttp%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd)&constraintLanguage=filter&constraint_language_version=1.1.0&typeNames=gmd%3AMD_Metadata&resultType=results&Constraint=<Filter><PropertyIsEqualTo><PropertyName>Title</PropertyName><Literal>egip</Literal></PropertyIsEqualTo></Filter>

I'm not very familiar with the OGC filterEncoding standard (nor CSW), but am wondering whether a CSW search using constraintLanguage=Filter (looking for anyText and 'egip") is incongruous with getRecords, as a "get" (rather than as a post) ??

This ESRI webpg seems to suggest it:
http://webhelp.esri.com/geoportal_extension/9.3.1/index.htm#geoportal_csw_cmpnts.htm

Kate

-----Original Message-----
From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, 24 October 2014 6:34 PM
To: Marten Hogeweg; Lista Geonetwork
Subject: Re: [GeoNetwork-users] Harvest from ESRI portal

Dear Marten,

this morning I started again with a fresh harvest connection toward esri geoportal server,

I set the CSW url as follow:

http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&SERVICE=CSW&acceptVERSION=2.0.2

and in the same time I run a tail on geonetwork log file, here you can find the error:

http://paste.ubuntu.com/8651709/

From the log lines the problem seems to be related to a specific prefix in the name of the possible field that I can use as search criteria.

This error appear when I was trying to save the harvest settings with the AnyText = EGIP

As I said yesterday, if I remove the search criteria I got 103 records.
After that If I put again the keyword EGIP I got these lines in the log file:

2014-10-24 09:23:49,128 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..2)
2014-10-24 09:23:49,316 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message= Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Raised exception when searching:
Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Changing to CSW harvester to use POST
2014-10-24 09:23:49,318 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..21)
2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message= Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

and these line in the geonetwork harvest history:

Error: Raised exception when searching:
                                                   Invalid parameter value: locator=PropertyName
                                                           
                                                Class: OperationAbortedEx
                                             
                                                Stack:
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute
                                             
                                                at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run
                                             
                                                at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run Here the catilina.out log, which is quite similar with the geonetwork.log:

http://paste.ubuntu.com/8651845/

I wonder if my problem is not related to the csw URL, otherwise I don't know, where could be the problem.

Kind regards

E.
                 
------------------------------------------------------------------------------
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Couple things:

The error indicates an issue with apiso:Abstract (Error on line 2: The prefix "apiso" for element "apiso:Abstract" is not bound.)

Make sure the request defines the apiso namespace as 'http://www.opengis.net/cat/csw/apiso/1.0

the reference to the 9.3.1 online help does not apply anymore (it's about 6 years old) since we made Geoportal Server open source 4 years ago and moved to GitHub. Documentation can be found in the wiki:
https://github.com/Esri/geoportal-server/wiki

Regarding get/post: please see this article on the Geoportal Server github site:
https://github.com/Esri/geoportal-server/wiki/Catalog-Service#GetRecords

that page explains Geoportal Server does support HTTP GET for GetRecords using this KVP example:
http://gptogc.esri.com/geoportal/csw?request=getRecords&service=CSW&startPosition=1&maxRecords=10&resultType=results&elementSetName=full&outputFormat=application/xml&outputschema=http://www.isotc211.org/2005/gmd&constraintLanguage=Filter&Constraint=<ogc:Filter><ogc:Overlaps><ogc:PropertyName>ows:BoundingBox</ogc:PropertyName><gml:Envelope><gml:lowerCorner>-90%20-180</gml:lowerCorner><gml:upperCorner>90%2090</gml:upperCorner></gml:Envelope></ogc:Overlaps></ogc:Filter>&namespace=xmlns(gml=http://www.opengis.net/gml),xmlns(ogc=http://www.opengis.net/ogc)

We have not implemented CQL as we have not had a user need for it. I don't know CQL enough to compare it to Filter and perhaps someone has a mapping/translation to share between the two.

Hope this helps,

Marten

-----Original Message-----
From: Kate Roberts [mailto:K.Roberts@anonymised.com]
Sent: Friday, October 24, 2014 10:29 AM
To: 'Eugenio Trumpy'; Marten Hogeweg
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Hi Eugenio,

Could it be the way that geoportal CSW is set up just for FILTER (rather than also for CQL_TEXT)?

A query using ConstraintLanguage=CQL_TEXT [below] retrieves an error message saying that CQL_TEXT isnt supported (and only "Filter" is supported);

http://gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&version=2.0.2&outputSchema=http%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd&namespace=xmlns(csw%3Dhttp%3A%2F%2Fwww.opengis.net%2Fcat%2Fcsw%2F2.0.2)%2Cxmlns(gmd%3Dhttp%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd)&constraintLanguage=CQL_TEXT&constraint_language_version=1.1.0&typeNames=csw%3ARecord&resultType=results&constraint=AnyText+=+'egim'

and this is confirmed by the GetCapabilities response.

And yes, this returns a statement of 105 records:
http://gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&acceptVersions=2.0.2

But this retrieved an error:
gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&version=2.0.2&outputSchema=http%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd&namespace=xmlns(csw%3Dhttp%3A%2F%2Fwww.opengis.net%2Fcat%2Fcsw%2F2.0.2)%2Cxmlns(gmd%3Dhttp%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd)&constraintLanguage=filter&constraint_language_version=1.1.0&typeNames=gmd%3AMD_Metadata&resultType=results&Constraint=<Filter><PropertyIsEqualTo><PropertyName>Title</PropertyName><Literal>egip</Literal></PropertyIsEqualTo></Filter>

I'm not very familiar with the OGC filterEncoding standard (nor CSW), but am wondering whether a CSW search using constraintLanguage=Filter (looking for anyText and 'egip") is incongruous with getRecords, as a "get" (rather than as a post) ??

This ESRI webpg seems to suggest it:
http://webhelp.esri.com/geoportal_extension/9.3.1/index.htm#geoportal_csw_cmpnts.htm

Kate

-----Original Message-----
From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, 24 October 2014 6:34 PM
To: Marten Hogeweg; Lista Geonetwork
Subject: Re: [GeoNetwork-users] Harvest from ESRI portal

Dear Marten,

this morning I started again with a fresh harvest connection toward esri geoportal server,

I set the CSW url as follow:

http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&SERVICE=CSW&acceptVERSION=2.0.2

and in the same time I run a tail on geonetwork log file, here you can find the error:

http://paste.ubuntu.com/8651709/

From the log lines the problem seems to be related to a specific prefix in the name of the possible field that I can use as search criteria.

This error appear when I was trying to save the harvest settings with the AnyText = EGIP

As I said yesterday, if I remove the search criteria I got 103 records.
After that If I put again the keyword EGIP I got these lines in the log file:

2014-10-24 09:23:49,128 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..2)
2014-10-24 09:23:49,316 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message= Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Raised exception when searching:
Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Changing to CSW harvester to use POST
2014-10-24 09:23:49,318 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..21)
2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message= Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

and these line in the geonetwork harvest history:

Error: Raised exception when searching:
                                                   Invalid parameter value: locator=PropertyName
                                                           
                                                Class: OperationAbortedEx
                                             
                                                Stack:
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest
                                             
                                                at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute
                                             
                                                at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run
                                             
                                                at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run Here the catilina.out log, which is quite similar with the geonetwork.log:

http://paste.ubuntu.com/8651845/

I wonder if my problem is not related to the csw URL, otherwise I don't know, where could be the problem.

Kind regards

E.
                 
------------------------------------------------------------------------------
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to Lýsigagnagátt and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________
From: Marten Hogeweg [mhogeweg@anonymised.com]
Sent: Friday, 24 October 2014 8:26 PM
To: Kate Roberts; 'Eugenio Trumpy'
Cc: Lista Geonetwork
Subject: Re: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Couple things:

The error indicates an issue with apiso:Abstract (Error on line 2: The prefix "apiso" for element "apiso:Abstract" is not bound.)

Make sure the request defines the apiso namespace as 'http://www.opengis.net/cat/csw/apiso/1.0

the reference to the 9.3.1 online help does not apply anymore (it's about 6 years old) since we made Geoportal Server open source 4 years ago and moved to GitHub. Documentation can be found in the wiki:

Regarding get/post: please see this article on the Geoportal Server github site:

that page explains Geoportal Server does support HTTP GET for GetRecords using this KVP example:
http://gptogc.esri.com/geoportal/csw?request=getRecords&service=CSW&startPosition=1&maxRecords=10&resultType=results&elementSetName=full&outputFormat=application/xml&outputschema=http://www.isotc211.org/2005/gmd&constraintLanguage=Filter&Constraint=<ogc:Filter><ogc:Overlaps><ogc:PropertyName>ows:BoundingBox</ogc:PropertyName><gml:Envelope><gml:lowerCorner>-90%20-180</gml:lowerCorner><gml:upperCorner>90%2090</gml:upperCorner></gml:Envelope></ogc:Overlaps></ogc:Filter>&namespace=xmlns(gml=http://www.opengis.net/gml),xmlns(ogc=http://www.opengis.net/ogc)

We have not implemented CQL as we have not had a user need for it. I don't know CQL enough to compare it to Filter and perhaps someone has a mapping/translation to share between the two.

Hope this helps,

Marten

-----Original Message-----
From: Kate Roberts [mailto:K.Roberts@anonymised.com]
Sent: Friday, October 24, 2014 10:29 AM
To: 'Eugenio Trumpy'; Marten Hogeweg
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Hi Eugenio,

Could it be the way that geoportal CSW is set up just for FILTER (rather than also for CQL_TEXT)?

A query using ConstraintLanguage=CQL_TEXT [below] retrieves an error message saying that CQL_TEXT isnt supported (and only "Filter" is supported);

http://gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&version=2.0.2&outputSchema=http%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd&namespace=xmlns(csw%3Dhttp%3A%2F%2Fwww.opengis.net%2Fcat%2Fcsw%2F2.0.2)%2Cxmlns(gmd%3Dhttp%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd)&constraintLanguage=CQL_TEXT&constraint_language_version=1.1.0&typeNames=csw%3ARecord&resultType=results&constraint=AnyText+=+'egim'

and this is confirmed by the GetCapabilities response.

And yes, this returns a statement of 105 records:
http://gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&acceptVersions=2.0.2

But this retrieved an error:
gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&version=2.0.2&outputSchema=http%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd&namespace=xmlns(csw%3Dhttp%3A%2F%2Fwww.opengis.net%2Fcat%2Fcsw%2F2.0.2)%2Cxmlns(gmd%3Dhttp%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd)&constraintLanguage=filter&constraint_language_version=1.1.0&typeNames=gmd%3AMD_Metadata&resultType=results&Constraint=<Filter><PropertyIsEqualTo><PropertyName>Title</PropertyName><Literal>egip</Literal></PropertyIsEqualTo></Filter>

I'm not very familiar with the OGC filterEncoding standard (nor CSW), but am wondering whether a CSW search using constraintLanguage=Filter (looking for anyText and 'egip") is incongruous with getRecords, as a "get" (rather than as a post) ??

This ESRI webpg seems to suggest it:
http://webhelp.esri.com/geoportal_extension/9.3.1/index.htm#geoportal_csw_cmpnts.htm

Kate

-----Original Message-----
From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, 24 October 2014 6:34 PM
To: Marten Hogeweg; Lista Geonetwork
Subject: Re: [GeoNetwork-users] Harvest from ESRI portal

Dear Marten,

this morning I started again with a fresh harvest connection toward esri geoportal server,

I set the CSW url as follow:

http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&SERVICE=CSW&acceptVERSION=2.0.2

and in the same time I run a tail on geonetwork log file, here you can find the error:

http://paste.ubuntu.com/8651709/

From the log lines the problem seems to be related to a specific prefix in the name of the possible field that I can use as search criteria.

This error appear when I was trying to save the harvest settings with the AnyText = EGIP

As I said yesterday, if I remove the search criteria I got 103 records.
After that If I put again the keyword EGIP I got these lines in the log file:

2014-10-24 09:23:49,128 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..2)
2014-10-24 09:23:49,316 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message= Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Raised exception when searching:
Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Changing to CSW harvester to use POST
2014-10-24 09:23:49,318 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..21)
2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message= Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

and these line in the geonetwork harvest history:

Error: Raised exception when searching:
                                                   Invalid parameter value: locator=PropertyName

                                                Class: OperationAbortedEx

                                                Stack:

                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch

                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search

                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest

                                                at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest

                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process

                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest

                                                at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute

                                                at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run

                                                at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run Here the catilina.out log, which is quite similar with the geonetwork.log:

http://paste.ubuntu.com/8651845/

I wonder if my problem is not related to the csw URL, otherwise I don't know, where could be the problem.

Kind regards

E.

------------------------------------------------------------------------------
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net

GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

That is possible as well. See this article on the supported syntax:
https://github.com/Esri/geoportal-server/wiki/REST-API-Syntax

other paths are to use the sitemap which follows the sitemap protocol (http://www.sitemaps.org/protocol.html):
http://gptogc.esri.com/geoportal/sitemap?f=sitemap

or use the hip new DCAT format as used in many open data contexts (available since Geoportal Server 1.2.4):
http://gptogc.esri.com/geoportal/dcat.json

-----Original Message-----
From: Simon.Pigot@anonymised.com [mailto:Simon.Pigot@anonymised.com]
Sent: Friday, October 24, 2014 12:18 PM
To: Marten Hogeweg; K.Roberts@anonymised.com; frippe12573@anonymised.com
Cc: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to http://gatt.lmi.is/geoportal122 and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________
From: Marten Hogeweg [mhogeweg@anonymised.com]
Sent: Friday, 24 October 2014 8:26 PM
To: Kate Roberts; 'Eugenio Trumpy'
Cc: Lista Geonetwork
Subject: Re: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Couple things:

The error indicates an issue with apiso:Abstract (Error on line 2: The prefix "apiso" for element "apiso:Abstract" is not bound.)

Make sure the request defines the apiso namespace as 'http://www.opengis.net/cat/csw/apiso/1.0

the reference to the 9.3.1 online help does not apply anymore (it's about 6 years old) since we made Geoportal Server open source 4 years ago and moved to GitHub. Documentation can be found in the wiki:
https://github.com/Esri/geoportal-server/wiki

Regarding get/post: please see this article on the Geoportal Server github site:
https://github.com/Esri/geoportal-server/wiki/Catalog-Service#GetRecords

that page explains Geoportal Server does support HTTP GET for GetRecords using this KVP example:
http://gptogc.esri.com/geoportal/csw?request=getRecords&service=CSW&startPosition=1&maxRecords=10&resultType=results&elementSetName=full&outputFormat=application/xml&outputschema=http://www.isotc211.org/2005/gmd&constraintLanguage=Filter&Constraint=<ogc:Filter><ogc:Overlaps><ogc:PropertyName>ows:BoundingBox</ogc:PropertyName><gml:Envelope><gml:lowerCorner>-90%20-180</gml:lowerCorner><gml:upperCorner>90%2090</gml:upperCorner></gml:Envelope></ogc:Overlaps></ogc:Filter>&namespace=xmlns(gml=http://www.opengis.net/gml),xmlns(ogc=http://www.opengis.net/ogc)

We have not implemented CQL as we have not had a user need for it. I don't know CQL enough to compare it to Filter and perhaps someone has a mapping/translation to share between the two.

Hope this helps,

Marten

-----Original Message-----
From: Kate Roberts [mailto:K.Roberts@anonymised.com]
Sent: Friday, October 24, 2014 10:29 AM
To: 'Eugenio Trumpy'; Marten Hogeweg
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Hi Eugenio,

Could it be the way that geoportal CSW is set up just for FILTER (rather than also for CQL_TEXT)?

A query using ConstraintLanguage=CQL_TEXT [below] retrieves an error message saying that CQL_TEXT isnt supported (and only "Filter" is supported);

http://gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&version=2.0.2&outputSchema=http%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd&namespace=xmlns(csw%3Dhttp%3A%2F%2Fwww.opengis.net%2Fcat%2Fcsw%2F2.0.2)%2Cxmlns(gmd%3Dhttp%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd)&constraintLanguage=CQL_TEXT&constraint_language_version=1.1.0&typeNames=csw%3ARecord&resultType=results&constraint=AnyText+=+'egim'

and this is confirmed by the GetCapabilities response.

And yes, this returns a statement of 105 records:
http://gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&acceptVersions=2.0.2

But this retrieved an error:
gatt.lmi.is/geoportal122/csw?request=GetRecords&service=CSW&version=2.0.2&outputSchema=http%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd&namespace=xmlns(csw%3Dhttp%3A%2F%2Fwww.opengis.net%2Fcat%2Fcsw%2F2.0.2)%2Cxmlns(gmd%3Dhttp%3A%2F%2Fwww.isotc211.org%2F2005%2Fgmd)&constraintLanguage=filter&constraint_language_version=1.1.0&typeNames=gmd%3AMD_Metadata&resultType=results&Constraint=<Filter><PropertyIsEqualTo><PropertyName>Title</PropertyName><Literal>egip</Literal></PropertyIsEqualTo></Filter>

I'm not very familiar with the OGC filterEncoding standard (nor CSW), but am wondering whether a CSW search using constraintLanguage=Filter (looking for anyText and 'egip") is incongruous with getRecords, as a "get" (rather than as a post) ??

This ESRI webpg seems to suggest it:
http://webhelp.esri.com/geoportal_extension/9.3.1/index.htm#geoportal_csw_cmpnts.htm

Kate

-----Original Message-----
From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, 24 October 2014 6:34 PM
To: Marten Hogeweg; Lista Geonetwork
Subject: Re: [GeoNetwork-users] Harvest from ESRI portal

Dear Marten,

this morning I started again with a fresh harvest connection toward esri geoportal server,

I set the CSW url as follow:

http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&SERVICE=CSW&acceptVERSION=2.0.2

and in the same time I run a tail on geonetwork log file, here you can find the error:

http://paste.ubuntu.com/8651709/

From the log lines the problem seems to be related to a specific prefix in the name of the possible field that I can use as search criteria.

This error appear when I was trying to save the harvest settings with the AnyText = EGIP

As I said yesterday, if I remove the search criteria I got 103 records.
After that If I put again the keyword EGIP I got these lines in the log file:

2014-10-24 09:23:49,128 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..2)
2014-10-24 09:23:49,316 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message= Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Raised exception when searching:
Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,317 DEBUG [geonetwork.harvester] - Changing to CSW harvester to use POST
2014-10-24 09:23:49,318 INFO [geonetwork.harvester] - Searching on : OS Iceland (1..21)
2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.InvalidParameterValueEx: code=InvalidParameterValue, locator=PropertyName, message= Invalid parameter value: locator=PropertyName

2014-10-24 09:23:49,424 WARN [geonetwork.harvester] - Raised exception while harvesting from : OS Iceland (CswHarvester)
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Class : OperationAbortedEx
2014-10-24 09:23:49,425 WARN [geonetwork.harvester] - (C) Message : Raised exception when searching:
Invalid parameter value: locator=PropertyName

and these line in the geonetwork harvest history:

Error: Raised exception when searching:
                                                   Invalid parameter value: locator=PropertyName

                                                Class: OperationAbortedEx

                                                Stack:

                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 508 method: doSearch

                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 231 method: search

                                                at: org.fao.geonet.kernel.harvest.harvester.csw.Harvester file: Harvester.java line: 103 method: harvest

                                                at: org.fao.geonet.kernel.harvest.harvester.csw.CswHarvester file: CswHarvester.java line: 244 method: doHarvest

                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor file: AbstractHarvester.java line: 400 method: process

                                                at: org.fao.geonet.kernel.harvest.harvester.AbstractHarvester file: AbstractHarvester.java line: 470 method: harvest

                                                at: org.fao.geonet.kernel.harvest.harvester.HarvesterJob file: HarvesterJob.java line: 29 method: execute

                                                at: org.quartz.core.JobRunShell file: JobRunShell.java line: 213 method: run

                                                at: org.quartz.simpl.SimpleThreadPool$WorkerThread file: SimpleThreadPool.java line: 557 method: run Here the catilina.out log, which is quite similar with the geonetwork.log:

http://paste.ubuntu.com/8651845/

I wonder if my problem is not related to the csw URL, otherwise I don't know, where could be the problem.

Kind regards

E.

------------------------------------------------------------------------------
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,
that's way I need to harvest CSW.

E.

From: Simon.Pigot@anonymised.com
To: mhogeweg@anonymised.com; K.Roberts@anonymised.com; frippe12573@anonymised.com
CC: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to http://gatt.lmi.is/geoportal122 and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________

Geoportal Server provides an INSPIRE compliant CSW service. Described here (since Geoportal Server is included with ArcGIS for INSPIRE):
http://resources.arcgis.com/en/help/arcgis-for-inspire/10.2/index.html#/Catalog_Service/014m000000m9000000/

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, October 24, 2014 1:59 PM
To: Simon.Pigot@anonymised.com; Marten Hogeweg; K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,
that's way I need to harvest CSW.

E.

From: Simon.Pigot@anonymised.com<mailto:Simon.Pigot@anonymised.com>
To: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>; K.Roberts@anonymised.com<mailto:K.Roberts@anonymised.com>; frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>
CC: geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@anonymised.comsourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to http://gatt.lmi.is/geoportal122 and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________

Dear all,

thank you again for any your suggestions!

I was reading at

http://webhelp.esri.com/geoportal_extension/9.3.1/index.htm#geoportal_csw_cmpnts.htm

in the bottom there a specific line:
9101: CS-W harvest for catalogs using the Geonetwork OGCCORE profile cannot be searched by the Modified parameter.
could be it related to my problem? (Remember my problem is on retrieve metadata with a search criteria since without csw harvest works fine)

Have I to insert some string more in csw URL to involve also apiso standard?

E.

From: mhogeweg@anonymised.com
To: frippe12573@anonymised.com; simon.pigot@anonymised.com; k.roberts@anonymised.com
CC: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 12:03:51 +0000

Geoportal Server provides an INSPIRE compliant CSW service. Described here (since Geoportal Server is included with ArcGIS for INSPIRE):
http://resources.arcgis.com/en/help/arcgis-for-inspire/10.2/index.html#/Catalog_Service/014m000000m9000000/

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]

Sent: Friday, October 24, 2014 1:59 PM

To: Simon.Pigot@anonymised.com; Marten Hogeweg; K.Roberts@anonymised.com

Cc: Lista Geonetwork

Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,

that's way I need to harvest CSW.

E.

From:

Simon.Pigot@anonymised.com

To: mhogeweg@anonymised.com;

K.Roberts@anonymised.com; frippe12573@anonymised.com

CC: geonetwork-users@lists.sourceforge.net

Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to

http://gatt.lmi.is/geoportal122 and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,

Simon

________________________________________

Hi Eugenio,

That document describes what you had to do in Esri Geoportal Extension 9.3.1 to harvest from a Geonetwork CSW. Thus: it harvests from Geonetwork into Geoportal Extension. What you appear to want is the other way around. For that you would need to look at Geonetwork documentation on how it can harvest Geoportal Server.

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, October 24, 2014 3:12 PM
To: Marten Hogeweg; Simon.Pigot@anonymised.com; K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Dear all,

thank you again for any your suggestions!

I was reading at

http://webhelp.esri.com/geoportal_extension/9.3.1/index.htm#geoportal_csw_cmpnts.htm

in the bottom there a specific line:
9101: CS-W harvest for catalogs using the Geonetwork OGCCORE profile cannot be searched by the Modified parameter.
could be it related to my problem? (Remember my problem is on retrieve metadata with a search criteria since without csw harvest works fine)

Have I to insert some string more in csw URL to involve also apiso standard?

E.

________________________________
From: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>
To: frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>; simon.pigot@anonymised.com.<mailto:simon.pigot@anonymised.com>; k.roberts@anonymised.com<mailto:k.roberts@anonymised.com5…>
CC: geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@anonymised.comurceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 12:03:51 +0000
Geoportal Server provides an INSPIRE compliant CSW service. Described here (since Geoportal Server is included with ArcGIS for INSPIRE):
http://resources.arcgis.com/en/help/arcgis-for-inspire/10.2/index.html#/Catalog_Service/014m000000m9000000/

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, October 24, 2014 1:59 PM
To: Simon.Pigot@anonymised.com<mailto:Simon.Pigot@anonymised.com>; Marten Hogeweg; K.Roberts@anonymised.com<mailto:K.Roberts@anonymised.com>
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,
that's way I need to harvest CSW.

E.

From: Simon.Pigot@anonymised.com<mailto:Simon.Pigot@anonymised.com>
To: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>; K.Roberts@anonymised.com<mailto:K.Roberts@anonymised.com>; frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>
CC: geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@anonymised.comsourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to http://gatt.lmi.is/geoportal122 and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________

Yes you are right Marten!

Now I tried also to set an harvesting by using Geoportal REST and then converting the result in OGCCSWGetCapabilities, I got no errors but any record are gathered.

I'm in a blind alley!

Just a question, can I test an URL to this csw to getrecord by anytext=EGIP ???

Regards

E.

From: mhogeweg@anonymised.com
To: frippe12573@anonymised.com; simon.pigot@anonymised.com; k.roberts@anonymised.com
CC: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 12:03:51 +0000

Geoportal Server provides an INSPIRE compliant CSW service. Described here (since Geoportal Server is included with ArcGIS for INSPIRE):
http://resources.arcgis.com/en/help/arcgis-for-inspire/10.2/index.html#/Catalog_Service/014m000000m9000000/

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]

Sent: Friday, October 24, 2014 1:59 PM

To: Simon.Pigot@anonymised.com; Marten Hogeweg; K.Roberts@anonymised.com

Cc: Lista Geonetwork

Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,

that's way I need to harvest CSW.

E.

From:

Simon.Pigot@anonymised.com

To: mhogeweg@anonymised.com;

K.Roberts@anonymised.com; frippe12573@anonymised.com

CC: geonetwork-users@lists.sourceforge.net

Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to

http://gatt.lmi.is/geoportal122 and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,

Simon

________________________________________

http://gatt.lmi.is/geoportal122/csw?request=getRecords&service=CSW&startPosition=1&maxRecords=10&resultType=results&elementSetName=full&outputFormat=application/xml&outputschema=http://www.isotc211.org/2005/gmd&constraintLanguage=Filter&Constraint=<ogc:Filter><ogc:PropertyIsLike%20wildCard%3D"%25"%20escapeChar%3D""%20singleChar%3D""><ogc:PropertyName>AnyText</ogc:PropertyName><ogc:Literal>EGIP</ogc:Literal></ogc:PropertyIsLike></ogc:Filter>&namespace=xmlns(gml=http://www.opengis.net/gml),xmlns(ogc=http://www.opengis.net/ogc)

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, October 24, 2014 3:31 PM
To: Marten Hogeweg; Simon.Pigot@anonymised.com; K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Yes you are right Marten!

Now I tried also to set an harvesting by using Geoportal REST and then converting the result in OGCCSWGetCapabilities, I got no errors but any record are gathered.

I'm in a blind alley!

Just a question, can I test an URL to this csw to getrecord by anytext=EGIP ???

Regards

E.
________________________________
From: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>
To: frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>; simon.pigot@anonymised.com.<mailto:simon.pigot@anonymised.com>; k.roberts@anonymised.com<mailto:k.roberts@anonymised.com5…>
CC: geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@anonymised.comurceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 12:03:51 +0000
Geoportal Server provides an INSPIRE compliant CSW service. Described here (since Geoportal Server is included with ArcGIS for INSPIRE):
http://resources.arcgis.com/en/help/arcgis-for-inspire/10.2/index.html#/Catalog_Service/014m000000m9000000/

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, October 24, 2014 1:59 PM
To: Simon.Pigot@anonymised.com<mailto:Simon.Pigot@anonymised.com>; Marten Hogeweg; K.Roberts@anonymised.com<mailto:K.Roberts@anonymised.com>
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,
that's way I need to harvest CSW.

E.

From: Simon.Pigot@anonymised.com<mailto:Simon.Pigot@anonymised.com>
To: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>; K.Roberts@anonymised.com<mailto:K.Roberts@anonymised.com>; frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>
CC: geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@anonymised.comsourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to http://gatt.lmi.is/geoportal122 and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________

Hi Eugenio,

Not sure what you mean by harvesting using Geoportal REST and then converting the result in ....? If you are using the Geoportal REST harvester in GeoNetwork, then I was able to harvest the three records correctly when I used it with base url as specified in my email below and search for EGIP so that shouldn't leave you in a blind alley :slight_smile:

In the CSW harvest, GeoNetwork attempts to POST an ogc:filter query to the ESRI server but is told that the propertyname is invalid? Trying to work out why this is now.

Cheers,
Simon
________________________________________
From: Eugenio Trumpy [frippe12573@anonymised.com]
Sent: Saturday, 25 October 2014 12:30 AM
To: Marten Hogeweg; Pigot, Simon (O&A, Hobart); K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Yes you are right Marten!

Now I tried also to set an harvesting by using Geoportal REST and then converting the result in OGCCSWGetCapabilities, I got no errors but any record are gathered.

I'm in a blind alley!

Just a question, can I test an URL to this csw to getrecord by anytext=EGIP ???

Regards

E.

________________________________
From: mhogeweg@anonymised.com
To: frippe12573@anonymised.com; simon.pigot@anonymised.com; k.roberts@anonymised.com
CC: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 12:03:51 +0000

Geoportal Server provides an INSPIRE compliant CSW service. Described here (since Geoportal Server is included with ArcGIS for INSPIRE):

http://resources.arcgis.com/en/help/arcgis-for-inspire/10.2/index.html#/Catalog_Service/014m000000m9000000/

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, October 24, 2014 1:59 PM
To: Simon.Pigot@anonymised.com; Marten Hogeweg; K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,
that's way I need to harvest CSW.

E.

From: Simon.Pigot@anonymised.com<mailto:Simon.Pigot@anonymised.com>
To: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>; K.Roberts@anonymised.com<mailto:K.Roberts@anonymised.com>; frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>
CC: geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@anonymised.comsourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to Lýsigagnagátt and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________

Hi Simon, that's where the apiso namespace definition error may come into play (see my earlier email)

-----Original Message-----
From: Simon.Pigot@anonymised.com [mailto:Simon.Pigot@anonymised.com]
Sent: Friday, October 24, 2014 4:13 PM
To: frippe12573@anonymised.com; Marten Hogeweg; k.roberts@anonymised.com
Cc: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Hi Eugenio,

Not sure what you mean by harvesting using Geoportal REST and then converting the result in ....? If you are using the Geoportal REST harvester in GeoNetwork, then I was able to harvest the three records correctly when I used it with base url as specified in my email below and search for EGIP so that shouldn't leave you in a blind alley :slight_smile:

In the CSW harvest, GeoNetwork attempts to POST an ogc:filter query to the ESRI server but is told that the propertyname is invalid? Trying to work out why this is now.

Cheers,
Simon
________________________________________
From: Eugenio Trumpy [frippe12573@anonymised.com]
Sent: Saturday, 25 October 2014 12:30 AM
To: Marten Hogeweg; Pigot, Simon (O&A, Hobart); K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Yes you are right Marten!

Now I tried also to set an harvesting by using Geoportal REST and then converting the result in OGCCSWGetCapabilities, I got no errors but any record are gathered.

I'm in a blind alley!

Just a question, can I test an URL to this csw to getrecord by anytext=EGIP ???

Regards

E.

________________________________
From: mhogeweg@anonymised.com
To: frippe12573@anonymised.com; simon.pigot@anonymised.com; k.roberts@anonymised.com
CC: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 12:03:51 +0000

Geoportal Server provides an INSPIRE compliant CSW service. Described here (since Geoportal Server is included with ArcGIS for INSPIRE):

http://resources.arcgis.com/en/help/arcgis-for-inspire/10.2/index.html#/Catalog_Service/014m000000m9000000/

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, October 24, 2014 1:59 PM
To: Simon.Pigot@anonymised.com; Marten Hogeweg; K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,
that's way I need to harvest CSW.

E.

From: Simon.Pigot@anonymised.com<mailto:Simon.Pigot@anonymised.com>
To: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>; K.Roberts@anonymised.com<mailto:K.Roberts@anonymised.com>; frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>
CC: geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@anonymised.comsourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to http://gatt.lmi.is/geoportal122 and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________

Hi Marten,

Actually the apiso namespace error was a red herring (it's due to a bug in GN 2.10.3 (and earlier) harvester editor which could not work with apiso: namespace prefixed queryables. The apiso namespace doesn't need to be declared in the query because its only used as a prefix on the text content of ogc:propertyname ie. it doesn't have any relevance to the namespaces of the xml query being posted.

When I included the latest patches plus one new fix I'll commit shortly, I can get the query to work when I use apiso:Subject/Subject with EGIP - returns the requisite 3 records.

I also discovered that GN tries to use ogc:PropertyIsEqualTo when searching on AnyText/apiso:AnyText. Geoportal doesn't like that: it says the propertyname is invalid because only ogc:PropertyIsLike is supported for AnyText/apiso:AnyText - which is fair enough :slight_smile: and therefore should be fixed in GN.

Cheers and thanks,
Simon
________________________________________
From: Marten Hogeweg [mhogeweg@anonymised.com]
Sent: Saturday, 25 October 2014 1:14 AM
To: Pigot, Simon (O&A, Hobart); frippe12573@anonymised.com; k.roberts@anonymised.com
Cc: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Hi Simon, that's where the apiso namespace definition error may come into play (see my earlier email)

-----Original Message-----
From: Simon.Pigot@anonymised.com [mailto:Simon.Pigot@anonymised.com]
Sent: Friday, October 24, 2014 4:13 PM
To: frippe12573@anonymised.com; Marten Hogeweg; k.roberts@anonymised.com
Cc: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Hi Eugenio,

Not sure what you mean by harvesting using Geoportal REST and then converting the result in ....? If you are using the Geoportal REST harvester in GeoNetwork, then I was able to harvest the three records correctly when I used it with base url as specified in my email below and search for EGIP so that shouldn't leave you in a blind alley :slight_smile:

In the CSW harvest, GeoNetwork attempts to POST an ogc:filter query to the ESRI server but is told that the propertyname is invalid? Trying to work out why this is now.

Cheers,
Simon
________________________________________
From: Eugenio Trumpy [frippe12573@anonymised.com]
Sent: Saturday, 25 October 2014 12:30 AM
To: Marten Hogeweg; Pigot, Simon (O&A, Hobart); K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Yes you are right Marten!

Now I tried also to set an harvesting by using Geoportal REST and then converting the result in OGCCSWGetCapabilities, I got no errors but any record are gathered.

I'm in a blind alley!

Just a question, can I test an URL to this csw to getrecord by anytext=EGIP ???

Regards

E.

________________________________
From: mhogeweg@anonymised.com
To: frippe12573@anonymised.com; simon.pigot@anonymised.com; k.roberts@anonymised.com
CC: geonetwork-users@lists.sourceforge.net
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 12:03:51 +0000

Geoportal Server provides an INSPIRE compliant CSW service. Described here (since Geoportal Server is included with ArcGIS for INSPIRE):

http://resources.arcgis.com/en/help/arcgis-for-inspire/10.2/index.html#/Catalog_Service/014m000000m9000000/

Marten

From: Eugenio Trumpy [mailto:frippe12573@anonymised.com]
Sent: Friday, October 24, 2014 1:59 PM
To: Simon.Pigot@anonymised.com; Marten Hogeweg; K.Roberts@anonymised.com
Cc: Lista Geonetwork
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]

Thank you Simon,

but I need to deploy CSW service in my project since it has to be INSPIRE compliant,
that's way I need to harvest CSW.

E.

From: Simon.Pigot@anonymised.com<mailto:Simon.Pigot@anonymised.com>
To: mhogeweg@anonymised.com<mailto:mhogeweg@anonymised.com>; K.Roberts@anonymised.com<mailto:K.Roberts@anonymised.com>; frippe12573@anonymised.com<mailto:frippe12573@anonymised.com>
CC: geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@anonymised.comsourceforge.net>
Subject: RE: [GeoNetwork-users] Harvest from ESRI portal .. [SEC=UNCLASSIFIED]
Date: Fri, 24 Oct 2014 10:18:09 +0000

Hi Eugenio,

Though I don't like to suggest a non-OGC standards path, how about using the GeoPortal REST harvester in GeoNetwork?

I can set up a harvester of this type (it's "GeoPortal 9.3.x via REST interface") in GeoNetwork 2.10.x, with base URL of the geoportal service set to Lýsigagnagátt and search term set to EGIP and retrieve the 3 EGIP records without issues.

Cheers,
Simon
________________________________________