[GeoNetwork-users] Question about harvesting

Hi,

I am useing Geonetwork 2.0.2 and want to make the harvesting feature work, but it seems I am not so fortunate. Definitely, the harvesting process is in progress, but I can only browse the harvested metadata records occasionally, that is, the harvested metadata records exist temporarily,and vanish with unknown reason. Can you figure out what is the problem? For your information, following are contents of the configureation file and the related log file.

Thank you very much!

The segment of the config file:
------------------------------------------------------------------------------------------
  <schedules package="org.fao.geonet">
<!-- Examples of the 'when' attribute:
    when='30 sec'
    when='1 min'
    when='12 hours'
    when='1 hour, 30 min'
    when='12 hours, 32 min, 13 sec'
-->
    <schedule name="geonetwork sync" class=".schedules.MetadataSync" when="1 min">
      <param name="sites">
        <site name="mapsondemand"> <!-- Servlet name of remote node -->
          <general>
            <host>193.43.36.137</host> <!-- domain name or IP of the remote host -->
            <port>80</port> <!-- port of the remote host. Usually 80 or 8080 -->
            <language>en</language>
            <username></username> <!-- This field can be left empty to perform anonymous (guest) searches -->
            <password></password> <!-- This field can be left empty to perform anonymous (guest) searches -->
          </general>
          <services>
            <login>xml.user.login</login>
            <logout>xml.user.logout</logout>
            <search>xml.search</search>
            <get>xml.metadata.get</get>
          </services>
          <search> <!-- These fields define the search parameters -->
            <extended>off</extended>
            <help>off</help>
            <relation>equal</relation>
            <any /> <!-- This field is the free text search field -->
            <remote>off</remote>
            <region/>
            <paper>off</paper>
            <siteId>OCHA</siteId> <!-- This is the unique site ID of the node information should be retrieved from. Can be used to set up trees of nodes -->
          </search>
          <search> <!-- By repeating the search blocks, you can define multiple searches on the same node -->
            <extended>off</extended>
            <help>off</help>
            <relation>equal</relation>
            <any>areas</any>
            <remote>off</remote>
            <region/>
            <paper>off</paper>
            <siteId>OCHA</siteId>
          </search>
          <group id="1"> <!-- These blocks define the groups and their privileges to be set for the harvested metadata -->
            <privilege>view</privilege> <!-- Members of group 1 (internet/all) can see the metadata -->
                   <privilege>download</privilege> <!-- Members can download related resources -->
                   <privilege>dynamic</privilege> <!-- Members can see interactive resources -->
          </group>
          <group id="0">
            <privilege>view</privilege> <!-- Members of group 0 (intranet) can see the metadata -->
                   <privilege>download</privilege> <!-- Members can download related resources -->
                   <privilege>dynamic</privilege> <!-- Members can see interactive resources -->
          </group>
        </site>
      </param>
    </schedule>

<!-- Example of metadata harvesting
    <schedule name="geonetwork harvest" class=".schedules.MetadataHarvest" when="30 sec">
      <param name="configFile" value="/my/work/fao/geonet2/cvs/geonetwork/docs/examples/harvesting-config.xml"/>
    </schedule>
-->
  </schedules>

------------------------------------------------------------------------------------------

The segment of log file:
------------------------------------------------------------------------------------------
2006-07-03 17:52:06 | [geonetwork sync] Searching on : mapsondemand
2006-07-03 17:52:17 | [geonetwork sync] Obtained:
<response xmlns:geonet="http://www.fao.org/geonetwork&quot; from="1" to="4">
  <summary count="4" type="local">
    <keywords>
      <keyword count="3" name="niger" />
      <keyword count="2" name="health" />
      <keyword count="1" name="africa" />
      <keyword count="1" name="climate" />
      <keyword count="1" name="continental climate" />
      <keyword count="1" name="health facilities" />
      <keyword count="1" name="hospitals" />
      <keyword count="1" name="malnutrition" />
      <keyword count="1" name="weather" />
    </keywords>
    <categories>
      <category count="3" name="datasets" />
      <category count="2" name="maps" />
    </categories>
  </summary>
  <metadata>
    <geonet:info>
      <id>507</id>
      <uuid>20b897d0-e525-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:44:18</createDate>
      <changeDate>2006-05-23T23:19:03</changeDate>
      <source>ocha</source>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>503</id>
      <uuid>a019e750-e51f-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:04:55</createDate>
      <changeDate>2006-05-23T23:22:24</changeDate>
      <source>ocha</source>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>506</id>
      <uuid>ab37e720-e521-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:19:33</createDate>
      <changeDate>2006-05-23T23:20:45</changeDate>
      <source>ocha</source>
      <category>maps</category>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>4594</id>
      <uuid>931392a0-fa1d-11da-8dc3-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-06-12T16:13:08</createDate>
      <changeDate>2006-06-13T16:37:16</changeDate>
      <source>ocha</source>
      <category>maps</category>
    </geonet:info>
  </metadata>
</response>
2006-07-03 17:52:17 | [geonetwork sync] Start of alignment for site-id : OCHA
2006-07-03 17:52:17 | [geonetwork sync] Obtained remote id=507, changeDate=2006-05-23T23:19:03
2006-07-03 17:52:28 | [geonetwork sync] - Added metadata with id=346
2006-07-03 17:52:28 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:28 | [geonetwork sync] --> download
2006-07-03 17:52:28 | [geonetwork sync] --> dynamic
2006-07-03 17:52:28 | [geonetwork sync] --> view
2006-07-03 17:52:28 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:28 | [geonetwork sync] --> download
2006-07-03 17:52:28 | [geonetwork sync] --> dynamic
2006-07-03 17:52:28 | [geonetwork sync] --> view
2006-07-03 17:52:28 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:28 | [geonetwork sync] Obtained remote id=503, changeDate=2006-05-23T23:22:24
2006-07-03 17:52:42 | [geonetwork sync] - Added metadata with id=347
2006-07-03 17:52:42 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:42 | [geonetwork sync] --> download
2006-07-03 17:52:42 | [geonetwork sync] --> dynamic
2006-07-03 17:52:42 | [geonetwork sync] --> view
2006-07-03 17:52:42 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:42 | [geonetwork sync] --> download
2006-07-03 17:52:42 | [geonetwork sync] --> dynamic
2006-07-03 17:52:42 | [geonetwork sync] --> view
2006-07-03 17:52:42 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:42 | [geonetwork sync] Obtained remote id=506, changeDate=2006-05-23T23:20:45
2006-07-03 17:52:53 | [geonetwork sync] - Added metadata with id=348
2006-07-03 17:52:53 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:54 | [geonetwork sync] --> download
2006-07-03 17:52:54 | [geonetwork sync] --> dynamic
2006-07-03 17:52:54 | [geonetwork sync] --> view
2006-07-03 17:52:54 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:54 | [geonetwork sync] --> download
2006-07-03 17:52:54 | [geonetwork sync] --> dynamic
2006-07-03 17:52:54 | [geonetwork sync] --> view
2006-07-03 17:52:54 | [geonetwork sync] - Set category : maps
2006-07-03 17:52:54 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:54 | [geonetwork sync] Obtained remote id=4594, changeDate=2006-06-13T16:37:16
2006-07-03 17:53:05 | [geonetwork sync] - Added metadata with id=349
2006-07-03 17:53:05 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:53:05 | [geonetwork sync] --> download
2006-07-03 17:53:05 | [geonetwork sync] --> dynamic
2006-07-03 17:53:05 | [geonetwork sync] --> view
2006-07-03 17:53:05 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:53:05 | [geonetwork sync] --> download
2006-07-03 17:53:05 | [geonetwork sync] --> dynamic
2006-07-03 17:53:05 | [geonetwork sync] --> view
2006-07-03 17:53:05 | [geonetwork sync] - Set category : maps
2006-07-03 17:53:05 | [geonetwork sync] End of alignment for site-id : OCHA
2006-07-03 17:53:05 | [geonetwork sync] Searching on : mapsondemand
2006-07-03 17:53:16 | [geonetwork sync] Obtained:
<response xmlns:geonet="http://www.fao.org/geonetwork&quot; from="0" to="0">
  <summary count="0" type="local">
    <keywords />
    <categories />
  </summary>
</response>
2006-07-03 17:53:16 | [geonetwork sync] Start of alignment for site-id : OCHA
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=348
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=347
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=346
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=349
2006-07-03 17:53:16 | [geonetwork sync] End of alignment for site-id : OCHA
------------------------------------------------------------------------------------------

--------------
Enri Zhou
2006-07-03

Hi,
I suggest you put in a harvesting schedule that is more in the order of hours than just 1 minute. Your extremely short repetitions in harvesting attempts may cause this behavior :slight_smile:
Ciao,
Jeroen

On Jul 3, 2006, at 12:09 PM, Enri Zhou wrote:

Hi,

I am useing Geonetwork 2.0.2 and want to make the harvesting feature work, but it seems I am not so fortunate. Definitely, the harvesting process is in progress, but I can only browse the harvested metadata records occasionally, that is, the harvested metadata records exist temporarily,and vanish with unknown reason. Can you figure out what is the problem? For your information, following are contents of the configureation file and the related log file.

Thank you very much!

The segment of the config file:
------------------------------------------------------------------------------------------
  <schedules package="org.fao.geonet">
<!-- Examples of the 'when' attribute:
    when='30 sec'
    when='1 min'
    when='12 hours'
    when='1 hour, 30 min'
    when='12 hours, 32 min, 13 sec'
-->
    <schedule name="geonetwork sync" class=".schedules.MetadataSync" when="1 min">
      <param name="sites">
        <site name="mapsondemand"> <!-- Servlet name of remote node -->
          <general>
            <host>193.43.36.137</host> <!-- domain name or IP of the remote host -->
            <port>80</port> <!-- port of the remote host. Usually 80 or 8080 -->
            <language>en</language>
            <username></username> <!-- This field can be left empty to perform anonymous (guest) searches -->
            <password></password> <!-- This field can be left empty to perform anonymous (guest) searches -->
          </general>
          <services>
            <login>xml.user.login</login>
            <logout>xml.user.logout</logout>
            <search>xml.search</search>
            <get>xml.metadata.get</get>
          </services>
          <search> <!-- These fields define the search parameters -->
            <extended>off</extended>
            <help>off</help>
            <relation>equal</relation>
            <any /> <!-- This field is the free text search field -->
            <remote>off</remote>
            <region/>
            <paper>off</paper>
            <siteId>OCHA</siteId> <!-- This is the unique site ID of the node information should be retrieved from. Can be used to set up trees of nodes -->
          </search>
          <search> <!-- By repeating the search blocks, you can define multiple searches on the same node -->
            <extended>off</extended>
            <help>off</help>
            <relation>equal</relation>
            <any>areas</any>
            <remote>off</remote>
            <region/>
            <paper>off</paper>
            <siteId>OCHA</siteId>
          </search>
          <group id="1"> <!-- These blocks define the groups and their privileges to be set for the harvested metadata -->
            <privilege>view</privilege> <!-- Members of group 1 (internet/all) can see the metadata -->
                   <privilege>download</privilege> <!-- Members can download related resources -->
                   <privilege>dynamic</privilege> <!-- Members can see interactive resources -->
          </group>
          <group id="0">
            <privilege>view</privilege> <!-- Members of group 0 (intranet) can see the metadata -->
                   <privilege>download</privilege> <!-- Members can download related resources -->
                   <privilege>dynamic</privilege> <!-- Members can see interactive resources -->
          </group>
        </site>
      </param>
    </schedule>

<!-- Example of metadata harvesting
    <schedule name="geonetwork harvest" class=".schedules.MetadataHarvest" when="30 sec">
      <param name="configFile" value="/my/work/fao/geonet2/cvs/geonetwork/docs/examples/harvesting-config.xml"/>
    </schedule>
-->
  </schedules>

------------------------------------------------------------------------------------------

The segment of log file:
------------------------------------------------------------------------------------------
2006-07-03 17:52:06 | [geonetwork sync] Searching on : mapsondemand
2006-07-03 17:52:17 | [geonetwork sync] Obtained:
<response xmlns:geonet="http://www.fao.org/geonetwork&quot; from="1" to="4">
  <summary count="4" type="local">
    <keywords>
      <keyword count="3" name="niger" />
      <keyword count="2" name="health" />
      <keyword count="1" name="africa" />
      <keyword count="1" name="climate" />
      <keyword count="1" name="continental climate" />
      <keyword count="1" name="health facilities" />
      <keyword count="1" name="hospitals" />
      <keyword count="1" name="malnutrition" />
      <keyword count="1" name="weather" />
    </keywords>
    <categories>
      <category count="3" name="datasets" />
      <category count="2" name="maps" />
    </categories>
  </summary>
  <metadata>
    <geonet:info>
      <id>507</id>
      <uuid>20b897d0-e525-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:44:18</createDate>
      <changeDate>2006-05-23T23:19:03</changeDate>
      <source>ocha</source>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>503</id>
      <uuid>a019e750-e51f-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:04:55</createDate>
      <changeDate>2006-05-23T23:22:24</changeDate>
      <source>ocha</source>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>506</id>
      <uuid>ab37e720-e521-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:19:33</createDate>
      <changeDate>2006-05-23T23:20:45</changeDate>
      <source>ocha</source>
      <category>maps</category>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>4594</id>
      <uuid>931392a0-fa1d-11da-8dc3-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-06-12T16:13:08</createDate>
      <changeDate>2006-06-13T16:37:16</changeDate>
      <source>ocha</source>
      <category>maps</category>
    </geonet:info>
  </metadata>
</response>
2006-07-03 17:52:17 | [geonetwork sync] Start of alignment for site-id : OCHA
2006-07-03 17:52:17 | [geonetwork sync] Obtained remote id=507, changeDate=2006-05-23T23:19:03
2006-07-03 17:52:28 | [geonetwork sync] - Added metadata with id=346
2006-07-03 17:52:28 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:28 | [geonetwork sync] --> download
2006-07-03 17:52:28 | [geonetwork sync] --> dynamic
2006-07-03 17:52:28 | [geonetwork sync] --> view
2006-07-03 17:52:28 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:28 | [geonetwork sync] --> download
2006-07-03 17:52:28 | [geonetwork sync] --> dynamic
2006-07-03 17:52:28 | [geonetwork sync] --> view
2006-07-03 17:52:28 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:28 | [geonetwork sync] Obtained remote id=503, changeDate=2006-05-23T23:22:24
2006-07-03 17:52:42 | [geonetwork sync] - Added metadata with id=347
2006-07-03 17:52:42 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:42 | [geonetwork sync] --> download
2006-07-03 17:52:42 | [geonetwork sync] --> dynamic
2006-07-03 17:52:42 | [geonetwork sync] --> view
2006-07-03 17:52:42 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:42 | [geonetwork sync] --> download
2006-07-03 17:52:42 | [geonetwork sync] --> dynamic
2006-07-03 17:52:42 | [geonetwork sync] --> view
2006-07-03 17:52:42 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:42 | [geonetwork sync] Obtained remote id=506, changeDate=2006-05-23T23:20:45
2006-07-03 17:52:53 | [geonetwork sync] - Added metadata with id=348
2006-07-03 17:52:53 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:54 | [geonetwork sync] --> download
2006-07-03 17:52:54 | [geonetwork sync] --> dynamic
2006-07-03 17:52:54 | [geonetwork sync] --> view
2006-07-03 17:52:54 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:54 | [geonetwork sync] --> download
2006-07-03 17:52:54 | [geonetwork sync] --> dynamic
2006-07-03 17:52:54 | [geonetwork sync] --> view
2006-07-03 17:52:54 | [geonetwork sync] - Set category : maps
2006-07-03 17:52:54 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:54 | [geonetwork sync] Obtained remote id=4594, changeDate=2006-06-13T16:37:16
2006-07-03 17:53:05 | [geonetwork sync] - Added metadata with id=349
2006-07-03 17:53:05 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:53:05 | [geonetwork sync] --> download
2006-07-03 17:53:05 | [geonetwork sync] --> dynamic
2006-07-03 17:53:05 | [geonetwork sync] --> view
2006-07-03 17:53:05 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:53:05 | [geonetwork sync] --> download
2006-07-03 17:53:05 | [geonetwork sync] --> dynamic
2006-07-03 17:53:05 | [geonetwork sync] --> view
2006-07-03 17:53:05 | [geonetwork sync] - Set category : maps
2006-07-03 17:53:05 | [geonetwork sync] End of alignment for site-id : OCHA
2006-07-03 17:53:05 | [geonetwork sync] Searching on : mapsondemand
2006-07-03 17:53:16 | [geonetwork sync] Obtained:
<response xmlns:geonet="http://www.fao.org/geonetwork&quot; from="0" to="0">
  <summary count="0" type="local">
    <keywords />
    <categories />
  </summary>
</response>
2006-07-03 17:53:16 | [geonetwork sync] Start of alignment for site-id : OCHA
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=348
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=347
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=346
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=349
2006-07-03 17:53:16 | [geonetwork sync] End of alignment for site-id : OCHA
------------------------------------------------------------------------------------------

--------------
Enri Zhou
2006-07-03

Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Geonetwork-devel mailing list
Geonetwork-devel@lists.sourceforge.net
geonetwork-devel List Signup and Options
GeoNetwork OpenSource is maintained at GeoNetwork - Geographic Metadata Catalog download | SourceForge.net

Hi, Jeroen,

Thank you for your response. I changed the harvesting schedule from '1 minute' to '1 hour', but the same problem is still there. The log file also reflects the same thing.

Thank you in advance for your further instruction.

Regards,
Enri

======= 2006-07-03 19:34:38 you wrote:=======

Hi,
I suggest you put in a harvesting schedule that is more in the order
of hours than just 1 minute. Your extremely short repetitions in
harvesting attempts may cause this behavior :slight_smile:
Ciao,
Jeroen

On Jul 3, 2006, at 12:09 PM, Enri Zhou wrote:

Hi,

I am useing Geonetwork 2.0.2 and want to make the harvesting
feature work, but it seems I am not so fortunate. Definitely, the
harvesting process is in progress, but I can only browse the
harvested metadata records occasionally, that is, the harvested
metadata records exist temporarily,and vanish with unknown reason.
Can you figure out what is the problem? For your information,
following are contents of the configureation file and the related
log file.

Thank you very much!

The segment of the config file:
----------------------------------------------------------------------
--------------------
  <schedules package="org.fao.geonet">
<!-- Examples of the 'when' attribute:
    when='30 sec'
    when='1 min'
    when='12 hours'
    when='1 hour, 30 min'
    when='12 hours, 32 min, 13 sec'
-->
    <schedule name="geonetwork sync" class=".schedules.MetadataSync"
when="1 min">
      <param name="sites">
        <site name="mapsondemand"> <!-- Servlet name of remote node -->
          <general>
            <host>193.43.36.137</host> <!-- domain name or IP of the
remote host -->
            <port>80</port> <!-- port of the remote host. Usually 80 or
8080 -->
            <language>en</language>
            <username></username> <!-- This field can be left empty to
perform anonymous (guest) searches -->
            <password></password> <!-- This field can be left empty to
perform anonymous (guest) searches -->
          </general>
          <services>
            <login>xml.user.login</login>
            <logout>xml.user.logout</logout>
            <search>xml.search</search>
            <get>xml.metadata.get</get>
          </services>
          <search> <!-- These fields define the search parameters -->
            <extended>off</extended>
            <help>off</help>
            <relation>equal</relation>
            <any /> <!-- This field is the free text search field -->
            <remote>off</remote>
            <region/>
            <paper>off</paper>
            <siteId>OCHA</siteId> <!-- This is the unique site ID of the
node information should be retrieved from. Can be used to set up
trees of nodes -->
          </search>
          <search> <!-- By repeating the search blocks, you can define
multiple searches on the same node -->
            <extended>off</extended>
            <help>off</help>
            <relation>equal</relation>
            <any>areas</any>
            <remote>off</remote>
            <region/>
            <paper>off</paper>
            <siteId>OCHA</siteId>
          </search>
          <group id="1"> <!-- These blocks define the groups and their
privileges to be set for the harvested metadata -->
            <privilege>view</privilege> <!-- Members of group 1 (internet/
all) can see the metadata -->
                   <privilege>download</privilege> <!-- Members can
download related resources -->
                   <privilege>dynamic</privilege> <!-- Members can see
interactive resources -->
          </group>
          <group id="0">
            <privilege>view</privilege> <!-- Members of group 0
(intranet) can see the metadata -->
                   <privilege>download</privilege> <!-- Members can
download related resources -->
                   <privilege>dynamic</privilege> <!-- Members can see
interactive resources -->
          </group>
        </site>
      </param>
    </schedule>

<!-- Example of metadata harvesting
    <schedule name="geonetwork harvest"
class=".schedules.MetadataHarvest" when="30 sec">
      <param name="configFile" value="/my/work/fao/geonet2/cvs/
geonetwork/docs/examples/harvesting-config.xml"/>
    </schedule>
-->
  </schedules>

----------------------------------------------------------------------
--------------------

The segment of log file:
----------------------------------------------------------------------
--------------------
2006-07-03 17:52:06 | [geonetwork sync] Searching on : mapsondemand
2006-07-03 17:52:17 | [geonetwork sync] Obtained:
<response xmlns:geonet="http://www.fao.org/geonetwork&quot; from="1"
to="4">
  <summary count="4" type="local">
    <keywords>
      <keyword count="3" name="niger" />
      <keyword count="2" name="health" />
      <keyword count="1" name="africa" />
      <keyword count="1" name="climate" />
      <keyword count="1" name="continental climate" />
      <keyword count="1" name="health facilities" />
      <keyword count="1" name="hospitals" />
      <keyword count="1" name="malnutrition" />
      <keyword count="1" name="weather" />
    </keywords>
    <categories>
      <category count="3" name="datasets" />
      <category count="2" name="maps" />
    </categories>
  </summary>
  <metadata>
    <geonet:info>
      <id>507</id>
      <uuid>20b897d0-e525-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:44:18</createDate>
      <changeDate>2006-05-23T23:19:03</changeDate>
      <source>ocha</source>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>503</id>
      <uuid>a019e750-e51f-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:04:55</createDate>
      <changeDate>2006-05-23T23:22:24</changeDate>
      <source>ocha</source>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>506</id>
      <uuid>ab37e720-e521-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:19:33</createDate>
      <changeDate>2006-05-23T23:20:45</changeDate>
      <source>ocha</source>
      <category>maps</category>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>4594</id>
      <uuid>931392a0-fa1d-11da-8dc3-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-06-12T16:13:08</createDate>
      <changeDate>2006-06-13T16:37:16</changeDate>
      <source>ocha</source>
      <category>maps</category>
    </geonet:info>
  </metadata>
</response>
2006-07-03 17:52:17 | [geonetwork sync] Start of alignment for site-
id : OCHA
2006-07-03 17:52:17 | [geonetwork sync] Obtained remote id=507,
changeDate=2006-05-23T23:19:03
2006-07-03 17:52:28 | [geonetwork sync] - Added metadata with id=346
2006-07-03 17:52:28 | [geonetwork sync] - Setting privileges
for group : 1
2006-07-03 17:52:28 | [geonetwork sync] --> download
2006-07-03 17:52:28 | [geonetwork sync] --> dynamic
2006-07-03 17:52:28 | [geonetwork sync] --> view
2006-07-03 17:52:28 | [geonetwork sync] - Setting privileges
for group : 0
2006-07-03 17:52:28 | [geonetwork sync] --> download
2006-07-03 17:52:28 | [geonetwork sync] --> dynamic
2006-07-03 17:52:28 | [geonetwork sync] --> view
2006-07-03 17:52:28 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:28 | [geonetwork sync] Obtained remote id=503,
changeDate=2006-05-23T23:22:24
2006-07-03 17:52:42 | [geonetwork sync] - Added metadata with id=347
2006-07-03 17:52:42 | [geonetwork sync] - Setting privileges
for group : 1
2006-07-03 17:52:42 | [geonetwork sync] --> download
2006-07-03 17:52:42 | [geonetwork sync] --> dynamic
2006-07-03 17:52:42 | [geonetwork sync] --> view
2006-07-03 17:52:42 | [geonetwork sync] - Setting privileges
for group : 0
2006-07-03 17:52:42 | [geonetwork sync] --> download
2006-07-03 17:52:42 | [geonetwork sync] --> dynamic
2006-07-03 17:52:42 | [geonetwork sync] --> view
2006-07-03 17:52:42 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:42 | [geonetwork sync] Obtained remote id=506,
changeDate=2006-05-23T23:20:45
2006-07-03 17:52:53 | [geonetwork sync] - Added metadata with id=348
2006-07-03 17:52:53 | [geonetwork sync] - Setting privileges
for group : 1
2006-07-03 17:52:54 | [geonetwork sync] --> download
2006-07-03 17:52:54 | [geonetwork sync] --> dynamic
2006-07-03 17:52:54 | [geonetwork sync] --> view
2006-07-03 17:52:54 | [geonetwork sync] - Setting privileges
for group : 0
2006-07-03 17:52:54 | [geonetwork sync] --> download
2006-07-03 17:52:54 | [geonetwork sync] --> dynamic
2006-07-03 17:52:54 | [geonetwork sync] --> view
2006-07-03 17:52:54 | [geonetwork sync] - Set category : maps
2006-07-03 17:52:54 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:54 | [geonetwork sync] Obtained remote id=4594,
changeDate=2006-06-13T16:37:16
2006-07-03 17:53:05 | [geonetwork sync] - Added metadata with id=349
2006-07-03 17:53:05 | [geonetwork sync] - Setting privileges
for group : 1
2006-07-03 17:53:05 | [geonetwork sync] --> download
2006-07-03 17:53:05 | [geonetwork sync] --> dynamic
2006-07-03 17:53:05 | [geonetwork sync] --> view
2006-07-03 17:53:05 | [geonetwork sync] - Setting privileges
for group : 0
2006-07-03 17:53:05 | [geonetwork sync] --> download
2006-07-03 17:53:05 | [geonetwork sync] --> dynamic
2006-07-03 17:53:05 | [geonetwork sync] --> view
2006-07-03 17:53:05 | [geonetwork sync] - Set category : maps
2006-07-03 17:53:05 | [geonetwork sync] End of alignment for site-
id : OCHA
2006-07-03 17:53:05 | [geonetwork sync] Searching on : mapsondemand
2006-07-03 17:53:16 | [geonetwork sync] Obtained:
<response xmlns:geonet="http://www.fao.org/geonetwork&quot; from="0"
to="0">
  <summary count="0" type="local">
    <keywords />
    <categories />
  </summary>
</response>
2006-07-03 17:53:16 | [geonetwork sync] Start of alignment for site-
id : OCHA
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with
id=348
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with
id=347
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with
id=346
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with
id=349
2006-07-03 17:53:16 | [geonetwork sync] End of alignment for site-
id : OCHA
----------------------------------------------------------------------
--------------------

--------------
Enri Zhou
2006-07-03

Using Tomcat but need to do more? Need to support web services,
security?
Get stuff done quickly with pre-integrated technology to make your
job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache
Geronimo
http://sel.as-us.falkag.net/sel?
cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Geonetwork-devel mailing list
Geonetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/
projects/geonetwork

Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Geonetwork-devel mailing list
Geonetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

= = = = = = = = = = = = = = = = = = = =

Hi Enri,

the harvesting is well configured and there are no errors on the log.
The question is: do you get this behaviour every time you start geonetwork?
If you got this only once, maybe someone has changed the privileges of those
metadata in the remote site.

Cheers,
Andrea

Hi,

I am useing Geonetwork 2.0.2 and want to make the harvesting feature work, but it seems I am not so fortunate. Definitely, the harvesting process is in progress, but I can only browse the harvested metadata records occasionally, that is, the harvested metadata records exist temporarily,and vanish with unknown reason. Can you figure out what is the problem? For your information, following are contents of the configureation file and the related log file.

Thank you very much!

The segment of the config file:
------------------------------------------------------------------------------------------
  <schedules package="org.fao.geonet">
<!-- Examples of the 'when' attribute:
    when='30 sec'
    when='1 min'
    when='12 hours'
    when='1 hour, 30 min'
    when='12 hours, 32 min, 13 sec'
-->
    <schedule name="geonetwork sync" class=".schedules.MetadataSync" when="1 min">
      <param name="sites">
        <site name="mapsondemand"> <!-- Servlet name of remote node -->
          <general>
            <host>193.43.36.137</host> <!-- domain name or IP of the remote host -->
            <port>80</port> <!-- port of the remote host. Usually 80 or 8080 -->
            <language>en</language>
            <username></username> <!-- This field can be left empty to perform anonymous (guest) searches -->
            <password></password> <!-- This field can be left empty to perform anonymous (guest) searches -->
          </general>
          <services>
            <login>xml.user.login</login>
            <logout>xml.user.logout</logout>
            <search>xml.search</search>
            <get>xml.metadata.get</get>
          </services>
          <search> <!-- These fields define the search parameters -->
            <extended>off</extended>
            <help>off</help>
            <relation>equal</relation>
            <any /> <!-- This field is the free text search field -->
            <remote>off</remote>
            <region/>
            <paper>off</paper>
            <siteId>OCHA</siteId> <!-- This is the unique site ID of the node information should be retrieved from. Can be used to set up trees of nodes -->
          </search>
          <search> <!-- By repeating the search blocks, you can define multiple searches on the same node -->
            <extended>off</extended>
            <help>off</help>
            <relation>equal</relation>
            <any>areas</any>
            <remote>off</remote>
            <region/>
            <paper>off</paper>
            <siteId>OCHA</siteId>
          </search>
          <group id="1"> <!-- These blocks define the groups and their privileges to be set for the harvested metadata -->
            <privilege>view</privilege> <!-- Members of group 1 (internet/all) can see the metadata -->
                   <privilege>download</privilege> <!-- Members can download related resources -->
                   <privilege>dynamic</privilege> <!-- Members can see interactive resources -->
          </group>
          <group id="0">
            <privilege>view</privilege> <!-- Members of group 0 (intranet) can see the metadata -->
                   <privilege>download</privilege> <!-- Members can download related resources -->
                   <privilege>dynamic</privilege> <!-- Members can see interactive resources -->
          </group>
        </site>
      </param>
    </schedule>

<!-- Example of metadata harvesting
    <schedule name="geonetwork harvest" class=".schedules.MetadataHarvest" when="30 sec">
      <param name="configFile" value="/my/work/fao/geonet2/cvs/geonetwork/docs/examples/harvesting-config.xml"/>
    </schedule>
-->
  </schedules>

------------------------------------------------------------------------------------------

The segment of log file:
------------------------------------------------------------------------------------------
2006-07-03 17:52:06 | [geonetwork sync] Searching on : mapsondemand
2006-07-03 17:52:17 | [geonetwork sync] Obtained:
<response xmlns:geonet="http://www.fao.org/geonetwork&quot; from="1" to="4">
  <summary count="4" type="local">
    <keywords>
      <keyword count="3" name="niger" />
      <keyword count="2" name="health" />
      <keyword count="1" name="africa" />
      <keyword count="1" name="climate" />
      <keyword count="1" name="continental climate" />
      <keyword count="1" name="health facilities" />
      <keyword count="1" name="hospitals" />
      <keyword count="1" name="malnutrition" />
      <keyword count="1" name="weather" />
    </keywords>
    <categories>
      <category count="3" name="datasets" />
      <category count="2" name="maps" />
    </categories>
  </summary>
  <metadata>
    <geonet:info>
      <id>507</id>
      <uuid>20b897d0-e525-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:44:18</createDate>
      <changeDate>2006-05-23T23:19:03</changeDate>
      <source>ocha</source>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>503</id>
      <uuid>a019e750-e51f-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:04:55</createDate>
      <changeDate>2006-05-23T23:22:24</changeDate>
      <source>ocha</source>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>506</id>
      <uuid>ab37e720-e521-11da-bf7e-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-05-16T23:19:33</createDate>
      <changeDate>2006-05-23T23:20:45</changeDate>
      <source>ocha</source>
      <category>maps</category>
      <category>datasets</category>
    </geonet:info>
  </metadata>
  <metadata>
    <geonet:info>
      <id>4594</id>
      <uuid>931392a0-fa1d-11da-8dc3-000d939bc5d8</uuid>
      <schema>iso19115</schema>
      <createDate>2006-06-12T16:13:08</createDate>
      <changeDate>2006-06-13T16:37:16</changeDate>
      <source>ocha</source>
      <category>maps</category>
    </geonet:info>
  </metadata>
</response>
2006-07-03 17:52:17 | [geonetwork sync] Start of alignment for site-id : OCHA
2006-07-03 17:52:17 | [geonetwork sync] Obtained remote id=507, changeDate=2006-05-23T23:19:03
2006-07-03 17:52:28 | [geonetwork sync] - Added metadata with id=346
2006-07-03 17:52:28 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:28 | [geonetwork sync] --> download
2006-07-03 17:52:28 | [geonetwork sync] --> dynamic
2006-07-03 17:52:28 | [geonetwork sync] --> view
2006-07-03 17:52:28 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:28 | [geonetwork sync] --> download
2006-07-03 17:52:28 | [geonetwork sync] --> dynamic
2006-07-03 17:52:28 | [geonetwork sync] --> view
2006-07-03 17:52:28 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:28 | [geonetwork sync] Obtained remote id=503, changeDate=2006-05-23T23:22:24
2006-07-03 17:52:42 | [geonetwork sync] - Added metadata with id=347
2006-07-03 17:52:42 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:42 | [geonetwork sync] --> download
2006-07-03 17:52:42 | [geonetwork sync] --> dynamic
2006-07-03 17:52:42 | [geonetwork sync] --> view
2006-07-03 17:52:42 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:42 | [geonetwork sync] --> download
2006-07-03 17:52:42 | [geonetwork sync] --> dynamic
2006-07-03 17:52:42 | [geonetwork sync] --> view
2006-07-03 17:52:42 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:42 | [geonetwork sync] Obtained remote id=506, changeDate=2006-05-23T23:20:45
2006-07-03 17:52:53 | [geonetwork sync] - Added metadata with id=348
2006-07-03 17:52:53 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:52:54 | [geonetwork sync] --> download
2006-07-03 17:52:54 | [geonetwork sync] --> dynamic
2006-07-03 17:52:54 | [geonetwork sync] --> view
2006-07-03 17:52:54 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:52:54 | [geonetwork sync] --> download
2006-07-03 17:52:54 | [geonetwork sync] --> dynamic
2006-07-03 17:52:54 | [geonetwork sync] --> view
2006-07-03 17:52:54 | [geonetwork sync] - Set category : maps
2006-07-03 17:52:54 | [geonetwork sync] - Set category : datasets
2006-07-03 17:52:54 | [geonetwork sync] Obtained remote id=4594, changeDate=2006-06-13T16:37:16
2006-07-03 17:53:05 | [geonetwork sync] - Added metadata with id=349
2006-07-03 17:53:05 | [geonetwork sync] - Setting privileges for group : 1
2006-07-03 17:53:05 | [geonetwork sync] --> download
2006-07-03 17:53:05 | [geonetwork sync] --> dynamic
2006-07-03 17:53:05 | [geonetwork sync] --> view
2006-07-03 17:53:05 | [geonetwork sync] - Setting privileges for group : 0
2006-07-03 17:53:05 | [geonetwork sync] --> download
2006-07-03 17:53:05 | [geonetwork sync] --> dynamic
2006-07-03 17:53:05 | [geonetwork sync] --> view
2006-07-03 17:53:05 | [geonetwork sync] - Set category : maps
2006-07-03 17:53:05 | [geonetwork sync] End of alignment for site-id : OCHA
2006-07-03 17:53:05 | [geonetwork sync] Searching on : mapsondemand
2006-07-03 17:53:16 | [geonetwork sync] Obtained:
<response xmlns:geonet="http://www.fao.org/geonetwork&quot; from="0" to="0">
  <summary count="0" type="local">
    <keywords />
    <categories />
  </summary>
</response>
2006-07-03 17:53:16 | [geonetwork sync] Start of alignment for site-id : OCHA
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=348
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=347
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=346
2006-07-03 17:53:16 | [geonetwork sync] - Removed metadata with id=349
2006-07-03 17:53:16 | [geonetwork sync] End of alignment for site-id : OCHA
------------------------------------------------------------------------------------------

--------------
Enri Zhou
2006-07-03