#1191: Harvester /
---------------------+------------------------------------------------------
Reporter: fxp | Owner: geonetwork-devel@…
Type: defect | Status: new
Priority: major | Milestone: v2.9.0
Component: General | Version: v2.8.0RC2
Keywords: |
---------------------+------------------------------------------------------
When harvesting (eg. http://xyz.ifremer.fr:8080/thredds/local/METEOFRANCE-
EUR-SST_L3MONOSENSOR_NRT-OBS/METEOFRANCE-EUR-SST_L3MONOSENSOR_NRT-
OBS.xml), the process sometimes fails due to harvestUri column size:
{{{
dataset EUROPE SEA SURFACE TEMPERATURE L3 MONO SENSOR NEAR REAL TIME
valid = true
2012-12-13 15:46:28,428 ERROR [geonetwork.harvester] - Thrown Exception
org.postgresql.util.PSQLException: ERROR: value too long for type
character varying(255) during dataset processing
org.postgresql.util.PSQLException: ERROR: value too long for type
character varying(255)
at
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2103)
at
org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1836)
at
org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
at
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:512)
at
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)
at
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:334)
at
org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
at
org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:105)
at jeeves.resources.dbms.Dbms.execute(Dbms.java:266)
at
org.fao.geonet.kernel.DataManager.setHarvestedExt(DataManager.java:1309)
at
org.fao.geonet.kernel.harvest.harvester.fragment.FragmentHarvester.createMetadata(FragmentHarvester.java:611)
at
org.fao.geonet.kernel.harvest.harvester.fragment.FragmentHarvester.addRecord(FragmentHarvester.java:232)
at
org.fao.geonet.kernel.harvest.harvester.fragment.FragmentHarvester.harvest(FragmentHarvester.java:139)
at
org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.createMetadataUsingFragments(Harvester.java:667)
at
org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.harvest(Harvester.java:476)
at
org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.crawlDatasets(Harvester.java:405)
at
org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.crawlDatasets(Harvester.java:399)
at
org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.crawlDatasets(Harvester.java:399)
at
org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.crawlDatasets(Harvester.java:399)
at
org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.harvestCatalog(Harvester.java:335)
at
org.fao.geonet.kernel.harvest.harvester.thredds.Harvester.harvest(Harvester.java:252)
at
org.fao.geonet.kernel.harvest.harvester.thredds.ThreddsHarvester.doHarvest(ThreddsHarvester.java:245)
at
org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor.process(AbstractHarvester.java:399)
at
org.fao.geonet.kernel.MetadataIndexerProcessor.processWithFastIndexing(MetadataIndexerProcessor.java:39)
at
org.fao.geonet.kernel.harvest.harvester.AbstractHarvester.harvest(AbstractHarvester.java:429)
at
org.fao.geonet.kernel.harvest.harvester.HarvesterJob.execute(HarvesterJob.java:29)
at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
}}}
Proposal: increase to 512 characters.
--
Ticket URL: <http://trac.osgeo.org/geonetwork/ticket/1191>
GeoNetwork opensource Developer website <http://sourceforge.net/projects/geonetwork/>
GeoNetwork opensource is a standards based, Free and Open Source catalog application to manage spatially referenced resources through the web. It provides powerful metadata editing and search functions as well as an embedded interactive web map viewer. This website contains information related to the development of the software.