Dear all,
I am trying to harvest the native WAF endpoint of an ERDDAP instance from GeoNetwork 3.10.6.
The harvesting finishes without error but in the log file clearly states that no metadata have been imported because of missing schemas:
- - - - - - - -
2022-02-26T12:58:00,907+0000 INFO [ERDDAP] - Starting harvesting of ERDDAP
2022-02-26T12:58:00,907+0000 DEBUG [ERDDAP] - AbstractHarvester login: ownerId = 116
2022-02-26T12:58:01,075+0000 INFO [ERDDAP] - Started harvesting from node : ERDDAP (WebDavHarvester)
2022-02-26T12:58:01,076+0000 INFO [ERDDAP] - WebDav doHarvest start
2022-02-26T12:58:01,091+0000 DEBUG [ERDDAP] - Retrieving remote metadata information for : ERDDAP
2022-02-26T12:58:01,091+0000 DEBUG [ERDDAP] - Scanning resource : https://erddap.ve.ismar.cnr.it/erddap/metadata/iso19115/xml/
2022-02-26T12:58:01,132+0000 DEBUG [ERDDAP] - Remote files found : 1
2022-02-26T12:58:01,132+0000 INFO [ERDDAP] - Start of alignment for : ERDDAP
2022-02-26T12:58:01,162+0000 DEBUG [ERDDAP] - Getting remote file : https://erddap.ve.ismar.cnr.it/erddap/metadata/iso19115/xml/cnr_ismar_b37f_8e81_db5d_iso19115.xml
2022-02-26T12:58:01,170+0000 DEBUG [ERDDAP] - Record got:
<gmi:MI_Metadata xmlns:gmi="http://www.isotc211.org/2005/gmi" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:gco="http://www.isotc211.org/2005/gco" xmlns:gmd="http://www.isotc211.org/2005/gmd" xmlns:gmx="http://www.isotc211.org/2005/gmx" xmlns:gml="http://www.opengis.net/gml/3.2" xmlns:gss="http://www.isotc211.org/2005/gss" xmlns:gts="http://www.isotc211.org/2005/gts" xmlns:gsr="http://www.isotc211.org/2005/gsr" xmlns:srv="http://www.isotc211.org/2005/srv" xsi:schemaLocation="https://www.isotc211.org/2005/gmi https://data.noaa.gov/resources/iso19139/schema.xsd">
<gmd:fileIdentifier>
<gco:CharacterString>cnr_ismar_b37f_8e81_db5d</gco:CharacterString>
</gmd:fileIdentifier>
### OMITTED FOR BREVITY ###
</gmi:MI_Metadata>
2022-02-26T12:58:01,172+0000 WARN [ERDDAP] - Skipping metadata with unknown schema. Path is : https://erddap.ve.ismar.cnr.it/erddap/metadata/iso19115/xml/cnr_ismar_b37f_8e81_db5d_iso19115.xml
2022-02-26T12:58:01,172+0000 INFO [ERDDAP] - End of alignment for : ERDDAP
2022-02-26T12:58:01,172+0000 INFO [ERDDAP] - WebDav doHarvest end
2022-02-26T12:58:01,172+0000 INFO [ERDDAP] - Ended harvesting from node : ERDDAP (WebDavHarvester)
- - - - - - - -
Here's the json repsonse to the query to the GeoNetwork API exposing the loaded schemas (https://geonetwork.ve.ismar.cnr.it/geonetwork/doc/api/index.html#/identifiers/getIdentifiers):
- - - - -
[
{
"name": "iso19115-3.2018",
"titles": {
"en": "Geographic information -- Metadata",
"fr": "Information géographique -- Métadonnées"
},
"descriptions": {
"en": "The objective of ISO 19115 is to provide a model for describing information or resources that can have geographic extents. This part of ISO 19115 is intended to be used by information system analysts, program planners, and developers of information systems, as well as others in order to define basic principles and requirements for standardized description of information resources. This part of ISO 19115 defines metadata elements, their properties, and the relationships between elements, and establishes a common set of metadata terminology, definitions, and extension procedures. Although the primary purpose of this part of ISO 19115 is to describe digital information that has a geographic extent, it can be used to describe all types of resources including textual documents, initiatives, software, sensors, non-geographic information, product specifications and repositories, i.e. it can be used to describe information resources that do not have geographic extent. Some domains have their own metadata standards, such as the Dublin Core for libraries. If necessary such standards and this part of ISO 19115 could be profiled to create a Community Schema. This schema also includes: - Describe imagery data (covered by ISO19115-2) - Embed data model (feature catalogue) in the dataset record (covered by ISO19110) - Data quality described using ISO19157 More information: - `Using the latest ISO Standard for Geographic Information (ISO19115-1) for an INSPIRE Discovery Service <http://cnig.gouv.fr/wp-content/uploads/2015/06/titellus_fx_prunayre_iso19115-3_inspire2015.pdf>\`\_ This standard is maintained on https://github.com/metadata101/iso19115-3.2018 and is available by default in GeoNetwork 3.8+. The TC211 is maintaining the XSD for this standard on https://github.com/ISO-TC211/XML. Example of catalogues using this standard: - `Metawal - Catalogue pour l'information géographique de Wallonie <http://metawal.wallonie.be/>\`\_ is using ISO19115-3 as the default standard for all records. Main advantages are: categorizations of related documents (eg. online sources, DQ reports, GIS styles, Data models), better description of organization / parties and roles, remain compliant to the INSPIRE directive by converting to ISO19139 through CSW. .. figure:: img/metawal-tramedesaxes.png - `Sextant - Checkpoints <https://sextant.ifremer.fr/>\`\_ is using ISO19115-3 for data quality description of Specification / Products and upstream data. .. figure:: img/sextant-checkpoint.png",
"fr": "L’objectif de l’ISO 19115 est de fournir un modèle destiné à décrire des informations ou des ressources pouvant avoir des étendues géographiques. Cette partie de l’ISO 19115 est destinée à être utilisée, entre autres, par des analystes de systèmes d’informations, des planificateurs de programmes et des développeurs de systèmes d’informations, dans le but de définir des principes de base et des exigences permettant d’établir une description normalisée des ressources d’informations. Cette partie de l’ISO 19115 définit les éléments de métadonnées, leurs propriétés et les relations entre les éléments et établit un ensemble commun de terminologies, de définitions et de procédures d’extension concernant les métadonnées. Bien que cette partie de l’ISO 19115 ait pour but principal de décrire les informations numériques qui ont une étendue géographique, elle peut être utilisée pour décrire tous les types de ressources, y compris les documents textuels, les initiatives, les logiciels, les informations non géographiques, les spécifications de produit et les entrepôts de données, c’est-à-dire qu’elle peut même être utilisée pour décrire des ressources d’informations n’ayant aucune étendue géographique. Certains domaines ont leurs propres normes de métadonnées, telles que celles du Dublin Core pour les bibliothèques. Si besoin, des profils de telles normes et de cette partie de l’ISO 19115 pourraient être développés pour créer un Schéma Communautaire. Ce schéma est également composé des normes : - ISO19110 pour les modèles de données - ISO19115-2 pour l'imagerie - ISO19157 pour la qualité des données"
},
"standardUrl": "http://www.iso.org/iso/home/store/catalogue_tc/catalogue_detail.htm?csnumber=32579",
"targetNamespace": "http://standards.iso.org/iso/19115/-3/mdb/2.0",
"namespaces": {
"dqm": "http://standards.iso.org/iso/19157/-2/dqm/1.0",
"gml": "http://www.opengis.net/gml/3.2",
"fcc": "http://standards.iso.org/iso/19110/fcc/1.0",
"mmi": "http://standards.iso.org/iso/19115/-3/mmi/1.0",
"mcc": "http://standards.iso.org/iso/19115/-3/mcc/1.0",
"msr": "http://standards.iso.org/iso/19115/-3/msr/2.0",
"mac": "http://standards.iso.org/iso/19115/-3/mac/2.0",
"cit": "http://standards.iso.org/iso/19115/-3/cit/2.0",
"gmw": "http://standards.iso.org/iso/19115/-3/gmw/1.0",
"gco": "http://standards.iso.org/iso/19115/-3/gco/1.0",
"reg": "http://standards.iso.org/iso/19135/-2/reg/1.0",
"xml": "http://www.w3.org/XML/1998/namespace",
"cat": "http://standards.iso.org/iso/19115/-3/cat/1.0",
"mco": "http://standards.iso.org/iso/19115/-3/mco/1.0",
"lan": "http://standards.iso.org/iso/19115/-3/lan/1.0",
"gex": "http://standards.iso.org/iso/19115/-3/gex/1.0",
"gcx": "http://standards.iso.org/iso/19115/-3/gcx/1.0",
"mas": "http://standards.iso.org/iso/19115/-3/mas/1.0",
"mrd": "http://standards.iso.org/iso/19115/-3/mrd/1.0",
"mrc": "http://standards.iso.org/iso/19115/-3/mrc/2.0",
"mpc": "http://standards.iso.org/iso/19115/-3/mpc/1.0",
"mex": "http://standards.iso.org/iso/19115/-3/mex/1.0",
"pre": "http://standards.iso.org/iso/19135/-2/pre/1.0",
"mri": "http://standards.iso.org/iso/19115/-3/mri/1.0",
"gfc": "http://standards.iso.org/iso/19110/gfc/1.1",
"mrl": "http://standards.iso.org/iso/19115/-3/mrl/2.0",
"mdb": "http://standards.iso.org/iso/19115/-3/mdb/2.0",
"mrs": "http://standards.iso.org/iso/19115/-3/mrs/1.0",
"srv": "http://standards.iso.org/iso/19115/-3/srv/2.1",
"dqc": "http://standards.iso.org/iso/19157/-2/dqc/1.0",
"mdq": "http://standards.iso.org/iso/19157/-2/mdq/1.0",
"xlink": "http://www.w3.org/1999/xlink"
},
"readwriteUUID": false,
"schematronRules": [
"schematron-rules-inspire.xsl",
"schematron-rules-iso.xsl"
],
"version": "1.0",
"appMinorVersionSupported": "3.5.0",
"appMajorVersionSupported": null,
"dependsOn": null
},
{
"name": "iso19139",
"titles": {
"en": "Geographic information -- Metadata (iso19139:2007)",
"fr": "Information géographique -- Métadonnées (iso19139:2007)"
},
"descriptions": {
"en": "ISO 19115 defines the schema required for describing geographic information and services by means of metadata. It provides information about the identification, the extent, the quality, the spatial and temporal aspects, the content, the spatial reference, the portrayal, distribution, and other properties of digital geographic data and services. ISO 19115 is applicable to: - the cataloguing of all types of resources, clearinghouse activities, and the full description of datasets and services; - geographic services, geographic datasets, dataset series, and individual geographic features and feature properties. ISO 19115 defines: - mandatory and conditional metadata sections, metadata entities, and metadata elements; - the minimum set of metadata required to serve most metadata applications (data discovery, determining data fitness for use, data access, data transfer, and use of digital data and services); - optional metadata elements to allow for a more extensive standard description of resources, if required; - a method for extending metadata to fit specialized needs. Though ISO 19115 is applicable to digital data and services, its principles can be extended to many other types of resources such as maps, charts, and textual documents as well as non-geographic data. Certain conditional metadata elements might not apply to these other forms of data."
},
"standardUrl": "https://www.iso.org/iso/home/store/catalogue_tc/catalogue_detail.htm?csnumber=53798\\n ",
"targetNamespace": "http://www.isotc211.org/2005/gmd",
"namespaces": {
"gco": "http://www.isotc211.org/2005/gco",
"gmx": "http://www.isotc211.org/2005/gmx",
"xml": "http://www.w3.org/XML/1998/namespace",
"gss": "http://www.isotc211.org/2005/gss",
"srv": "http://www.isotc211.org/2005/srv",
"gts": "http://www.isotc211.org/2005/gts",
"gsr": "http://www.isotc211.org/2005/gsr",
"gml": "http://www.opengis.net/gml/3.2",
"gmd": "http://www.isotc211.org/2005/gmd",
"xlink": "http://www.w3.org/1999/xlink"
},
"readwriteUUID": false,
"schematronRules": [
"schematron-rules-url-check.xsl",
"schematron-rules-inspire-sds.xsl",
"schematron-rules-geonetwork.xsl",
"schematron-rules-inspire.xsl",
"schematron-rules-iso.xsl",
"schematron-rules-inspire-strict.xsl"
],
"version": "1.0",
"appMinorVersionSupported": "3.4.0",
"appMajorVersionSupported": null,
"dependsOn": null
},
{
"name": "dublin-core",
"titles": {
"en": "Dublin core"
},
"descriptions": {},
"standardUrl": "http://dublincore.org/documents/dces/",
"targetNamespace": null,
"namespaces": {
"": "http://purl.org/dc/dcmitype/",
"dct": "http://purl.org/dc/terms/",
"xml": "http://www.w3.org/XML/1998/namespace",
"dc": "http://purl.org/dc/elements/1.1/"
},
"readwriteUUID": false,
"schematronRules": ,
"version": "1.0",
"appMinorVersionSupported": "3.4.0",
"appMajorVersionSupported": null,
"dependsOn": null
},
{
"name": "csw-record",
"titles": {
"en": "Dublin core (for CSW only)"
},
"descriptions": {},
"standardUrl": null,
"targetNamespace": "http://www.opengis.net/cat/csw/2.0.2",
"namespaces": {
"dct": "http://purl.org/dc/terms/",
"csw": "http://www.opengis.net/cat/csw/2.0.2",
"ows": "http://www.opengis.net/ows",
"dc": "http://purl.org/dc/elements/1.1/",
"xlink": "http://www.w3.org/1999/xlink"
},
"readwriteUUID": false,
"schematronRules": ,
"version": "2.0.2",
"appMinorVersionSupported": "3.4.0",
"appMajorVersionSupported": null,
"dependsOn": null
},
{
"name": "iso19110",
"titles": {
"en": "Geographic information -- Methodology for feature cataloguing",
"fr": "Information géographique -- Méthodologie de catalogage des entités"
},
"descriptions": {},
"standardUrl": "\n http://www.iso.org/iso/home/store/catalogue_tc/catalogue_detail.htm?csnumber=39965\\n ",
"targetNamespace": "http://www.isotc211.org/2005/gfc",
"namespaces": {
"": "http://www.isotc211.org/2005/gss",
"gco": "http://www.isotc211.org/2005/gco",
"gmx": "http://www.isotc211.org/2005/gmx",
"gfc": "http://www.isotc211.org/2005/gfc",
"gml": "http://www.opengis.net/gml",
"gts": "http://www.isotc211.org/2005/gts",
"gsr": "http://www.isotc211.org/2005/gsr",
"gmd": "http://www.isotc211.org/2005/gmd",
"xlink": "http://www.w3.org/1999/xlink"
},
"readwriteUUID": false,
"schematronRules": ,
"version": "1.0",
"appMinorVersionSupported": "3.4.0",
"appMajorVersionSupported": null,
"dependsOn": "iso19139"
}
]
- - - - - - -
Do I have to load the missing schemas on GeoNetwork or do I have to perform some post processing on ERDDAP WAF endpoint in order to let GeoNetwork perform a smooth harvesting?
With Best Regards,
Pierpaolo Culurciello
(attachments)
harvester_webdav_ERDDAP_202202261258.log (54.8 KB)
Geonetwork_metadata_standards.txt (11.7 KB)