Thanks José,
I tried to rebuild GeoNetwork with the modifications, however, I get à
build failure at the "JS API and Service documentation" that seems to be
related with the npm installation.
I'm behind a proxy (it is probably related to it), anyway maven is working
fine since its able to download and build other projects.
Any ideas of what could be causing the problem ?
[...]
[INFO] ------------------------------------------------------------
------------
[INFO] Building JS API and Service documentation 3.5.0-SNAPSHOT
[INFO] ------------------------------------------------------------
------------
[INFO]
[INFO] --- frontend-maven-plugin:0.0.23:install-node-and-npm (install node
and npm) @ web-ui-docs ---
[INFO] Installing node version v0.10.24
[INFO] Creating temporary directory /media/mibarra/Data/IBARRA/
Moissonnage/deux-geonetwork-sourcecode/core-geonetwork/web-ui-docs/node_tmp
[INFO] Downloading Node.js from http://nodejs.org/dist/v0.10.
24/node-v0.10.24-linux-x64.tar.gz to /media/mibarra/Data/IBARRA/
Moissonnage/deux-geonetwork-sourcecode/core-geonetwork/
web-ui-docs/node_tmp/node.tar.gz
[INFO] Downloading via proxy ProxyConfig{protocol='http', host='proxy.ign.fr',
port=3128}
[INFO] Extracting Node.js files in node_tmp
[INFO] Unpacking /media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs/node_tmp/node.tar.gz into
/media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs/node_tmp
[INFO] Moving node binary to /media/mibarra/Data/IBARRA/
Moissonnage/deux-geonetwork-sourcecode/core-geonetwork/web-ui-docs/node/node
[INFO] Deleting temporary directory /media/mibarra/Data/IBARRA/
Moissonnage/deux-geonetwork-sourcecode/core-geonetwork/web-ui-docs/node_tmp
[INFO] Installed node locally.
[INFO] Installing npm version 1.3.23
[INFO] Downloading NPM from http://registry.npmjs.org/npm/-/npm-1.3.23.tgz
to /media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs/npm.tar.gz
[INFO] Downloading via proxy ProxyConfig{protocol='http', host='proxy.ign.fr',
port=3128}
[INFO] Extracting NPM files in node/
[INFO] Unpacking /media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs/npm.tar.gz into
/media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs/node
[INFO] Installed NPM locally.
[INFO]
[INFO] --- frontend-maven-plugin:0.0.23:npm (npm download modules) @
web-ui-docs ---
[INFO] Running 'npm install --color=false --proxy=http://proxy.ign.fr:3128'
in /media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs
[ERROR] npm WARN package.json geonetwork-docs@anonymised.com No repository field.
[ERROR] npm http GET https://registry.npmjs.org/grunt
[ERROR] npm http GET https://registry.npmjs.org/grunt-ngdocs
[ERROR] npm http GET https://registry.npmjs.org/grunt-cli
[ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-connect
[ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-clean/0.4.1
[ERROR] npm http GET https://registry.npmjs.org/grunt
[ERROR] npm http GET https://registry.npmjs.org/grunt-ngdocs
[ERROR] npm http GET https://registry.npmjs.org/grunt-cli
[ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-connect
[ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-clean/0.4.1
[ERROR] npm http GET https://registry.npmjs.org/grunt
[ERROR] npm http GET https://registry.npmjs.org/grunt-cli
[ERROR] npm http GET https://registry.npmjs.org/grunt-ngdocs
[ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-connect
[ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-clean/0.4.1
[ERROR] npm ERR! network tunneling socket could not be established,
cause=140058678122304:error:140770FC:SSL
routines:SSL23_GET_SERVER_HELLO:unknown
protocol:../deps/openssl/openssl/ssl/s23_clnt.c:766:
[ERROR] npm ERR! network
[ERROR] npm ERR! network This is most likely not a problem with npm itself
[ERROR] npm ERR! network and is related to network connectivity.
[ERROR] npm ERR! network In most cases you are behind a proxy or have bad
network settings.
[ERROR] npm ERR! network
[ERROR] npm ERR! network If you are behind a proxy, please make sure that
the
[ERROR] npm ERR! network 'proxy' config is set properly. See: 'npm help
config'
[ERROR]
[ERROR] npm ERR! System Linux 4.10.0-37-generic
[ERROR] npm ERR! command "/media/mibarra/Data/IBARRA/
Moissonnage/deux-geonetwork-sourcecode/core-geonetwork/web-ui-docs/node/node"
"/media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs/node/npm/bin/npm-cli.js" "install"
"--color=false" "--proxy=http://proxy.ign.fr:3128"
[ERROR] npm ERR! cwd /media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs
[ERROR] npm ERR! node -v v0.10.24
[ERROR] npm ERR! npm -v 1.3.23
[ERROR] npm ERR! code ECONNRESET
[ERROR] npm ERR!
[ERROR] npm ERR! Additional logging details can be found in:
[ERROR] npm ERR! /media/mibarra/Data/IBARRA/Moissonnage/deux-geonetwork-
sourcecode/core-geonetwork/web-ui-docs/npm-debug.log
[ERROR] npm ERR! not ok code 0
[INFO] ------------------------------------------------------------
------------
[INFO] Reactor Summary:
[INFO]
[INFO] GeoNetwork opensource .............................. SUCCESS [
0.281 s]
[INFO] common utils ....................................... SUCCESS [
3.341 s]
[INFO] Caching xslt module ................................ SUCCESS [
0.143 s]
[INFO] ArcSDE module (dummy-api) .......................... SUCCESS [
0.515 s]
[INFO] GeoNetwork domain .................................. SUCCESS [
10.130 s]
[INFO] Oaipmh modules ..................................... SUCCESS [
0.430 s]
[INFO] GeoNetwork Events .................................. SUCCESS [
0.310 s]
[INFO] GeoNetwork schema plugins .......................... SUCCESS [
0.004 s]
[INFO] GeoNetwork schema plugins core ..................... SUCCESS [
0.408 s]
[INFO] GeoNetwork schema plugin for ISO19139/119 standards SUCCESS [
0.320 s]
[INFO] GeoNetwork index using Elasticsearch ............... SUCCESS [
0.004 s]
[INFO] GeoNetwork index Elasticsearch client .............. SUCCESS [
0.168 s]
[INFO] GeoNetwork core .................................... SUCCESS [
11.248 s]
[INFO] GeoNetwork schema plugin for Dublin Core records retrieved by CSW
SUCCESS [ 0.072 s]
[INFO] GeoNetwork schema plugin for Dublin Core standard .. SUCCESS [
0.153 s]
[INFO] GeoNetwork schema plugin for ISO19110 standard ..... SUCCESS [
0.146 s]
[INFO] GeoNetwork CSW server .............................. SUCCESS [
1.238 s]
[INFO] GeoNetwork harvesters .............................. SUCCESS [
2.305 s]
[INFO] GeoNetwork health monitor .......................... SUCCESS [
0.534 s]
[INFO] GeoNetwork services ................................ SUCCESS [
11.235 s]
[INFO] Geonetwork Web Resources 4 Java .................... SUCCESS [
7.963 s]
[INFO] GeoNetwork INSPIRE Atom ............................ SUCCESS [
1.742 s]
[INFO] GeoNetwork dashboard app based on Kibana ........... SUCCESS [
0.036 s]
[INFO] messaging .......................................... SUCCESS [
0.548 s]
[INFO] workers ............................................ SUCCESS [
0.004 s]
[INFO] WFS features harvester ............................. SUCCESS [
1.193 s]
[INFO] Tests for schema plugins ........................... SUCCESS [
0.340 s]
[INFO] GeoNetwork user interface module ................... SUCCESS [
51.251 s]
[INFO] JS API and Service documentation ................... FAILURE [01:15
min]
[INFO] GeoNetwork Web module .............................. SKIPPED
[INFO] GeoNetwork E2E Javascript Tests .................... SKIPPED
[INFO] ------------------------------------------------------------
------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------
------------
[INFO] Total time: 03:01 min
[INFO] Finished at: 2017-11-03T18:38:19+01:00
[INFO] Final Memory: 126M/346M
[INFO] ------------------------------------------------------------
------------
[ERROR] Failed to execute goal
com.github.eirslett:frontend-maven-plugin:0.0.23:npm
(npm download modules) on project web-ui-docs: Failed to run task: 'npm
install --color=false --proxy=http://proxy.ign.fr:3128' failed. (error code
1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :web-ui-docs
2017-09-29 12:22 GMT+02:00 Jose Garcia <jose.garcia@anonymised.com>:
Hi María
I tried yesterday and got similar results as you, there problem is related
on how works the CSW harvester and also about an invalid date format
returned by the remote server.
Let me explain how the CSW harvester:
1) First a search to retrieve the remote metadata (uuid, change date) is
issued, using Summary format (for performance)
2) For each result is checked if present locally or not to decide insert
or update it (if changed in the remote server, checking the results
obtained in previous step)
The problem is that for 1) I did time a change to optimize the requests,
to request Dublin Core format instead of ISO format, to improve the
performance, but that seem not a good option as seem the change date
returned in Dublin Core format doesn't seem to correspond always to the
change date in ISO format (that is usually the format you want to harvest).
Also there's a related issue with this server causing the problem: the
Dublin Core response in step 1) is returning for most metadata this format:
YYYY-MM-DD HH:MM:SS, but that seem not a valid ISO8601 date and makes
GeoNetwork fail the parsing.
Also is curious as if you request the metadata in ISO format, the date
returned in Dublin Core format doesn't appear anywhere in the ISO document.
There're 2 solutions:
- The server returns valid ISO8601 dates (not sure if you have control
over this).
- Avoid forcing to use Dublin Core format in step 1 of harvesting (I'll
check to commit this change next week), but in the meantime if you have the
option to build GeoNetwork, you can remove the following lines and rebuild
it. That should request in step 1 ISO format instead of Dublin
- https://github.com/geonetwork/core-geonetwork/blob/3.2.x/
harvesters/src/main/java/org/fao/geonet/kernel/harvest/
harvester/csw/Harvester.java#L255
<https://github.com/geonetwork/core-geonetwork/blob/3.2.x/harvesters/src/main/java/org/fao/geonet/kernel/harvest/harvester/csw/Harvester.java#L255>
- https://github.com/geonetwork/core-geonetwork/blob/3.2.x/
harvesters/src/main/java/org/fao/geonet/kernel/harvest/
harvester/csw/Harvester.java#L275
<https://github.com/geonetwork/core-geonetwork/blob/3.2.x/harvesters/src/main/java/org/fao/geonet/kernel/harvest/harvester/csw/Harvester.java#L275>
I tested this change and got harvested all records.
Regards,
Jose García
On Fri, Sep 29, 2017 at 9:54 AM, María del Mar Ibarra <
mariadelmariv22@anonymised.com> wrote:
Hello Jose,
(Sorry for my late reply, I was in holidays)
Can you try using this URL :
http://wxs.ign.fr/geoportail/csw?VERSION=2.0.2&SERVICE=CSW&R
EQUEST=GetCapabilities
<https://hamac.ign.fr/owa/redir.aspx?C=f1a88eb86669418c970703b60ec496c3&URL=http%3A%2F%2Fwxs.ign.fr%2Fgeoportail%2Fcsw%3FVERSION%3D2.0.2%26SERVICE%3DCSW%26REQUEST%3DGetCapabilities>
2017-09-21 17:43 GMT+02:00 Jose Garcia <jose.garcia@anonymised.com>:
Hi
Maybe is restricted the access, at least trying to access it from the
browser I get a 403 error.
Regards,
Jose García
On Thu, Sep 21, 2017 at 5:35 PM, María del Mar Ibarra <
mariadelmariv22@anonymised.com> wrote:
yes :
http://wxs.ign.fr/catalogue/csw/ISOAP?VERSION=2.0.2&SERVICE=
CSW&REQUEST=GetCapabilities
2017-09-21 17:28 GMT+02:00 Jose Garcia <jose.garcia@anonymised.com>:
Hi María
Any option to provide the url of the server you're harvesting to check
it?
Regards,
Jose García
On Thu, Sep 21, 2017 at 4:09 PM, María del Mar Ibarra <
mariadelmariv22@anonymised.com> wrote:
Hello
I'm using GeoNetwork 3.2.1.
I’m trying to harvest a CSW node (3216 metadata records). I am
launching
the harvesting from the web interface.
Once it is finished, the interface shows the message : 105 harvested
records
However, when I search in my catalogue, it is still empty (0
records). The
metadata table of the database is also empty.
The logfile of the harvest operation shows errors about the syntax of
the
records like the one below. However, I am selecting the option :
accept all
records without validation.
One of the lines of the log-file :
Record failed: IGNF_ORTHO-SATr_1-0_GUYANE-EST4_2014102250606954.xml.
Error
is: Invalid ISO date : 2017-05-22 02:00:00.0
Maria
--
------------------------------------------------------------
------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/project
s/geonetwork
--
*Vriendelijke groeten / Kind regards,Jose García
<http://www.geocat.net/>Veenderweg 13
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+The+Netherlands&entry=gmail&source=g>6721
WD Bennekom
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+The+Netherlands&entry=gmail&source=g>The
Netherlands
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+The+Netherlands&entry=gmail&source=g>T: +31
(0)318 416664 <+31318416664> <https://www.facebook.com/geocatbv>
<https://twitter.com/geocat_bv>
<https://plus.google.com/u/1/+GeocatNetbv/posts>Please consider the
environment before printing this email.*
--
María del Mar IBARRA VIVAS
--
*Vriendelijke groeten / Kind regards,Jose García
<http://www.geocat.net/>Veenderweg 13
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>+The+Netherlands+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>&entry=gmail&source=g>6721
WD Bennekom
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>+The+Netherlands+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>&entry=gmail&source=g>The
Netherlands
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>+The+Netherlands+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>&entry=gmail&source=g>T: +31
(0)318 416664 <+31318416664> <https://www.facebook.com/geocatbv>
<https://twitter.com/geocat_bv>
<https://plus.google.com/u/1/+GeocatNetbv/posts>Please consider the
environment before printing this email.*
--
María del Mar IBARRA VIVAS
--
*Vriendelijke groeten / Kind regards,Jose García
<http://www.geocat.net/>Veenderweg 13
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>+The+Netherlands+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>&entry=gmail&source=g>6721
WD Bennekom
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>+The+Netherlands+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>&entry=gmail&source=g>The
Netherlands
<https://maps.google.com/?q=Veenderweg+13+6721+WD+Bennekom+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>+The+Netherlands+<https://maps.google.com/?q%3DVeenderweg%2B13%2B6721%2BWD%2BBennekom%2BThe%2BNetherlands%26entry%3Dgmail%26source%3Dg>&entry=gmail&source=g>T: +31
(0)318 416664 <+31318416664> <https://www.facebook.com/geocatbv>
<https://twitter.com/geocat_bv>
<https://plus.google.com/u/1/+GeocatNetbv/posts>Please consider the
environment before printing this email.*
--
María del Mar IBARRA VIVAS