Sorry I did not copy the entire output
curl -X PUT http://10.8.244.64:9200/gn-records -H "Content-Type:application/json" -d @../apps/geonetwork/WEB-INF/data/config/index/records.json
Warning: Couldn't read data from file
Warning: "../apps/geonetwork/WEB-INF/data/config/index/records.json", this
Warning: makes an empty POST.
{"acknowledged":true,"shards_acknowledged":true,"index":"gn-records"}
now it is correct
regards,
Bart
________________________________
From: Florent Gravin <florent.gravin@...137...>
Sent: Thursday, October 19, 2023 08:54
To: Ventura Bartolomeo <bartolomeo.ventura@...1518...>
Cc: Juan Luis Rodriguez Ponce <juanluisrp@...444...>; Florent Gravin via GeoNetwork-users <geonetwork-users@lists.sourceforge.net>
Subject: Re: [GeoNetwork-users] Elastic search version for the latest GN version
Then you don't have gn-records index =)
Also you might got some issues with the ENV IDX_PREFIX
Just put the correct name in the url directly eg.
curl -X PUT http://10.8.244.64:9200/$IDX_PREFIX-records>gn\-records -H "Content-Type:application/json" -d @../apps/geonetwork/WEB-INF/data/config/index/records.json
and check that this request succeed
On Thu, Oct 19, 2023 at 8:50 AM Ventura Bartolomeo <bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>> wrote:
Hi,
this is wat I get
curl http://10.8.244.64:9200/_cat/indices
green open .geoip_databases K3TvrTkGQDCJXSMSiGZgnQ 1 0 42 0 40.6mb 40.6mb
yellow open features zef2zMOOSteO7lqH0mtBpw 1 1 0 0 208b 208b
yellow open searchlogs j3SK2Y3OQw2yeWH12P8RwA 1 1 0 0 208b 208b
yellow open gn-searchlogs VvDwV60RQ1WaEg4sMhUOJQ 1 1 0 0 208b 208b
the index is not there and as a consequence
curl http://10.8.244.64:9200/_cat/indices/gn-records
{"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [gn-records]","resource.type":"index_or_alias","resource.id<http://resource.id/>":"gn\-records","index\_uuid":"\_na\_","index":"gn\-records"\}],"type":"index_not_found_exception","reason":"no such index [gn-records]","resource.type":"index_or_alias","resource.id<http://resource.id/>":"gn\-records","index\_uuid":"\_na\_","index":"gn\-records"\},"status":404}
Thanks,
Bartolomeo
________________________________
From: Juan Luis Rodriguez Ponce <juanluisrp@...444...<mailto:juanluisrp@…444…>>
Sent: Thursday, October 19, 2023 08:47
To: Florent Gravin <florent.gravin@...137...<mailto:florent.gravin@…137…>>
Cc: Florent Gravin via GeoNetwork-users <geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>>; Ventura Bartolomeo <bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>>
Subject: Re: [GeoNetwork-users] Elastic search version for the latest GN version
You can check the existing indexes with this request:
curl https://elascticsearch-host:9200/_cat/indices
If the gn-records index is there you can check the details calling
curl https://elascticsearch-host:9200/_cat/indices/gn-records
If you can try them from the GN host to check if there is any connectivity problem between ES and GN.
Best regards,
Juan Luis.
[https://www.geocat.net/wp-content/uploads/2022/08/Logo-Colour_w250.png\]<https://www.geocat.net/>
Juan Luis Rodriguez Ponce
E-mail: juanluisrp@...444...<mailto:juanluisrp@…444…>
https://www.geocat.net/>
Veenderweg 13
6721 WD Bennekom
The Netherlands
Tel: +31318416664
[https://www.geocat.net/wp-content/uploads/2022/08/NRK-logo_Vrienden_van_EN_ON_WHITE_237x150px.png\]
---- On Thu, 19 Oct 2023 08:39:35 +0200 Florent Gravin via GeoNetwork-users <geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>> wrote ---
Then remove the parameter max_concurrent_shards from the request, does it
work ?
On Thu, Oct 19, 2023 at 8:38 AM Ventura Bartolomeo <
bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>> wrote:
Hi,
this is what I get from the request:{
"error": {
"root_cause": [
{
"type": "illegal_argument_exception",
"reason": "request [/gn-records/_search] contains unrecognized parameter: [max_concurrent_shards]"
}
],
"type": "illegal_argument_exception",
"reason": "request [/gn-records/_search] contains unrecognized parameter: [max_concurrent_shards]"
},
"status": 400
}regards,
------------------------------
*From:* Florent Gravin <florent.gravin@...137...<mailto:florent.gravin@…137…>>
*Sent:* Thursday, October 19, 2023 08:35
*To:* Ventura Bartolomeo <bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>>
*Cc:* geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net> <
geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>>
*Subject:* Re: [GeoNetwork-users] Elastic search version for the latest
GN versionERROR [geonetwork.index] - Error during querying index. method [POST],
host [[http://10.8.244.64:9200&]http://10.8.244.64:9200<http://10.8.244.64:9200/&gt;\], URI
[/gn-records/_search?typed_keys=true&max_concurrent_shards=open&allow_no_indices=true&ignore_throttled=true&search_type=query_then_fetch&batched_reduce_size=512],
status line [HTTP/1.1 404 Not Found]
Warnings: [[ignore_throttled] parameter is deprecated because frozen
indices have been deprecated. Consider cold or frozen tiers in place of
frozen indices.]
{"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no
such index [gn-records]","resource.type":"index_or_alias","resource.id<http://resource.id/>":"gn\-records","index\_uuid":"\_na\_","index"reason":"no
such index [gn-records]","resource.type":"index_or_alias","resource.id<http://resource.id/>
":"gn-records","index_uuid":"_na_","index":"gn-records"},"status":404}Well, the logs indicate that
- GeoNetwork actually fetches ES on http://10.8.244.64:9200/> (which is
correct)
- The index is not found
- It seems that ES is answering something though, so would mean that
GN can talk to ES, but the gn-records index is not found (it's just a guess
from the logs).Does this request returns something ?
http://10.8.244.64:9200/gn-records/_search?typed_keys=true&max_concurrent_shards=open&allow_no_indices=true&ignore_throttled=true&search_type=query_then_fetch&batched_reduce_size=512I don't think it's related to the DB, but to the ability of GN to reach ES
or that ES does not have a gn-records index.
I am not too much of an infra guy so maybe people in the ML who are more
comfortable with setting GeoNetwork up could give some hints.On Thu, Oct 19, 2023 at 8:21 AM Ventura Bartolomeo <
bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>> wrote:Hi,
elasticsearch seems to be there as you can see in the following figure
where the gn-records index seems to be present too
Might it be an error related to the DB?thanks!
------------------------------
*From:* Florent Gravin <florent.gravin@...137...<mailto:florent.gravin@…137…>>
*Sent:* Wednesday, October 18, 2023 17:06
*To:* Ventura Bartolomeo <bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>>
*Cc:* geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net> <
geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>>
*Subject:* Re: [GeoNetwork-users] Elastic search version for the latest
GN versionOk, everything looks good, you can confirm the ES config from the admin
console: admin.console#/dashboard/information (at the bottom)On Wed, Oct 18, 2023 at 4:05 PM Ventura Bartolomeo <
bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>> wrote:Hi,
- you have created the index on the correct instance
these are the commands I used:
*IDX_PREFIX=gn*
*curl -X DELETE http://10.8.244.64:9200/$IDX_PREFIX-searchlogs
<http://10.8.244.64:9200/$IDX_PREFIX-searchlogs>*
*curl -X DELETE http://10.8.244.64:9200/$IDX_PREFIX-records
<http://10.8.244.64:9200/$IDX_PREFIX-records>*
*curl -X DELETE http://10.8.244.64:9200/$IDX_PREFIX-features
<http://10.8.244.64:9200/$IDX_PREFIX-features>** curl -X PUT http://10.8.244.64:9200/$IDX_PREFIX-records
<http://10.8.244.64:9200/$IDX_PREFIX-records> -H
"Content-Type:application/json" -d
@../apps/geonetwork/WEB-INF/data/config/index/records.json**curl -X PUT http://10.8.244.64:9200/$IDX_PREFIX-features
<http://10.8.244.64:9200/$IDX_PREFIX-features> -H
"Content-Type:application/json" -d
@../apps/geonetwork/WEB-INF/data/config/index/features.json**curl -X PUT http://10.8.244.64:9200/$IDX_PREFIX-searchlogs
<http://10.8.244.64:9200/$IDX_PREFIX-searchlogs> -H
"Content-Type:application/json" -d
@../apps/geonetwork/WEB-INF/data/config/index/searchlogs.json*- you have set up the correct ES path in GeoNetwork
this is the section extracted from the
/opt/geonetwork/apps/geonetwork/WEB-INF/config.properties filel*anguage.default=eng*
*language.forceDefault=true**# Define using CRON expression when watchlist notifier is triggered
(Default 4AM)*
*usersavedselection.watchlist.frequency=0 0 4 * * ?**# Define the link to the list of updated records sent by email by the
watchlist notifier**usersavedselection.watchlist.searchurl=catalog.search#/search?_uuid={{filter}}*
*# Define the link to each record sent by email by the watchlist notifier*
*usersavedselection.watchlist.recordurl=api/records/{{index:uuid}}**es.protocol=http*
*es.port=9200*
*es.host=10.8.244.64*
*es.url=${es.protocol}://${es.host}:${es.port}*
*es.username=*
*es.password=*
*es.index.features=gn-features*
*es.index.features.type=features*Is it enough or should I check somewhere else?
- GeoNetwork web app can reach your ES in terms of network
Elasticsearch is installed on the same VM. To be sure Is there a specific
way to check it?thanks!
------------------------------
*From:* Florent Gravin <florent.gravin@...137...<mailto:florent.gravin@…137…>>
*Sent:* Wednesday, October 18, 2023 15:41
*To:* Ventura Bartolomeo <bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>>
*Cc:* geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net> <
geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>>
*Subject:* Re: [GeoNetwork-users] Elastic search version for the latest
GN versionHmm,
If you are sure that you've created the gn-records index on *10.8.244.64:9200/gn-records<http://10.8.244.64:9200/gn-records>
<http://10.8.244.64:9200/gn-records>* and not on *localhost:9200*, and
that you are sure that your GeoNetwork points to the ES on *10.8.244.64:9200<http://10.8.244.64:9200/>
<http://10.8.244.64:9200/>*/gn-records, then yes, I don't see why it
complains about not finding the gn-records index.Could you double check that:
- you have created the index on the correct instance
- you have set up the correct ES path in GeoNetwork
- GeoNetwork web app can reach your ES in terms of networkOn Wed, Oct 18, 2023 at 3:26 PM Ventura Bartolomeo <
bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>> wrote:Hi,
unfortunately it did not help.I deleted the index and created them again. But as soon as I try to add a
metadata the same error message returns.I tried to delete and reindex via GN but it did not help too
the error in this case is
[gn-records] ElasticsearchStatusException[Elasticsearch exception [type=index_not_found_exception, reason=no such index [gn-records]]]
------------------------------
*From:* Florent Gravin <florent.gravin@...137...<mailto:florent.gravin@…137…>>
*Sent:* Wednesday, October 18, 2023 14:52
*To:* Ventura Bartolomeo <bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>>
*Cc:* geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net> <
geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>>
*Subject:* Re: [GeoNetwork-users] Elastic search version for the latest
GN versionYou don't often get email from florent.gravin@...137...<mailto:florent.gravin@…137…>. Learn why
this is important <https://aka.ms/LearnAboutSenderIdentification>
Hello,I would follow the instructions right there:
https://github.com/geonetwork/core-geonetwork/tree/main/es#configuration
You may need to *delete* your index first, and recreate it.
Let us know if it helps.On Wed, Oct 18, 2023 at 2:49 PM Ventura Bartolomeo <
bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>> wrote:Hi all,
I installed the version 7.15.1 but even if it is up and running I'm
getting the following error*ERROR [geonetwork.index] - Error during index creation. Error is: Could
not connect to index 'gn-records'. Error is Compressor detection can only
be called on some xcontent bytes or compressed xcontent bytes. Is the index
server up and running?*Elasticsearch is up and running
If I create via curl the gn-index
*curl -X PUT "10.8.244.64:9200/gn-records<http://10.8.244.64:9200/gn-records>
<http://10.8.244.64:9200/gn-records>" -H 'Content-Type: application/json'*it seems working but if I create a metadata and I search for it the same
error appears againAny suggestions?
thanks
------------------------------
*From:* Florent Gravin <florent.gravin@...137...<mailto:florent.gravin@…137…>>
*Sent:* Tuesday, October 17, 2023 15:20
*To:* Ventura Bartolomeo <bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…>>
*Cc:* geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net> <
geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>>
*Subject:* Re: [GeoNetwork-users] Elastic search version for the latest
GN versionYou don't often get email from florent.gravin@...137...<mailto:florent.gravin@…137…>. Learn why
this is important <https://aka.ms/LearnAboutSenderIdentification>
Hello,The actual supported version is the *7.15.1*.
See https://github.com/geonetwork/core-geonetwork/blob/main/pom.xml#L1524On Tue, Oct 17, 2023 at 3:09 PM Ventura Bartolomeo via GeoNetwork-users <
geonetwork-users@lists.sourceforge.net<mailto:geonetwork-users@lists.sourceforge.net>> wrote:Hi all,
could you please tell me which version of elasticsearch you recommend to
be used for GN v4.4.0?I tried using the last one elasticsearch-8.10.3 but I got the following
error:ERROR [geonetwork.index] - Error during querying index. method [POST],
host [[http://10.8.244.64:9200/>\],]http://10.8.244.64:9200/>\], URI
[/gn-records/_search?typed_keys=true&max_concurrent_shards=open&allow_no_indices=true&ignore_throttled=true&search_type=query_then_fetch&batched_reduce_size=512],
status line [HTTP/1.1 404 Not Found]
Warnings: [[ignore_throttled] parameter is deprecated because frozen
indices have been deprecated. Consider cold or frozen tiers in place of
frozen indices.]
{"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no
such index [gn-records]","resource.type":"index_or_alias","resource.id<http://resource.id/>":"gn\-records","index\_uuid":"\_na\_","index"reason":"no
such index [gn-records]","resource.type":"index_or_alias","resource.id<http://resource.id/>
":"gn-records","index_uuid":"_na_","index":"gn-records"},"status":404}even if I created the index as indicated in the GN guideline
regards,
Bartolomeo Ventura, PhD
Eurac Research
Institute for Earth Observation
T +39 0471 055 374
F +39 0471 055 389
bartolomeo.ventura@...1518...<mailto:bartolomeo.ventura@…1518…><mailto:bartolomeo.ventura@…1518…>Viale Druso 1
I-39100 Bolzano
www.eurac.edu<http://www.eurac.edu/><http://www.eurac.edu/&gt;This transmission is intended only for the use of the addressee and may
contain confidential or legally privileged information.
If you receive this transmission by error, please notify the author
immediately by mail and delete all copies of this transmission and any
attachments.
Any use or dissemination of this communication is strictly prohibited by
the "Privacy-Code", D.Lgs. 196/2003 and may lead to penal prosecution and
liability for damages.
P Think before you print_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net<mailto:GeoNetwork-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork--
[image: This is Florent Gravin's card. Their email is
florent.gravin@...137...<mailto:florent.gravin@…137…>.]
<https://hihello.me/p/198272c7-2709-4f8c-8bb0-0b01e91cac7f>--
[image: This is Florent Gravin's card. Their email is
florent.gravin@...137...<mailto:florent.gravin@…137…>.]
<https://hihello.me/p/198272c7-2709-4f8c-8bb0-0b01e91cac7f>--
[image: This is Florent Gravin's card. Their email is
florent.gravin@...137...<mailto:florent.gravin@…137…>.]
<https://hihello.me/p/198272c7-2709-4f8c-8bb0-0b01e91cac7f>--
[image: This is Florent Gravin's card. Their email is
florent.gravin@...137...<mailto:florent.gravin@…137…>.]
<https://hihello.me/p/198272c7-2709-4f8c-8bb0-0b01e91cac7f>--
[image: This is Florent Gravin's card. Their email is
florent.gravin@...137...<mailto:florent.gravin@…137…>.]
<https://hihello.me/p/198272c7-2709-4f8c-8bb0-0b01e91cac7f>
--
[image: This is Florent Gravin's card. Their email is
florent.gravin@...137...<mailto:florent.gravin@…137…>.]
<https://hihello.me/p/198272c7-2709-4f8c-8bb0-0b01e91cac7f>
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net<mailto:GeoNetwork-users@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
--
[This is Florent Gravin's card. Their email is florent.gravin@...1966...]<https://hihello.me/p/198272c7-2709-4f8c-8bb0-0b01e91cac7f>