[GeoNetwork-devel] Confirm versions of ElasticSearch and Kibana?

GeoNetwork GeoNetwork Developer
, , ,
1

Hi All,

In Geonetwork 3.8, are the instructions and versions for ElasticSearch
and Kibana the same as for previous versions?

Example pages:
https://github.com/geonetwork/core-geonetwork/tree/master/es
https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch

I believe from the changelog at
https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
that it should be ElastcSearch 7.2.1- is that correct, and is it the
same version of Kibana?

Happy to do the work updating the documentation once confirmed.

Thanks

Jo

--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
--
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates&gt; for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/&gt; twitter:@astuntech
<https://twitter.com/astuntech&gt;

iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/&gt;
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training&gt;

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login&gt;

Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.

2

Hi Jo, ES and KB setup is the same as before and 3.8.0 require ES 7+ (mainly due to removal of the document type in ES7) and is built with 7.3.0 (same for master and ES branch).
https://github.com/geonetwork/core-geonetwork/blob/3.8.x/pom.xml#L1360

7.3.1 is the latest and works fine too.

Cheers.

Francois

Le jeu. 12 sept. 2019 à 13:44, Jo Cook <jocook@anonymised.com.> a écrit :

Hi All,

In Geonetwork 3.8, are the instructions and versions for ElasticSearch
and Kibana the same as for previous versions?

Example pages:
https://github.com/geonetwork/core-geonetwork/tree/master/es
https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch

I believe from the changelog at
https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
that it should be ElastcSearch 7.2.1- is that correct, and is it the
same version of Kibana?

Happy to do the work updating the documentation once confirmed.

Thanks

Jo

–
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

–

Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates> for updates on news,
products, conferences, events and training
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
<https://twitter.com/astuntech>

iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/>
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training>

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login>

Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.

GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

3

Hi Francois,

Thanks- can you confirm the elasticdump steps on this page
https://github.com/geonetwork/core-geonetwork/tree/3.8.x/es/es-dashboards
the index-dashboard.json and index-mapping.json files are no longer
available (they are in the 3,6,x branch though).

I'm testing the debian packages for elasticsearch and kibana 7.3.2 as
it's much easier to download them and set them up as services, however
it's not quite working yet and I'm not sure if it's a version problem.
Currently I have elasticsearch working on localhost:9200 and kibana
working on localhost:5601 but from localhost:8080/geonetwork/dashboard
I get the following error:
resource_not_foundNo portal found with id 'dashboard'. The list of
available portals are: [srv]ResourceNotFoundException
and when I view the content statistics page in geonetwork the embedded
page is the tomcat index page!

What I've done so far is load features.json,records.json and
searchlogs.json and configured kibana.yml using the instructions at
the above link, that's it.

Any ideas?

Thanks again

Jo

On Thu, Sep 12, 2019 at 1:05 PM Francois Prunayre <fx.prunayre@anonymised.com> wrote:

Hi Jo, ES and KB setup is the same as before and 3.8.0 require ES 7+ (mainly due to removal of the document type in ES7) and is built with 7.3.0 (same for master and ES branch).
https://github.com/geonetwork/core-geonetwork/blob/3.8.x/pom.xml#L1360
7.3.1 is the latest and works fine too.

Cheers.

Francois

Le jeu. 12 sept. 2019 à 13:44, Jo Cook <jocook@anonymised.com> a écrit :

Hi All,

In Geonetwork 3.8, are the instructions and versions for ElasticSearch
and Kibana the same as for previous versions?

Example pages:
https://github.com/geonetwork/core-geonetwork/tree/master/es
https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch

I believe from the changelog at
https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
that it should be ElastcSearch 7.2.1- is that correct, and is it the
same version of Kibana?

Happy to do the work updating the documentation once confirmed.

Thanks

Jo

--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
--
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates&gt; for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/&gt; twitter:@astuntech
<https://twitter.com/astuntech&gt;

iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/&gt;
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training&gt;

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login&gt;

Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.

_______________________________________________
GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
--
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates&gt; for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/&gt; twitter:@astuntech
<https://twitter.com/astuntech&gt;

iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/&gt;
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training&gt;

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login&gt;

Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.

4

Jo,

Le jeu. 12 sept. 2019 à 18:27, Jo Cook <jocook@anonymised.com> a écrit :

Hi Francois,

Thanks- can you confirm the elasticdump steps on this page
https://github.com/geonetwork/core-geonetwork/tree/3.8.x/es/es-dashboards
the index-dashboard.json and index-mapping.json files are no longer
available (they are in the 3,6,x branch though).

Indeed for the dashboard, in 7.x user can go to Kibana > Saved Object and restore
https://github.com/geonetwork/core-geonetwork/blob/3.8.x/es/es-dashboards/data/export.json
directly which loads index pattern + search + visualization + dashboard.

So we can remove instructions about elasticdump which is more complicated to use.

I’m testing the debian packages for elasticsearch and kibana 7.3.2 as
it’s much easier to download them and set them up as services, however
it’s not quite working yet and I’m not sure if it’s a version problem.
Currently I have elasticsearch working on localhost:9200 and kibana
working on localhost:5601 but from localhost:8080/geonetwork/dashboard
I get the following error:
resource_not_foundNo portal found with id ‘dashboard’. The list of
available portals are: [srv]ResourceNotFoundException
and when I view the content statistics page in geonetwork the embedded
page is the tomcat index page!

What I’ve done so far is load features.json,records.json and
searchlogs.json and configured kibana.yml using the instructions at
the above link, that’s it.

Any ideas?

The KB proxy is created by https://github.com/geonetwork/core-geonetwork/blob/master/web/src/main/webResources/WEB-INF/web.xml#L444-L459
and the url should be http://localhost:8080/geonetwork/dashboards with a ‘s’ ?

Francois

Thanks again

Jo

On Thu, Sep 12, 2019 at 1:05 PM Francois Prunayre <fx.prunayre@anonymised.com> wrote:

Hi Jo, ES and KB setup is the same as before and 3.8.0 require ES 7+ (mainly due to removal of the document type in ES7) and is built with 7.3.0 (same for master and ES branch).
https://github.com/geonetwork/core-geonetwork/blob/3.8.x/pom.xml#L1360
7.3.1 is the latest and works fine too.

Cheers.

Francois

Le jeu. 12 sept. 2019 à 13:44, Jo Cook <jocook@anonymised.com> a écrit :

Hi All,

In Geonetwork 3.8, are the instructions and versions for ElasticSearch
and Kibana the same as for previous versions?

Example pages:
https://github.com/geonetwork/core-geonetwork/tree/master/es
https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch

I believe from the changelog at
https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
that it should be ElastcSearch 7.2.1- is that correct, and is it the
same version of Kibana?

Happy to do the work updating the documentation once confirmed.

Thanks

Jo

–
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

–

Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates> for updates on news,
products, conferences, events and training
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
<https://twitter.com/astuntech>

iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/>
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training>

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login>

Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.

GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

–
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

–

Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates> for updates on news,
products, conferences, events and training
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
<https://twitter.com/astuntech>

iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/>
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training>

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login>

Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.

5

Hi Francois,

Yes, that works (using export.json from the kibana dashboard and
correcting typos). The final part of the puzzle was commenting out the
section in web-inf/web.xml:
<filter-mapping>
      <filter-name>XFrameOptionsFilter</filter-name>
      <url-pattern>/*</url-pattern>
    </filter-mapping>

I'll create some new documentation on this, as I can confirm that the
standard packages work from the debian/ubuntu repositories and they
can easily be set up as services.

Thanks again

Jo

On Thu, Sep 12, 2019 at 5:38 PM Francois Prunayre <fx.prunayre@anonymised.com> wrote:

Jo,

Le jeu. 12 sept. 2019 à 18:27, Jo Cook <jocook@anonymised.com> a écrit :

Hi Francois,

Thanks- can you confirm the elasticdump steps on this page
https://github.com/geonetwork/core-geonetwork/tree/3.8.x/es/es-dashboards
the index-dashboard.json and index-mapping.json files are no longer
available (they are in the 3,6,x branch though).

Indeed for the dashboard, in 7.x user can go to Kibana > Saved Object and restore
https://github.com/geonetwork/core-geonetwork/blob/3.8.x/es/es-dashboards/data/export.json
directly which loads index pattern + search + visualization + dashboard.

So we can remove instructions about elasticdump which is more complicated to use.

I'm testing the debian packages for elasticsearch and kibana 7.3.2 as
it's much easier to download them and set them up as services, however
it's not quite working yet and I'm not sure if it's a version problem.
Currently I have elasticsearch working on localhost:9200 and kibana
working on localhost:5601 but from localhost:8080/geonetwork/dashboard
I get the following error:
resource_not_foundNo portal found with id 'dashboard'. The list of
available portals are: [srv]ResourceNotFoundException
and when I view the content statistics page in geonetwork the embedded
page is the tomcat index page!

What I've done so far is load features.json,records.json and
searchlogs.json and configured kibana.yml using the instructions at
the above link, that's it.

Any ideas?

The KB proxy is created by https://github.com/geonetwork/core-geonetwork/blob/master/web/src/main/webResources/WEB-INF/web.xml#L444-L459
and the url should be http://localhost:8080/geonetwork/dashboards with a 's' ?

Francois

Thanks again

Jo

On Thu, Sep 12, 2019 at 1:05 PM Francois Prunayre <fx.prunayre@anonymised.com> wrote:
>
> Hi Jo, ES and KB setup is the same as before and 3.8.0 require ES 7+ (mainly due to removal of the document type in ES7) and is built with 7.3.0 (same for master and ES branch).
> https://github.com/geonetwork/core-geonetwork/blob/3.8.x/pom.xml#L1360
> 7.3.1 is the latest and works fine too.
>
> Cheers.
>
> Francois
>
> Le jeu. 12 sept. 2019 à 13:44, Jo Cook <jocook@anonymised.com> a écrit :
>>
>> Hi All,
>>
>> In Geonetwork 3.8, are the instructions and versions for ElasticSearch
>> and Kibana the same as for previous versions?
>>
>> Example pages:
>> https://github.com/geonetwork/core-geonetwork/tree/master/es
>> https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
>> https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch
>>
>> I believe from the changelog at
>> https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
>> that it should be ElastcSearch 7.2.1- is that correct, and is it the
>> same version of Kibana?
>>
>> Happy to do the work updating the documentation once confirmed.
>>
>> Thanks
>>
>> Jo
>>
>>
>> --
>> Jo Cook
>> t:+44 7930 524 155/twitter:@archaeogeek
>> Please note that currently I do not work on Friday afternoons. For
>> urgent responses at that time, please visit
>> support.astuntechnology.com or phone our office on 01372 744009
>>
>> --
>> --
>> *Sign up to our mailing list
>> <https://astuntechnology.com/company/#email-updates&gt; for updates on news,
>> products, conferences, events and training*
>> *
>> *
>>
>> Astun Technology Ltd, The
>> Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
>> t:+44 1372 744
>> 009 w: astuntechnology.com <http://astuntechnology.com/&gt; twitter:@astuntech
>> <https://twitter.com/astuntech&gt;
>>
>>
>>
>> iShare - enterprise geographic
>> intelligence platform <https://astuntechnology.com/ishare/&gt;
>> GeoServer,
>> PostGIS and QGIS training <https://astuntechnology.com/services/#training&gt;
>>
>> Helpdesk and customer portal
>> <http://support.astuntechnology.com/support/login&gt;
>>
>>
>>
>>
>> Company registration
>> no. 5410695. Registered in England and Wales. Registered office: 120 Manor
>> Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.
>>
>>
>> _______________________________________________
>> GeoNetwork-devel mailing list
>> GeoNetwork-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
>> GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
--
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates&gt; for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/&gt; twitter:@astuntech
<https://twitter.com/astuntech&gt;

iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/&gt;
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training&gt;

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login&gt;

Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.

--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
--
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates&gt; for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/&gt; twitter:@astuntech
<https://twitter.com/astuntech&gt;

iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/&gt;
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training&gt;

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login&gt;

Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.