[GeoNetwork-users] Maximum number of records that can be harvested

GeoNetwork GeoNetwork User
, , ,
1

Hi List,

I'm trying to fix a strange and urgent problem with my Geonetwork
installation (two servers, both running 2.10), and I was wondering if
there's a limit to the number of records that can be harvested from one
geonetwork installation to another? I am consistently seeing 1000 records
being harvested when I know there should be more than that. Both servers
have the maximum number of selected records set to 2000 in the system
configuration.

Thanks

Jo

--
*Jo Cook*
t:+44 7930 524 155/twitter:@archaeogeek

--
--
Astun Technology Ltd, The Coach House, 17 West Street, Epsom, Surrey, KT18
7RL, UK
t:+44 1372 744 009 w: astuntechnology.com twitter:@astuntech
<https://twitter.com/astuntech&gt;

iShare - enterprise geographic intelligence platform
<https://astuntechnology.com/ishare/&gt;
GeoServer, PostGIS and QGIS training
<https://astuntechnology.com/services/#training&gt;
Helpdesk and customer portal
<http://support.astuntechnology.com/support/login&gt;

Company registration no. 5410695. Registered in England and Wales.
Registered office: 120 Manor Green Road, Epsom, Surrey, KT19 8LN VAT no.
864201149.

------------------------------

2

Hi,

AFAIK, there is no relation between max number of selected records and
harvesters.

Francois

2016-06-10 13:21 GMT+02:00 Jo Cook <jocook@anonymised.com>:

Hi List,

I'm trying to fix a strange and urgent problem with my Geonetwork
installation (two servers, both running 2.10), and I was wondering if
there's a limit to the number of records that can be harvested from one
geonetwork installation to another? I am consistently seeing 1000 records
being harvested when I know there should be more than that. Both servers
have the maximum number of selected records set to 2000 in the system
configuration.

Thanks

Jo

--
*Jo Cook*
t:+44 7930 524 155/twitter:@archaeogeek

--
--
Astun Technology Ltd, The Coach House, 17 West Street, Epsom, Surrey, KT18
7RL, UK
t:+44 1372 744 009 w: astuntechnology.com twitter:@astuntech
<https://twitter.com/astuntech&gt;

iShare - enterprise geographic intelligence platform
<https://astuntechnology.com/ishare/&gt;
GeoServer, PostGIS and QGIS training
<https://astuntechnology.com/services/#training&gt;
Helpdesk and customer portal
<http://support.astuntechnology.com/support/login&gt;

Company registration no. 5410695. Registered in England and Wales.
Registered office: 120 Manor Green Road, Epsom, Surrey, KT19 8LN VAT no.
864201149.

------------------------------

------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and
traffic
patterns at an interface-level. Reveals which users, apps, and protocols
are
consuming the most bandwidth. Provides multi-vendor support for NetFlow,
J-Flow, sFlow and other flows. Make informed decisions using capacity
planning reports. https://ad.doubleclick.net/ddm/clk/305295220;132659582;e
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

3

Hi Jo,

what is exactly your setup: one of the two 2.10 instances is harvesting the
other one, or which GN version is harvesting which? Which protocol are you
using, CSW or direct GN harvesting? Is the harvested GN instance accessibile
on the internet so that tests could be performed ?

   Cheers,
   Emanuele

Alle 13:21:44 di Friday 10 June 2016, Jo Cook ha scritto:

Hi List,

I'm trying to fix a strange and urgent problem with my Geonetwork
installation (two servers, both running 2.10), and I was wondering if
there's a limit to the number of records that can be harvested from one
geonetwork installation to another? I am consistently seeing 1000 records
being harvested when I know there should be more than that. Both servers
have the maximum number of selected records set to 2000 in the system
configuration.

Thanks

Jo

--

GeoServer Professional Services from the experts!
Visit http://goo.gl/NWWaa2 for more information.

Ing. Emanuele Tajariol
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 380 2116282

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

4

Hi Emanuele,

We have two 2.10 instances, one harvesting from the other, using direct
geonetwork harvesting. The private instance (that we are harvesting from)
is not available publicly on the internet but I have been able to repeat
this using other geonetwork instances too. Currently we are working around
this problem by creating new nodes pointing to the same server but pulling
records with different keywords (so we keep the number of records for each
node below 1000).

Thanks

Jo

On Thu, Jul 7, 2016 at 3:18 PM, Emanuele Tajariol <etj@anonymised.com>
wrote:

Hi Jo,

what is exactly your setup: one of the two 2.10 instances is harvesting the
other one, or which GN version is harvesting which? Which protocol are you
using, CSW or direct GN harvesting? Is the harvested GN instance
accessibile
on the internet so that tests could be performed ?

   Cheers,
   Emanuele

Alle 13:21:44 di Friday 10 June 2016, Jo Cook ha scritto:
> Hi List,
>
> I'm trying to fix a strange and urgent problem with my Geonetwork
> installation (two servers, both running 2.10), and I was wondering if
> there's a limit to the number of records that can be harvested from one
> geonetwork installation to another? I am consistently seeing 1000 records
> being harvested when I know there should be more than that. Both servers
> have the maximum number of selected records set to 2000 in the system
> configuration.
>
> Thanks
>
> Jo

--

GeoServer Professional Services from the experts!
Visit http://goo.gl/NWWaa2 for more information.

Ing. Emanuele Tajariol
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 380 2116282

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

--
*Jo Cook*
t:+44 7930 524 155/twitter:@archaeogeek

--
--
Astun Technology Ltd, The Coach House, 17 West Street, Epsom, Surrey, KT18
7RL, UK
t:+44 1372 744 009 w: astuntechnology.com twitter:@astuntech
<https://twitter.com/astuntech&gt;

iShare - enterprise geographic intelligence platform
<https://astuntechnology.com/ishare/&gt;
GeoServer, PostGIS and QGIS training
<https://astuntechnology.com/services/#training&gt;
Helpdesk and customer portal
<http://support.astuntechnology.com/support/login&gt;

Company registration no. 5410695. Registered in England and Wales.
Registered office: 120 Manor Green Road, Epsom, Surrey, KT19 8LN VAT no.
864201149.