Hi everybody,
what's the best way to import 100.000 ISO 19139 XML datasets in
GeoNetwork 2.4.1 ?
I tried to use CSW-T (only one Dataset / CSW insert post) but the import
slows down after ~ 15.000 Datasets.
How can I post more than one ISO 19139 dataset per one CSW Insert to
increase the speed?
Has anybody experience with such an amount of data?
Thank You for your support!
Best regards,
Juergen
Hi Juergen,
I did not try importing this amount of data, but did use the Kettle ETL package for insertion of XML file records directly into the Geonetwork database. I only did this for about 20 records, so I have no idea if it would work for your case, but an ETL approach it might be worth a try.
Did you perhaps try and give Geonetwork more memory to see if this helped?
Regards,
Jason
--
Jason P. Pickering
Consultant
WHO/Ministry of Health Zambia
email: pickeringj@anonymised.com
tel: +260968395190
________________________________
From: Jürgen [mailto:juergen.weichand@anonymised.com]
Sent: Fri 2009-09-04 10:47
To: geonetwork-users@lists.sourceforge.net
Subject: [GeoNetwork-users] Best way to import 100.000 Datasets?
Hi everybody,
what's the best way to import 100.000 ISO 19139 XML datasets in
GeoNetwork 2.4.1 ?
I tried to use CSW-T (only one Dataset / CSW insert post) but the import
slows down after ~ 15.000 Datasets.
How can I post more than one ISO 19139 dataset per one CSW Insert to
increase the speed?
Has anybody experience with such an amount of data?
Thank You for your support!
Best regards,
Juergen
------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork