#896: Loading ISO19135 sample records slows Geonetwork-ANZMEST dramatically
-----------------------------------+----------------------------------------
Reporter: awalsh | Owner: geonetwork-devel@…
Type: defect | Status: new
Priority: major | Milestone: v2.7.0
Component: General | Version:
Keywords: performance, ISO19135 |
-----------------------------------+----------------------------------------
I built GN trunk SVN9041 + ANZMEST schemas from trunk and tested
loading of ISO19135 records.
Noted that GN became VERY SLOW after I had added the sample ISO19135
records. CPU load became v. high (50%) on displaying 'home' page and basic
search (all results) ,
java.exe memory use jumped from 200mb to 645mb.
The request /geonetwork/srv/eng/main.home took 17 mins to finish! and
reload the home page.
I got 'Java heap space' error from basic search request
/geonetwork/srv/eng/main.search.embedded as follows:
Search Error
×
HTTP ERROR 500
Problem accessing /geonetwork/srv/eng/main.search.embedded. Reason:
Java heap space
Caused by:
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2882)
at
java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:390)
at java.lang.StringBuffer.append(StringBuffer.java:224)
at java.io.StringWriter.write(StringWriter.java:84)
at org.jdom.output.XMLOutputter.indent(XMLOutputter.java:1217)
....
....
Powered by Jetty://
FYI Maximum heap memory was set to 512m and java->Jetty start command was:
java -Xms48m -Xmx512m -Xss2M -XX:MaxPermSize=128m
-Dmime-mappings=..\web\geonetwork\WEB-INF\mime-types.properties
-DSTOP.PORT=8079
-Djava.awt.headless=true
-DSTOP.KEY=geonetwork -jar start.jar
Further info:
Hardware Intel core 2 duo CPU 3.33 GHZ
3.5 GB RAM
Op. System Windows XP
Java 1.6_07
Jetty
--
Ticket URL: <http://trac.osgeo.org/geonetwork/ticket/896>
GeoNetwork opensource Developer website <http://sourceforge.net/projects/geonetwork/>
GeoNetwork opensource is a standards based, Free and Open Source catalog application to manage spatially referenced resources through the web. It provides powerful metadata editing and search functions as well as an embedded interactive web map viewer. This website contains information related to the development of the software.
#896: Loading ISO19135 sample records slows Geonetwork-ANZMEST dramatically
-----------------------------------+----------------------------------------
Reporter: awalsh | Owner: geonetwork-devel@…
Type: defect | Status: new
Priority: major | Milestone: v2.7.0
Component: General | Version:
Keywords: performance, ISO19135 |
-----------------------------------+----------------------------------------
Comment(by simonp):
Andrew - if you run short of memory everything runs slowly as there is
often a lot of time spent trying to retrieve memory in the java virtual
machine so the sensational time of 17 mins to load the home page isn't
really useful.
The memory requirements here are large because these records can be quite
large and GeoNetwork editor tries to create an html form that includes the
whole record.
Later revs (you should wait until my proposal on subtemplate extraction is
hopefully approved) step around this issue by:
- only allowing global register info to be edited in the GeoNetwork editor
- extracting register items as subtemplates which can then be edited using
Admin->Manage Directories
It's a coming thing that records will become larger so the strategy of
editing large records in a single html form needs help which is why other
strategies are being and need to be developed.
Also, on a 3.5Gb RAM machine, you might be a little more generous with
what you allocate to GeoNetwork - how about 1.5Gb (-Xmx1.5g) at least? 
--
Ticket URL: <http://trac.osgeo.org/geonetwork/ticket/896#comment:1>
GeoNetwork opensource Developer website <http://sourceforge.net/projects/geonetwork/>
GeoNetwork opensource is a standards based, Free and Open Source catalog application to manage spatially referenced resources through the web. It provides powerful metadata editing and search functions as well as an embedded interactive web map viewer. This website contains information related to the development of the software.
#896: Loading ISO19135 sample records slows Geonetwork-ANZMEST dramatically
-----------------------------------+----------------------------------------
Reporter: awalsh | Owner: geonetwork-devel@…
Type: defect | Status: new
Priority: major | Milestone: v2.7.0
Component: General | Version:
Keywords: performance, ISO19135 |
-----------------------------------+----------------------------------------
Comment(by simonp):
I'll leave this open until you get a chance to run later revisions (9104)
of GeoNetwork with the recommended approach to large register records.
--
Ticket URL: <http://trac.osgeo.org/geonetwork/ticket/896#comment:2>
GeoNetwork opensource Developer website <http://sourceforge.net/projects/geonetwork/>
GeoNetwork opensource is a standards based, Free and Open Source catalog application to manage spatially referenced resources through the web. It provides powerful metadata editing and search functions as well as an embedded interactive web map viewer. This website contains information related to the development of the software.
#896: Loading ISO19135 sample records slows Geonetwork-ANZMEST dramatically
-----------------------------------+----------------------------------------
Reporter: awalsh | Owner: geonetwork-devel@…
Type: defect | Status: new
Priority: major | Milestone: v2.7.0
Component: General | Version:
Keywords: performance, ISO19135 |
-----------------------------------+----------------------------------------
Comment(by simonp):
Or I should say until the extract-subtemplates proposal and documentation
describing how to edit large register records is committed which I hope
will be svn rev 9104 (the next rev :-))
--
Ticket URL: <http://trac.osgeo.org/geonetwork/ticket/896#comment:3>
GeoNetwork opensource Developer website <http://sourceforge.net/projects/geonetwork/>
GeoNetwork opensource is a standards based, Free and Open Source catalog application to manage spatially referenced resources through the web. It provides powerful metadata editing and search functions as well as an embedded interactive web map viewer. This website contains information related to the development of the software.
#896: Loading ISO19135 sample records slows Geonetwork-ANZMEST dramatically
-----------------------------------+----------------------------------------
Reporter: awalsh | Owner: geonetwork-devel@…
Type: defect | Status: new
Priority: major | Milestone: v2.7.0
Component: General | Version:
Keywords: performance, ISO19135 |
-----------------------------------+----------------------------------------
Comment(by awalsh):
Thanks Simon, makes sense. Will try a more recent rev. and increase my
heap
space.
--
Ticket URL: <http://trac.osgeo.org/geonetwork/ticket/896#comment:4>
GeoNetwork opensource Developer website <http://sourceforge.net/projects/geonetwork/>
GeoNetwork opensource is a standards based, Free and Open Source catalog application to manage spatially referenced resources through the web. It provides powerful metadata editing and search functions as well as an embedded interactive web map viewer. This website contains information related to the development of the software.
#896: Loading ISO19135 sample records slows Geonetwork-ANZMEST dramatically
-----------------------------------+----------------------------------------
Reporter: awalsh | Owner: geonetwork-devel@…
Type: defect | Status: new
Priority: major | Milestone: v2.8.0
Component: General | Version:
Keywords: performance, ISO19135 |
-----------------------------------+----------------------------------------
Changes (by ianwallen):
* milestone: v2.7.0 => v2.8.0
--
Ticket URL: <http://trac.osgeo.org/geonetwork/ticket/896#comment:5>
GeoNetwork opensource Developer website <http://sourceforge.net/projects/geonetwork/>
GeoNetwork opensource is a standards based, Free and Open Source catalog application to manage spatially referenced resources through the web. It provides powerful metadata editing and search functions as well as an embedded interactive web map viewer. This website contains information related to the development of the software.