I have a GN installation (using MySQL) with about 1 million records, imported
recently.
A couple of days ago the server had to be shut down for hardware
maintenance. When I tried to put the GN server back online, I got the
dreaded Out of Memory: Java Heap Space error. After quite a lot of research
and tinkering, I was able to avoid the out of memory error using he
following parameters:
java -Xms2048m -Xmn1024m -Xmx2048m -Xss2M -XX:MaxPermSize=256m
-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/usr/local/geonetwork/jetty/logs/java_heap.hprof
-XX:CompileCommandFile=hotspot_compiler
-Dmime-mappings=../web/geonetwork/WEB-INF/mime-types.properties
-DSTOP.PORT=8079 -Djava.awt.headless=true -DSTOP.KEY=geonetwork -jar
start.jar ../bin/jetty.xml
The host is running a 32-bit OS, so I cannot allocate more memory to Java
heap.
Problem is, the initializing process is taking more than 20 hours, and
counting:
2012-07-17 13:08:36,338 INFO [jeeves.engine] - --- Handler started
---------------------------------------
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Starting schedule manager...
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Memory used is : 1288292 Kb
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Total memory is : 1966080 Kb
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Startup time is : 137 (secs)
2012-07-17 13:08:36,338 INFO [jeeves.engine] - === System working
. . .
2012-07-17 13:09:03,829 DEBUG [jeeves.engine] - TransformerFactoryFactory:
de.fzi.dbs.xml.transform.CachingTransformerFactory
2012-07-17 13:09:03,955 DEBUG [jeeves.engine] - TransformerFactoryFactory:
produces transformer implementation net.sf.saxon.IdentityTransformer
. . .
2012-07-18 09:22:48,239 DEBUG [jeeves.engine] - TransformerFactoryFactory:
de.fzi.dbs.xml.transform.CachingTransformerFactory
2012-07-18 09:22:48,239 DEBUG [jeeves.engine] - TransformerFactoryFactory:
produces transformer implementation net.sf.saxon.IdentityTransformer
Is this normal/expected?
Or am I doing something wrong, and is there anything else I can do speed
things up?
--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Server-taking-a-very-long-time-to-initialize-tp4989066.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.
Hi
Sounds like it's indexing the metadata and taking so many time due to big
catalog, but more than 20 h seem too much.
You can check the WEB-INF/lucene/nonspatial folder to verify if any
activity there. Also probably in log file is being log the indexing
processing.
Regards,
Jose García
On Wed, Jul 18, 2012 at 2:35 PM, apontes <apontes@anonymised.com> wrote:
I have a GN installation (using MySQL) with about 1 million records,
imported
recently.
A couple of days ago the server had to be shut down for hardware
maintenance. When I tried to put the GN server back online, I got the
dreaded Out of Memory: Java Heap Space error. After quite a lot of research
and tinkering, I was able to avoid the out of memory error using he
following parameters:
java -Xms2048m -Xmn1024m -Xmx2048m -Xss2M -XX:MaxPermSize=256m
-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/usr/local/geonetwork/jetty/logs/java_heap.hprof
-XX:CompileCommandFile=hotspot_compiler
-Dmime-mappings=../web/geonetwork/WEB-INF/mime-types.properties
-DSTOP.PORT=8079 -Djava.awt.headless=true -DSTOP.KEY=geonetwork -jar
start.jar ../bin/jetty.xml
The host is running a 32-bit OS, so I cannot allocate more memory to Java
heap.
Problem is, the initializing process is taking more than 20 hours, and
counting:
2012-07-17 13:08:36,338 INFO [jeeves.engine] - --- Handler started
---------------------------------------
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Starting schedule
manager...
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Memory used is : 1288292
Kb
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Total memory is : 1966080
Kb
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Startup time is : 137
(secs)
2012-07-17 13:08:36,338 INFO [jeeves.engine] - === System working
. . .
2012-07-17 13:09:03,829 DEBUG [jeeves.engine] - TransformerFactoryFactory:
de.fzi.dbs.xml.transform.CachingTransformerFactory
2012-07-17 13:09:03,955 DEBUG [jeeves.engine] - TransformerFactoryFactory:
produces transformer implementation net.sf.saxon.IdentityTransformer
. . .
2012-07-18 09:22:48,239 DEBUG [jeeves.engine] - TransformerFactoryFactory:
de.fzi.dbs.xml.transform.CachingTransformerFactory
2012-07-18 09:22:48,239 DEBUG [jeeves.engine] - TransformerFactoryFactory:
produces transformer implementation net.sf.saxon.IdentityTransformer
Is this normal/expected?
Or am I doing something wrong, and is there anything else I can do speed
things up?
--
View this message in context:
http://osgeo-org.1560.n6.nabble.com/Server-taking-a-very-long-time-to-initialize-tp4989066.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork
--
*
GeoCat Bridge for ArcGIS allows instant publishing of data and metadata on
GeoServer and GeoNetwork. Visit http://geocat.net for details.
_________________________
Jose García
GeoCat bv
Veenderweg 13
6721 WD Bennekom
The Netherlands
http://GeoCat.net/>
*
Maybe have a look to
http://geonetwork-opensource.org/manuals/trunk/eng/users/admin/advanced-configuration/index.html#advanced-configuration-for-larger-catalogs
which could provide some ideas for large catalog.
HTH.
Francois
2012/7/18 Jose Garcia <jose.garcia@anonymised.com>:
Hi
Sounds like it's indexing the metadata and taking so many time due to big
catalog, but more than 20 h seem too much.
You can check the WEB-INF/lucene/nonspatial folder to verify if any
activity there. Also probably in log file is being log the indexing
processing.
Regards,
Jose García
On Wed, Jul 18, 2012 at 2:35 PM, apontes <apontes@anonymised.com> wrote:
I have a GN installation (using MySQL) with about 1 million records,
imported
recently.
A couple of days ago the server had to be shut down for hardware
maintenance. When I tried to put the GN server back online, I got the
dreaded Out of Memory: Java Heap Space error. After quite a lot of research
and tinkering, I was able to avoid the out of memory error using he
following parameters:
java -Xms2048m -Xmn1024m -Xmx2048m -Xss2M -XX:MaxPermSize=256m
-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/usr/local/geonetwork/jetty/logs/java_heap.hprof
-XX:CompileCommandFile=hotspot_compiler
-Dmime-mappings=../web/geonetwork/WEB-INF/mime-types.properties
-DSTOP.PORT=8079 -Djava.awt.headless=true -DSTOP.KEY=geonetwork -jar
start.jar ../bin/jetty.xml
The host is running a 32-bit OS, so I cannot allocate more memory to Java
heap.
Problem is, the initializing process is taking more than 20 hours, and
counting:
2012-07-17 13:08:36,338 INFO [jeeves.engine] - --- Handler started
---------------------------------------
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Starting schedule
manager...
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Memory used is : 1288292
Kb
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Total memory is : 1966080
Kb
2012-07-17 13:08:36,338 INFO [jeeves.engine] - Startup time is : 137
(secs)
2012-07-17 13:08:36,338 INFO [jeeves.engine] - === System working
. . .
2012-07-17 13:09:03,829 DEBUG [jeeves.engine] - TransformerFactoryFactory:
de.fzi.dbs.xml.transform.CachingTransformerFactory
2012-07-17 13:09:03,955 DEBUG [jeeves.engine] - TransformerFactoryFactory:
produces transformer implementation net.sf.saxon.IdentityTransformer
. . .
2012-07-18 09:22:48,239 DEBUG [jeeves.engine] - TransformerFactoryFactory:
de.fzi.dbs.xml.transform.CachingTransformerFactory
2012-07-18 09:22:48,239 DEBUG [jeeves.engine] - TransformerFactoryFactory:
produces transformer implementation net.sf.saxon.IdentityTransformer
Is this normal/expected?
Or am I doing something wrong, and is there anything else I can do speed
things up?
--
View this message in context:
http://osgeo-org.1560.n6.nabble.com/Server-taking-a-very-long-time-to-initialize-tp4989066.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork
--
*
GeoCat Bridge for ArcGIS allows instant publishing of data and metadata on
GeoServer and GeoNetwork. Visit http://geocat.net for details.
_________________________
Jose García
GeoCat bv
Veenderweg 13
6721 WD Bennekom
The Netherlands
http://GeoCat.net/>
*
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Jose,
Yes, there is activity in both .../nonspatial and .../spatial folders. Right
now I have:
nonspatial:
-rw-r--r-- 1 root root 1166301355 Jul 19 12:32 _grj8.cfs
-rw-r--r-- 1 root root 851935 Jul 19 12:32 _grj9.cfs
-rw-r--r-- 1 root root 13749446 Jul 20 00:13 _grja.cfs
-rw-r--r-- 1 root root 22394724 Jul 20 08:29 _grja.fdt
-rw-r--r-- 1 root root 242484 Jul 20 07:46 _grja.fdx
-rw-r--r-- 1 root root 502 Jul 19 12:32 segments_f4x5
-rw-r--r-- 1 root root 20 Jul 19 12:32 segments.gen
-rw-r--r-- 1 root root 0 Jul 17 13:08 write.lock
spatial:
-rw-r--r-- 1 root root 169301705 Jul 20 08:15 spatialindex.dbf
-rw-r--r-- 1 root root 7967149 Jul 20 08:15 spatialindex.fix
-rw-r--r-- 1 root root 335 Jul 17 13:06 spatialindex.prj
-rw-r--r-- 1 root root 2811972 Jul 20 08:15 spatialindex.qix
-rw-r--r-- 1 root root 90294308 Jul 20 08:15 spatialindex.shp
-rw-r--r-- 1 root root 5311524 Jul 20 08:15 spatialindex.shx
This has been going on for 3 straight days now.
I know I can use the database for the spatial index, and I'll be doing that
asap. But what about the nonspacial index(es)?
Is there any other way to speed things up? All this time to start up the
server is impractical.
Thanks in advance.
Regards,
André.
--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Server-taking-a-very-long-time-to-initialize-tp4989066p4989603.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.