[GeoNetwork-devel] Help: Records Number drops

Jesse_Eichar2 · March 14, 2013, 3:06pm

That is odd… I assume that no indexing is taking place at the moment? Did you check the logs for out of memory errors?

Jesse

From: Kai Liu <kliu4@anonymised.com>
Sent: ‎March‎ ‎14‎, ‎2013 ‎3‎:‎53‎ ‎PM
To: Jesse Eichar <jesse.eichar@anonymised.com>
CC: Devel geonetwork-devel@lists.sourceforge.net
Subject: Re: RE: [GeoNetwork-devel] Help: Records Number drops

Hi Jesse,

It now shows 56794. The file is as below:

http://ec2-54-234-123-20.compute-1.amazonaws.com/geonetwork/srv/eng/q?fast=index&from=1&to=10

It seems it changes over time.

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

----- Original Message -----
From: Jesse Eichar <jesse.eichar@anonymised.com>
Date: Thursday, March 14, 2013 10:29 am
Subject: RE: [GeoNetwork-devel] Help: Records Number drops

What version of Geonetwork are you using?

Can you run:

geonetwork/srv/eng/q?fast=index&from=1&to=10

and make sure that result agrees with the 25,000 result?

Jesse

From: Kai Liu <kliu4@anonymised.com>
Sent: ‎March‎ ‎14‎, ‎2013 ‎3‎:‎22‎ ‎PM
To: Devel geonetwork-devel@lists.sourceforge.net
Subject: [GeoNetwork-devel] Help: Records Number drops

Dear Developers,

I used the latest GeoNetwork codes to build a portal on Linux.
There are
about 100,000 records last night, but it shows only 25,000 records
thismorning. However, the database shows all records (100,000)
records are
still in database.

Is this a Lucene problem? I tried rebuild lucene but it will drop
again. I
wonder how I can fix it.

Thanks and best regards,

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_mar

GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

Kai_Liu1 · March 14, 2013, 3:34pm

Hi Jesse,

I checked the log just now. It doesn't have out of memory problem. I found the lucene files in WEB-INF/data/index/index/eng is very small (about35M). The total size for the records in database is about 2G and I used old geonetwork the lucene index file is 442M!

Maybe the lucene index has never been finished?

Thanks and best regards,

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

----- Original Message -----
From: Jesse Eichar <jesse.eichar@anonymised.com>
Date: Thursday, March 14, 2013 11:06 am
Subject: RE: [GeoNetwork-devel] Help: Records Number drops

That is odd... I assume that no indexing is taking place at the
moment?Did you check the logs for out of memory errors?

Jesse

*From:* Kai Liu <kliu4@anonymised.com>
*Sent:* ‎March‎ ‎14‎, ‎2013 ‎3‎:‎53‎ ‎PM
*To:* Jesse Eichar <jesse.eichar@anonymised.com>
*CC:* Devel geonetwork-devel@lists.sourceforge.net
*Subject:* Re: RE: [GeoNetwork-devel] Help: Records Number drops

Hi Jesse,

It now shows 56794. The file is as below:

http://ec2-54-234-123-20.compute-
1.amazonaws.com/geonetwork/srv/eng/q?fast=index&from=1&to=10
It seems it changes over time.

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

----- Original Message -----
From: Jesse Eichar <jesse.eichar@anonymised.com>
Date: Thursday, March 14, 2013 10:29 am
Subject: RE: [GeoNetwork-devel] Help: Records Number drops

> What version of Geonetwork are you using?
>
> Can you run:
>
> geonetwork/srv/eng/q?fast=index&from=1&to=10
>
> and make sure that result agrees with the 25,000 result?
>
> Jesse
>
> *From:* Kai Liu <kliu4@anonymised.com>
> *Sent:* ‎March‎ ‎14‎, ‎2013 ‎3‎:‎22‎ ‎PM
> *To:* Devel geonetwork-devel@lists.sourceforge.net
> *Subject:* [GeoNetwork-devel] Help: Records Number drops
>
> Dear Developers,
>
> I used the latest GeoNetwork codes to build a portal on Linux.
> There are
> about 100,000 records last night, but it shows only 25,000 records
> thismorning. However, the database shows all records (100,000)
> records are
> still in database.
>
> Is this a Lucene problem? I tried rebuild lucene but it will drop
> again. I
> wonder how I can fix it.
>
> Thanks and best regards,
>
> Kai
> Joint Center for Intelligent Spatial Computing
> 703-395-2337
>
> -----------------------------------------------------------------
--
> -----------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_mar
> _______________________________________________
> GeoNetwork-devel mailing list
> GeoNetwork-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>

Kai_Liu1 · March 14, 2013, 4:03pm

Hi Jesse,

There are some errors when I restart the GeoNetwork. It seems some gml can't be converted into spatial index. However, I don't think it will stop building index. The error is as below:

2013-03-14 11:55:41,990 ERROR [geonetwork.index] - Failed to convert gml to jts object: <gml:Polygon xmlns:gml="http://www.opengis.net/gml" xmlns="http://www.isotc211.org/2005/gmd" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:srv="http://www.isotc211.org/2005/srv" xmlns:fo="http://www.w3.org/1999/XSL/Format" xmlns:gsr="http://www.isotc211.org/2005/gsr" xmlns:advmis="http://www.geodatenzentrum.de/advmis" xmlns:gts="http://www.isotc211.org/2005/gts" xmlns:gmx="http://www.isotc211.org/2005/gmx" xmlns:geonet="http://www.fao.org/geonetwork" gml:id="ID4454830497488301721" srsName="not defined">
  <gml:exterior>
    <gml:LinearRing>
      <gml:pos>15.0 55.0 0.0</gml:pos>
      <gml:pos>6.0 55.0 0.0</gml:pos>
      <gml:pos>6.0 47.0 0.0</gml:pos>
      <gml:pos>15.0 47.0 0.0</gml:pos>
      <gml:pos>15.0 47.0 0.0</gml:pos>
    </gml:LinearRing>
  </gml:exterior>
</gml:Polygon>
        No authority was defined for code "NOT DEFINED". Did you forget "AUTHORITY:NUMBER"?
org.opengis.referencing.NoSuchAuthorityCodeException: No authority was defined for code "NOT DEFINED". Did you forget "AUTHORITY:NUMBER"?
        at org.geotools.referencing.factory.ManyAuthoritiesFactory.noSuchAuthority(ManyAuthoritiesFactory.java:489)
        at org.geotools.referencing.factory.ManyAuthoritiesFactory.getAuthorityFactory(ManyAuthoritiesFactory.java:467)
        at org.geotools.referencing.factory.ManyAuthoritiesFactory.getCRSAuthorityFactory(ManyAuthoritiesFactory.java:548)
        at org.geotools.referencing.factory.AuthorityFactoryAdapter.createCoordinateReferenceSystem(AuthorityFactoryAdapter.java:801)
        at org.geotools.referencing.factory.ThreadedAuthorityFactory.createCoordinateReferenceSystem(ThreadedAuthorityFactory.java:731)
        at org.geotools.referencing.DefaultAuthorityFactory.createCoordinateReferenceSystem(DefaultAuthorityFactory.java:179)
        at org.geotools.referencing.CRS.decode(CRS.java:489)
        at org.geotools.referencing.CRS.decode(CRS.java:417)
        at org.fao.geonet.kernel.search.spatial.SpatialIndexWriter.extractGeometriesFrom(SpatialIndexWriter.java:303)
        at org.fao.geonet.kernel.search.spatial.SpatialIndexWriter.index(SpatialIndexWriter.java:157)
        at org.fao.geonet.kernel.search.SearchManager.indexGeometry(SearchManager.java:715)
        at org.fao.geonet.kernel.search.SearchManager.index(SearchManager.java:698)
        at org.fao.geonet.kernel.DataManager.indexMetadata(DataManager.java:560)
        at org.fao.geonet.kernel.DataManager$IndexMetadataTask.run(DataManager.java:386)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

----- Original Message -----
From: Kai Liu <kliu4@anonymised.com>
Date: Thursday, March 14, 2013 11:34 am
Subject: Re: RE: [GeoNetwork-devel] Help: Records Number drops

Hi Jesse,

I checked the log just now. It doesn't have out of memory problem.
I found the lucene files in WEB-INF/data/index/index/eng is very
small (about35M). The total size for the records in database is
about 2G and I used old geonetwork the lucene index file is 442M!

Maybe the lucene index has never been finished?

Thanks and best regards,

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

----- Original Message -----
From: Jesse Eichar <jesse.eichar@anonymised.com>
Date: Thursday, March 14, 2013 11:06 am
Subject: RE: [GeoNetwork-devel] Help: Records Number drops

> That is odd... I assume that no indexing is taking place at the
> moment?Did you check the logs for out of memory errors?
>
> Jesse
>
> *From:* Kai Liu <kliu4@anonymised.com>
> *Sent:* ‎March‎ ‎14‎, ‎2013 ‎3‎:‎53‎ ‎PM
> *To:* Jesse Eichar <jesse.eichar@anonymised.com>
> *CC:* Devel geonetwork-devel@lists.sourceforge.net
> *Subject:* Re: RE: [GeoNetwork-devel] Help: Records Number drops
>
> Hi Jesse,
>
> It now shows 56794. The file is as below:
>
> http://ec2-54-234-123-20.compute-
> 1.amazonaws.com/geonetwork/srv/eng/q?fast=index&from=1&to=10
> It seems it changes over time.
>
> Kai
> Joint Center for Intelligent Spatial Computing
> 703-395-2337
>
> ----- Original Message -----
> From: Jesse Eichar <jesse.eichar@anonymised.com>
> Date: Thursday, March 14, 2013 10:29 am
> Subject: RE: [GeoNetwork-devel] Help: Records Number drops
>
> > What version of Geonetwork are you using?
> >
> > Can you run:
> >
> > geonetwork/srv/eng/q?fast=index&from=1&to=10
> >
> > and make sure that result agrees with the 25,000 result?
> >
> > Jesse
> >
> > *From:* Kai Liu <kliu4@anonymised.com>
> > *Sent:* ‎March‎ ‎14‎, ‎2013 ‎3‎:‎22‎ ‎PM
> > *To:* Devel geonetwork-devel@lists.sourceforge.net
> > *Subject:* [GeoNetwork-devel] Help: Records Number drops
> >
> > Dear Developers,
> >
> > I used the latest GeoNetwork codes to build a portal on Linux.
> > There are
> > about 100,000 records last night, but it shows only 25,000 records
> > thismorning. However, the database shows all records (100,000)
> > records are
> > still in database.
> >
> > Is this a Lucene problem? I tried rebuild lucene but it will drop
> > again. I
> > wonder how I can fix it.
> >
> > Thanks and best regards,
> >
> > Kai
> > Joint Center for Intelligent Spatial Computing
> > 703-395-2337
> >
> > ---------------------------------------------------------------
--
> --
> > -----------
> > Everyone hates slow websites. So do we.
> > Make your web apps faster with AppDynamics
> > Download AppDynamics Lite for free today:
> > http://p.sf.net/sfu/appdyn_d2d_mar
> > _______________________________________________
> > GeoNetwork-devel mailing list
> > GeoNetwork-devel@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
> > GeoNetwork OpenSource is maintained at
> > http://sourceforge.net/projects/geonetwork
> >
>