[GeoNetwork-users] maxClauseCount Problem

GeoNetwork GeoNetwork User
1

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

2

Hi,
I have the same problem right now.
I harvested the FAO node and I encountered this error while performing some
spatial search (in some cases it works...).
The error message is TooManyClauses : maxClauseCount is set to 1024

The GN version is the same as Kai's: 2.4.3
Thanks for your help.

Bye

Paolo
--
View this message in context: http://osgeo-org.1803224.n2.nabble.com/Fwd-maxClauseCount-Problem-tp5495565p5510498.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

3

Hi Paolo,

If the number of records is not big(less than 40K)in your GeoNetwork. A simple way to avoid this error is that You can increase the maxClauseCount to (16384)in /luceneQueryBuilder.java and /luceneSearcher.java .

Cheers,

Kai

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

----- Original Message -----
From: Paolo Pasquali <paolo.pasquali@anonymised.com>
Date: Wednesday, September 8, 2010 8:48 am
Subject: Re: [GeoNetwork-users] Fwd: maxClauseCount Problem

Hi,
I have the same problem right now.
I harvested the FAO node and I encountered this error while
performing some
spatial search (in some cases it works...).
The error message is TooManyClauses : maxClauseCount is set to 1024

The GN version is the same as Kai's: 2.4.3
Thanks for your help.

Bye

Paolo
--
View this message in context: http://osgeo-
org.1803224.n2.nabble.com/Fwd-maxClauseCount-Problem-
tp5495565p5510498.htmlSent from the GeoNetwork users mailing list
archive at Nabble.com.

-------------------------------------------------------------------
-----------
This SF.net Dev2Dev email is sponsored by:

Show off your parallel programming skills.
Enter the Intel(R) Threading Challenge 2010.
http://p.sf.net/sfu/intel-thread-sfd
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

4

Hi Paolo,

And another way maybe from Francois you can try:
http://osgeo-org.1803224.n2.nabble.com/maxClauseCount-Problem-td5493735.html#a5493735

2010/9/3 Kai Liu <kliu4@anonymised.com>:

Hi All,

We've havested 440K metadata to GEOSS clearinghouse(http://clearinghouse.cisc.gmu.edu/geonetwork).

But When I do the boundingbox search, the following problem occurs:

<error id="error">
<message>maxClauseCount is set to 32768</message>
<class>TooManyClauses</class>
<stack>
   <at class="org.apache.lucene.search.BooleanQuery" file="BooleanQuery.java" line="153" method="add" />
   <at class="org.apache.lucene.search.BooleanQuery" file="BooleanQuery.java" line="144" method="add" />
   <at class="org.apache.lucene.search.MultiTermQuery$ScoringBooleanQueryRewrite" file="MultiTermQuery.java" line="110" method="rewrite" />
   <at class="org.apache.lucene.search.MultiTermQuery" file="MultiTermQuery.java" line="382" method="rewrite" />
   <at class="org.apache.lucene.search.RangeQuery" file="RangeQuery.java" line="106" method="rewrite" />
   <at class="org.apache.lucene.search.BooleanQuery" file="BooleanQuery.java" line="438" method="rewrite" />
   <at class="org.apache.lucene.search.IndexSearcher" file="IndexSearcher.java" line="307" method="rewrite" />
   <at class="org.apache.lucene.search.Query" file="Query.java" line="98" method="weight" />
   <at class="org.apache.lucene.search.Searcher" file="Searcher.java" line="230" method="createWeight" />
   <at class="org.apache.lucene.search.Searcher" file="Searcher.java" line="171" method="search" />
</stack>
<request>
   <language>en</language>
   <service>main.search.embedded</service>
</request>
</error>

When I increase the maxClauseCount to (Integer.MAX_VALUE) but this will trigger out of memory exception and the boundingbox search still doesn't work.

The version we used is 2.4.3. Is there a way to avoid maxClauseCount Problem when boundingbox search is done?

I've one node with 140K records and don't face that issue for now. An
option could be to switch from northBL, southBL, eastBL and westBL
parameters to the geometry parameter (geometry=POLYGON(...)) which use
the spatial index instead of Lucene for the spatial part of the
search... but you need to make some changes to the JS for that (see
gn_search.js).

Cheers.

Francois

Thanks and best regards,

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

----- Original Message -----
From: Paolo Pasquali <paolo.pasquali@anonymised.com>
Date: Wednesday, September 8, 2010 8:48 am
Subject: Re: [GeoNetwork-users] Fwd: maxClauseCount Problem

Hi,
I have the same problem right now.
I harvested the FAO node and I encountered this error while
performing some
spatial search (in some cases it works...).
The error message is TooManyClauses : maxClauseCount is set to 1024

The GN version is the same as Kai's: 2.4.3
Thanks for your help.

Bye

Paolo
--
View this message in context: http://osgeo-
org.1803224.n2.nabble.com/Fwd-maxClauseCount-Problem-
tp5495565p5510498.htmlSent from the GeoNetwork users mailing list
archive at Nabble.com.

-------------------------------------------------------------------
-----------
This SF.net Dev2Dev email is sponsored by:

Show off your parallel programming skills.
Enter the Intel(R) Threading Challenge 2010.
http://p.sf.net/sfu/intel-thread-sfd
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

5

Hi Kai and Paolo,

2010/9/8 Kai Liu <kliu4@anonymised.com>:

Hi Paolo,

And another way maybe from Francois you can try:
http://osgeo-org.1803224.n2.nabble.com/maxClauseCount-Problem-td5493735.html#a5493735

Another option is also to use precise search using a similarity
parameter set to 1 instead of .8 by default.

OpenSearch suggestion could help to suggest indexed terms to users
before searching and then make precise search instead of fuzzy ones.

Francois.

2010/9/3 Kai Liu <kliu4@anonymised.com>:

Hi All,

We've havested 440K metadata to GEOSS clearinghouse(http://clearinghouse.cisc.gmu.edu/geonetwork).

But When I do the boundingbox search, the following problem occurs:

<error id="error">
<message>maxClauseCount is set to 32768</message>
<class>TooManyClauses</class>
<stack>
<at class="org.apache.lucene.search.BooleanQuery" file="BooleanQuery.java" line="153" method="add" />
<at class="org.apache.lucene.search.BooleanQuery" file="BooleanQuery.java" line="144" method="add" />
<at class="org.apache.lucene.search.MultiTermQuery$ScoringBooleanQueryRewrite" file="MultiTermQuery.java" line="110" method="rewrite" />
<at class="org.apache.lucene.search.MultiTermQuery" file="MultiTermQuery.java" line="382" method="rewrite" />
<at class="org.apache.lucene.search.RangeQuery" file="RangeQuery.java" line="106" method="rewrite" />
<at class="org.apache.lucene.search.BooleanQuery" file="BooleanQuery.java" line="438" method="rewrite" />
<at class="org.apache.lucene.search.IndexSearcher" file="IndexSearcher.java" line="307" method="rewrite" />
<at class="org.apache.lucene.search.Query" file="Query.java" line="98" method="weight" />
<at class="org.apache.lucene.search.Searcher" file="Searcher.java" line="230" method="createWeight" />
<at class="org.apache.lucene.search.Searcher" file="Searcher.java" line="171" method="search" />
</stack>
<request>
<language>en</language>
<service>main.search.embedded</service>
</request>
</error>

When I increase the maxClauseCount to (Integer.MAX_VALUE) but this will trigger out of memory exception and the boundingbox search still doesn't work.

The version we used is 2.4.3. Is there a way to avoid maxClauseCount Problem when boundingbox search is done?

I've one node with 140K records and don't face that issue for now. An
option could be to switch from northBL, southBL, eastBL and westBL
parameters to the geometry parameter (geometry=POLYGON(...)) which use
the spatial index instead of Lucene for the spatial part of the
search... but you need to make some changes to the JS for that (see
gn_search.js).

Cheers.

Francois

Thanks and best regards,

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

Kai
Joint Center for Intelligent Spatial Computing
703-395-2337

----- Original Message -----
From: Paolo Pasquali <paolo.pasquali@anonymised.com>
Date: Wednesday, September 8, 2010 8:48 am
Subject: Re: [GeoNetwork-users] Fwd: maxClauseCount Problem

Hi,
I have the same problem right now.
I harvested the FAO node and I encountered this error while
performing some
spatial search (in some cases it works...).
The error message is TooManyClauses : maxClauseCount is set to 1024

The GN version is the same as Kai's: 2.4.3
Thanks for your help.

Bye

Paolo
--
View this message in context: http://osgeo-
org.1803224.n2.nabble.com/Fwd-maxClauseCount-Problem-
tp5495565p5510498.htmlSent from the GeoNetwork users mailing list
archive at Nabble.com.

-------------------------------------------------------------------
-----------
This SF.net Dev2Dev email is sponsored by:

Show off your parallel programming skills.
Enter the Intel(R) Threading Challenge 2010.
http://p.sf.net/sfu/intel-thread-sfd
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

------------------------------------------------------------------------------
This SF.net Dev2Dev email is sponsored by:

Show off your parallel programming skills.
Enter the Intel(R) Threading Challenge 2010.
http://p.sf.net/sfu/intel-thread-sfd
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

6

Hi all,
this sounds like I have to change a java class... I'm not a java expert so
I'll try other ways first.

I mean, I have a GN 2.1 node up and running that is harvesting the same FAO
node. The same search doesn't cause the maxClauseCount Problem as the GN
2.4.3 (i.e. keyword: boundaries and country: Madagascar, selected from the
drop down menu).
But if you try the same Madagascar search on the FAO GN
(http://www.fao.org/geonetwork) it causes the problem! Could it be a problem
with the Lucene index?

Thanks for your help.
Bye

Paolo
--
View this message in context: http://osgeo-org.1803224.n2.nabble.com/Fwd-maxClauseCount-Problem-tp5495565p5513940.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.