[Geoserver-users] Apache Solr Plugin

GeoServer GeoServer User
1

Hi All,

We found a issue in the configuration interface, after adding a Solr storage, when we try to add a layer, the field configuration window shows only 38 fields, we have more than 230 fields our collection. Can we do something to limit this field list? Maybe a configuration parameter with a list of fields to query in Solr, ignoring anything else.

Best regards,

Fernando Silveira de Quadro

Senior GIS Analyst

Tel +55 48 3333 2030

fernando.silveira@anonymised.com.

www.neoway.com.br

R. Patrício Farias, 131 - 3o andar | 88034-132 | Florianópolis | Santa Catarina| Brasil

2

On Tue, Oct 14, 2014 at 3:11 PM, Fernando Silveira de Quadro <
fernando.silveira@anonymised.com> wrote:

Hi All,

We found a issue in the configuration interface, after adding a Solr
storage, when we try to add a layer, the field configuration window shows
only 38 fields, we have more than 230 fields our collection. Can we do
something to limit this field list? Maybe a configuration parameter with a
list of fields to query in Solr, ignoring anything else.

GeoServer lists by default only fields that have at least one non null
value in
the documents, but there is a checkbox to make it list also the ones
without a value (just on top of the table)
Have you tried it?

Cheers
Andrea

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

-------------------------------------------------------

3

Andrea,

Yes, I’ve tried. All of our fields has value.

Best Regards,

···

Att,

Fernando Silveira de Quadro

Senior GIS Analyst

Tel +55 48 3333 2030

fernando.silveira@anonymised.com

www.neoway.com.br

R. Patrício Farias, 131 - 3o andar | 88034-132 | Florianópolis | Santa Catarina| Brasil

2014-10-14 10:48 GMT-03:00 Andrea Aime <andrea.aime@anonymised.com>:

On Tue, Oct 14, 2014 at 3:11 PM, Fernando Silveira de Quadro <fernando.silveira@anonymised.com> wrote:

Hi All,

We found a issue in the configuration interface, after adding a Solr storage, when we try to add a layer, the field configuration window shows only 38 fields, we have more than 230 fields our collection. Can we do something to limit this field list? Maybe a configuration parameter with a list of fields to query in Solr, ignoring anything else.

GeoServer lists by default only fields that have at least one non null value in
the documents, but there is a checkbox to make it list also the ones without a value (just on top of the table)
Have you tried it?

Cheers
Andrea

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

==

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

4

Ciao Fernando,
do you have a SolR instance that wen can hit to try and replicate this issue or actually check if this is an issue.

···

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts! Visit http://goo.gl/NWWaa2 for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

On Tue, Oct 14, 2014 at 4:28 PM, Fernando Silveira de Quadro <fernando.silveira@anonymised.com> wrote:

Andrea,

Yes, I’ve tried. All of our fields has value.

Best Regards,

Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho

Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Att,

Fernando Silveira de Quadro

Senior GIS Analyst

Tel +55 48 3333 2030

fernando.silveira@anonymised.com

www.neoway.com.br

R. Patrício Farias, 131 - 3o andar | 88034-132 | Florianópolis | Santa Catarina| Brasil

2014-10-14 10:48 GMT-03:00 Andrea Aime <andrea.aime@anonymised.com>:

On Tue, Oct 14, 2014 at 3:11 PM, Fernando Silveira de Quadro <fernando.silveira@anonymised.com> wrote:

Hi All,

We found a issue in the configuration interface, after adding a Solr storage, when we try to add a layer, the field configuration window shows only 38 fields, we have more than 230 fields our collection. Can we do something to limit this field list? Maybe a configuration parameter with a list of fields to query in Solr, ignoring anything else.

GeoServer lists by default only fields that have at least one non null value in
the documents, but there is a checkbox to make it list also the ones without a value (just on top of the table)
Have you tried it?

Cheers
Andrea

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

==

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

5

Hi Simone,

Due to security restrictions on sensible data, our Solr access is restricted. We will try to create some sample data for testing.

Best Regards,

···

Att,

Fernando Silveira de Quadro

Senior GIS Analyst

Tel +55 48 3333 2030

fernando.silveira@anonymised.com

www.neoway.com.br

R. Patrício Farias, 131 - 3o andar | 88034-132 | Florianópolis | Santa Catarina| Brasil

2014-10-14 12:29 GMT-03:00 Simone Giannecchini <simone.giannecchini@anonymised.com>:

Ciao Fernando,
do you have a SolR instance that wen can hit to try and replicate this issue or actually check if this is an issue.

Regards,
Simone Giannecchini

GeoServer Professional Services from the experts! Visit http://goo.gl/NWWaa2 for more information.

Ing. Simone Giannecchini
@simogeo
Founder/Director

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 333 8128928

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003
Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

On Tue, Oct 14, 2014 at 4:28 PM, Fernando Silveira de Quadro <fernando.silveira@anonymised.com676…> wrote:

Andrea,

Yes, I’ve tried. All of our fields has value.

Best Regards,

Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho

Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Att,

Fernando Silveira de Quadro

Senior GIS Analyst

Tel +55 48 3333 2030

fernando.silveira@anonymised.com

www.neoway.com.br

R. Patrício Farias, 131 - 3o andar | 88034-132 | Florianópolis | Santa Catarina| Brasil

2014-10-14 10:48 GMT-03:00 Andrea Aime <andrea.aime@anonymised.com>:

On Tue, Oct 14, 2014 at 3:11 PM, Fernando Silveira de Quadro <fernando.silveira@anonymised.com> wrote:

Hi All,

We found a issue in the configuration interface, after adding a Solr storage, when we try to add a layer, the field configuration window shows only 38 fields, we have more than 230 fields our collection. Can we do something to limit this field list? Maybe a configuration parameter with a list of fields to query in Solr, ignoring anything else.

GeoServer lists by default only fields that have at least one non null value in
the documents, but there is a checkbox to make it list also the ones without a value (just on top of the table)
Have you tried it?

Cheers
Andrea

–

==

GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

==

Ing. Andrea Aime

@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy’s New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.

6

On Tue, Oct 14, 2014 at 9:49 PM, Fernando Silveira de Quadro <
fernando.silveira@anonymised.com> wrote:

Hi Simone,

Due to security restrictions on sensible data, our Solr access is
restricted. We will try to create some sample data for testing.

Another possibility is that right now we only handle fields that we know
how to map to java types,
from the code:

/**
     * Maps SOLR types to JAVA types
     */
    public static Class<?> decodeSolrFieldType(String className) {
        if (className.equals("org.apache.solr.schema.TextField")
                || className.equals("org.apache.solr.schema.StrField"))
            return String.class;
        if (className.equals("org.apache.solr.schema.TrieLongField")
                || className.equals("org.apache.solr.schema.LongField"))
            return Long.class;
        if (className.equals("org.apache.solr.schema.BoolField"))
            return Boolean.class;
        if
(className.equals("org.apache.solr.schema.SpatialRecursivePrefixTreeFieldType")
                || className.equals("org.apache.solr.schema.LatLonType"))
            return Geometry.class;
        if (className.equals("org.apache.solr.schema.DateField")
                || className.equals("org.apache.solr.schema.TrieDateField"))
            return Date.class;
        if (className.equals("org.apache.solr.schema.IntField")
                || className.equals("org.apache.solr.schema.TrieIntField"))
            return Integer.class;
        if (className.equals("org.apache.solr.schema.FloatField")
                ||
className.equals("org.apache.solr.schema.TrieFloatField"))
            return Float.class;

        return null;
    }

Maybe the attributes that are not showing up are associated to types that
we don't
know how to map to a java type.
It certainly looks like we could expand this list, it's leaving out a fair
amount
of data types.

I've just committed a change in the code that will log, at debug level, all
the fields that we are leaving out, and their type.
You need to use a Oct 15th build and set the logging level to "geotools
developer
logging" to see the results.

Cheers
Andrea

--

GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

-------------------------------------------------------