[GeoNetwork-users] Harvest GeoServer with thumbnails creation (GeoNetwork V. 2.9))

Lionel_Menard · October 5, 2012, 1:08pm

Hi,
Version:2.9.0-SNAPSHOT

I tried to harvest WMS from my GeoServer with the option "Create thumbnails
for WMS layers." on !
Unfortunately no thumbnails are created after the creation of the harvested
metadata.
I get this error in the "History" link of the "Harvest Management" section:
Total 180
Added 1
179
Thumbnails failed 179

Does this feature is enable yet in the version 2.9 SNAPSHOT ?

Where could I look in order to enable this handy feature ?

Thanks in advance for your help

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

Francois_Prunayre · October 5, 2012, 1:11pm

Hello,
turning log level to debug for harvester in log4j.cfg
log4j.logger.geonetwork.harvester = WARN
should provide more information about that including the URL used to
create the thumbnail.

Cheers.

Francois

2012/10/5 Lionel Menard <lionel.menard@anonymised.com>:

Hi,
Version:2.9.0-SNAPSHOT

I tried to harvest WMS from my GeoServer with the option "Create thumbnails
for WMS layers." on !
Unfortunately no thumbnails are created after the creation of the harvested
metadata.
I get this error in the "History" link of the "Harvest Management" section:
Total 180
Added 1
179
Thumbnails failed 179

Does this feature is enable yet in the version 2.9 SNAPSHOT ?

Where could I look in order to enable this handy feature ?

Thanks in advance for your help

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Lionel_Menard · October 5, 2012, 1:24pm

Hi Francois,
thanks for your fast and helpful reply.
I've checked my log4j.cfg config file and the the
log4j.logger.geonetwork.harvester is already set to WARN.

So where you I get this information about the URL to create thumbnails ?

Maybe the # Default Logging Configuration log4j.rootLogger currently set to
OFF should be set to ON ?

Just in case I copy this file at the bottom of this email.

Thanks in advance for your help.

Cheers,

Lionel

# Default Logging Configuration
log4j.rootLogger = OFF

### GEONETWORK SETTINGS
########################################################

log4j.logger.geonetwork = WARN, console, jeeves
log4j.logger.geonetwork.search = WARN
log4j.logger.geonetwork.schemamanager = WARN
log4j.logger.geonetwork.thesaurus-man = WARN
log4j.logger.geonetwork.thesaurus = WARN
log4j.logger.geonetwork.editorexpandelement = WARN
log4j.logger.geonetwork.editoraddelement = WARN
log4j.logger.geonetwork.LanguageDetector = WARN
log4j.logger.geonetwork.index = WARN
log4j.logger.geonetwork.csw = WARN
log4j.logger.geonetwork.csw.search = WARN
log4j.logger.geonetwork.harvester = WARN
log4j.logger.geonetwork.mef = WARN
log4j.logger.geonetwork.z3950server = WARN
log4j.logger.geonetwork.z3950 = WARN
log4j.logger.geonetwork.sru = WARN
log4j.logger.geonetwork.sru.search = WARN
log4j.logger.geonetwork.GeoServerPublisher = WARN
log4j.logger.geonetwork.data.directory = WARN

### JEEVES SETTINGS
############################################################

log4j.logger.jeeves = DEBUG, console, jeeves
log4j.logger.jeeves.dbms = WARN

# If resourcetracking is set to DEBUG then each time a resource
# is obtained an exception will be created to track the stack trace
# of where the resource was obtained. The traces can be viewed by
# calling debug.openconnection.accessors as administrator
log4j.logger.jeeves.dbms.resourcetracking = WARN

log4j.logger.jeeves.monitor = WARN
log4j.logger.jeeves.engine = WARN
log4j.logger.jeeves.dbmspool = WARN
log4j.logger.jeeves.resources = WARN
log4j.logger.jeeves.xlinkprocessor = WARN
log4j.logger.jeeves.transformerFactory = WARN
log4j.logger.jeeves.xmlresolver = ERROR

### SPRING ####

log4j.logger.org.springframework = WARN, jeeves, console

### JZKIT SETTINGS ####

log4j.logger.com.k_int=WARN, console, jeeves
log4j.logger.org.jzkit=WARN, console, jeeves
log4j.logger.org.jzkit.a2j=WARN, console, jeeves
log4j.logger.org.jzkit.search.impl.LRUCache = WARN, console,jeeves

### JEEVES APPENDER
############################################################

log4j.appender.jeeves =org.apache.log4j.DailyRollingFileAppender
log4j.appender.jeeves.DatePattern='.'yyyy-MM-dd
log4j.appender.jeeves.file = logs/geonetwork.log
#log4j.appender.jeeves.file = ${catalina.home}/logs/geonetwork.log
log4j.appender.jeeves.layout = org.apache.log4j.PatternLayout
log4j.appender.jeeves.layout.ConversionPattern=%d{ISO8601} %-5p [%c] - %m%n

### CONSOLE SETTINGS
###########################################################

log4j.appender.console = org.apache.log4j.ConsoleAppender
log4j.appender.console.layout = org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{ISO8601} %-5p [%c] - %m%n

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5006669.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

Heikki_Doeleman · October 5, 2012, 1:29pm

I think he meant setting it from WARN to DEBUG

On Fri, Oct 5, 2012 at 3:24 PM, Lionel Menard <
lionel.menard@anonymised.com> wrote:

Hi Francois,
thanks for your fast and helpful reply.
I've checked my log4j.cfg config file and the the
log4j.logger.geonetwork.harvester is already set to WARN.

So where you I get this information about the URL to create thumbnails ?

Maybe the # Default Logging Configuration log4j.rootLogger currently set to
OFF should be set to ON ?

Just in case I copy this file at the bottom of this email.

Thanks in advance for your help.

Cheers,

Lionel

# Default Logging Configuration
log4j.rootLogger = OFF

### GEONETWORK SETTINGS
########################################################

log4j.logger.geonetwork = WARN, console, jeeves
log4j.logger.geonetwork.search = WARN
log4j.logger.geonetwork.schemamanager = WARN
log4j.logger.geonetwork.thesaurus-man = WARN
log4j.logger.geonetwork.thesaurus = WARN
log4j.logger.geonetwork.editorexpandelement = WARN
log4j.logger.geonetwork.editoraddelement = WARN
log4j.logger.geonetwork.LanguageDetector = WARN
log4j.logger.geonetwork.index = WARN
log4j.logger.geonetwork.csw = WARN
log4j.logger.geonetwork.csw.search = WARN
log4j.logger.geonetwork.harvester = WARN
log4j.logger.geonetwork.mef = WARN
log4j.logger.geonetwork.z3950server = WARN
log4j.logger.geonetwork.z3950 = WARN
log4j.logger.geonetwork.sru = WARN
log4j.logger.geonetwork.sru.search = WARN
log4j.logger.geonetwork.GeoServerPublisher = WARN
log4j.logger.geonetwork.data.directory = WARN

### JEEVES SETTINGS
############################################################

log4j.logger.jeeves = DEBUG, console, jeeves
log4j.logger.jeeves.dbms = WARN

# If resourcetracking is set to DEBUG then each time a resource
# is obtained an exception will be created to track the stack trace
# of where the resource was obtained. The traces can be viewed by
# calling debug.openconnection.accessors as administrator
log4j.logger.jeeves.dbms.resourcetracking = WARN

log4j.logger.jeeves.monitor = WARN
log4j.logger.jeeves.engine = WARN
log4j.logger.jeeves.dbmspool = WARN
log4j.logger.jeeves.resources = WARN
log4j.logger.jeeves.xlinkprocessor = WARN
log4j.logger.jeeves.transformerFactory = WARN
log4j.logger.jeeves.xmlresolver = ERROR

### SPRING ####

log4j.logger.org.springframework = WARN, jeeves, console

### JZKIT SETTINGS ####

log4j.logger.com.k_int=WARN, console, jeeves
log4j.logger.org.jzkit=WARN, console, jeeves
log4j.logger.org.jzkit.a2j=WARN, console, jeeves
log4j.logger.org.jzkit.search.impl.LRUCache = WARN, console,jeeves

### JEEVES APPENDER
############################################################

log4j.appender.jeeves =org.apache.log4j.DailyRollingFileAppender
log4j.appender.jeeves.DatePattern='.'yyyy-MM-dd
log4j.appender.jeeves.file = logs/geonetwork.log
#log4j.appender.jeeves.file = ${catalina.home}/logs/geonetwork.log
log4j.appender.jeeves.layout = org.apache.log4j.PatternLayout
log4j.appender.jeeves.layout.ConversionPattern=%d{ISO8601} %-5p [%c] - %m%n

### CONSOLE SETTINGS
###########################################################

log4j.appender.console = org.apache.log4j.ConsoleAppender
log4j.appender.console.layout = org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{ISO8601} %-5p [%c] -
%m%n

--
View this message in context:
http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5006669.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

Lionel_Menard · October 5, 2012, 2:18pm

Heikki Doeleman wrote

I think he meant setting it from WARN to DEBUG...

Yes Heikki Francois meant this (private email)...Thanks for replying.
So I turn the mode to DEBUG. Restart GeoNetwork. Delete previous harvested
WMS. Rerun Harvest.
An still I get the same message:
Total 180
Added 1
179
Thumbnails failed 179

I've check my metadata entries and no thumbnails are displayed with the
record.

I guess I need to look elsewhere to have more info ?

Lionel

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5006680.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

Lionel_Menard · October 5, 2012, 4:24pm

I move a bit forward....
I re-harvest my GeoServer and I corrected my "Service url" target as follow:
http://my.geoserver.org/geoserver/wms?namespace=test

The last harvest log entry in /var/log/tomcat6/geonetwork.log is as follow

2012-10-05 18:00:55,894 DEBUG [geonetwork.harvester] - Retrieving remote
document:
http://gmy.geoserver.org/geoserver/wms?namespace=test&&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&FORMAT=image/png&WIDTH=900&SRS=EPSG:4326&HEIGHT=360&LAYERS=test:res_25_50_lOM_bfond_lFR_Lo&STYLES=&BBOX=-25.043782837128,45.976133651709006,25.043782837304,66.023866348449
2012-10-05 18:00:56,314 DEBUG [geonetwork.harvester] - Get 200
2012-10-05 18:00:56,414 DEBUG [geonetwork.harvester] - - File:
b62672909ceda9e5b6fb864476b50086643b9ba5.png
2012-10-05 18:00:56,682 INFO [geonetwork.harvester] - Ended harvesting from
node : Webservice-Energy:Test (OgcWxSHarvester)

So everything seems to went OK.
I can view the b62672909ceda9e5b6fb864476b50086643b9ba5.png and the
b62672909ceda9e5b6fb864476b50086643b9ba5_s.png PNG files.

[root@anonymised.com]# pwd
/var/lib/tomcat6/webapps/geonetwork

[root@anonymised.com]# find . -name "b62672909ceda9e5b6fb864476b50086643b9ba5.png"
-print
./WEB-INF/data/data/metadata_data/00400-00499/446/public/b62672909ceda9e5b6fb864476b50086643b9ba5.png

But unfortunately the thumbnails are not attached to the metadata record
when I display them in the GeoNetwork interface.

Could you put me back on tracks.

Thanks in advance for your help.

Lionel

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5006720.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

andrew_walsh · October 7, 2012, 10:32pm

Hi Lionel,

I had the same issue as yourself with the OGCWxs harvester
(no thumbnail displayed in the search results, but harvested
OK to the data directory). I reported this issue here:
http://trac.osgeo.org/geonetwork/ticket/1006

Would be great if the devs. could look into fixing this one.

Andrew

----- Original Message ----- From: "Lionel Menard" <lionel.menard@anonymised.com>
To: <geonetwork-users@lists.sourceforge.net>
Sent: Saturday, October 06, 2012 3:24 AM
Subject: Re: [GeoNetwork-users] Harvest GeoServer with thumbnails creation(GeoNetwork V. 2.9))

I move a bit forward....
I re-harvest my GeoServer and I corrected my "Service url" target as follow:
http://my.geoserver.org/geoserver/wms?namespace=test

The last harvest log entry in /var/log/tomcat6/geonetwork.log is as follow

2012-10-05 18:00:55,894 DEBUG [geonetwork.harvester] - Retrieving remote
document:
http://gmy.geoserver.org/geoserver/wms?namespace=test&&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&FORMAT=image/png&WIDTH=900&SRS=EPSG:4326&HEIGHT=360&LAYERS=test:res_25_50_lOM_bfond_lFR_Lo&STYLES=&BBOX=-25.043782837128,45.976133651709006,25.043782837304,66.023866348449
2012-10-05 18:00:56,314 DEBUG [geonetwork.harvester] - Get 200
2012-10-05 18:00:56,414 DEBUG [geonetwork.harvester] - - File:
b62672909ceda9e5b6fb864476b50086643b9ba5.png
2012-10-05 18:00:56,682 INFO [geonetwork.harvester] - Ended harvesting from
node : Webservice-Energy:Test (OgcWxSHarvester)

So everything seems to went OK.
I can view the b62672909ceda9e5b6fb864476b50086643b9ba5.png and the
b62672909ceda9e5b6fb864476b50086643b9ba5_s.png PNG files.

[root@anonymised.com]# pwd
/var/lib/tomcat6/webapps/geonetwork

[root@anonymised.com]# find . -name "b62672909ceda9e5b6fb864476b50086643b9ba5.png"
-print
./WEB-INF/data/data/metadata_data/00400-00499/446/public/b62672909ceda9e5b6fb864476b50086643b9ba5.png

But unfortunately the thumbnails are not attached to the metadata record
when I display them in the GeoNetwork interface.

Could you put me back on tracks.

Thanks in advance for your help.

Lionel

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5006720.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Lionel_Menard · October 8, 2012, 9:13am

Hi Andrew,
thanks for sharing this info.
Yes please devs...provides us with some hints...

In your ticket, you mention:
"However the XML is missing for the
gmd:graphicOverview><gmd:MD_BrowseGraphic> .... which holds the thumbnail
reference is missing so no thumbnail is displayed in the search results."
Could you tell me in which file this missing tag is supposed to be part of ?

Cheers,

Lionel

andrew walsh wrote

Hi Lionel,

I had the same issue as yourself with the OGCWxs harvester
(no thumbnail displayed in the search results, but harvested
OK to the data directory). I reported this issue here:
http://trac.osgeo.org/geonetwork/ticket/1006

Would be great if the devs. could look into fixing this one.

Andrew

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5007071.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

Lionel_Menard · October 8, 2012, 11:37am

Hi,
as I always see the glass half full rather than half empty and as the
thumbnails are automatically created during the harvest process I can
manually add them using the "File identifier" unique number to the
Metadata record.
Long operation though with hundreds of records...

By the way, where does the large file is supposed to be available. I was
guessing that this would be done by clicking on the thumbnail, but it is not
clickable ?

Cheers,

Lionel

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5007116.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

andrew_walsh · October 8, 2012, 9:54pm

Hi Lionel,

The XML file I mention is the metadata record which is harvested by the
OGCWxS harvester. The XML fragment which references the thumbnail should look
like:

<gmd:graphicOverview>
<gmd:MD_BrowseGraphic>
<gmd:fileName>
<gco:CharacterString>7ebe857c-9e99-4250-ac50-151ff12124d2_s.png</gco:CharacterString>
</gmd:fileName>
<gmd:fileDescription>
<gco:CharacterString>thumbnail</gco:CharacterString>
</gmd:fileDescription>
<gmd:fileType>
<gco:CharacterString>png</gco:CharacterString>
</gmd:fileType>
</gmd:MD_BrowseGraphic>
</gmd:graphicOverview>
<gmd:graphicOverview>
<gmd:MD_BrowseGraphic>
<gmd:fileName>
<gco:CharacterString>7ebe857c-9e99-4250-ac50-151ff12124d2.png</gco:CharacterString>
</gmd:fileName>
<gmd:fileDescription>
<gco:CharacterString>large_thumbnail</gco:CharacterString>
</gmd:fileDescription>
<gmd:fileType>
<gco:CharacterString>png</gco:CharacterString>
</gmd:fileType>
</gmd:MD_BrowseGraphic>
</gmd:graphicOverview>

For example see this URL:

http://www.metoc.gov.au/geonetwork/srv/en/metadata.show?id=2301&currTab=simple

HTH

Andrew

----- Original Message ----- From: "Lionel Menard" <lionel.menard@anonymised.com>
To: <geonetwork-users@lists.sourceforge.net>
Sent: Monday, October 08, 2012 8:13 PM
Subject: Re: [GeoNetwork-users] Harvest GeoServer with thumbnailscreation(GeoNetwork V. 2.9))

Hi Andrew,
thanks for sharing this info.
Yes please devs...provides us with some hints...

In your ticket, you mention:
"However the XML is missing for the
gmd:graphicOverview><gmd:MD_BrowseGraphic> .... which holds the thumbnail
reference is missing so no thumbnail is displayed in the search results."
Could you tell me in which file this missing tag is supposed to be part of ?

Cheers,

Lionel

andrew walsh wrote

Hi Lionel,

I had the same issue as yourself with the OGCWxs harvester
(no thumbnail displayed in the search results, but harvested
OK to the data directory). I reported this issue here:
http://trac.osgeo.org/geonetwork/ticket/1006

Would be great if the devs. could look into fixing this one.

Andrew

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5007071.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

andrew_walsh · October 8, 2012, 10:18pm

Hi Lionel,

Adding the thumbnail manually would be a very tedious and error prone
process, better to get the harvester fixed to back how it was in GN 2.6.4. Generally harvested
records shouldn't be edited as it disrupts the integrity of harvest process should
records be re-harvested.

The OGCWxS harvester is currently only doing "half the glass", its just missing the XML fragment
I mentioned in my last email to you.

Andrew

----- Original Message ----- From: "Lionel Menard" <lionel.menard@anonymised.com>
To: <geonetwork-users@lists.sourceforge.net>
Sent: Monday, October 08, 2012 10:37 PM
Subject: Re: [GeoNetwork-users] Harvest GeoServer with thumbnailscreation(GeoNetwork V. 2.9))

Hi,
as I always see the glass half full rather than half empty and as the
thumbnails are automatically created during the harvest process I can
manually add them using the "File identifier" unique number to the
Metadata record.
Long operation though with hundreds of records...

By the way, where does the large file is supposed to be available. I was
guessing that this would be done by clicking on the thumbnail, but it is not
clickable ?

Cheers,

Lionel

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5007116.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Lionel_Menard · October 9, 2012, 5:27am

Hi Andrew,
thanks for pointing the xml fragment.
Regarding your advice below, I'm aware of the harvest process integrity.
In my harvest "use case" I have a series of WMS in my GeoServer that I
consider as "final" and I will not harvest it twice.
I have set the harvest process to this series by specifying the GeoServer
"namespace" in the target url of the Harvest Management section.
By doing so I expect to manage possible harvest option of the same GeoServer
(One shot vs re-harvest).
As a result I only get this subset as a starter for editing and enhancing
these harvested records (eg. Thumbnails).
What other option, beside manually editing from scratch hundreds of records
do I have .

Does this practice could present some latter drawbacks I did not think of ?

Of course I would prefer the thumbnails to be ok...
Cheers,

Lionel

andrew walsh wrote

Hi Lionel,

Adding the thumbnail manually would be a very tedious and error prone
process, better to get the harvester fixed to back how it was in GN 2.6.4.
Generally harvested
records shouldn't be edited as it disrupts the integrity of harvest
process
should
records be re-harvested.

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5007306.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

andrew_walsh · October 9, 2012, 7:07am

Hi Lionel,

If, as you say your harvests will be "once-only" and you are not concerned with map updates
then I suppose its OK to allow editing of the harvested content. Of course keep in mind
that if you did re-harvest in future you could lose your manual additions.

You could switch off the thumbnail option in the harvestor and add your own thumbnail
graphics later through the Geonetwork editor. This process would let you add nicer
looking thumbnail graphics to than the ones that Geonetwork makes which
are only the 1 basic map layer with points/lines/polgyon

Andrew

----- Original Message ----- From: "Lionel Menard" <lionel.menard@anonymised.com>
To: <geonetwork-users@lists.sourceforge.net>
Sent: Tuesday, October 09, 2012 4:27 PM
Subject: Re: [GeoNetwork-users] Harvest GeoServer withthumbnailscreation(GeoNetwork V. 2.9))

Hi Andrew,
thanks for pointing the xml fragment.
Regarding your advice below, I'm aware of the harvest process integrity.
In my harvest "use case" I have a series of WMS in my GeoServer that I
consider as "final" and I will not harvest it twice.
I have set the harvest process to this series by specifying the GeoServer
"namespace" in the target url of the Harvest Management section.
By doing so I expect to manage possible harvest option of the same GeoServer
(One shot vs re-harvest).
As a result I only get this subset as a starter for editing and enhancing
these harvested records (eg. Thumbnails).
What other option, beside manually editing from scratch hundreds of records
do I have .

Does this practice could present some latter drawbacks I did not think of ?

Of course I would prefer the thumbnails to be ok...
Cheers,

Lionel

andrew walsh wrote

Hi Lionel,

Adding the thumbnail manually would be a very tedious and error prone
process, better to get the harvester fixed to back how it was in GN 2.6.4.
Generally harvested
records shouldn't be edited as it disrupts the integrity of harvest
process
should
records be re-harvested.

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5007306.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Lionel_Menard · October 9, 2012, 7:19am

Hi Andrew,
thanks for sharing your thoughts and experience about this. I appreciate...
I consider the generation of thumbnails for my WMS based maps to be rather
good and considering the amount of layers (few hundreds) I think this a
quite productive approach vs manually created them.

All the best.

Lionel

andrew walsh wrote

Hi Lionel,

If, as you say your harvests will be "once-only" and you are not concerned
with
map updates
then I suppose its OK to allow editing of the harvested content. Of course
keep
in mind
that if you did re-harvest in future you could lose your manual additions.

You could switch off the thumbnail option in the harvestor and add your
own
thumbnail
graphics later through the Geonetwork editor. This process would let you
add
nicer
looking thumbnail graphics to than the ones that Geonetwork makes which
are only the 1 basic map layer with points/lines/polgyon

Andrew

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5007326.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

Francois_Prunayre · October 9, 2012, 7:36am

Hi Andrew, testing the WMS you provided using trunk was working fine.
I also tested mapserver or GeoServer WMS with success.

@Lionel, is your WMS public ? so I could have a try. Did you test
using version 1.1.1 or 1.3.0 - did you get the same results ?

This morning, I made a minor changes related to a bug if you use a
custom directory (which is probably not the case). I'll have a try
later on 2.8.x branch.

Cheers.

Francois

2012/10/8 andrew walsh <awalsh@anonymised.com>:

Hi Lionel,

I had the same issue as yourself with the OGCWxs harvester
(no thumbnail displayed in the search results, but harvested
OK to the data directory). I reported this issue here:
http://trac.osgeo.org/geonetwork/ticket/1006

Would be great if the devs. could look into fixing this one.

Andrew

----- Original Message -----
From: "Lionel Menard" <lionel.menard@anonymised.com>
To: <geonetwork-users@lists.sourceforge.net>
Sent: Saturday, October 06, 2012 3:24 AM
Subject: Re: [GeoNetwork-users] Harvest GeoServer with thumbnails
creation(GeoNetwork V. 2.9))

I move a bit forward....
I re-harvest my GeoServer and I corrected my "Service url" target as follow:
http://my.geoserver.org/geoserver/wms?namespace=test

The last harvest log entry in /var/log/tomcat6/geonetwork.log is as follow

2012-10-05 18:00:55,894 DEBUG [geonetwork.harvester] - Retrieving remote
document:
http://gmy.geoserver.org/geoserver/wms?namespace=test&&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&FORMAT=image/png&WIDTH=900&SRS=EPSG:4326&HEIGHT=360&LAYERS=test:res_25_50_lOM_bfond_lFR_Lo&STYLES=&BBOX=-25.043782837128,45.976133651709006,25.043782837304,66.023866348449
2012-10-05 18:00:56,314 DEBUG [geonetwork.harvester] - Get 200
2012-10-05 18:00:56,414 DEBUG [geonetwork.harvester] - - File:
b62672909ceda9e5b6fb864476b50086643b9ba5.png
2012-10-05 18:00:56,682 INFO [geonetwork.harvester] - Ended harvesting from
node : Webservice-Energy:Test (OgcWxSHarvester)

So everything seems to went OK.
I can view the b62672909ceda9e5b6fb864476b50086643b9ba5.png and the
b62672909ceda9e5b6fb864476b50086643b9ba5_s.png PNG files.

[root@anonymised.com]# pwd
/var/lib/tomcat6/webapps/geonetwork

[root@anonymised.com]# find . -name "b62672909ceda9e5b6fb864476b50086643b9ba5.png"
-print
./WEB-INF/data/data/metadata_data/00400-00499/446/public/b62672909ceda9e5b6fb864476b50086643b9ba5.png

But unfortunately the thumbnails are not attached to the metadata record
when I display them in the GeoNetwork interface.

Could you put me back on tracks.

Thanks in advance for your help.

Lionel

--
View this message in context:
http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5006720.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

Lionel_Menard · October 9, 2012, 8:14am

Hi Francois,
I just test the harvest with 1.3.0:
1/ I don't have any thumbnails attached in the metadata record.
2/ The big png file (900x360) as well as the small one (_s 180x72) that have
been created while harvesting are all containing a blank rectangle as png
result file ?

I will provide you with the GetCapabilities of my GeoServer in a private
email for testing as this section is not yet available for public.

Francois Prunayre wrote

Hi Andrew, testing the WMS you provided using trunk was working fine.
I also tested mapserver or GeoServer WMS with success.

@Lionel, is your WMS public ? so I could have a try. Did you test
using version 1.1.1 or 1.3.0 - did you get the same results ?

This morning, I made a minor changes related to a bug if you use a
custom directory (which is probably not the case). I'll have a try
later on 2.8.x branch.

Cheers.

Francois

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5007345.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

Lionel_Menard · October 15, 2012, 6:57am

Hi,
any updates on this topic... ?
I have a bunch of WMS layers I postpone to harvest waiting for this feature
to possibly work as it could save me a great amount of time....

Thanks again.

Cheers,

Lionel

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5008608.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

Francois_Prunayre · January 11, 2013, 2:05pm

Lionel,

2012/10/15 Lionel Menard <lionel.menard@anonymised.com>

Hi,
any updates on this topic... ?

I finally managed to look more in details into this problem. It should be
fine now [1].

Cheers.

Francois

[1] http://trac.osgeo.org/geonetwork/ticket/1197

I have a bunch of WMS layers I postpone to harvest waiting for this feature
to possibly work as it could save me a great amount of time....

Thanks again.

Cheers,

Lionel

--
View this message in context:
http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5008608.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

Lionel_Menard · February 25, 2013, 3:16pm

Dear Francois, dear all,
I finally coming back on this topic with a successful harvest including
thumbnail creation on the fly.
We have updated our catalog and we use now the latest version (2.9) of
GeoNetwork available in the Github.
Your fix were part of this version.
You can have a look by searching for example for "cener" in our catalog:
http://geocatalog.webservice-energy.org
Thanks a lot for your effort. This is to my opinion a very handy feature.
Nevertheless I've face some problems.
1/ Mapservers that were part of my targeted list of server does not seems to
provide this feature. Search for "sander"in the catalog. Is there a reason
why ?
2/ One Geoserver does not provide thumbnails. Search for "chile" on the
catalog. Is this something on the server side or how could I provide a
diagnostic ?
3/ Some thumbnails are provided but they are blank while the Mapviewer is
correctly displaying the layer. Search for "annual mean wind speed 100".
What is happening in that case ?

Thanks again for any hints or help you might provide.

Best regards,

Lionel

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Harvest-GeoServer-with-thumbnails-creation-GeoNetwork-V-2-9-tp5006662p5036682.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.