[GeoNetwork-users] batch export of metadata

Is there a simple method for batch exporting metadata in a GeoNetwork
repository? I'm using the latest 2.8 release (on Windows) and cannot find
a tool to do that. I remember in past versions GAST had the capability to
export all records in MEF format, which I believe also included the
thumbnails. The latest GAST version doesn't have that option (that I can
find) and the Administration page does not have an export tool.

Thanks for your help. Sorry if I'm missing something obvious.

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

I found a way to export all of the metadata records. Through the standard
catalog site, as you are viewing the metadata records, check each one you
want to export (or select All Records.) Then, save as archived zip file.
All of the records, including uploaded datasets and thumbnail images, will
be downloaded in one zip file. Nice.

However, I see no way to get these records back into GeoNetwork. The
structure of the zip file contains subdirectories, one for each record,
named as the UUID. In each subdirectory, there is an info.xml file, and
directories for metadata, private, and public, that contain the actual
data. The GN Batch import tool is not accepting this structure. Should
this work? Is there another way to batch import these records? Thanks.

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

On Sat, Feb 23, 2013 at 11:38 PM, John Callahan <john.callahan@anonymised.com>wrote:

Is there a simple method for batch exporting metadata in a GeoNetwork
repository? I'm using the latest 2.8 release (on Windows) and cannot find
a tool to do that. I remember in past versions GAST had the capability to
export all records in MEF format, which I believe also included the
thumbnails. The latest GAST version doesn't have that option (that I can
find) and the Administration page does not have an export tool.

Thanks for your help. Sorry if I'm missing something obvious.

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

Hi John

There's another option: Import metadata that allows to select the file
format (xml or mef), that by default is xml.

See
http://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/import/index.html#importing-a-metadata-record-from-xml-or-a-mef-file

Regards,
Jose GArcía

On Mon, Feb 25, 2013 at 3:47 PM, John Callahan <john.callahan@anonymised.com>wrote:

I found a way to export all of the metadata records. Through the standard
catalog site, as you are viewing the metadata records, check each one you
want to export (or select All Records.) Then, save as archived zip file.
All of the records, including uploaded datasets and thumbnail images, will
be downloaded in one zip file. Nice.

However, I see no way to get these records back into GeoNetwork. The
structure of the zip file contains subdirectories, one for each record,
named as the UUID. In each subdirectory, there is an info.xml file, and
directories for metadata, private, and public, that contain the actual
data. The GN Batch import tool is not accepting this structure. Should
this work? Is there another way to batch import these records? Thanks.

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

On Sat, Feb 23, 2013 at 11:38 PM, John Callahan <john.callahan@anonymised.com
>wrote:

> Is there a simple method for batch exporting metadata in a GeoNetwork
> repository? I'm using the latest 2.8 release (on Windows) and cannot
find
> a tool to do that. I remember in past versions GAST had the capability
to
> export all records in MEF format, which I believe also included the
> thumbnails. The latest GAST version doesn't have that option (that I can
> find) and the Administration page does not have an export tool.
>
> Thanks for your help. Sorry if I'm missing something obvious.
>
> - John
>
>
> John Callahan
> Research Scientist
> Delaware Geological Survey
> University of Delaware
> http://www.dgs.udel.edu
> john.callahan@anonymised.com
>
>

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

--
*
GeoCat Bridge for ArcGIS allows instant publishing of data and metadata on
GeoServer and GeoNetwork. Visit http://geocat.net for details.
_________________________
Jose García
GeoCat bv
Veenderweg 13
6721 WD Bennekom
The Netherlands
http://GeoCat.net/&gt;

*

Thank you Jose. Using this method allows for only one record at a time,
and does not import the thumbnail, the categories or permissions, or
downloadable data associated with each record. As a last resort., I could
go recreate every record this way that would take quite a while.

I had thought there was a batch export and import process available through
GeoNetwork, in some way, comparable to what the old GAST tool did. Thanks.

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

On Mon, Feb 25, 2013 at 9:55 AM, Jose Garcia <jose.garcia@anonymised.com> wrote:

Hi John

There's another option: Import metadata that allows to select the file
format (xml or mef), that by default is xml.

See
http://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/import/index.html#importing-a-metadata-record-from-xml-or-a-mef-file

Regards,
Jose GArcía

On Mon, Feb 25, 2013 at 3:47 PM, John Callahan <john.callahan@anonymised.com>wrote:

I found a way to export all of the metadata records. Through the standard
catalog site, as you are viewing the metadata records, check each one you
want to export (or select All Records.) Then, save as archived zip file.
All of the records, including uploaded datasets and thumbnail images,
will
be downloaded in one zip file. Nice.

However, I see no way to get these records back into GeoNetwork. The
structure of the zip file contains subdirectories, one for each record,
named as the UUID. In each subdirectory, there is an info.xml file, and
directories for metadata, private, and public, that contain the actual
data. The GN Batch import tool is not accepting this structure. Should
this work? Is there another way to batch import these records? Thanks.

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

On Sat, Feb 23, 2013 at 11:38 PM, John Callahan <john.callahan@anonymised.com
>wrote:

> Is there a simple method for batch exporting metadata in a GeoNetwork
> repository? I'm using the latest 2.8 release (on Windows) and cannot
find
> a tool to do that. I remember in past versions GAST had the capability
to
> export all records in MEF format, which I believe also included the
> thumbnails. The latest GAST version doesn't have that option (that I
can
> find) and the Administration page does not have an export tool.
>
> Thanks for your help. Sorry if I'm missing something obvious.
>
> - John
>
>
> John Callahan
> Research Scientist
> Delaware Geological Survey
> University of Delaware
> http://www.dgs.udel.edu
> john.callahan@anonymised.com
>
>

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

--
*
GeoCat Bridge for ArcGIS allows instant publishing of data and metadata on
GeoServer and GeoNetwork. Visit http://geocat.net for details.
_________________________
Jose García
GeoCat bv
Veenderweg 13
6721 WD Bennekom
The Netherlands
http://GeoCat.net/&gt;

*

John,

The directory structure you described seems to be the exact structure of a
MEF file. You could make a script to zip each UUID directory an rename the
.zip files to .mef and inport those.

How many records are yoy trying to import?

- André

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/batch-export-of-metadata-tp5036412p5036681.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

Excellent! It worked perfectly. I had no idea that is a MEF was. The
directory structure was by default when downloading selected records from
the website as Export (Zip), under Other Actions.

As we are just getting started and still in testing, we have only 15 or so
records. I can manually do this amount, however, scripting will be easy
enough when we expand our collection.

What is the preferred method for doing batch exports and imports for GN
metadata catalogs? I assume it's not the method that I am using. Is there
a planned tool for the Administration page to export all records in a
format compatible with the batch import tool?

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

On Mon, Feb 25, 2013 at 10:16 AM, apontes <apontes@anonymised.com> wrote:

John,

The directory structure you described seems to be the exact structure of a
MEF file. You could make a script to zip each UUID directory an rename the
.zip files to .mef and inport those.

How many records are yoy trying to import?

- André

--
View this message in context:
http://osgeo-org.1560.n6.nabble.com/batch-export-of-metadata-tp5036412p5036681.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

Hi John

Unless this has change or there's a bug, you can export several metadata to
mef, creating one mef file that includes all the records. Later in Import
Metadata, selecting MEF format and the previous file, should import all the
records with thumbnails, etc.

If this is not the case, I'm afraid that sounds like a bug.

Anyway, if you have a big number of records to import seem a better option
to use Batch Import.

Regards,
Jose García

On Mon, Feb 25, 2013 at 5:06 PM, John Callahan <john.callahan@anonymised.com>wrote:

Excellent! It worked perfectly. I had no idea that is a MEF was. The
directory structure was by default when downloading selected records from
the website as Export (Zip), under Other Actions.

As we are just getting started and still in testing, we have only 15 or so
records. I can manually do this amount, however, scripting will be easy
enough when we expand our collection.

What is the preferred method for doing batch exports and imports for GN
metadata catalogs? I assume it's not the method that I am using. Is there
a planned tool for the Administration page to export all records in a
format compatible with the batch import tool?

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

On Mon, Feb 25, 2013 at 10:16 AM, apontes <apontes@anonymised.com> wrote:

> John,
>
> The directory structure you described seems to be the exact structure of
a
> MEF file. You could make a script to zip each UUID directory an rename
the
> .zip files to .mef and inport those.
>
> How many records are yoy trying to import?
>
>
> - André
>
>
>
> --
> View this message in context:
>
http://osgeo-org.1560.n6.nabble.com/batch-export-of-metadata-tp5036412p5036681.html
> Sent from the GeoNetwork users mailing list archive at Nabble.com.
>
>
>
------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_feb
> _______________________________________________
> GeoNetwork-users mailing list
> GeoNetwork-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

--
*
GeoCat Bridge for ArcGIS allows instant publishing of data and metadata on
GeoServer and GeoNetwork. Visit http://geocat.net for details.
_________________________
Jose García
GeoCat bv
Veenderweg 13
6721 WD Bennekom
The Netherlands
http://GeoCat.net/&gt;

*

This worked even better! Thank you! Using the zipped file that was
downloaded with all of my records, I simply changed the extension to mef.,
then uploaded the file using "Metadata insert" on the Administration page.
Yes, for me, this is a better method to batch import records than using
the "Batch import" tool. :wink:

I was trying to unzip the file that was downloaded with all my records,
then zip and rename each subdirectory, then use the Batch import tool.
Actually, this did not work (it stalled on the second mef file), however,
uploading each mef file using the Metadata insert tool one at a time did
work fine.

Sorry for the list noise. The answer was already in place; I just didn't
know how to use the tools. Thanks.

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

On Mon, Feb 25, 2013 at 11:54 AM, Jose Garcia <jose.garcia@anonymised.com>wrote:

Hi John

Unless this has change or there's a bug, you can export several metadata
to mef, creating one mef file that includes all the records. Later in
Import Metadata, selecting MEF format and the previous file, should import
all the records with thumbnails, etc.

If this is not the case, I'm afraid that sounds like a bug.

Anyway, if you have a big number of records to import seem a better option
to use Batch Import.

Regards,
Jose García

On Mon, Feb 25, 2013 at 5:06 PM, John Callahan <john.callahan@anonymised.com>wrote:

Excellent! It worked perfectly. I had no idea that is a MEF was. The
directory structure was by default when downloading selected records from
the website as Export (Zip), under Other Actions.

As we are just getting started and still in testing, we have only 15 or so
records. I can manually do this amount, however, scripting will be easy
enough when we expand our collection.

What is the preferred method for doing batch exports and imports for GN
metadata catalogs? I assume it's not the method that I am using. Is
there
a planned tool for the Administration page to export all records in a
format compatible with the batch import tool?

- John

John Callahan
Research Scientist
Delaware Geological Survey
University of Delaware
http://www.dgs.udel.edu
john.callahan@anonymised.com

On Mon, Feb 25, 2013 at 10:16 AM, apontes <apontes@anonymised.com> wrote:

> John,
>
> The directory structure you described seems to be the exact structure
of a
> MEF file. You could make a script to zip each UUID directory an rename
the
> .zip files to .mef and inport those.
>
> How many records are yoy trying to import?
>
>
> - André
>
>
>
> --
> View this message in context:
>
http://osgeo-org.1560.n6.nabble.com/batch-export-of-metadata-tp5036412p5036681.html
> Sent from the GeoNetwork users mailing list archive at Nabble.com.
>
>
>
------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_feb
> _______________________________________________
> GeoNetwork-users mailing list
> GeoNetwork-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb
_______________________________________________
GeoNetwork-users mailing list
GeoNetwork-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at
http://sourceforge.net/projects/geonetwork

--
*
GeoCat Bridge for ArcGIS allows instant publishing of data and metadata on
GeoServer and GeoNetwork. Visit http://geocat.net for details.
_________________________
Jose García
GeoCat bv
Veenderweg 13
6721 WD Bennekom
The Netherlands
http://GeoCat.net/&gt;

*

I think the preferred method will depend on how many records you will be
importing.

In my case, it's 1 million+ records, so I had to write a program to handle
importing through GN services. Batch import simply couldn't cope with so
much data.

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/batch-export-of-metadata-tp5036412p5036737.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.