Hi Michael,
I'm not sure about the tarball but it certainly looks like it i sthe latest
code, judging from the line numbers.
I've been trying to harvest from the 3 sources you mention, with the results
as below (none successful, all in a different way). In the first source I
get a timeout on GetCapabilities, that's where it ends; in the other 2
sources GetCapabilitites goes fine, but then GetRecords chokes, albeit in 2
different ways.
Meanwhile maybe you could try to harvest from one of the sources that I can
successfully harvest, as a complementary test ? Try for example
http://www.geodata.alterra.nl/excat/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2
.
I'll continue to look into this, in the meantime..
1. Could not test, request timeout
2.
http://gdz.bkg.bund.de/advmiscsw/advmiscsw?Request=GetCapabilities&Service=CSW
GR request :
<csw:GetRecords xmlns:csw="http://www.opengis.net/cat/csw/2.0.2"
service="CSW" version="2.0.2" resultType="results" startPosition=
"1" maxRecords="10">
<csw:Query>
<csw:ElementSetName>summary</csw:ElementSetName>
</csw:Query>
</csw:GetRecords>
GR response :
<ExceptionReport xmlns="http://www.opengis.net/ows" xmlns:xsi="
http://www.w3.org/2001/XMLSchema-instance" language="en" version="1
.0.0" xsi:schemaLocation="http://www.opengis.net/ows
http://schemas.opengis.net/ows/1.0.0/owsExceptionReport.xsd">
<Exception exceptionCode="MissingParameterValue" locator="typeNames">
<ExceptionText>Attribute 'typeNames' is missing.</ExceptionText>
</Exception>
</ExceptionReport>
I do not know why this is returned. The GetRecords request is exactly the
same as it is sent to CSW202 servers which I can harvest succesfully. I'll
check this request against the CSW 202 XSD though.
3.
http://www.sdi-suite.de/soapServices/CSWStartup?Request=GetCapabilities&Service=CSW
request :
<csw:GetRecords xmlns:csw="http://www.opengis.net/cat/csw/2.0.2"
service="CSW" version="2.0.2" resultType="results" startPosition=
"1" maxRecords="10">
<csw:Query>
<csw:ElementSetName>summary</csw:ElementSetName>
</csw:Query>
</csw:GetRecords>
the response is unparseable: the GN harvesting client throws
"org.xml.sax.SAXParseException: Invalid encoding name "UTF8"." Xerces does
this if it tries to parse a document that has encoding "UTF8" rather than
"UTF-8" -- apparently this is what the harvesting source returns..
Then I fixed this by setting feature "
http://apache.org/xml/features/allow-java-encodings" in class
org.fao.geonet.csw.common.util.Xml, the response can be parsed but it is
<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi
="http://www.w3.org/2001/XMLSchema-instance">
<soapenv:Body>
<soapenv:Fault>
<faultcode xmlns:ns1="http://xml.apache.org/axis/
">ns1:Client.NoSOAPAction</faultcode>
<faultstring>no SOAPAction header!</faultstring>
<detail>
<ns2:hostname xmlns:ns2="http://xml.apache.org/axis/
">sdisuite</ns2:hostname>
</detail>
</soapenv:Fault>
</soapenv:Body>
</soapenv:Envelope>
I have no clue yet why this is returned but it is obiously not the
GetRecords response that GeoNetwork is expecting ..
Let's look into this more and find out what's wrong. I'll check in the
allow-java-encodings fix in the trunk.
Kind regards
Heikki Doeleman
On Mon, Sep 15, 2008 at 7:35 AM, Michael Lill <Michael-Lill@anonymised.com> wrote:
Hi,
thanks for the information, tried it immediately, but nothing changed,
still not able to harvest csw2.0.1 or 2.0.2.
I did the following:
Because I never worked with svn bevore, I went to
http://geonetwork.svn.sourceforge.net/viewvc/geonetwork/trunk/ and chose
"Download GNU Tarball". (Do I need a real svn-client? Did I download old
code?)
Then copied it to one of my machines, compiled the installer with ant,
copied it to another machine (new, empty and clean except of Java),
installed and tested it with several Geonetwork-nodes and other CSWs.
But there is the same error I got on all installations so far when trying
to harvest csw:
Class OperationAbortedEx
Message Raised exception when searching
Stack Harvester.java 356
Harvester.java 202
Harvester.java 92
CSWHarvester.java 211
AbstractHarvester.java 329
Executor.java 87
For example I tried harvesting csw from:
1.
http://geoportal.dachplus.org:8080/geonetwork/srv/csw?Request=GetCapabilities&Service=CSW
(a Geonetwork 2.2 installation from an initiative in the region of the Lake
Constance that wants to offer harmonised data from Germany, Suisse and
Austria; of course, I could harvest this one as Geonetwork-node, but we are
testing csw..)
2.
http://gdz.bkg.bund.de/advmiscsw/advmiscsw?Request=GetCapabilities&Service=CSW
(an "old" Intergraph-System from a german goverment agency).
3.
http://www.sdi-suite.de/soapServices/CSWStartup?Request=GetCapabilities&Service=CSW
(another csw-software/catalogue as online demo)
If you're interested in a special log-file or access to the machine, just
give me a hint.
Best regards,
Michael Lill
-------- Original-Nachricht --------
> Datum: Mon, 15 Sep 2008 03:16:02 -0700
> Von: heikki <tropicano@anonymised.com>
> An: "Michael Lill" <Michael-Lill@anonymised.com>
> CC: geonetwork-users@lists.sourceforge.net
> Betreff: Re: [GeoNetwork-users] Harvesting of CSW 2.0.2
> hi Michael,
>
> your observation that CSW 2.0.2 harvesting won't work in any current
> GeoNetwork release is correct.
>
> Amongst the problems were : in the harvesting client part the value of
> OutputSchema from the GetCapabilities response was ignored, causing some
> Harvesting servers to return metadata in DC, which was subsequently not
> stored by GeoNetwork. And in GeoNetwork's harvesting server part the
value
> of OutputSchema was compared against values that are not the values in
the
> specification, so if it received a correct OutputSchema value it would
> throw
> an error.
>
> I have recently fixed these issues and you can find them in GeoNetwork's
> svn
> trunk. You can download the source using an svn client, and run
> <download-dir>/install/ant to create an installer from the source.
>
> I'm quite curious how the new code will work for you; could you keep us
> posted on how you're doing ?
>
> Kind regards
> Heikki Doeleman
>
>
>
> On Mon, Sep 15, 2008 at 3:07 AM, Michael Lill <Michael-Lill@anonymised.com>
wrote:
>
> > Hello to all,
> >
> > I' a member of a research team at the Technical University Munich
> > (Technische Universität München - chair of geoinformation-systems of
> Prof.
> > Schilcher). We are testing different CSW-software against each other
> (what
> > features are included) and if they work together (especially harvesting
> and
> > differences in the implementation of the CSW-standard). Most of this
> takes
> > place in the context of the Humboldt-project (1) and INSPIRE.
> >
> > Our problem is now that nearly all of our CSWs are CSW 2.0.2, only
> > Geonetwork (so far) is still 2.0.1. So we got some problems with the
> > Harvesting-function in GeoNetwork. It seems to me unpossible to harvest
> any
> > 2.0.2 CSW with any Geonetwork-Release.
> >
> > This is really disappointing as we would like to use Geonetwork as main
> CSW
> > for our part at the Humboldt-project.
> >
> >
> > I can hardly imagine that we are the first who want to harvest a
> 2.0.2-CSW
> > with Geonetwork!?
> >
> >
> > We tried harvesting between Geonetwork, works fine with Geonetwork and
> > CSW-type. But when adding a 2.0.2-csw we always get
> "OperationAbortedEx,
> > Raised exception when searching, ..". So far, I was not really
> concerned as
> > the manual says that only 2.0.1-csw is supported.
> >
> > So I tried a version of GeoNetwork by Archibald Warnock that I found
> here
> > (2). This one is able to deliver 2.0.2-csw, but it seems to me that the
> > csw-harvesting-engine won't work with 2.0.2, neither with 2.0.1
> > (geonetwork-type harvesting works). I compiled this version on two
> different
> > machines, WinXP Pro Tablet and Win2003 Server and in both Geonetwork is
> not
> > able to harvest csw.
> >
> >
> > So, is there anybody who solved the problem of harvesting 2.0.2-csw in
> > Geonetwork, with or without keeping the ability to harvest 2.0.1-csw?
> >
> > We would appreciate any help!
> >
> >
> >
> > Thanks and Best Regards,
> >
> > Michael Lill
> >
> >
> > (1) www.esdi-humboldt.eu
> > (2) www.awcubed.com/index.php?page=csw-installation
> > --
> > GMX startet ShortView.de. Hier findest Du Leute mit Deinen Interessen!
> > Jetzt dabei sein:
> > http://www.shortview.de/wasistshortview.php?mc=sv_ext_mf@anonymised.com
> >
> >
> ------------------------------------------------------------
-------------
> > This SF.Net email is sponsored by the Moblin Your Move Developer's
> > challenge
> > Build the coolest Linux based applications with Moblin SDK & win great
> > prizes
> > Grand prize is a trip for two to an Open Source event anywhere in the
> world
> > http://moblin-contest.org/redirect.php?banner_id=100&url=/
> > _______________________________________________
> > GeoNetwork-users mailing list
> > GeoNetwork-users@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> > GeoNetwork OpenSource is maintained at
> > http://sourceforge.net/projects/geonetwork
> >
> ------------------------------------------------------------
-------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's
> challenge
> Build the coolest Linux based applications with Moblin SDK & win great
> prizes
> Grand prize is a trip for two to an Open Source event anywhere in the
> world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> GeoNetwork-users mailing list
> GeoNetwork-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
--
GMX Kostenlose Spiele: Einfach online spielen und Spaß haben mit Pastry
Passion!
http://games.entertainment.gmx.net/de/entertainment/games/free/puzzle/6169196