Hi all,
We are having some issues harvesting from a GN 4.2.9 CSW endpoint. There are about 970 records in this portal, and we are getting timeouts because the total request takes over two and a half minutes to complete. Has anyone had this same issue? We use a PostgreSQL 16 database and a dockerised GN 4.2.9
The request we’re making is “request=GetRecords&resultType=results&outputSchema=http://www.opengis.net/cat/csw/2.0.2&NAMESPACE=xmlns(gmd=http://www.isotc211.org/2005/gmd)&typeNames=gmd:MD_Metadata&elementSetName=full&startPosition=1&maxRecords=976”
From looking at the logs, it seems that a request is made to the database to retrieve each record, then XSL is applied, and then the final result is returned, containing all records. None of the select queries takes long in particular, but added up, they take over two and a half minutes, and we hit timeouts from the system we are trying to harvest from.
Does anyone have any ideas on how we could make this response faster? I have thought of requesting paginated responses, i.e. not all at once, but ideally we’d like to get the whole response in one go, if possible.
Any help would be greatly appreciated! 