Hi,
I was looking at the build times and found a geoserver master build takes a whopping 55 minutes,
checked if there was anything obviously wrong, but it seems the build is really just slow, here are the logs
of the supported modules build results (then there are the community ones adding to it to reach the 55 minutes):
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for GeoServer 2.16-SNAPSHOT:
[INFO]
[INFO] GeoServer .......................................... SUCCESS [ 8.004 s]
[INFO] Core Platform Module ............................... SUCCESS [ 12.392 s]
[INFO] Open Web Service Module ............................ SUCCESS [ 10.839 s]
[INFO] Main Module ........................................ SUCCESS [01:21 min]
[INFO] GeoServer Security Modules ......................... SUCCESS [ 0.060 s]
[INFO] GeoServer Security Tests Module .................... SUCCESS [01:49 min]
[INFO] GeoServer JDBC Security Module ..................... SUCCESS [ 47.643 s]
[INFO] GeoServer LDAP Security Module ..................... SUCCESS [ 46.876 s]
[INFO] Web Coverage Service Module ........................ SUCCESS [ 0.437 s]
[INFO] Web Coverage Service 1.0 Module .................... SUCCESS [ 18.772 s]
[INFO] Web Coverage Service 1.1 Module .................... SUCCESS [ 17.702 s]
[INFO] Web Coverage Service 2.0 Module .................... SUCCESS [01:18 min]
[INFO] Web Feature Service Module ......................... SUCCESS [01:20 min]
[INFO] Web Map Service Module ............................. SUCCESS [02:49 min]
[INFO] KML support for GeoServer .......................... SUCCESS [ 18.840 s]
[INFO] gs-rest ............................................ SUCCESS [ 7.124 s]
[INFO] GeoWebCache (GWC) Module ........................... SUCCESS [ 55.811 s]
[INFO] gs-restconfig ...................................... SUCCESS [01:34 min]
[INFO] gs-restconfig-wcs .................................. SUCCESS [ 20.335 s]
[INFO] gs-restconfig-wfs .................................. SUCCESS [ 22.511 s]
[INFO] gs-restconfig-wms .................................. SUCCESS [ 22.210 s]
[INFO] GeoServer Web Modules .............................. SUCCESS [ 0.261 s]
[INFO] Core UI Module ..................................... SUCCESS [ 58.319 s]
[INFO] WMS UI Module ...................................... SUCCESS [06:42 min]
[INFO] GWC UI Module ...................................... SUCCESS [04:20 min]
[INFO] WFS UI Module ...................................... SUCCESS [ 10.408 s]
[INFO] Demos Module ....................................... SUCCESS [06:29 min]
[INFO] WCS UI Module ...................................... SUCCESS [ 9.732 s]
[INFO] Security UI Modules ................................ SUCCESS [ 0.105 s]
[INFO] Security UI Core Module ............................ SUCCESS [01:27 min]
[INFO] Security UI JDBC Module ............................ SUCCESS [08:07 min]
[INFO] Security UI LDAP Module ............................ SUCCESS [ 31.635 s]
[INFO] REST UI Module ..................................... SUCCESS [ 10.209 s]
[INFO] GeoServer Extensions ............................... SUCCESS [ 0.145 s]
[INFO] Printing Module .................................... SUCCESS [ 10.857 s]
[INFO] GeoServer Web Application .......................... SUCCESS [ 5.022 s]
[INFO] Community Space .................................... SUCCESS [ 0.102 s]
[INFO] Application Schema Support ......................... SUCCESS [ 0.131 s]
[INFO] Application Schema Integration Test ................ SUCCESS [05:54 min]
[INFO] Sample DataAccess Integration Test ................. SUCCESS [ 8.476 s]
[INFO] ArcSDE DataStore Extension ......................... SUCCESS [ 9.695 s]
[INFO] H2 DataStore Extension ............................. SUCCESS [ 9.756 s]
[INFO] SQL Server DataStore Extension ..................... SUCCESS [ 0.947 s]
[INFO] Oracle DataStore Extension ......................... SUCCESS [ 0.696 s]
[INFO] MySQL DataStore Extension .......................... SUCCESS [ 0.198 s]
[INFO] DB2 DataStore Extension ............................ SUCCESS [ 0.340 s]
[INFO] ImageMap Output Format ............................. SUCCESS [ 6.160 s]
[INFO] ImageI/O-Ext GDAL Coverage Extension ............... SUCCESS [ 3.405 s]
[INFO] JP2K Coverage Extension ............................ SUCCESS [ 0.239 s]
[INFO] OGR parent ......................................... SUCCESS [ 0.020 s]
[INFO] OGR CORE ........................................... SUCCESS [ 0.354 s]
[INFO] OGR WFS ............................................ SUCCESS [ 5.457 s]
[INFO] Web Processing Service parent ...................... SUCCESS [ 0.023 s]
[INFO] Web Processing Service Module ...................... SUCCESS [01:03 min]
[INFO] OGR WPS ............................................ SUCCESS [ 6.869 s]
[INFO] Excel Output Format ................................ SUCCESS [ 11.174 s]
[INFO] Chart external graphics support .................... SUCCESS [ 0.462 s]
[INFO] Feature Generalization Extension ................... SUCCESS [ 0.475 s]
[INFO] Image Mosaic JDBC Extension ........................ SUCCESS [ 0.483 s]
[INFO] OWS request flow controller ........................ SUCCESS [ 11.003 s]
[INFO] Web process status sharing with Hazelcast .......... SUCCESS [ 14.725 s]
[INFO] Web Processing Service GUI ......................... SUCCESS [ 25.293 s]
[INFO] GeoServer Layer Querying filter functions .......... SUCCESS [ 14.875 s]
[INFO] Teradata DataStore Extension ....................... SUCCESS [ 0.541 s]
[INFO] GeoServer Monitor Extensions ....................... SUCCESS [ 0.029 s]
[INFO] Core Monitor Extension ............................. SUCCESS [01:41 min]
[INFO] GeoServer Security Extension Modules ............... SUCCESS [ 0.042 s]
[INFO] GeoServer CAS Security Module ...................... SUCCESS [ 3.202 s]
[INFO] GeoServer Security Extension Web Modules ........... SUCCESS [ 0.052 s]
[INFO] GeoServer CAS Security Web Module .................. SUCCESS [ 0.313 s]
[INFO] XLST based WFS output format ....................... SUCCESS [ 14.758 s]
[INFO] GeoServer INSPIRE Extensions ....................... SUCCESS [ 24.538 s]
[INFO] GeoServer CSS Styling .............................. SUCCESS [ 13.554 s]
[INFO] Catalog Services for the Web parent ................ SUCCESS [ 0.045 s]
[INFO] Catalog Services for the Web interfaces ............ SUCCESS [ 8.224 s]
[INFO] Catalog Services for the Web - Simple CatalogStore implementation SUCCESS [ 7.192 s]
[INFO] Catalog Services for the Web core module ........... SUCCESS [05:10 min]
[INFO] CSW UI Module ...................................... SUCCESS [ 10.014 s]
[INFO] DXF WFS output format and WPS PPIO ................. SUCCESS [ 0.051 s]
[INFO] DXF WFS output format .............................. SUCCESS [ 11.549 s]
[INFO] DXF WPS PPIO ....................................... SUCCESS [ 6.799 s]
[INFO] GeoServer WCS 2.0 Earth Observation Extensions ..... SUCCESS [ 0.068 s]
[INFO] Web Coverage Service 2.0 Earth Observation extensions SUCCESS [ 13.466 s]
[INFO] Web Coverage Service 2.0 Earth Observation GUI extension SUCCESS [02:20 min]
[INFO] GeoServer libjpeg-turbo Module ..................... SUCCESS [ 10.942 s]
[INFO] GeoServer Data Importer ............................ SUCCESS [ 0.089 s]
[INFO] Importer Core Module ............................... SUCCESS [ 32.424 s]
[INFO] Importer REST Api Module-ng ........................ SUCCESS [ 42.613 s]
[INFO] Importer Berkley DB Persistence Module ............. SUCCESS [06:13 min]
[INFO] Importer Web UI Module ............................. SUCCESS [ 9.757 s]
[INFO] GRIB Coverage Format ............................... SUCCESS [ 19.761 s]
[INFO] NetCDF Coverage format ............................. SUCCESS [ 52.768 s]
[INFO] WCS NetCDF output Module ........................... SUCCESS [05:11 min]
[INFO] Vector Tiles ....................................... SUCCESS [ 15.517 s]
[INFO] Ysld GeoServer Plugin .............................. SUCCESS [ 9.858 s]
[INFO] MongoDB Data Store ................................. SUCCESS [ 1.481 s]
[INFO] REST SLD service ................................... SUCCESS [09:08 min]
[INFO] GeoFence security integration ...................... SUCCESS [04:13 min]
[INFO] GeoFence Server .................................... SUCCESS [06:04 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 50:54 min (Wall Clock)
[INFO] Finished at: 2019-05-31T20:45:14Z
[INFO] ------------------------------------------------------------------------
Part of it may be due to the lack of an up-to-date local repository, wondering if we should try to do something like Travis
and keep a repository cache? And yet at the beginning of the build I don’t see maven downloading all the basic
plugins, so some caching should be there.
Another hypothesis might be file system related, maybe there is no real local filesystem and everything is S3 mounted?
Dunno.
For reference, Travis is building GeoServer master is 27 minutes total, and for just the supported modules, 24:
[INFO] Reactor Summary for GeoServer 2.16-SNAPSHOT:
[INFO]
[INFO] GeoServer .......................................... SUCCESS [ 11.514 s]
[INFO] Core Platform Module ............................... SUCCESS [ 13.224 s]
[INFO] Open Web Service Module ............................ SUCCESS [ 10.736 s]
[INFO] Main Module ........................................ SUCCESS [01:10 min]
[INFO] GeoServer Security Modules ......................... SUCCESS [ 0.198 s]
[INFO] GeoServer Security Tests Module .................... SUCCESS [03:09 min]
[INFO] GeoServer JDBC Security Module ..................... SUCCESS [ 41.100 s]
[INFO] GeoServer LDAP Security Module ..................... SUCCESS [ 35.351 s]
[INFO] Web Coverage Service Module ........................ SUCCESS [ 1.094 s]
[INFO] Web Coverage Service 1.0 Module .................... SUCCESS [ 35.872 s]
[INFO] Web Coverage Service 1.1 Module .................... SUCCESS [ 35.418 s]
[INFO] Web Coverage Service 2.0 Module .................... SUCCESS [02:29 min]
[INFO] Web Feature Service Module ......................... SUCCESS [02:58 min]
[INFO] Web Map Service Module ............................. SUCCESS [04:56 min]
[INFO] KML support for GeoServer .......................... SUCCESS [ 51.117 s]
[INFO] gs-rest ............................................ SUCCESS [ 20.791 s]
[INFO] GeoWebCache (GWC) Module ........................... SUCCESS [02:22 min]
[INFO] gs-restconfig ...................................... SUCCESS [02:41 min]
[INFO] gs-restconfig-wcs .................................. SUCCESS [ 31.609 s]
[INFO] gs-restconfig-wfs .................................. SUCCESS [ 36.461 s]
[INFO] gs-restconfig-wms .................................. SUCCESS [ 29.272 s]
[INFO] GeoServer Web Modules .............................. SUCCESS [ 0.350 s]
[INFO] Core UI Module ..................................... SUCCESS [02:16 min]
[INFO] WMS UI Module ...................................... SUCCESS [01:07 min]
[INFO] GWC UI Module ...................................... SUCCESS [01:29 min]
[INFO] WFS UI Module ...................................... SUCCESS [ 20.054 s]
[INFO] Demos Module ....................................... SUCCESS [ 36.667 s]
[INFO] WCS UI Module ...................................... SUCCESS [ 24.304 s]
[INFO] Security UI Modules ................................ SUCCESS [ 0.220 s]
[INFO] Security UI Core Module ............................ SUCCESS [03:11 min]
[INFO] Security UI JDBC Module ............................ SUCCESS [02:13 min]
[INFO] Security UI LDAP Module ............................ SUCCESS [ 38.326 s]
[INFO] REST UI Module ..................................... SUCCESS [ 20.318 s]
[INFO] GeoServer Web Application .......................... SUCCESS [ 16.627 s]
[INFO] Community Space .................................... SUCCESS [ 0.270 s]
[INFO] GeoServer Extensions ............................... SUCCESS [ 0.231 s]
[INFO] Application Schema Support ......................... SUCCESS [ 0.111 s]
[INFO] Application Schema Integration Test ................ SUCCESS [02:38 min]
[INFO] Sample DataAccess Integration Test ................. SUCCESS [ 22.740 s]
[INFO] ArcSDE DataStore Extension ......................... SUCCESS [ 15.696 s]
[INFO] H2 DataStore Extension ............................. SUCCESS [ 19.359 s]
[INFO] SQL Server DataStore Extension ..................... SUCCESS [ 1.746 s]
[INFO] Oracle DataStore Extension ......................... SUCCESS [ 2.033 s]
[INFO] MySQL DataStore Extension .......................... SUCCESS [ 0.505 s]
[INFO] DB2 DataStore Extension ............................ SUCCESS [ 0.904 s]
[INFO] ImageMap Output Format ............................. SUCCESS [ 9.157 s]
[INFO] ImageI/O-Ext GDAL Coverage Extension ............... SUCCESS [ 2.684 s]
[INFO] JP2K Coverage Extension ............................ SUCCESS [ 1.657 s]
[INFO] OGR parent ......................................... SUCCESS [ 0.208 s]
[INFO] OGR CORE ........................................... SUCCESS [ 1.120 s]
[INFO] OGR WFS ............................................ SUCCESS [ 13.603 s]
[INFO] Web Processing Service parent ...................... SUCCESS [ 0.185 s]
[INFO] Web Processing Service Module ...................... SUCCESS [02:31 min]
[INFO] OGR WPS ............................................ SUCCESS [ 14.065 s]
[INFO] Excel Output Format ................................ SUCCESS [ 24.799 s]
[INFO] Chart external graphics support .................... SUCCESS [ 1.206 s]
[INFO] Feature Generalization Extension ................... SUCCESS [ 1.342 s]
[INFO] Image Mosaic JDBC Extension ........................ SUCCESS [ 1.176 s]
[INFO] OWS request flow controller ........................ SUCCESS [ 13.450 s]
[INFO] Web process status sharing with Hazelcast .......... SUCCESS [ 17.146 s]
[INFO] Web Processing Service GUI ......................... SUCCESS [ 53.519 s]
[INFO] GeoServer Layer Querying filter functions .......... SUCCESS [ 30.617 s]
[INFO] Teradata DataStore Extension ....................... SUCCESS [ 1.201 s]
[INFO] GeoServer Monitor Extensions ....................... SUCCESS [ 0.235 s]
[INFO] Core Monitor Extension ............................. SUCCESS [ 40.232 s]
[INFO] GeoServer Security Extension Modules ............... SUCCESS [ 0.139 s]
[INFO] GeoServer CAS Security Module ...................... SUCCESS [ 4.037 s]
[INFO] GeoServer Security Extension Web Modules ........... SUCCESS [ 0.173 s]
[INFO] GeoServer CAS Security Web Module .................. SUCCESS [ 0.812 s]
[INFO] XLST based WFS output format ....................... SUCCESS [ 32.652 s]
[INFO] GeoServer INSPIRE Extensions ....................... SUCCESS [01:03 min]
[INFO] GeoServer CSS Styling .............................. SUCCESS [ 25.535 s]
[INFO] Catalog Services for the Web parent ................ SUCCESS [ 0.128 s]
[INFO] Catalog Services for the Web interfaces ............ SUCCESS [ 14.436 s]
[INFO] Catalog Services for the Web - Simple CatalogStore implementation SUCCESS [ 13.944 s]
[INFO] Catalog Services for the Web core module ........... SUCCESS [01:05 min]
[INFO] CSW UI Module ...................................... SUCCESS [ 14.975 s]
[INFO] DXF WFS output format and WPS PPIO ................. SUCCESS [ 0.133 s]
[INFO] DXF WFS output format .............................. SUCCESS [ 20.982 s]
[INFO] DXF WPS PPIO ....................................... SUCCESS [ 15.245 s]
[INFO] Printing Module .................................... SUCCESS [ 21.183 s]
[INFO] GeoServer WCS 2.0 Earth Observation Extensions ..... SUCCESS [ 0.128 s]
[INFO] Web Coverage Service 2.0 Earth Observation extensions SUCCESS [ 31.163 s]
[INFO] Web Coverage Service 2.0 Earth Observation GUI extension SUCCESS [ 22.774 s]
[INFO] GeoServer libjpeg-turbo Module ..................... SUCCESS [ 16.189 s]
[INFO] GeoServer Data Importer ............................ SUCCESS [ 0.146 s]
[INFO] Importer Core Module ............................... SUCCESS [01:12 min]
[INFO] Importer REST Api Module-ng ........................ SUCCESS [01:14 min]
[INFO] Importer Berkley DB Persistence Module ............. SUCCESS [ 26.051 s]
[INFO] Importer Web UI Module ............................. SUCCESS [ 23.428 s]
[INFO] GRIB Coverage Format ............................... SUCCESS [ 28.074 s]
[INFO] NetCDF Coverage format ............................. SUCCESS [ 39.287 s]
[INFO] WCS NetCDF output Module ........................... SUCCESS [ 59.596 s]
[INFO] Vector Tiles ....................................... SUCCESS [ 30.400 s]
[INFO] Ysld GeoServer Plugin .............................. SUCCESS [ 26.082 s]
[INFO] MongoDB Data Store ................................. SUCCESS [ 3.135 s]
[INFO] REST SLD service ................................... SUCCESS [ 44.052 s]
[INFO] GeoFence security integration ...................... SUCCESS [ 44.609 s]
[INFO] GeoFence Server .................................... SUCCESS [01:02 min]
[INFO] GeoServer Release Module ........................... SUCCESS [ 4.709 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 23:58 min (Wall Clock)
[INFO] Finished at: 2019-05-31T00:09:45Z
[INFO] ------------------------------------------------------------------------
The timing difference does not have the same proportion on all modules, it’s not a linear factory, for example
the Importer Berkeley DB module is 12+ times slower on the official build server than on Travis (24 seconds
versions 6 minutes), whilst for example the app-schema integration tests are faster on the official build server.
Makes me think about a file system related issue, but maybe it’s just due to different combinations of modules
building together (I believe both builds are -T2)
Cheers
Andrea
···
== GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information. == Ing. Andrea Aime @geowolf Technical Lead GeoSolutions S.A.S. Via di Montramito 3/A 55054 Massarosa (LU) phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 339 8844549 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia. This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.