[Geoserver-users] ImageMosaic - indexer.xml, time domain, custom dimensions

I can’t seem to find any documentation for it yet, so I am following Simone’s presentation as well as investigating the code for adding custom dimensions using ImageMosaic and the new indexer.xml properties file.

[For reference, the presentation is at: http://www.slideshare.net/geosolutions/geoserver-for-spatiotemporal-data-handling-with-examples-for-metoc-and-remote-sensing]

I am able to get the custom dimensions to populate in my database table … but I am now struggling with the TIME dimension … a non-custom dimension. If I go the indexer.properties route, the time is picked up correctly. However, using indexer.xml, the time is not being picked up from my filenames.

For the “new” way of doing this with indexer.xml, where do I need to specify the regex for the time dimension and elevation dimension? Do they now go somewhere besides the regex .properties files?

For reference, my coverage/store is called “surfacemore”. My indexer.xml and timeregex.properties files are below, as is my file listing. I’m not sure they are correct, but I’m trying to follow the presentation and some of the code to make this work.

Thanks,

Mike Grogan
Meteorologist & Systems Engineer
WeatherFlow, Inc., Synoptic

indexer.xml:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?> time fileDate *the_geom:Polygon,location:String,time:java.util.Date,fileDate:java.util.Date surfacemore [0-9]{8} TimestampFileNameExtractorSPI fileDate

timeregex.properties:
regex=[0-9]{8}T[0-9]{9}Z(?!.*[0-9]{8}T[0-9]{9}Z.*)

file listing:
surfacemore_20140523T130000000Z.tiff
surfacemore_20140523T150000000Z.tiff

(note: same results without the surfacemore_ in front)

Hi Mike,

when using the indexer.xml there is no more need of the other regex.properties file… You just need to specify the regex in the collectors sections.

Therefore, similarly to what you did with fileData, you can do this (It’s just an example which also allows you to specify the format of the datetime):

time ... ... format=yyyyMMddHHmmss,regex=[0-9]{14} TimestampFileNameExtractorSPI time ...

Cheers,
Daniele

···

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Fri, Jun 6, 2014 at 6:23 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

I can’t seem to find any documentation for it yet, so I am following Simone’s presentation as well as investigating the code for adding custom dimensions using ImageMosaic and the new indexer.xml properties file.

[For reference, the presentation is at: http://www.slideshare.net/geosolutions/geoserver-for-spatiotemporal-data-handling-with-examples-for-metoc-and-remote-sensing]

I am able to get the custom dimensions to populate in my database table … but I am now struggling with the TIME dimension … a non-custom dimension. If I go the indexer.properties route, the time is picked up correctly. However, using indexer.xml, the time is not being picked up from my filenames.

For the “new” way of doing this with indexer.xml, where do I need to specify the regex for the time dimension and elevation dimension? Do they now go somewhere besides the regex .properties files?

For reference, my coverage/store is called “surfacemore”. My indexer.xml and timeregex.properties files are below, as is my file listing. I’m not sure they are correct, but I’m trying to follow the presentation and some of the code to make this work.

Thanks,

Mike Grogan
Meteorologist & Systems Engineer
WeatherFlow, Inc., Synoptic

indexer.xml:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?> time fileDate *the_geom:Polygon,location:String,time:java.util.Date,fileDate:java.util.Date surfacemore [0-9]{8} TimestampFileNameExtractorSPI fileDate

timeregex.properties:
regex=[0-9]{8}T[0-9]{9}Z(?!.*[0-9]{8}T[0-9]{9}Z.*)

file listing:
surfacemore_20140523T130000000Z.tiff
surfacemore_20140523T150000000Z.tiff

(note: same results without the surfacemore_ in front)


Learn Graph Databases - Download FREE O’Reilly Book
“Graph Databases” is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech


Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Daniele, thanks for the quick reply! One additional question, what would the look like for the elevation dimension if my filename were to look like:

surfacemore_20140523T130000000Z_500.tiff

where the _500 is the elevation?

Thanks again!

  • Mike
···

On Fri, Jun 6, 2014 at 12:46 PM, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Hi Mike,

when using the indexer.xml there is no more need of the other regex.properties file… You just need to specify the regex in the collectors sections.

Therefore, similarly to what you did with fileData, you can do this (It’s just an example which also allows you to specify the format of the datetime):

time ... ... format=yyyyMMddHHmmss,regex=[0-9]{14} TimestampFileNameExtractorSPI time ...

Cheers,
Daniele

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Fri, Jun 6, 2014 at 6:23 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

I can’t seem to find any documentation for it yet, so I am following Simone’s presentation as well as investigating the code for adding custom dimensions using ImageMosaic and the new indexer.xml properties file.

[For reference, the presentation is at: http://www.slideshare.net/geosolutions/geoserver-for-spatiotemporal-data-handling-with-examples-for-metoc-and-remote-sensing]

I am able to get the custom dimensions to populate in my database table … but I am now struggling with the TIME dimension … a non-custom dimension. If I go the indexer.properties route, the time is picked up correctly. However, using indexer.xml, the time is not being picked up from my filenames.

For the “new” way of doing this with indexer.xml, where do I need to specify the regex for the time dimension and elevation dimension? Do they now go somewhere besides the regex .properties files?

For reference, my coverage/store is called “surfacemore”. My indexer.xml and timeregex.properties files are below, as is my file listing. I’m not sure they are correct, but I’m trying to follow the presentation and some of the code to make this work.

Thanks,

Mike Grogan
Meteorologist & Systems Engineer
WeatherFlow, Inc., Synoptic

indexer.xml:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?> time fileDate *the_geom:Polygon,location:String,time:java.util.Date,fileDate:java.util.Date surfacemore [0-9]{8} TimestampFileNameExtractorSPI fileDate

timeregex.properties:
regex=[0-9]{8}T[0-9]{9}Z(?!.*[0-9]{8}T[0-9]{9}Z.*)

file listing:
surfacemore_20140523T130000000Z.tiff
surfacemore_20140523T150000000Z.tiff

(note: same results without the surfacemore_ in front)


Learn Graph Databases - Download FREE O’Reilly Book
“Graph Databases” is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

I guess that was a silly follow up question asked in haste … I just needed to play with the regex a little bit more …

(?<=Z_)([0-9]{3})

  • Mike
···

On Fri, Jun 6, 2014 at 12:52 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

Daniele, thanks for the quick reply! One additional question, what would the look like for the elevation dimension if my filename were to look like:

surfacemore_20140523T130000000Z_500.tiff

where the _500 is the elevation?

Thanks again!

  • Mike

On Fri, Jun 6, 2014 at 12:46 PM, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Hi Mike,

when using the indexer.xml there is no more need of the other regex.properties file… You just need to specify the regex in the collectors sections.

Therefore, similarly to what you did with fileData, you can do this (It’s just an example which also allows you to specify the format of the datetime):

time ... ... format=yyyyMMddHHmmss,regex=[0-9]{14} TimestampFileNameExtractorSPI time ...

Cheers,
Daniele

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Fri, Jun 6, 2014 at 6:23 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

I can’t seem to find any documentation for it yet, so I am following Simone’s presentation as well as investigating the code for adding custom dimensions using ImageMosaic and the new indexer.xml properties file.

[For reference, the presentation is at: http://www.slideshare.net/geosolutions/geoserver-for-spatiotemporal-data-handling-with-examples-for-metoc-and-remote-sensing]

I am able to get the custom dimensions to populate in my database table … but I am now struggling with the TIME dimension … a non-custom dimension. If I go the indexer.properties route, the time is picked up correctly. However, using indexer.xml, the time is not being picked up from my filenames.

For the “new” way of doing this with indexer.xml, where do I need to specify the regex for the time dimension and elevation dimension? Do they now go somewhere besides the regex .properties files?

For reference, my coverage/store is called “surfacemore”. My indexer.xml and timeregex.properties files are below, as is my file listing. I’m not sure they are correct, but I’m trying to follow the presentation and some of the code to make this work.

Thanks,

Mike Grogan
Meteorologist & Systems Engineer
WeatherFlow, Inc., Synoptic

indexer.xml:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?> time fileDate *the_geom:Polygon,location:String,time:java.util.Date,fileDate:java.util.Date surfacemore [0-9]{8} TimestampFileNameExtractorSPI fileDate

timeregex.properties:
regex=[0-9]{8}T[0-9]{9}Z(?!.*[0-9]{8}T[0-9]{9}Z.*)

file listing:
surfacemore_20140523T130000000Z.tiff
surfacemore_20140523T150000000Z.tiff

(note: same results without the surfacemore_ in front)


Learn Graph Databases - Download FREE O’Reilly Book
“Graph Databases” is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Hi Mike,
sorry for not having provided you an answer to the second question on Friday, but I have left the office just one minute before you sent it.

Good that you haven’t be blocked from that.

Daniele

···

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Fri, Jun 6, 2014 at 8:15 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

I guess that was a silly follow up question asked in haste … I just needed to play with the regex a little bit more …

(?<=Z_)([0-9]{3})

  • Mike

On Fri, Jun 6, 2014 at 12:52 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

Daniele, thanks for the quick reply! One additional question, what would the look like for the elevation dimension if my filename were to look like:

surfacemore_20140523T130000000Z_500.tiff

where the _500 is the elevation?

Thanks again!

  • Mike

On Fri, Jun 6, 2014 at 12:46 PM, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Hi Mike,

when using the indexer.xml there is no more need of the other regex.properties file… You just need to specify the regex in the collectors sections.

Therefore, similarly to what you did with fileData, you can do this (It’s just an example which also allows you to specify the format of the datetime):

time ... ... format=yyyyMMddHHmmss,regex=[0-9]{14} TimestampFileNameExtractorSPI time ...

Cheers,
Daniele

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Fri, Jun 6, 2014 at 6:23 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

I can’t seem to find any documentation for it yet, so I am following Simone’s presentation as well as investigating the code for adding custom dimensions using ImageMosaic and the new indexer.xml properties file.

[For reference, the presentation is at: http://www.slideshare.net/geosolutions/geoserver-for-spatiotemporal-data-handling-with-examples-for-metoc-and-remote-sensing]

I am able to get the custom dimensions to populate in my database table … but I am now struggling with the TIME dimension … a non-custom dimension. If I go the indexer.properties route, the time is picked up correctly. However, using indexer.xml, the time is not being picked up from my filenames.

For the “new” way of doing this with indexer.xml, where do I need to specify the regex for the time dimension and elevation dimension? Do they now go somewhere besides the regex .properties files?

For reference, my coverage/store is called “surfacemore”. My indexer.xml and timeregex.properties files are below, as is my file listing. I’m not sure they are correct, but I’m trying to follow the presentation and some of the code to make this work.

Thanks,

Mike Grogan
Meteorologist & Systems Engineer
WeatherFlow, Inc., Synoptic

indexer.xml:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?> time fileDate *the_geom:Polygon,location:String,time:java.util.Date,fileDate:java.util.Date surfacemore [0-9]{8} TimestampFileNameExtractorSPI fileDate

timeregex.properties:
regex=[0-9]{8}T[0-9]{9}Z(?!.*[0-9]{8}T[0-9]{9}Z.*)

file listing:
surfacemore_20140523T130000000Z.tiff
surfacemore_20140523T150000000Z.tiff

(note: same results without the surfacemore_ in front)


Learn Graph Databases - Download FREE O’Reilly Book
“Graph Databases” is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

No problem at all! I was just in a rush and didn’t think the follow-up question through before I sent it. I just needed to think about it for a minute.

Thanks,

MIke

···

On Mon, Jun 9, 2014 at 10:20 AM, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Hi Mike,
sorry for not having provided you an answer to the second question on Friday, but I have left the office just one minute before you sent it.

Good that you haven’t be blocked from that.

Daniele

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Fri, Jun 6, 2014 at 8:15 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

I guess that was a silly follow up question asked in haste … I just needed to play with the regex a little bit more …

(?<=Z_)([0-9]{3})

  • Mike

On Fri, Jun 6, 2014 at 12:52 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

Daniele, thanks for the quick reply! One additional question, what would the look like for the elevation dimension if my filename were to look like:

surfacemore_20140523T130000000Z_500.tiff

where the _500 is the elevation?

Thanks again!

  • Mike

On Fri, Jun 6, 2014 at 12:46 PM, Daniele Romagnoli <daniele.romagnoli@anonymised.com> wrote:

Hi Mike,

when using the indexer.xml there is no more need of the other regex.properties file… You just need to specify the regex in the collectors sections.

Therefore, similarly to what you did with fileData, you can do this (It’s just an example which also allows you to specify the format of the datetime):

time ... ... format=yyyyMMddHHmmss,regex=[0-9]{14} TimestampFileNameExtractorSPI time ...

Cheers,
Daniele

==
GeoServer Professional Services from the experts! Visit
http://goo.gl/NWWaa2 for more information.

Ing. Daniele Romagnoli
Senior Software Engineer

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Fri, Jun 6, 2014 at 6:23 PM, Mike Grogan <d.michael.grogan@anonymised.com> wrote:

I can’t seem to find any documentation for it yet, so I am following Simone’s presentation as well as investigating the code for adding custom dimensions using ImageMosaic and the new indexer.xml properties file.

[For reference, the presentation is at: http://www.slideshare.net/geosolutions/geoserver-for-spatiotemporal-data-handling-with-examples-for-metoc-and-remote-sensing]

I am able to get the custom dimensions to populate in my database table … but I am now struggling with the TIME dimension … a non-custom dimension. If I go the indexer.properties route, the time is picked up correctly. However, using indexer.xml, the time is not being picked up from my filenames.

For the “new” way of doing this with indexer.xml, where do I need to specify the regex for the time dimension and elevation dimension? Do they now go somewhere besides the regex .properties files?

For reference, my coverage/store is called “surfacemore”. My indexer.xml and timeregex.properties files are below, as is my file listing. I’m not sure they are correct, but I’m trying to follow the presentation and some of the code to make this work.

Thanks,

Mike Grogan
Meteorologist & Systems Engineer
WeatherFlow, Inc., Synoptic

indexer.xml:

<?xml version="1.0" encoding="UTF-8" standalone="yes"?> time fileDate *the_geom:Polygon,location:String,time:java.util.Date,fileDate:java.util.Date surfacemore [0-9]{8} TimestampFileNameExtractorSPI fileDate

timeregex.properties:
regex=[0-9]{8}T[0-9]{9}Z(?!.*[0-9]{8}T[0-9]{9}Z.*)

file listing:
surfacemore_20140523T130000000Z.tiff
surfacemore_20140523T150000000Z.tiff

(note: same results without the surfacemore_ in front)


Learn Graph Databases - Download FREE O’Reilly Book
“Graph Databases” is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users