[Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com
http://lists.osgeo.org/mailman/listinfo/gdal-dev

Hi Ammar,
have you checked that the original geotiff tiles have a white border or a nodata border?

···

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Sun, Jan 12, 2014 at 7:31 PM, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com926…
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

···

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com926…
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Hi Ammar.
Please keep the discussion on-list, that way prospectively others can help too.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

···

If the data does it in QGIS too then it’s almost certainly a no-data issue. I can’t suggest how to resolve that as I don’t know anything about your dataset.

Regards,
Jonathan

On 14 January 2014 11:10, Ammar <ammar83_h@anonymised.com> wrote:

Jonathan,

First, I am really sorry about the last name thing. Probably I was working like a mule at the time I created the post.

When I load the files directly into QGIS, I get the same white lines and distortions. When zooming in, the lines disappear at certain levels then after zooming in more, I get them back! It is like they are coming and going. The thing is, the lines happen exactly at the borders of each of the 21 merged Images!

Any ideas?

Regards,
Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@anonymised.comts.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Monday, January 13, 2014 4:44 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

Hello Jonathan,

I merged all the files in one huge BIGTIFF image (700000 x 656000) and it came out perfect with no gaps, lines or distortions. The problem with this approach is that I tried to create overviews for the image and it took 4 continuous days of gdaladdo running without any progress until I had to cancel the gdaladdo operation.

So, what I am saying is, the original images don’t have gaps or no data in them. I am suspecting that the problem occurs because of gdaladdo. I have tested on smaller images, with and without overviews and the images that have no overviews came perfect with no lines or gaps!

Any ideas, tips or suggestions on other options or alternatives methods to creating overviews by gdaladdo?

//Ammar


From: Jonathan Moules jonathanmoules@anonymised.com
To: Ammar ammar83_h@anonymised.com; geoserver-users@anonymised.comt
Sent: Tuesday, January 14, 2014 12:17 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar.
Please keep the discussion on-list, that way prospectively others can help too.

If the data does it in QGIS too then it’s almost certainly a no-data issue. I can’t suggest how to resolve that as I don’t know anything about your dataset.

Regards,
Jonathan

On 14 January 2014 11:10, Ammar <ammar83_h@anonymised.com> wrote:

Jonathan,

First, I am really sorry about the last name thing. Probably I was working like a mule at the time I created the post.

When I load the files directly into QGIS, I get the same white lines and distortions. When zooming in, the lines disappear at certain levels then after zooming in more, I get them back! It is like they are coming and going. The thing is, the lines happen exactly at the borders of each of the 21 merged Images!

Any ideas?

Regards,
Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Monday, January 13, 2014 4:44 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com.
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

Hi Ammar,

The problem with this approach is that I tried to create overviews for the image and it took 4 continuous days of gdaladdo running without any progress until I had to cancel the gdaladdo operation.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

···

That’s a known “limitation” of Gdal. It can’t handle large files well when pyramiding/overviewing.

I’m afraid I’m not sure what the issue with the white lines is though. Maybe someone else does?

Jonathan

Hello list,

The white lines problem has been solved by using a lossless compression, in my case LZW with a predictor of 2. Now, when I am loading the 21 images into a software such as QGIS, I get a perfect image (screen shot #1) but when I upload the images into GeoServer and put them either in a layer group or in an Image Mosaic, I get strips of white tiles (screen shot #2).

Any ideas?

//Ammar


From: Ammar ammar83_h@anonymised.com
To: Jonathan Moules jonathanmoules@anonymised.com; “geoserver-users@anonymised.comeforge.netgeoserver-users@lists.sourceforge.net
Sent: Tuesday, January 21, 2014 12:40 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hello Jonathan,

I merged all the files in one huge BIGTIFF image (700000 x 656000) and it came out perfect with no gaps, lines or distortions. The problem with this approach is that I tried to create overviews for the image and it took 4 continuous days of gdaladdo running without any progress until I had to cancel the gdaladdo operation.

So, what I am saying is, the original images don’t have gaps or no data in them. I am suspecting that the problem occurs because of gdaladdo. I have tested on smaller images, with and without overviews and the images that have no overviews came perfect with no lines or gaps!

Any ideas, tips or suggestions on other options or alternatives methods to creating overviews by gdaladdo?

//Ammar


From: Jonathan Moules jonathanmoules@anonymised.com
To: Ammar ammar83_h@anonymised.com; geoserver-users@anonymised.comurceforge.net
Sent: Tuesday, January 14, 2014 12:17 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar.
Please keep the discussion on-list, that way prospectively others can help too.

If the data does it in QGIS too then it’s almost certainly a no-data issue. I can’t suggest how to resolve that as I don’t know anything about your dataset.

Regards,
Jonathan

On 14 January 2014 11:10, Ammar <ammar83_h@anonymised.com> wrote:

Jonathan,

First, I am really sorry about the last name thing. Probably I was working like a mule at the time I created the post.

When I load the files directly into QGIS, I get the same white lines and distortions. When zooming in, the lines disappear at certain levels then after zooming in more, I get them back! It is like they are coming and going. The thing is, the lines happen exactly at the borders of each of the 21 merged Images!

Any ideas?

Regards,
Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Monday, January 13, 2014 4:44 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com.
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

1.jpeg

2.jpeg

Hi Ammar,
from the screenshot it seems to me like some granules are missing from the mosaic. Is that possible? Or maybe the imagesa are overlapping?

Can you please send a screenshot with the granules seamlines on top of it? (This is easily doable by loading the mosaic index as a vectorial layer on GeoServer)

Alessio.

···

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Sun, Jan 26, 2014 at 9:13 PM, Ammar <ammar83_h@anonymised.com> wrote:

Hello list,

The white lines problem has been solved by using a lossless compression, in my case LZW with a predictor of 2. Now, when I am loading the 21 images into a software such as QGIS, I get a perfect image (screen shot #1) but when I upload the images into GeoServer and put them either in a layer group or in an Image Mosaic, I get strips of white tiles (screen shot #2).

Any ideas?

//Ammar


From: Ammar <ammar83_h@anonymised.com>
To: Jonathan Moules <jonathanmoules@anonymised.com>; “geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Tuesday, January 21, 2014 12:40 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hello Jonathan,

I merged all the files in one huge BIGTIFF image (700000 x 656000) and it came out perfect with no gaps, lines or distortions. The problem with this approach is that I tried to create overviews for the image and it took 4 continuous days of gdaladdo running without any progress until I had to cancel the gdaladdo operation.

So, what I am saying is, the original images don’t have gaps or no data in them. I am suspecting that the problem occurs because of gdaladdo. I have tested on smaller images, with and without overviews and the images that have no overviews came perfect with no lines or gaps!

Any ideas, tips or suggestions on other options or alternatives methods to creating overviews by gdaladdo?

//Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>; geoserver-users@lists.sourceforge.net
Sent: Tuesday, January 14, 2014 12:17 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar.
Please keep the discussion on-list, that way prospectively others can help too.

If the data does it in QGIS too then it’s almost certainly a no-data issue. I can’t suggest how to resolve that as I don’t know anything about your dataset.

Regards,
Jonathan

On 14 January 2014 11:10, Ammar <ammar83_h@anonymised.com> wrote:

Jonathan,

First, I am really sorry about the last name thing. Probably I was working like a mule at the time I created the post.

When I load the files directly into QGIS, I get the same white lines and distortions. When zooming in, the lines disappear at certain levels then after zooming in more, I get them back! It is like they are coming and going. The thing is, the lines happen exactly at the borders of each of the 21 merged Images!

Any ideas?

Regards,
Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Monday, January 13, 2014 4:44 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@anonymised.comsts.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Alessio,

Thank you for your reply. At first, I thought there are some granules missing from the mosaic but now after looking at the mosaic index, it seems that the images are overlapping! Please take a look at the attached screen shot and tell me if they are clear and I added the index the right way or if I need to re-take another snapshots!

Regards,
Ammar


From: Alessio Fabiani alessio.fabiani@anonymised.com
To: Ammar ammar83_h@anonymised.com
Cc:geoserver-users@lists.sourceforge.netgeoserver-users@lists.sourceforge.net
Sent: Monday, January 27, 2014 10:06 AM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,
from the screenshot it seems to me like some granules are missing from the mosaic. Is that possible? Or maybe the imagesa are overlapping?

Can you please send a screenshot with the granules seamlines on top of it? (This is easily doable by loading the mosaic index as a vectorial layer on GeoServer)

Alessio.

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Sun, Jan 26, 2014 at 9:13 PM, Ammar <ammar83_h@anonymised.com> wrote:

Hello list,

The white lines problem has been solved by using a lossless compression, in my case LZW with a predictor of 2. Now, when I am loading the 21 images into a software such as QGIS, I get a perfect image (screen shot #1) but when I upload the images into GeoServer and put them either in a layer group or in an Image Mosaic, I get strips of white tiles (screen shot #2).

Any ideas?

//Ammar


From: Ammar <ammar83_h@anonymised.com>
To: Jonathan Moules <jonathanmoules@anonymised.com942…>; “geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Tuesday, January 21, 2014 12:40 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hello Jonathan,

I merged all the files in one huge BIGTIFF image (700000 x 656000) and it came out perfect with no gaps, lines or distortions. The problem with this approach is that I tried to create overviews for the image and it took 4 continuous days of gdaladdo running without any progress until I had to cancel the gdaladdo operation.

So, what I am saying is, the original images don’t have gaps or no data in them. I am suspecting that the problem occurs because of gdaladdo. I have tested on smaller images, with and without overviews and the images that have no overviews came perfect with no lines or gaps!

Any ideas, tips or suggestions on other options or alternatives methods to creating overviews by gdaladdo?

//Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>; geoserver-users@lists.sourceforge.net
Sent: Tuesday, January 14, 2014 12:17 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar.
Please keep the discussion on-list, that way prospectively others can help too.

If the data does it in QGIS too then it’s almost certainly a no-data issue. I can’t suggest how to resolve that as I don’t know anything about your dataset.

Regards,
Jonathan

On 14 January 2014 11:10, Ammar <ammar83_h@anonymised.com> wrote:

Jonathan,

First, I am really sorry about the last name thing. Probably I was working like a mule at the time I created the post.

When I load the files directly into QGIS, I get the same white lines and distortions. When zooming in, the lines disappear at certain levels then after zooming in more, I get them back! It is like they are coming and going. The thing is, the lines happen exactly at the borders of each of the 21 merged Images!

Any ideas?

Regards,
Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Monday, January 13, 2014 4:44 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com.
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

index1.jpeg

index2.jpeg

Hello Ammar,
sorry for the delay.

Looking at your screenshots my guess is that the overlapping granules may have the nodata not correctly setted, and in any case my understanding is that in your mosaic you have configured the transparency on black color but the white nodata sections overlapping are opaque, and so generating such strange white lines effect.

Alessio.

···

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Mon, Jan 27, 2014 at 11:42 AM, Ammar <ammar83_h@anonymised.com> wrote:

Alessio,

Thank you for your reply. At first, I thought there are some granules missing from the mosaic but now after looking at the mosaic index, it seems that the images are overlapping! Please take a look at the attached screen shot and tell me if they are clear and I added the index the right way or if I need to re-take another snapshots!

Regards,
Ammar


From: Alessio Fabiani <alessio.fabiani@anonymised.com>

To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@anonymised.comt>

Sent: Monday, January 27, 2014 10:06 AM

Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,
from the screenshot it seems to me like some granules are missing from the mosaic. Is that possible? Or maybe the imagesa are overlapping?

Can you please send a screenshot with the granules seamlines on top of it? (This is easily doable by loading the mosaic index as a vectorial layer on GeoServer)

Alessio.

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Sun, Jan 26, 2014 at 9:13 PM, Ammar <ammar83_h@anonymised.com> wrote:

Hello list,

The white lines problem has been solved by using a lossless compression, in my case LZW with a predictor of 2. Now, when I am loading the 21 images into a software such as QGIS, I get a perfect image (screen shot #1) but when I upload the images into GeoServer and put them either in a layer group or in an Image Mosaic, I get strips of white tiles (screen shot #2).

Any ideas?

//Ammar


From: Ammar <ammar83_h@anonymised.com…>
To: Jonathan Moules <jonathanmoules@anonymised.com>; “geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Tuesday, January 21, 2014 12:40 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hello Jonathan,

I merged all the files in one huge BIGTIFF image (700000 x 656000) and it came out perfect with no gaps, lines or distortions. The problem with this approach is that I tried to create overviews for the image and it took 4 continuous days of gdaladdo running without any progress until I had to cancel the gdaladdo operation.

So, what I am saying is, the original images don’t have gaps or no data in them. I am suspecting that the problem occurs because of gdaladdo. I have tested on smaller images, with and without overviews and the images that have no overviews came perfect with no lines or gaps!

Any ideas, tips or suggestions on other options or alternatives methods to creating overviews by gdaladdo?

//Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>; geoserver-users@lists.sourceforge.net
Sent: Tuesday, January 14, 2014 12:17 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar.
Please keep the discussion on-list, that way prospectively others can help too.

If the data does it in QGIS too then it’s almost certainly a no-data issue. I can’t suggest how to resolve that as I don’t know anything about your dataset.

Regards,
Jonathan

On 14 January 2014 11:10, Ammar <ammar83_h@anonymised.com> wrote:

Jonathan,

First, I am really sorry about the last name thing. Probably I was working like a mule at the time I created the post.

When I load the files directly into QGIS, I get the same white lines and distortions. When zooming in, the lines disappear at certain levels then after zooming in more, I get them back! It is like they are coming and going. The thing is, the lines happen exactly at the borders of each of the 21 merged Images!

Any ideas?

Regards,
Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Monday, January 13, 2014 4:44 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Alessio,

Thank you very much for your reply.

Is there anyway to solve this problem? Any recommendations or suggestions?

Regards,
Ammar


From: Alessio Fabiani alessio.fabiani@anonymised.com
To: Ammar <ammar83_h@anonymised.com…>
Cc:geoserver-users@lists.sourceforge.netgeoserver-users@lists.sourceforge.net
Sent: Wednesday, January 29, 2014 10:51 AM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hello Ammar,
sorry for the delay.

Looking at your screenshots my guess is that the overlapping granules may have the nodata not correctly setted, and in any case my understanding is that in your mosaic you have configured the transparency on black color but the white nodata sections overlapping are opaque, and so generating such strange white lines effect.

Alessio.

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Mon, Jan 27, 2014 at 11:42 AM, Ammar <ammar83_h@anonymised.com> wrote:

Alessio,

Thank you for your reply. At first, I thought there are some granules missing from the mosaic but now after looking at the mosaic index, it seems that the images are overlapping! Please take a look at the attached screen shot and tell me if they are clear and I added the index the right way or if I need to re-take another snapshots!

Regards,
Ammar


From: Alessio Fabiani <alessio.fabiani@anonymised.com>

To: Ammar <ammar83_h@anonymised.com.>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>

Sent: Monday, January 27, 2014 10:06 AM

Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,
from the screenshot it seems to me like some granules are missing from the mosaic. Is that possible? Or maybe the imagesa are overlapping?

Can you please send a screenshot with the granules seamlines on top of it? (This is easily doable by loading the mosaic index as a vectorial layer on GeoServer)

Alessio.

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Sun, Jan 26, 2014 at 9:13 PM, Ammar <ammar83_h@anonymised.com> wrote:

Hello list,

The white lines problem has been solved by using a lossless compression, in my case LZW with a predictor of 2. Now, when I am loading the 21 images into a software such as QGIS, I get a perfect image (screen shot #1) but when I upload the images into GeoServer and put them either in a layer group or in an Image Mosaic, I get strips of white tiles (screen shot #2).

Any ideas?

//Ammar


From: Ammar <ammar83_h@anonymised.com>
To: Jonathan Moules <jonathanmoules@anonymised.com>; “geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Tuesday, January 21, 2014 12:40 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hello Jonathan,

I merged all the files in one huge BIGTIFF image (700000 x 656000) and it came out perfect with no gaps, lines or distortions. The problem with this approach is that I tried to create overviews for the image and it took 4 continuous days of gdaladdo running without any progress until I had to cancel the gdaladdo operation.

So, what I am saying is, the original images don’t have gaps or no data in them. I am suspecting that the problem occurs because of gdaladdo. I have tested on smaller images, with and without overviews and the images that have no overviews came perfect with no lines or gaps!

Any ideas, tips or suggestions on other options or alternatives methods to creating overviews by gdaladdo?

//Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>; geoserver-users@lists.sourceforge.net
Sent: Tuesday, January 14, 2014 12:17 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar.
Please keep the discussion on-list, that way prospectively others can help too.

If the data does it in QGIS too then it’s almost certainly a no-data issue. I can’t suggest how to resolve that as I don’t know anything about your dataset.

Regards,
Jonathan

On 14 January 2014 11:10, Ammar <ammar83_h@anonymised.com> wrote:

Jonathan,

First, I am really sorry about the last name thing. Probably I was working like a mule at the time I created the post.

When I load the files directly into QGIS, I get the same white lines and distortions. When zooming in, the lines disappear at certain levels then after zooming in more, I get them back! It is like they are coming and going. The thing is, the lines happen exactly at the borders of each of the 21 merged Images!

Any ideas?

Regards,
Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Monday, January 13, 2014 4:44 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com.
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Well to be honest is not very easy to suggest something specific without knowing the dataset and the environment.

One thing you can try to do is to add to the gdal_translate string also the NODATA parameter in order to set the nodata values on the granules.

An example usage

gdal_translate –a_srs … -a_nodata -32636 -co “TILED=YES” -co “BLOCKXSIZE=512” –co “BLOCKYSIZE=512” in.tif out.tif

(the exact parameters/values depend on your specific needs)

Let me know if this helps to solve the issue.

···

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Wed, Jan 29, 2014 at 12:32 PM, Ammar <ammar83_h@anonymised.com> wrote:

Alessio,

Thank you very much for your reply.

Is there anyway to solve this problem? Any recommendations or suggestions?

Regards,
Ammar


From: Alessio Fabiani <alessio.fabiani@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@anonymised.comts.sourceforge.net” <geoserver-users@lists.sourceforge.net>

Sent: Wednesday, January 29, 2014 10:51 AM

Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hello Ammar,
sorry for the delay.

Looking at your screenshots my guess is that the overlapping granules may have the nodata not correctly setted, and in any case my understanding is that in your mosaic you have configured the transparency on black color but the white nodata sections overlapping are opaque, and so generating such strange white lines effect.

Alessio.

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Mon, Jan 27, 2014 at 11:42 AM, Ammar <ammar83_h@anonymised.com> wrote:

Alessio,

Thank you for your reply. At first, I thought there are some granules missing from the mosaic but now after looking at the mosaic index, it seems that the images are overlapping! Please take a look at the attached screen shot and tell me if they are clear and I added the index the right way or if I need to re-take another snapshots!

Regards,
Ammar


From: Alessio Fabiani <alessio.fabiani@anonymised.com>

To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>

Sent: Monday, January 27, 2014 10:06 AM

Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,
from the screenshot it seems to me like some granules are missing from the mosaic. Is that possible? Or maybe the imagesa are overlapping?

Can you please send a screenshot with the granules seamlines on top of it? (This is easily doable by loading the mosaic index as a vectorial layer on GeoServer)

Alessio.

==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information.

Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead

GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it


On Sun, Jan 26, 2014 at 9:13 PM, Ammar <ammar83_h@anonymised.com> wrote:

Hello list,

The white lines problem has been solved by using a lossless compression, in my case LZW with a predictor of 2. Now, when I am loading the 21 images into a software such as QGIS, I get a perfect image (screen shot #1) but when I upload the images into GeoServer and put them either in a layer group or in an Image Mosaic, I get strips of white tiles (screen shot #2).

Any ideas?

//Ammar


From: Ammar <ammar83_h@anonymised.com…>
To: Jonathan Moules <jonathanmoules@anonymised.com>; “geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Tuesday, January 21, 2014 12:40 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hello Jonathan,

I merged all the files in one huge BIGTIFF image (700000 x 656000) and it came out perfect with no gaps, lines or distortions. The problem with this approach is that I tried to create overviews for the image and it took 4 continuous days of gdaladdo running without any progress until I had to cancel the gdaladdo operation.

So, what I am saying is, the original images don’t have gaps or no data in them. I am suspecting that the problem occurs because of gdaladdo. I have tested on smaller images, with and without overviews and the images that have no overviews came perfect with no lines or gaps!

Any ideas, tips or suggestions on other options or alternatives methods to creating overviews by gdaladdo?

//Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>; geoserver-users@lists.sourceforge.net
Sent: Tuesday, January 14, 2014 12:17 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar.
Please keep the discussion on-list, that way prospectively others can help too.

If the data does it in QGIS too then it’s almost certainly a no-data issue. I can’t suggest how to resolve that as I don’t know anything about your dataset.

Regards,
Jonathan

On 14 January 2014 11:10, Ammar <ammar83_h@anonymised.com> wrote:

Jonathan,

First, I am really sorry about the last name thing. Probably I was working like a mule at the time I created the post.

When I load the files directly into QGIS, I get the same white lines and distortions. When zooming in, the lines disappear at certain levels then after zooming in more, I get them back! It is like they are coming and going. The thing is, the lines happen exactly at the borders of each of the 21 merged Images!

Any ideas?

Regards,
Ammar


From: Jonathan Moules <jonathanmoules@anonymised.com>
To: Ammar <ammar83_h@anonymised.com>
Cc:geoserver-users@lists.sourceforge.net” <geoserver-users@lists.sourceforge.net>
Sent: Monday, January 13, 2014 4:44 PM
Subject: Re: [Geoserver-users] White lines in merged GeoTIFF files after ImageMosaicing

Hi Ammar,

The commands that I used are: (recommended by Jonathan Mule)

That’s an original spelling of my last name. :wink:

Do the images mosaic together neatly in something like QGIS when loaded as separate files? There may be whitespace as Alessio says. Does the whitespace appear/disappear as you zoom in/out?
Cheers,
Jonathan

On 12 January 2014 18:31, Ammar <ammar83_h@anonymised.com> wrote:

Dear list,

I have merged 21 GeoTIFF images using GDAL utilities. Each image is the result of merging 500 smaller tiles. I am using ImageMosaic in Geoserver but I am getting a mosaic that contains white lines

What could be the reason behind having those white lines?

The commands that I used are: (recommended by Jonathan Mule)

gdalbuildvrt -srcnodata 255 -vrtnodata 255 -a_srs EPSG:27700 -input_file_list tiff_list.txt mosaic.vrt

gdal_translate -of GTiff -co TILED=YES -co BIGTIFF=YES -co COMPRESS=JPEG -co JPEG_QUALITY=80 -co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co PHOTOMETRIC=YCBCR mosaic.vrt mosaic.tif

gdaladdo mosaic.tif -r average --config COMPRESS_OVERVIEW JPEG --config JPEG_QUALITY_OVERVIEW 60 --config INTERLEAVE_OVERVIEW PIXEL --config PHOTOMETRIC_OVERVIEW YCBCR 2 4 8 16 32 64 128 256 512

Thank you in advance

//Ammar


gdal-dev mailing list
gdal-dev@anonymised.com
http://lists.osgeo.org/mailman/listinfo/gdal-dev


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.

This transmission is intended for the named addressee(s) only and may contain sensitive or protectively marked material up to RESTRICTED and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All email traffic sent to or from us, including without limitation all GCSX traffic, may be subject to recording and/or monitoring in accordance with relevant legislation.


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users


CenturyLink Cloud: The Leader in Enterprise Cloud Services.
Learn Why More Businesses Are Choosing CenturyLink Cloud For
Critical Workloads, Development Environments & Everything In Between.
Get a Quote or Start a Free Trial Today.
http://pubads.g.doubleclick.net/gampad/clk?id=119420431&iu=/4140/ostg.clktrk


Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users