To ensure continuous support of various Sentinel-2 browsers we have implemented a service, which will provide permanent access to the following meta-data:
Update 2018-08-06 - the date was wrongly listed as 2019. We corrected it to 2018. As it was always stated that things will happen in 2018, we hope that readers got the right info.
Yes, this service is part of Register of open data (RODA), AWSâ initiative. Access does not require any authentication and there are no charges attached.
In your example link above to list available products, the results are capped at 1,000 items. Reviewing the S3 docs [1], it seems like the âNextContinuationTokenâ value should be included as the request parameter âcontinuation-tokenâ in order to fetch the subsequent pages. When I tested it however, I always seem to get back the first page only. Is there something else needed to page the results or is the parameter maybe not being forwarded to S3 properly?
I am new to this. You state you have implemented a service to provide access the metadata - where is this service? I can only link to the examples. Iâm looking for tileInfo.jsons.
Hi Naoto,
I clicked the link you have provided and it works fine for me.
We have noticed that AWS Lambda sometimes simply does not work and we do not know, what is the reason for that. However, this happens rarely and few minutes later usually works fine.
Is the problem persisting?
Thanks a lot for your prompt reply!
Unfortunately, the problem remains and no access to âmetadata.xmlâ
Because of this problem, the download command (e.g., sentinelhub.aws --tile T54HVH 2017-04-14 -e) doesnât work.
I can access to âtileInfo.jsonâ and âproductInfo.jsonâ but no access to âmetadata.xmlâ and âpreview.jpgâ.
I will try alternative ways of downloading data.
Hi Eder,
as described in the first post in this thread, only meta-data are available over this interface. B8A.jp2 is not meta-data (see a list of available files on top).
For your case you need to use signed requests as described in this post, check options 1-4.
Hi,
I found that the last update of sentinelhub-py (vision = 2.4.1) on GitHub, and the config.json has changed from "aws_base_url": "http://sentinel-s2-l1c.s3.amazonaws.com/"
to "aws_metadata_base_url": "https://roda.sentinel-hub.com/"
and no âaws base urlâ anyway.
Is it means we cannot download S2 images as before by sentinelhub-py 2.4.1 because of these changes?
I have used the old version (2.0.1) to download image data (.jp2) successfully, which can replace the new version.
you are correct - older versions of sentinelhub-py are now outdated and cannot download S2 images from AWS anymore. sentinelhub-py serves only as an interface for download and the data is not available at âhttp://sentinel-s2-l1c.s3.amazonaws.com/â anymore. Therefore I recommend upgrading the package.
By the way, sentinelhub-py 2.4.2 has just been released with a few improvements in handling jpeg 2000 images.
But I canât download images by version 2.4.1, thereâs some bugs with connecting to AWS S3 buckets, and the url is âhttps://roda.sentinel-hub.comâ.
I assume the version 2.0.1 still works because you have set parameter "use_s3_l1c_bucket": true which then downloads everything from s3 bucket instead of âhttp://sentinel-s2-l1c.s3.amazonaws.com/â. In newer versions those metadata files which are available from âhttps://roda.sentinel-hub.comâ are downloaded from there, hence slightly less requests to s3.
It is possible that newer versions are causing you problems because we changed library for reading Jpeg 2000 images from OpenCV to Pillow. Even though Pillow doesnât raise errors during installation sometimes its capabilities to read Jpeg 2000 images donât get installed properly (especially on Windows). Hence installation from wheel is recommended.
Anyway if you will still have some problems with the newest version of sentinelhub-py please create a new thread on this forum about it or raise an issue on Github. We will be happy to help you resolve the problem.
Yes, I set "use_s3_l1c_bucket" as true, and filled my aws id and key in "aws_access_key_id" and "aws_secret_access_key". Then I can download anything in S3.
Is that means I can download metadata only in âhttps://roda.sentinel-hub.comâ? Then I need to write a new program to access S3 to download jp2 images.
Everything else, jp2 images included, will still be downloaded from s3 just like before. Only those metadata files which are available at âhttps://roda.sentinel-hub.comâ will be downloaded from there. This is all handled internally by sentinelhub-py, hence your code would still work without having to make any changes.
