How to access S-2 meta-data in AWS after bucket goes to Requester pays?

Hi @maleksandrov,

Yes, I set "use_s3_l1c_bucket" as true, and filled my aws id and key in "aws_access_key_id" and "aws_secret_access_key". Then I can download anything in S3.

Is that means I can download metadata only in “https://roda.sentinel-hub.com”? Then I need to write a new program to access S3 to download jp2 images.

Regards

Everything else, jp2 images included, will still be downloaded from s3 just like before. Only those metadata files which are available at “https://roda.sentinel-hub.com” will be downloaded from there. This is all handled internally by sentinelhub-py, hence your code would still work without having to make any changes.

Hi, when I try to download images, when sentinelhub.aws try to get the metadata I get the error:

503 ERROR
The request could not be satisfied.

Even if I access the example (https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/16/R/BV/2018/4/16/0/metadata.xml) directly from the browser I get the same error.

Hi @pablotcarreira,

I tried accessing the link you provided and it works fine. Is it possible that this service was temporarily unavailable when you tried to access the file?

This happens in some cases but only in limited AWS regions. We do not yet know the reason for this error and are looking into it.
Usually though it works soon after.

Ok, thank you for the quick response. I’m accessing from Brazil and I’m still getting the error, I’ll try again later.
Edit: I tried accessing the address from an Ec2 instance in Ohio, Zona A and it worked.

Hi @pablotcarreira and @geoinformatics2018,
can you please try, if the access to meta-data now works from your location?
e.g.
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/1/K/AT/2018/7/20/0/tileInfo.json
or

Thanks,
Grega

Hi Grega,

Thanks for your effort!
I can access to “tileInfo.json”, “productInfo.json”, and “preview.jpg” but still no access to “metadata.xml”.
I’m from Japan.

Naoto

Hi, tested at 14:25 utc for two scenes. tileInfo.json works and metadata.xml return Error 503.

Tests:

https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/16/R/BV/2018/4/16/0/tileInfo.json OK
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/16/R/BV/2018/4/16/0/metadata.xml ERROR
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/1/K/AT/2018/7/20/0/tileInfo.json OK
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/1/K/AT/2018/7/20/0/metadata.xml ERROR

The Error is:

503 ERROR
The request could not be satisfied.
The Lambda function associated with the CloudFront distribution is invalid or doesn’t have the required permissions.
If you received this error while trying to use an app or access a website, please contact the provider or website owner for assistance.
If you provide content to customers through CloudFront, you can find steps to troubleshoot and help prevent this error by following steps in the CloudFront documentation (http://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/http-503-service-unavailable.html).

Generated by cloudfront (CloudFront)
Request ID: ba7JhQYbdPvUXe2osi0UDDhrwWiRLvibHlflNRAAZ_xv6kPZQg-k9g==

Can you try one more time? Thanks.

I can access to metadata.xml now!!
Many thanks for your great work.

1 Like

metadata.xml is working now. Thanks!

Hello everydbody.
I have access to metadata.xml but I need also, as before the requester pays changes, the access to product metadata.xml.
I trying to access via AWS CLI but the results is this:
aws s3 cp s3://sentinel-s2-l1c/tiles/32/T/QM/2018/9/8/0/productmetadata.xml C:\Users\User\Desktop\prova\productmetadata.xml --region eu-central-1 --request-payer requester
fatal error: An error occurred (404) when calling the HeadObject operation: Key “tiles/32/T/QM/2018/9/8/0/productmetadata.xml” does not exist

Does anybody know where the product metadata is?

Hello,

metadata for your tile is here: https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/32/T/QM/2018/9/8/0/metadata.xml

Metadata files are not in requester pays buckets

No, I am not looking for the metadata.xml, I am looking for the file productmetadata.xml, which is different because it contains (better, It was containing before the requester aws changes) all the radiometric informations about bands and much more.
It was locate, before the pays changes, here: http://sentinel-s2-l1c.s3.amazonaws.com/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/productmetadata.xml (it an example…)
anybody can help me?
thanks you a lot

Are you maybe referring to this file:
s3://sentinel-s2-l1c/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/datastrip/0/metadata.xml

productmetadata.xml doesn’t ring a bell to me

Dear rksoir!
Yes, Here i find the data that interest me, that are solar irradiance values, quantification value, physical gain etc…So thank you! I am very happy.
But, before the request changes, I was downloading very small size productmetadata.xml with the values i need…
But at moment it is ok, I hope. Thank you!

Are you referring to productInfo.json file? This is available also now. There was never “productmetadata.xml” file available on AWS.

Dear all,

I was looking for to this product (here there’s an image of Sentinel Esa Products Guide)

and, on this product I was interested in these values (quantification values, solar irradiance…)

I’m sorry, the name “productmetadata.xml” was only a rename that I used. Sorry.
Anyway, the product I was looking for it is the one in the last screenshot image.

Dear all,
I think at the moment I am ok. Changing the url strip, I was able to find the metdata.xml I was looking for. s3://sentinel-s2-l1c/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/metadata.xml

Thanks to all for your great help.