How to access S-2 meta-data in AWS after bucket goes to Requester pays?

Hi @pablotcarreira,

I tried accessing the link you provided and it works fine. Is it possible that this service was temporarily unavailable when you tried to access the file?

This happens in some cases but only in limited AWS regions. We do not yet know the reason for this error and are looking into it.
Usually though it works soon after.

Ok, thank you for the quick response. Iā€™m accessing from Brazil and Iā€™m still getting the error, Iā€™ll try again later.
Edit: I tried accessing the address from an Ec2 instance in Ohio, Zona A and it worked.

Hi @pablotcarreira and @geoinformatics2018,
can you please try, if the access to meta-data now works from your location?
e.g.
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/1/K/AT/2018/7/20/0/tileInfo.json
or

Thanks,
Grega

Hi Grega,

Thanks for your effort!
I can access to ā€œtileInfo.jsonā€, ā€œproductInfo.jsonā€, and ā€œpreview.jpgā€ but still no access to ā€œmetadata.xmlā€.
Iā€™m from Japan.

Naoto

Hi, tested at 14:25 utc for two scenes. tileInfo.json works and metadata.xml return Error 503.

Tests:

https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/16/R/BV/2018/4/16/0/tileInfo.json OK
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/16/R/BV/2018/4/16/0/metadata.xml ERROR
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/1/K/AT/2018/7/20/0/tileInfo.json OK
https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/1/K/AT/2018/7/20/0/metadata.xml ERROR

The Error is:

503 ERROR
The request could not be satisfied.
The Lambda function associated with the CloudFront distribution is invalid or doesnā€™t have the required permissions.
If you received this error while trying to use an app or access a website, please contact the provider or website owner for assistance.
If you provide content to customers through CloudFront, you can find steps to troubleshoot and help prevent this error by following steps in the CloudFront documentation (http://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/http-503-service-unavailable.html).

Generated by cloudfront (CloudFront)
Request ID: ba7JhQYbdPvUXe2osi0UDDhrwWiRLvibHlflNRAAZ_xv6kPZQg-k9g==

Can you try one more time? Thanks.

I can access to metadata.xml now!!
Many thanks for your great work.

1 Like

metadata.xml is working now. Thanks!

Hello everydbody.
I have access to metadata.xml but I need also, as before the requester pays changes, the access to product metadata.xml.
I trying to access via AWS CLI but the results is this:
aws s3 cp s3://sentinel-s2-l1c/tiles/32/T/QM/2018/9/8/0/productmetadata.xml C:\Users\User\Desktop\prova\productmetadata.xml --region eu-central-1 --request-payer requester
fatal error: An error occurred (404) when calling the HeadObject operation: Key ā€œtiles/32/T/QM/2018/9/8/0/productmetadata.xmlā€ does not exist

Does anybody know where the product metadata is?

Hello,

metadata for your tile is here: https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/32/T/QM/2018/9/8/0/metadata.xml

Metadata files are not in requester pays buckets

No, I am not looking for the metadata.xml, I am looking for the file productmetadata.xml, which is different because it contains (better, It was containing before the requester aws changes) all the radiometric informations about bands and much more.
It was locate, before the pays changes, here: http://sentinel-s2-l1c.s3.amazonaws.com/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/productmetadata.xml (it an exampleā€¦)
anybody can help me?
thanks you a lot

Are you maybe referring to this file:
s3://sentinel-s2-l1c/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/datastrip/0/metadata.xml

productmetadata.xml doesnā€™t ring a bell to me

Dear rksoir!
Yes, Here i find the data that interest me, that are solar irradiance values, quantification value, physical gain etcā€¦So thank you! I am very happy.
But, before the request changes, I was downloading very small size productmetadata.xml with the values i needā€¦
But at moment it is ok, I hope. Thank you!

Are you referring to productInfo.json file? This is available also now. There was never ā€œproductmetadata.xmlā€ file available on AWS.

Dear all,

I was looking for to this product (here thereā€™s an image of Sentinel Esa Products Guide)

and, on this product I was interested in these values (quantification values, solar irradianceā€¦)

Iā€™m sorry, the name ā€œproductmetadata.xmlā€ was only a rename that I used. Sorry.
Anyway, the product I was looking for it is the one in the last screenshot image.

Dear all,
I think at the moment I am ok. Changing the url strip, I was able to find the metdata.xml I was looking for. s3://sentinel-s2-l1c/products/2018/9/8/S2B_MSIL1C_20180908T100019_N0206_R122_T32TQM_20180908T135059/metadata.xml

Thanks to all for your great help.

A post was merged into an existing topic: Sentinel s2 l1c - 502 error by cloudfront - Unable to access meta-files and preview image from http

I am happy that you provide permanent open access to the Sentinel-2 L1C meta-data as announced above.

Indeed I use your json url interface to check for product availability. By and large it works fine.
However, there are rare cases when roda. sentinel-hub. com responds no product (KeyCount: 0) when there is actual product on the official Copernicus sci-hub.

e.g.: https://roda.sentinel-hub.com/sentinel-s2-l1c/tiles/32/S/MJ/2017/9/16/

(at Copernicus sci-hub the quicklook when download is called:
S2B_MSIL1C_20170919T102009_N0205_R065_T32SMJ_20170919T102557-ql.jpg)

Q: if I supply a list of such missing items would it possible for their meta-data to be restored to roda. sentinel-hub .com ?

Sincerely

G Brelstaff CRS4 Sardinia

Hi @gjb.crs4,
we will look into it but I cannot promise, when this will happen. We are spending significant resources to have the data synced at all so these kind of rare problems are of lower priority, especially if related to the old data.