Trying to download imagery via the hub api and it is really slow.
Is something down?
Hello,
Which API are you using? The Process API?
Best regards
Pontus
https://services.sentinel-hub.com/api/v1/process
passing a payload to extract the NDVI, using a boundary mask.
Been using this for over a year, today just seems very slow.
Using sentinel-2-l2a collection
Note: my usage is way below my account allowance.
Thank you for the information!
We currently aren’t experiencing any issues with the Process API. Please let me know if your issue persists until tomorrow and we will investigate your issue further.
Best regards
Pontus
Ill try again in the morning, but still having issues.
Requesting each image available for the the year, currently stuck on the date ‘2021-06-18 02:35:52’
2021-08-19 02:25:56
2021-08-17 02:35:54
2021-08-14 02:25:59
2021-08-12 02:35:52
2021-08-04 02:25:59
2021-08-02 02:35:53
2021-07-18 02:35:55
2021-07-10 02:25:58
2021-06-30 02:25:57
2021-06-25 02:25:58
2021-06-18 02:35:52
Are older images coming from some other storage?
Ill attached request now.
{‘request’: ‘{“input”: {“bounds”: {“properties”: {“crs”: “http://www.opengis.net/def/crs/OGC/1.3/CRS84”}, “geometry”: {“type”: “Polygon”, “coordinates”: }}, “data”: [{“type”: “S2L1C”, “dataFilter”: {“timeRange”: {“from”: “2021-06-15T00:00:00Z”, “to”: “2021-06-16T00:00:00Z”}}}]}, “output”: {“width”: 630.6666856931129, “height”: 512, “responses”: [{“identifier”: “default”, “format”: {“type”: “image/tiff”, “quality”: 80}}]}}’, ‘evalscript’: '//VERSION=3\nfunction setup() {\n return {\n input: [{\n bands:[“B08”, “B04”],\n }],\n output: {\n id: “default”,\n bands: 1,\n }\n }\n}\n\nfunction evaluatePixel(sample) {\n return [(sample.B08 - sample.B04) / (sample.B08 + sample.B04)]} '}
Im using quite a detailed coordinate array that i cant post due to size limits on here.
Having a detailed coordinate array will indeed take longer to execute, so that’s probably what you are experiencing in this case.
Best regards
Pontus
Hi again,
We want to investigate this a bit further. It would be great if you could give me some information about:
-
Is it the Sentinel2 L2A or L1C collection you’re using?
-
On average, how long do the slow requests take?
Best regards
Pontus
Hi Pontus,
Sorry it is the S2L1C.
Just ran a new download just then, you’ll see the all is going well, then one took 80 seconds (which with what I was seeing yesterday is actually pretty good)
2021-08-15 01:06:21 - 4.97 sec
2021-07-26 01:06:23 - 4.02 sec
2021-07-06 01:06:23 - 3.06 sec
2021-07-01 01:06:23 - 2.44 sec
2021-06-26 01:06:22 - 2.91 sec
2021-06-21 01:06:22 - 3.73 sec
2021-05-27 01:06:22 - 5.26 sec
2021-05-22 01:06:22 - 5.18 sec
2021-05-17 01:06:21 - 3.97 sec
2021-05-12 01:06:21 - 4.45 sec
2021-04-27 01:06:16 - 82.1 sec
2021-04-17 01:06:17 - 2.07 sec
2021-04-07 01:06:19 - 2.54 sec
2021-04-02 01:06:18 - 2.87 sec
2021-03-28 01:06:20 - 4.06 sec
2021-03-23 01:06:20 - 2.30 sec
2021-03-18 01:06:20 - 2.36 sec
2021-03-03 01:06:21 - 2.64 sec
2021-02-26 01:06:20 - 3.37 sec
2021-02-21 01:06:21 - 2.14 sec
2021-02-16 01:06:19 - 2.34 sec
2021-01-22 01:06:22 - 4.55 sec
2021-01-17 01:06:21 - 4.50 sec
2021-01-12 01:06:22 - 2.53 sec
2021-01-07 01:06:20 - 2.88 sec
2021-01-02 01:06:21 - 2.38 sec
Also another run, this time a 44 second and a 89 second:
2021-08-19 02:25:41 - 3.101 seconds
2021-08-17 02:35:43 - 4.848 seconds
2021-08-17 02:35:40 - 5.306 seconds
2021-08-14 02:25:49 - 2.295826 seconds
2021-08-14 02:25:44 - 44.46076 seconds
2021-08-12 02:35:41 - 4.04784 seconds
2021-08-12 02:35:38 - 2.14576 seconds
2021-08-04 02:25:49 - 3.105277 seconds
2021-08-04 02:25:45 - 4.31438 seconds
2021-08-02 02:35:42 - 4.84954 seconds
2021-08-02 02:35:39 - 3.949547 seconds
2021-07-25 02:25:50 - 2.7549 seconds
2021-07-25 02:25:45 - 2.673945 seconds
2021-07-18 02:35:41 - 4.60022 seconds
2021-07-18 02:35:39 - 4.40891 seconds
2021-07-10 02:25:44 - 5.84196 seconds
2021-07-08 02:35:40 - 3.65744 seconds
2021-06-30 02:25:47 - 3.04066 seconds
2021-06-30 02:25:43 - 2.70971 seconds
2021-06-28 02:35:42 - 4.366545 seconds
2021-06-28 02:35:39 - 16.12184 seconds
2021-06-25 02:25:48 - 3.860693 seconds
2021-06-25 02:25:43 - 2.172304 seconds
2021-06-18 02:35:41 - 5.30337 seconds
2021-06-18 02:35:38 - 3.572055 seconds
2021-06-15 02:25:47 - 89.1306 seconds
2021-06-15 02:25:42 - 4.32003 seconds
2021-06-13 02:35:42 - 4.05035 seconds
2021-06-13 02:35:39 - 2.2163 seconds
2021-06-05 02:25:47 - 2.44923 seconds
2021-06-05 02:25:43 - 4.68856 seconds
2021-06-03 02:35:42 - 3.43647 seconds
2021-06-03 02:35:38 - 3.32965 seconds
2021-05-31 02:25:47 - 2.485248 seconds
2021-05-31 02:25:43 - 2.551614 seconds
2021-05-21 02:25:46 - 3.29103 seconds
2021-05-21 02:25:42 - 3.170362 seconds
2021-05-19 02:35:38 - 2.17642 seconds
2021-05-19 02:35:36 - 2.707957 seconds
2021-05-09 02:35:40 - 3.900584 seconds
2021-05-09 02:35:37 - 3.418293 seconds
2021-05-01 02:25:42 - 2.930913 seconds
2021-04-26 02:25:43 - 4.07482 seconds
2021-04-26 02:25:38 - 5.30216 seconds
2021-04-24 02:35:35 - 3.03797 seconds
2021-04-24 02:35:32 - 5.36254 seconds
2021-04-21 02:25:41 - 2.976482 seconds
2021-04-21 02:25:36 - 4.69671 seconds
regards
I’m sure this cant be a coincidence, but generally we see a real slowdown when we are seeing 2 images for the same date.
I am using the https://services.sentinel-hub.com/api/v1/catalog/search to find available images and noticing quite a few times we get 2 images separated by seconds.
later when using the process api to get the images we see one of them is generally really slow.
just investigating further now
Hi,
could you explain a bit your processing chain for downloading the images?
Would it be possible to time every step of the processing separately maybe?
I am suspecting that delay is coming from something other then the rendering process.
I was able to pinpoint the timing of one of your long request on our rendering machines, however the rendering time was consistent with all other requests that you issued ( The rendering time for image dated 2021-04-27 01:06:16 was under 0.5 seconds ).
Best regards,
Rok
Hi rkosir,
All the times from the above posting is the time for the HTTP Post request to the https://services.sentinel-hub.com/api/v1/process api.
rkosir, please hold off any further investigations, I’ve rerun the same scenarios outside of our work network and seen much better results