Acessing the images catalog using Kubernetes #316
Unanswered
thaimunhoz
asked this question in
Q&A
Replies: 1 comment
-
I'll typically use tools like snakeviz or line-profile to see where time is being spent.
The profiling tools will tell you where time is being spent. If most of the time is spent on reading data (as I'm guessing) then the most important thing would be to put your compute in the same Azure region as the data (West Europe in the case of sentinel-2-l2a). That will maximize the bandwidth between the storage nodes and the Blob Storage service. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello.
I'm currently trying to access and process Sentinel-2 images using the Planetary catalog. In order to improve the scalable computing i'm using Dask in a kubernete. However, even with the use of Dask, accessing the images has taken a significant amount of time. Could anyone tell me how to improve processing performance outside of the Microsoft Hub?
I've tried different configurations in the K8S, but no success.
P.S.: I'm using a dask gateway cluster with the .adapt function (min = 4, max = 300).
This is the part of my code where I access the images:
Beta Was this translation helpful? Give feedback.
All reactions