You actually configure the datasource in exactly the same manner as for Sentinel. The difference is only in how you use it within your app then.
There, you need to change the URL of the WMS end-point.
E.g. if you copy this from Dashboard:
you change it to
If you login to EO Browser with your username, you should be able to access your configurations by selecting “Themes” at the left bottom part, under the rest of the data sources.
That being said, I am not 100% sure it works for non-Sentinel data sources as it was designed prior to multi-system functionality of Sentinel Hub. Give it a try.