Don't know if it's what you thought about but there is Breezy Weather which allows setting a location in one of the supported service. This means that you can specify several times the same location with different providers and access them by swiping right/left or setup a widget for each.
It's available through Obtainium or on IzzyOnDroid F-droid repository.
Just tested it out, as you said one can add multiple locations but use the same location with multiple weather services, so thats nice.
What I don't like is that you need to swipe between the different locations to see their data instead of just having one page with the graphs one under another, but I guess that is personal preference.
Also there is just one widget that shows multiple locations and that only shows the whole day summary. If you add the hourly widget you cannot change location, it always uses the same one. But that seems like a simple thing to request from the dev, so I will do that.
They are all using the same data set it all comes from the US government assuming you are in the US so it does not matter what app you use it is sad the US government was sued when they tried to come out with their own app so people could get the info from the source !