Frozen on multiplayer loading screen

This happens to me often enough to be annoying and I think it is related to my internet speed or lack thereof. Whilst my net is slow it’s usually decent enough to play games over Xbox live, if I hotspot to my phone however, using a faster connection, I never have a problem. Anyone else with this issue think it is related or am I on my own with hampster wheel internet?