On the Porters five forces scheme of things, the SoC vendors have much better bargaing power than device makers.
Long time ago, people also though ARM was going to close doors.
If Qualcomm refuses, other would gladly do and eventually become good enough for Qualcomm to either change their mind or become irrelevant.
The majority of my devices don't have Qualcomm.