It doesn't matter if you own crypto or not. The mere existence of it creates a threat for every relatively rich person out there. They can simply coerce your family to buy bitcoin and give them some, on threat that they kill you.
I'm sure it's not impossible to find 'under the radar' rich people - and people who take care to not flaunt their wealth will probably be more likely to try and make the whole thing go away quietly by paying up.