Most of that crowd that I interact with was already off Telegram to begin with, and (in some cases, begrudgingly) run their own Matrix instances.

I think if you interact with non-tech-users, Signal is the go-to; Matrix has way too many thorns for normal users to put up with in comparison to the alternatives.