>Is this actually a problem?

Yes. Every dollar in the pocket of a trust fund baby is a dollar missing from an underfunded public school, a homeless relief program, a cancer research center, a library...