Wouldn't ALL the hardware need to be open source, to be able to trust it?

With our beloved NSA accused of back-dooring routers, this pretty much eliminates retail routers from consideration, doesn't it?

It seems like the entire stack from top to bottom would need to be open source.

DISCLAIMER: I'm just a wireless user. I don't know about either HW or driver design. These are just my questions.