You need to grind your coffee into bigger pieces. With a good coffee grinder there should be no dust created. The coffee grinders with a rotating knife are just awful, throw it away and get one that works like a pepper grinder.
If you buy already ground coffee you need to tell the shop to make it coarser, tell them you need it for the French press they will know. If you buy the coffee online, you can usually chose the grade of grinding in the online shop.
It’s the opposite for an espresso machine, there you need it extra-fine.
Pre-packaged powder from the supermarket usually tastes like mud, because it’s not freshly grinded.
I mentioned this above, but the Aeropress is a great solution for French press simplicity and taste without the grounds ending up in your cup. It has tiny round paper filters and it's pretty much self-cleaning. After using it (all manual), you just unscrew the filter and eject the coffee grounds.
I need to try one of those once. But if you need filters that’s really bad for me. I always forget to restock on those little things. I’m already happy if I managed to buy coffee on time ;)
Okay, that’s good. I can keep the French press as a fallback.
But usually I run on green tea, which you can always do Chinese style, by just putting the leaves into a glass with hot water and wait until they reach the bottom of the glass.