I would personally very much not like that move. If we are fondling, it will get to the point where I'm touching the guy's dick without any sort of prodding on his part, unless he does something to turn me off like forcibly place my hand on his dick.
If I do the same thing in a bedroom with a woman who I've already been (consensually) fondling, is it?