It's all relative. You can use gravity assists to get closer to the sun, but there are a lot more planets above our orbit than below it (and mercury is too small to be useful). ...so timing gravity assisted deceleration orbits is not just hard, but it takes forever and the only reasonable solution is a very eccentric orbit.