We have some notes on using differential privacy to slow down over-fitting here: http://www.win-vector.com/blog/2015/10/a-simpler-explanation...