>Entire team goes around and answers the question: who do you want to leave?

This sounds like it might work as a one-time thing, but just imagine the second-order effects. Your annual reviews literally become Survivor, how could you ever prevent backroom alliances?