I'm starting to realize it's partly because backing out of an app was a way in my mind to close the app. But ICS doesn't seem to pay attention to that anymore, so you're right, I should just hit the home key.