Jaron Lanier recently gave a talk at UCSB, and he mentioned that Microsoft is be funding a lab he's setting up in SF to explore new avenues of perception opened up by Kinnect. He mentioned using it to see the world as a lobster, or understand say perhaps a mathematical function by translating body movements to avatar changes.