Agreed - removing the driver would make it much more interesting. Safety regulations could then be relaxed considerably so we'd see more spectacular crashes. Also a human's inability to control a vehicle during high G force cornering severely restricts the speed you can allow the cars to go.

And the driver salaries could be donated to charity ;-)