Most 'visual servoing' systems need edges or contours but not colour.

In the long run it would still probably be cheaper to have infrared cameras or a few LED rings around the camera lense rather than full on industrial grade lighting 365 days in the year.