I don't care about any language that isn't natively supported in the browsers.

Not all browsers have support for source maps, and sometimes you really need to debug browser specific behaviours without having to debug generated code along the way.

Additionally in most teams I work on, it is often the case that besides myself no one even knows what CoffeScript is.

CoffeScript just adds more code to debug without any real benefit.