It's calibrated where it's calibrated and not where its not. Their "confidence" score is rather bunk, so it's hard to say. As with other LLMs, you have to eval it for your setting, and if you find it calibrated, then great.
Interestingly enough, at lunch this week it turns out that one of my buddies work colleagues has actually developed a relatively well calibrated version of this, so it's not impossible.
It's probably much harder for arbitrary data though (like most things).
