Wow that was quick :) Meh, I feel like comment points have become somewhat untethered to comment quality (at least assuming threads are roughly sorted by comment score). It’s a good heuristic usually but it’s wrong often enough for it to be difficult to rely on.
I want to improve the classifier scores too. There’s some parameters in the loss function I could play around with more when training which basically optimize for more false negatives or false positives. Problems with no ground truth are very frustrating lol (though I suppose dang/tomhow’s manually written warnings could be treated as labels instead of using labels from GPT, but I suspect there’s not enough of them).
I want to improve the classifier scores too. There’s some parameters in the loss function I could play around with more when training which basically optimize for more false negatives or false positives. Problems with no ground truth are very frustrating lol (though I suppose dang/tomhow’s manually written warnings could be treated as labels instead of using labels from GPT, but I suspect there’s not enough of them).