Hm, this is true. Perhaps you could scrape /newcomments and keep track of which stories are getting new comments?

This would hinge on the frequency of all comments to the site and having your scraping interval be less than the difference of the most recent comment and last comment displayed on /newcomments.

I think it'd just be really great to have another view into "Most active discussions".