With Gerrit, you have the patch that lands on master and then you have the stages that that patch went through to get to that point, reviews on older versions of the patch, etc. all recorded in the web interface.

So maybe just switch to a code review tool and use its interface to converse with the bots?