I love it! We have a similar thing in my company. We run a hosted CI service (https://circleci.com), and occasionally tests on Circle, but don't locally for the customer. That would just cause the customer to stop using us (and therefore not sign up at the end of the trial).
So we added a "report this build" button, and some text: "Uh-oh, this failed. If you didn't expect it to, report this build and we'll look into it". Since we added it about 3 months ago, this has led to dozens of bug fixes on our end, tons of improvements to the docs and language in the app, and lots of conversations with customers which helped us refine the product.
We should definitely add the same thing to our docs, like Stripe does. See the footer at https://stripe.com/docs/api
So we added a "report this build" button, and some text: "Uh-oh, this failed. If you didn't expect it to, report this build and we'll look into it". Since we added it about 3 months ago, this has led to dozens of bug fixes on our end, tons of improvements to the docs and language in the app, and lots of conversations with customers which helped us refine the product.
We should definitely add the same thing to our docs, like Stripe does. See the footer at https://stripe.com/docs/api