Benchmark that failed to execute should not export any metrics

[adamsitnik]

A sample failure can be found here: #2590 (comment)

Here #2590 (comment) @DrewScoggins has referenced the code that needs to be changed.