Assigned
Status Update
Comments
cc...@google.com <cc...@google.com> #2
Update: according to the trace, dex2oat starts at the same moment as the application. So i guess, the problem lays in xiaomi firmware that starts the optimization with the application during benchmark
Description
We want to expose, through a listener, the metric measurements for each iteration and test. This would allow users to build some mechanism to store previous benchmark results (one or more) that could be used for regression and trend analysis over time.
An example of the callback would look like:
Note that iteration results are already reported as instrumentation:https://developer.android.com/topic/performance/benchmarking/benchmarking-in-ci#benchmark-data-example
It's a pretty manual process at the moment but raw data allows other analysis also off-device