Status Update
No update yet.
Comments
cc...@google.com
This functionality was released in benchmark 1.2.0-alpha06:
You'll need to use an Android 13 (API 33) emulator, and androidx.benchmark:benchmark-macro-junit4:1.2.0-alpha06, which removes the requirement for root, and thus works on Play emulator images.
Description
Alert on dashboard:https://androidx-perf.skia.org/t/?begin=1651487327&end=1651487328&subset=all
CLs in build:https://android-build.googleplex.com/builds/jump-to-build/8524746
E.g. androidx.compose.integration.macrobenchmark.SmallListStartupBenchmark_startup_startup_COLD_compilation_None_ went from 340 -> 380ms.
As these were rooted devices, this indicates --reset (done in our rooted CI) does not put the device into the same state as fully reinstallation (after CL landed).
Tagging with 1.1 since we should understand this performance difference better.