IssueTracker

Component used: macrobench 1.2.0-alpha09, profileinstaller 1.3.0-alpha03 Devices/Android versions reproduced on:

• Emulator Pixel 6 API 33
• user Pixel 7 API 33

When running benchmarks with -Pandroid.testInstrumentationRunnerArguments.androidx.benchmark.dryRunMode.enable=true they fail with missing metrics.

java.lang.IllegalArgumentException: Unable to read any metrics during benchmark (metric list: [androidx.benchmark.macro.StartupTimingMetric@f9dfeca]).
Check that you're performing the operations to be measured. For example, if
using StartupTimingMetric, are you starting an activity for the specified package
in the measure block?
at androidx.benchmark.macro.MacrobenchmarkKt.macrobenchmark(Macrobenchmark.kt:296)
at androidx.benchmark.macro.MacrobenchmarkKt.macrobenchmarkWithStartupMode(Macrobenchmark.kt:367)
at androidx.benchmark.macro.junit4.MacrobenchmarkRule.measureRepeated(MacrobenchmarkRule.kt:107)
at com.google.samples.apps.nowinandroid.startup.AbstractStartupBenchmark.startup(StartupBenchmark.kt:78)
at com.google.samples.apps.nowinandroid.startup.AbstractStartupBenchmark.startupBaselineProfileDisabled(StartupBenchmark.kt:68)

For BaselineProfile generators it fails with profile being empty:

java.lang.IllegalStateException: Generated Profile is empty, before filtering.
Ensure your profileBlock invokes the target app, and
runs a non-trivial amount of code.
at androidx.benchmark.macro.BaselineProfilesKt.collectBaselineProfile(BaselineProfiles.kt:75)
at androidx.benchmark.macro.junit4.BaselineProfileRule.collectBaselineProfile(BaselineProfileRule.kt:124)
at androidx.benchmark.macro.junit4.BaselineProfileRule.collectBaselineProfile$default(BaselineProfileRule.kt:117)
at com.google.samples.apps.nowinandroid.baselineprofile.BaselineProfileGenerator.generate(BaselineProfileGenerator.kt:38)