Reset compilation without reinstall [249143766]

Fixed

Bug

Status Update

No update yet.

Description

cc...@google.com

created issue #1

Sep 26, 2022 08:17PM

See b/230518212 and b/230665435

Comments

cc...@google.com <cc...@google.com> #2Sep 28, 2022 10:34PM

Public --reset should be added in API 34, but delete-dexopt landed in API 33.

Unfortunately, we don't get stable numbers with delete-dexopt or, as suggested by art, using -f -m verify. Detailed analysis here

ap...@google.com <ap...@google.com> #3Oct 28, 2022 03:44PM

Marked as fixed.

Project: platform/frameworks/support
Branch: androidx-main

commit 7c275cf935cf13bb319a7af0a0e1c87bcb493f32
Author: Chris Craik <ccraik@google.com>
Date: Thu Oct 20 17:27:34 2022

Reset Compilation cleanly, without reinstall

Fixes: 249143766
Test: CompilationConsistencyBenchmark
Test: CompilationModeTest
Relnote: " No longer uninstall and reinstall target app to reset
compilation. With further investigation, the sole reason this was
necessary was to reset shader state, which has been fixed
separately. Now the target app remains installed, even without root,
without affecting app data. "

Change-Id: I8405b59a85e04f9ae3eeee0e3eecedcc47241e02

M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/CompilationMode.kt
A compose/integration-tests/macrobenchmark/src/androidTest/java/androidx/compose/integration/macrobenchmark/CompilationConsistencyBenchmark.kt

https://android-review.googlesource.com/2264162

cc...@google.com <cc...@google.com> #4Oct 31, 2022 10:42PM

Status: Assigned (reopened)

The change to no longer use command pkg compile --reset has made baseline profiles and warmup iterations much closer than before, for example:

CompilationMode.Full + None aren't affected, so it looks like profiles aren't getting cleared as we'd expect them to.

ji...@google.com <ji...@google.com> #5Nov 1, 2022 01:45PM

This is WAI. Neither delete-dexopt nor compile -f -m verify touches any profile. They should only change the compilation state. We intentionally keep the profiles so that they can be used again on the next compile -m speed-profile. If you would like to clear profiles, please use compile --reset.

ap...@google.com <ap...@google.com> #6Nov 2, 2022 01:02AM

Project: platform/frameworks/support
Branch: androidx-main

commit 85512318758266d73a60c2fe74960387827068e5
Author: Chris Craik <ccraik@google.com>
Date: Tue Nov 01 15:56:03 2022

Revert "Reset Compilation cleanly, without reinstall"

Bug:249143766
Fixes:256693133
Test: BaselineProfileRuleTest

Resetting compilation without reinstall will need to wait for API 34,
as there's no way to clear the reference profile for any methods
already compiled.

A follow up should use --reset on API 34, and consider skipping
--reset for Full / None, as it shouldn't be necessary.

Note that this revert leaves the kdoc changes in place.

This reverts commit 7c275cf935cf13bb319a7af0a0e1c87bcb493f32.

Change-Id: I5719feb75876b450402009a9cb529c2a79c7cf2b

M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/CompilationMode.kt
D compose/integration-tests/macrobenchmark/src/androidTest/java/androidx/compose/integration/macrobenchmark/CompilationConsistencyBenchmark.kt

https://android-review.googlesource.com/2282121

ap...@google.com <ap...@google.com> #7Feb 8, 2023 11:08PM

Marked as fixed.

Project: platform/frameworks/support
Branch: androidx-main

commit 89b4c45ba74dfb3eb7a702c4534140074e8f3cd5
Author: Chris Craik <ccraik@google.com>
Date: Wed Feb 08 13:41:13 2023

Support cmd package compile --reset on Android 14

Fixes: 249143766
Test: TrivialStartupBenchmark
Test: CompilationModeTest
Relnote: "On Android 14+, Macrobenchmark no longer reinstalls target
applications to reset compilation state, thanks to a new platform
feature. Previously it was necessary to have a rooted device, or to
deal with all application state (e.g. login) being removed before each
benchmark runs."

Also adds clarifying error to internal legacy metric failure occurring
on Android 14.

Change-Id: I9b08cfecc36735d057b388e75d1c9b50b53ed083

M benchmark/benchmark-macro/build.gradle
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/CompilationMode.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/Metric.kt

https://android-review.googlesource.com/2427952

na...@google.com <na...@google.com> #8Feb 22, 2023 07:11PM

The following release(s) address this bug.It is possible this bug has only been partially addressed:

androidx.benchmark:benchmark-macro:1.2.0-alpha10