Regression Benchmark Plugin 1.2.0-beta05 -> 1.2.0-rc01, Profile not pulled from device. [303034735]

Verified

Bug

Status Update

No update yet.

Description

we...@sky.uk

created issue #1

Oct 2, 2023 03:03PM

Component used: androidx.baselineprofile, androidx.benchmark:benchmark-macro-junit4

Version used: 1.2.0-rc01

Devices/Android versions reproduced on: Pixel 7 Android 34 Emulator

Android Studio Iguana | 2023.2.1 Canary 6

Build #AI-232.9921.47.2321.10875067, built on September 28, 2023

Runtime version: 17.0.8+0-17.0.8b1000.22-10799086 aarch64

VM: OpenJDK 64-Bit Server VM by JetBrains s.r.o.

macOS 13.5.2

There seems to be a regression between beta05 and rc01 of the baselineProfile plugin.

saveInSrc = true works correctly in beta05, but doesn't pull the profile from device to the host and save it when using rc01.

rc1 produces the following logcat which seems to output the end of the test twice, is this the issue?

15:46:30.897  D  Profile Installer - Save Profile
15:46:31.421  D  Killing process it.sky.skysport
15:46:31.421  D  Executing shell command: am force-stop it.sky.skysport
15:46:34.957  D  Profiles stable in iteration 10 (for 2 iterations)
15:46:34.957  D  Baseline profile for it.sky.skysport is stable.
15:46:35.883  D  Moving /storage/emulated/0/Android/media/com.sky.baselineprofile/BaselineProfileGenerator_startup-baseline-prof.txt to /sdcard/Android/media/com.sky.baselineprofile/additional_test_output/BaselineProfileGenerator_startup-baseline-prof.txt
15:46:35.891  D  Pull Baseline Profile with: `adb pull "/storage/emulated/0/Android/media/com.sky.baselineprofile/BaselineProfileGenerator_startup-baseline-prof-2023-10-02-14-46-35.txt" .`
15:46:35.900  D  Moving /storage/emulated/0/Android/media/com.sky.baselineprofile/BaselineProfileGenerator_startup-baseline-prof-2023-10-02-14-46-35.txt to /sdcard/Android/media/com.sky.baselineprofile/additional_test_output/BaselineProfileGenerator_startup-baseline-prof-2023-10-02-14-46-35.txt
15:46:35.907  D  Total Run Time Ns: 176800101959
15:46:35.908  D  Killing process it.sky.skysport
15:46:35.908  D  Executing shell command: am force-stop it.sky.skysport
15:46:35.921  I  finished: startup(com.sky.baselineprofile.BaselineProfileGenerator)
15:46:35.924  I  run finished: 1 tests, 0 failed, 0 ignored
15:47:34.697  D  Configuring clns-6 for other apk /system/framework/android.test.mock.jar. target_sdk_version=28, uses_libraries=ALL, library_path=/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/lib/arm64:/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/base.apk!/lib/arm64-v8a, permitted_path=/data:/mnt/expand:/data/user/0/com.sky.baselineprofile
15:47:34.699  D  Configuring clns-7 for other apk /system/framework/android.test.runner.jar. target_sdk_version=28, uses_libraries=ALL, library_path=/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/lib/arm64:/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/base.apk!/lib/arm64-v8a, permitted_path=/data:/mnt/expand:/data/user/0/com.sky.baselineprofile
15:47:34.699  W  Unable to open '/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/base.dm': No such file or directory
15:47:34.699  W  Unable to open '/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/base.dm': No such file or directory
15:47:34.715  D  Configuring clns-8 for other apk /data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/base.apk. target_sdk_version=28, uses_libraries=, library_path=/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/lib/arm64:/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/base.apk!/lib/arm64-v8a, permitted_path=/data:/mnt/expand:/data/user/0/com.sky.baselineprofile
15:47:34.735  I  onCreate Bundle[{testTimeoutSeconds=31536000, additionalTestOutputDir=/sdcard/Android/media/com.sky.baselineprofile/additional_test_output, androidx.benchmark.enabledRules=BaselineProfile}]
15:47:34.744  I  Scanning classpath to find tests in paths [/data/app/~~BztptjmP6QiqoilvFuuUiA==/com.sky.baselineprofile-fFiA80txe2v3bvjg46PqMw==/base.apk]
15:47:35.086  I  started: startup(com.sky.baselineprofile.BaselineProfileGenerator)
15:47:35.094  I  Requesting permission: pm grant com.sky.baselineprofile android.permission.READ_EXTERNAL_STORAGE
15:47:35.119  I  Requesting permission: pm grant com.sky.baselineprofile android.permission.WRITE_EXTERNAL_STORAGE
15:47:35.140  D  additionalTestOutputDir=/sdcard/Android/media/com.sky.baselineprofile/additional_test_output
15:47:35.159  D  Usable output directory: /storage/emulated/0/Android/media/com.sky.baselineprofile
15:47:35.159  D  Output Directory: /sdcard/Android/media/com.sky.baselineprofile/additional_test_output
15:47:40.136  D  Installing profile for com.sky.baselineprofile
15:47:45.147  W  Timed out waiting 5000ms on the condition.
                 java.util.concurrent.TimeoutException: Expected event not received within: 5000 ms among: []
                 	at android.app.UiAutomation.executeAndWaitForEvent(UiAutomation.java:1071)
                 	at androidx.test.uiautomator.UiDevice.performActionAndWait(UiDevice.java:219)
                 	at androidx.test.uiautomator.GestureController.performGestureAndWait(GestureController.java:96)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:843)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:817)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:35)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:28)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$1.invoke(BaselineProfiles.kt:77)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$1.invoke(BaselineProfiles.kt:71)
                 	at androidx.benchmark.macro.CompilationMode$Partial.compileImpl$benchmark_macro_release(CompilationMode.kt:318)
                 	at androidx.benchmark.macro.CompilationMode.resetAndCompile$benchmark_macro_release(CompilationMode.kt:114)
                 	at androidx.benchmark.macro.BaselineProfilesKt.collect(BaselineProfiles.kt:71)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect(BaselineProfileRule.kt:136)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect$default(BaselineProfileRule.kt:126)
                 	at com.sky.baselineprofile.BaselineProfileGenerator.startup(BaselineProfileGenerator.kt:28)
                 	at java.lang.reflect.Method.invoke(Native Method)
                 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
                 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
                 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
                 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule$applyInternal$1.evaluate(BaselineProfileRule.kt:98)
                 	at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:136)
                 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
                 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at androidx.test.ext.junit.runners.AndroidJUnit4.run(AndroidJUnit4.java:162)
                 	at org.junit.runners.Suite.runChild(Suite.java:128)
                 	at org.junit.runners.Suite.runChild(Suite.java:27)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:67)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:58)
15:48:02.404  W  Timed out waiting 5000ms on the condition.
                 java.util.concurrent.TimeoutException: Expected event not received within: 5000 ms among: [EventType: TYPE_WINDOW_CONTENT_CHANGED; EventTime: 32643707; PackageName: com.android.systemui; MovementGranularity: 0; Action: 0; ContentChangeTypes: [CONTENT_CHANGE_TYPE_TEXT]; WindowChangeTypes: [] [ ClassName: android.widget.TextView; Text: []; ContentDescription: 3:47 PM; ItemCount: -1; CurrentItemIndex: -1; Enabled: true; Password: false; Checked: false; FullScreen: false; Scrollable: false; ImportantForAccessibility: true; AccessibilityDataSensitive: false; BeforeText: null; FromIndex: -1; ToIndex: -1; ScrollX: 0; ScrollY: 0; MaxScrollX: 0; MaxScrollY: 0; ScrollDeltaX: -1; ScrollDeltaY: -1; AddedCount: -1; RemovedCount: -1; ParcelableData: null; DisplayId: 0 ]; recordCount: 1, EventType: TYPE_WINDOW_CONTENT_CHANGED; EventTime: 32643808; PackageName: com.android.systemui; MovementGranularity: 0; Action: 0; ContentChangeTypes: [CONTENT_CHANGE_TYPE_CONTENT_DESCRIPTION]; WindowChangeTypes: [] [ ClassName: android.widget.TextView; Text: []; ContentDescription: 3:48 PM; ItemCount: -1; CurrentItemIndex: -1; Enabled: true; Password: false; Checked: false; FullScreen: false; Scrollable: false; ImportantForAccessibility: true; AccessibilityDataSensitive: false; BeforeText: null; FromIndex: -1; ToIndex: -1; ScrollX: 0; ScrollY: 0; MaxScrollX: 0; MaxScrollY: 0; ScrollDeltaX: -1; ScrollDeltaY: -1; AddedCount: -1; RemovedCount: -1; ParcelableData: null; DisplayId: 0 ]; recordCount: 1]
                 	at android.app.UiAutomation.executeAndWaitForEvent(UiAutomation.java:1071)
                 	at androidx.test.uiautomator.UiDevice.performActionAndWait(UiDevice.java:219)
                 	at androidx.test.uiautomator.GestureController.performGestureAndWait(GestureController.java:96)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:843)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:817)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:35)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:28)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:89)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.CompilationMode$Partial.compileImpl$benchmark_macro_release(CompilationMode.kt:318)
                 	at androidx.benchmark.macro.BaselineProfilesKt.collect(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect(BaselineProfileRule.kt:136)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect$default(BaselineProfileRule.kt:126)
                 	at com.sky.baselineprofile.BaselineProfileGenerator.startup(BaselineProfileGenerator.kt:28)
                 	at java.lang.reflect.Method.invoke(Native Method)
                 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
                 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
                 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
                 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule$applyInternal$1.evaluate(BaselineProfileRule.kt:98)
                 	at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:136)
                 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
                 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
15:48:19.709  W  Timed out waiting 5000ms on the condition.
                 java.util.concurrent.TimeoutException: Expected event not received within: 5000 ms among: []
                 	at android.app.UiAutomation.executeAndWaitForEvent(UiAutomation.java:1071)
                 	at androidx.test.uiautomator.UiDevice.performActionAndWait(UiDevice.java:219)
                 	at androidx.test.uiautomator.GestureController.performGestureAndWait(GestureController.java:96)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:843)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:817)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:35)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:28)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:89)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.CompilationMode$Partial.compileImpl$benchmark_macro_release(CompilationMode.kt:318)
                 	at androidx.benchmark.macro.BaselineProfilesKt.collect(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect(BaselineProfileRule.kt:136)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect$default(BaselineProfileRule.kt:126)
                 	at com.sky.baselineprofile.BaselineProfileGenerator.startup(BaselineProfileGenerator.kt:28)
                 	at java.lang.reflect.Method.invoke(Native Method)
                 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
                 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
                 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
                 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule$applyInternal$1.evaluate(BaselineProfileRule.kt:98)
                 	at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:136)
                 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
                 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at androidx.test.ext.junit.runners.AndroidJUnit4.run(AndroidJUnit4.java:162)
                 	at org.junit.runners.Suite.runChild(Suite.java:128)
                 	at org.junit.runners.Suite.runChild(Suite.java:27)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:67)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:58)
                 	at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:446)
                 	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2402)
15:48:37.327  W  Timed out waiting 5000ms on the condition.
                 java.util.concurrent.TimeoutException: Expected event not received within: 5000 ms among: []
                 	at android.app.UiAutomation.executeAndWaitForEvent(UiAutomation.java:1071)
                 	at androidx.test.uiautomator.UiDevice.performActionAndWait(UiDevice.java:219)
                 	at androidx.test.uiautomator.GestureController.performGestureAndWait(GestureController.java:96)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:843)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:817)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:35)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:28)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:89)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.CompilationMode$Partial.compileImpl$benchmark_macro_release(CompilationMode.kt:318)
                 	at androidx.benchmark.macro.BaselineProfilesKt.collect(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect(BaselineProfileRule.kt:136)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect$default(BaselineProfileRule.kt:126)
                 	at com.sky.baselineprofile.BaselineProfileGenerator.startup(BaselineProfileGenerator.kt:28)
                 	at java.lang.reflect.Method.invoke(Native Method)
                 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
                 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
                 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
                 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule$applyInternal$1.evaluate(BaselineProfileRule.kt:98)
                 	at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:136)
                 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
                 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at androidx.test.ext.junit.runners.AndroidJUnit4.run(AndroidJUnit4.java:162)
                 	at org.junit.runners.Suite.runChild(Suite.java:128)
                 	at org.junit.runners.Suite.runChild(Suite.java:27)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:67)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:58)
                 	at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:446)
                 	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2402)
15:48:55.410  W  Timed out waiting 5000ms on the condition.
                 java.util.concurrent.TimeoutException: Expected event not received within: 5000 ms among: []
                 	at android.app.UiAutomation.executeAndWaitForEvent(UiAutomation.java:1071)
                 	at androidx.test.uiautomator.UiDevice.performActionAndWait(UiDevice.java:219)
                 	at androidx.test.uiautomator.GestureController.performGestureAndWait(GestureController.java:96)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:843)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:817)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:35)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:28)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:89)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.CompilationMode$Partial.compileImpl$benchmark_macro_release(CompilationMode.kt:318)
                 	at androidx.benchmark.macro.BaselineProfilesKt.collect(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect(BaselineProfileRule.kt:136)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect$default(BaselineProfileRule.kt:126)
                 	at com.sky.baselineprofile.BaselineProfileGenerator.startup(BaselineProfileGenerator.kt:28)
                 	at java.lang.reflect.Method.invoke(Native Method)
                 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
                 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
                 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
                 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule$applyInternal$1.evaluate(BaselineProfileRule.kt:98)
                 	at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:136)
                 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
                 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at androidx.test.ext.junit.runners.AndroidJUnit4.run(AndroidJUnit4.java:162)
                 	at org.junit.runners.Suite.runChild(Suite.java:128)
                 	at org.junit.runners.Suite.runChild(Suite.java:27)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:67)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:58)
                 	at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:446)
                 	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2402)
15:49:12.910  W  Timed out waiting 5000ms on the condition.
                 java.util.concurrent.TimeoutException: Expected event not received within: 5000 ms among: []
                 	at android.app.UiAutomation.executeAndWaitForEvent(UiAutomation.java:1071)
                 	at androidx.test.uiautomator.UiDevice.performActionAndWait(UiDevice.java:219)
                 	at androidx.test.uiautomator.GestureController.performGestureAndWait(GestureController.java:96)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:843)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:817)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:35)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:28)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:89)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.CompilationMode$Partial.compileImpl$benchmark_macro_release(CompilationMode.kt:318)
                 	at androidx.benchmark.macro.BaselineProfilesKt.collect(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect(BaselineProfileRule.kt:136)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect$default(BaselineProfileRule.kt:126)
                 	at com.sky.baselineprofile.BaselineProfileGenerator.startup(BaselineProfileGenerator.kt:28)
                 	at java.lang.reflect.Method.invoke(Native Method)
                 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
                 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
                 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
                 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule$applyInternal$1.evaluate(BaselineProfileRule.kt:98)
                 	at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:136)
                 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
                 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at androidx.test.ext.junit.runners.AndroidJUnit4.run(AndroidJUnit4.java:162)
                 	at org.junit.runners.Suite.runChild(Suite.java:128)
                 	at org.junit.runners.Suite.runChild(Suite.java:27)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:67)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:58)
                 	at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:446)
                 	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2402)
15:49:30.061  W  Timed out waiting 5000ms on the condition.
                 java.util.concurrent.TimeoutException: Expected event not received within: 5000 ms among: [EventType: TYPE_WINDOW_CONTENT_CHANGED; EventTime: 32733475; PackageName: com.android.systemui; MovementGranularity: 0; Action: 0; ContentChangeTypes: [CONTENT_CHANGE_TYPE_CONTENT_DESCRIPTION]; WindowChangeTypes: [] [ ClassName: android.widget.FrameLayout; Text: []; ContentDescription: Phone signal full.; ItemCount: -1; CurrentItemIndex: -1; Enabled: true; Password: false; Checked: false; FullScreen: false; Scrollable: false; ImportantForAccessibility: true; AccessibilityDataSensitive: false; BeforeText: null; FromIndex: -1; ToIndex: -1; ScrollX: 0; ScrollY: 0; MaxScrollX: 0; MaxScrollY: 0; ScrollDeltaX: -1; ScrollDeltaY: -1; AddedCount: -1; RemovedCount: -1; ParcelableData: null; DisplayId: 0 ]; recordCount: 1]
                 	at android.app.UiAutomation.executeAndWaitForEvent(UiAutomation.java:1071)
                 	at androidx.test.uiautomator.UiDevice.performActionAndWait(UiDevice.java:219)
                 	at androidx.test.uiautomator.GestureController.performGestureAndWait(GestureController.java:96)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:843)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:817)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:35)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:28)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:89)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.CompilationMode$Partial.compileImpl$benchmark_macro_release(CompilationMode.kt:318)
                 	at androidx.benchmark.macro.BaselineProfilesKt.collect(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect(BaselineProfileRule.kt:136)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect$default(BaselineProfileRule.kt:126)
                 	at com.sky.baselineprofile.BaselineProfileGenerator.startup(BaselineProfileGenerator.kt:28)
                 	at java.lang.reflect.Method.invoke(Native Method)
                 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
                 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
                 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
                 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule$applyInternal$1.evaluate(BaselineProfileRule.kt:98)
                 	at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:136)
                 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
                 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at androidx.test.ext.junit.runners.AndroidJUnit4.run(AndroidJUnit4.java:162)
                 	at org.junit.runners.Suite.runChild(Suite.java:128)
                 	at org.junit.runners.Suite.runChild(Suite.java:27)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
15:49:47.409  W  Timed out waiting 5000ms on the condition.
                 java.util.concurrent.TimeoutException: Expected event not received within: 5000 ms among: []
                 	at android.app.UiAutomation.executeAndWaitForEvent(UiAutomation.java:1071)
                 	at androidx.test.uiautomator.UiDevice.performActionAndWait(UiDevice.java:219)
                 	at androidx.test.uiautomator.GestureController.performGestureAndWait(GestureController.java:96)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:843)
                 	at androidx.test.uiautomator.UiObject2.fling(UiObject2.java:817)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:35)
                 	at com.sky.baselineprofile.BaselineProfileGenerator$startup$1.invoke(BaselineProfileGenerator.kt:28)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:89)
                 	at androidx.benchmark.macro.BaselineProfilesKt$collect$1$2.invoke(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.CompilationMode$Partial.compileImpl$benchmark_macro_release(CompilationMode.kt:318)
                 	at androidx.benchmark.macro.BaselineProfilesKt.collect(BaselineProfiles.kt:83)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect(BaselineProfileRule.kt:136)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule.collect$default(BaselineProfileRule.kt:126)
                 	at com.sky.baselineprofile.BaselineProfileGenerator.startup(BaselineProfileGenerator.kt:28)
                 	at java.lang.reflect.Method.invoke(Native Method)
                 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
                 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
                 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
                 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
                 	at androidx.benchmark.macro.junit4.BaselineProfileRule$applyInternal$1.evaluate(BaselineProfileRule.kt:98)
                 	at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:136)
                 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
                 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
                 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at androidx.test.ext.junit.runners.AndroidJUnit4.run(AndroidJUnit4.java:162)
                 	at org.junit.runners.Suite.runChild(Suite.java:128)
                 	at org.junit.runners.Suite.runChild(Suite.java:27)
                 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
                 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
                 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
                 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
                 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
                 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
                 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
                 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:67)
                 	at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:58)
                 	at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:446)
                 	at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2402)
15:49:57.611  D  Moving /storage/emulated/0/Android/media/com.sky.baselineprofile/BaselineProfileGenerator_startup_baseline_prof.txt to /sdcard/Android/media/com.sky.baselineprofile/additional_test_output/BaselineProfileGenerator_startup_baseline_prof.txt
15:49:57.618  D  Pull Baseline Profile with: `adb pull "/storage/emulated/0/Android/media/com.sky.baselineprofile/BaselineProfileGenerator_startup_baseline_prof_2023_10_02_14_49_57.txt" .`
15:49:57.625  D  Moving /storage/emulated/0/Android/media/com.sky.baselineprofile/BaselineProfileGenerator_startup_baseline_prof_2023_10_02_14_49_57.txt to /sdcard/Android/media/com.sky.baselineprofile/additional_test_output/BaselineProfileGenerator_startup_baseline_prof_2023_10_02_14_49_57.txt
15:49:57.642  I  finished: startup(com.sky.baselineprofile.BaselineProfileGenerator)

Baseline Test is simple:

@RunWith(AndroidJUnit4::class)
class BaselineProfileGenerator {
    @get:Rule
    val baselineProfileRule = BaselineProfileRule()

    @Test
    fun startup() = baselineProfileRule.collect(
        packageName = TARGET_PACKAGE
    ) {
        pressHome()
        startActivityAndWait()
        device.waitAndFind(By.scrollable(true)).also {
            it.setGestureMargin(device.displayWidth / 5)
            it.fling(Direction.DOWN)
        }
    }
}

Also seeing a lot of time out warnings around the fling(Direction.Down) call. Can log another issue for that if needed.

Comments

cc...@google.com <cc...@google.com> #2Oct 2, 2023 11:30PM

Reassigned to be...@google.com.

b/241974799 fixes #3, i.e. optimize for load once, query many

Perfetto trace shell processor now runs in http server mode.

cc...@google.com <cc...@google.com> #3Oct 2, 2023 11:49PM

Pulling back to 1.2 because there are many instances of external users blocked on this. Plan is to open up what we have as experimental in 1.2.

cc...@google.com <cc...@google.com> Oct 3, 2023 09:25PM

Reassigned to cc...@google.com.

ap...@google.com <ap...@google.com> #4Oct 4, 2023 03:14AM

Marked as fixed.

Project: platform/frameworks/support
Branch: androidx-main

commit 80d9e8a14fae3015890c6ada4d6f72131cfd0d39
Author: Chris Craik <ccraik@google.com>
Date: Mon Feb 20 10:06:57 2023

Public experimental API for TraceProcessor

Bug:219851406
Test: ./gradlew bench:b-m:cC
Test: PerfettoTraceProcessorTest
Test: PerfettoTraceProcessorBenchmark
Relnote: "Added public experimental API for PerfettoTraceProcessor to
enable parsing trace content. This is a step toward fully custom
metrics based on Perfetto trace data."

Change-Id: I2659e84e85281f62f77abb6806f9c00bc2442f56

M benchmark/benchmark-macro/api/public_plus_experimental_current.txt
M benchmark/benchmark-macro/build.gradle
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/PerfettoTraceRuleTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/PowerMetricTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/StartupTimingMetricTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/TraceSectionMetricTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/AndroidxTracingTraceTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/AudioUnderrunQueryTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/BatteryDischargeQueryTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/FrameTimingQueryTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/PerfettoCaptureSweepTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/PerfettoSdkTraceTest.kt
D benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/PerfettoTraceProcessorTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/PowerQueryTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/perfetto/StartupTimingQueryTest.kt
A benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/perfetto/PerfettoTraceProcessorTest.kt
A benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/perfetto/RowTest.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/Macrobenchmark.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/Metric.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/AudioUnderrunQuery.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/BatteryDischargeQuery.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/FrameTimingQuery.kt
D benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/PerfettoTraceProcessor.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/PowerQuery.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/StartupTimingQuery.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/StringHelper.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/server/PerfettoHttpServer.kt
A benchmark/benchmark-macro/src/main/java/androidx/benchmark/perfetto/ExperimentalPerfettoTraceProcessorApi.kt
A benchmark/benchmark-macro/src/main/java/androidx/benchmark/perfetto/PerfettoTraceProcessor.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/perfetto/QueryResultIterator.kt
A benchmark/benchmark-macro/src/main/java/androidx/benchmark/perfetto/Row.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/perfetto/Slice.kt
M benchmark/benchmark/build.gradle
M benchmark/integration-tests/macrobenchmark/src/androidTest/java/androidx/benchmark/integration/macrobenchmark/PerfettoTraceProcessorBenchmark.kt

https://android-review.googlesource.com/2447462

cc...@google.com <cc...@google.com> #5Oct 4, 2023 05:14AM

Verified by cc...@google.com.

Project: platform/frameworks/support
Branch: androidx-main

commit a1afb0d256ee6bf1aafb0ffd2cd958ac09c1fadd
Author: Chris Craik <ccraik@google.com>
Date: Thu Mar 09 16:43:42 2023

Add Experimental TraceMetric for fully custom metrics from traces

Fixes: 219851406
Test: ./gradlew bench:b-m:cC
Relnote: "Added new experimental TraceMetric API for defining fully
custom metrics based on content of a Perfetto trace."

Along with opening up the metric, migrates Metric to more extensible
output types. This allows us to eventually add further per-submetric
customization (such as per-submetric strictness on presence in each
iteration, custom display in studio, etc.

Also now correctly propogates TraceProcessor errors (e.g. query syntax
errors) to Kotlin callers.

This change also removes the concept of timelineRange in metric
results / trace UiState, as it's no longer necessary after
optimizations to remove sleep()s at the beginning/end of trace
capture.

Change-Id: I4ce3147b5bd1a13ae6a500389abdae3df461cacd

M benchmark/benchmark-common/src/main/java/androidx/benchmark/perfetto/UiState.kt
M benchmark/benchmark-macro/api/public_plus_experimental_current.txt
M benchmark/benchmark-macro/build.gradle
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/PowerMetricTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/StartupTimingMetricTest.kt
A benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/TraceMetricTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/macro/TraceSectionMetricTest.kt
M benchmark/benchmark-macro/src/androidTest/java/androidx/benchmark/perfetto/PerfettoTraceProcessorTest.kt
D benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/IterationResult.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/Macrobenchmark.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/Metric.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/MetricResultExtensions.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/macro/perfetto/server/PerfettoHttpServer.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/perfetto/PerfettoTraceProcessor.kt
M benchmark/benchmark-macro/src/main/java/androidx/benchmark/perfetto/QueryResultIterator.kt

https://android-review.googlesource.com/2479937

pr...@google.com <pr...@google.com> #6Oct 6, 2023 05:19PM

The following release(s) address this bug.It is possible this bug has only been partially addressed:

androidx.benchmark:benchmark-macro:1.2.0-alpha12

Issue 303034735