IssueTracker

Hi!

In our project we generate baseline and startup profiles through GMDs running on GitHub Actions. Those recently started to fail. I discovered that those tests are running fine if I launch them on a local device or an emulator, however if I run them with a GMD they become extremely flaky. I am able to consistently reproduce the issue and can see those tests pass live.

Our tests are pretty simple - first part based on XML works fine, however Compose part (scrolling a LazyColumn plus tapping an element on it) is the one failing the most. When dumping screenshots it looks like everything is there, dumping view hierarchy results in either views missing or just a simple empty FrameLayout being present.

Noticed that opening Recents App and coming back to it helps out a bit, which seemed odd:

fun UiDevice.forceRefreshViewHierarchy() {
  pressRecentApps()
  wait(5000)
  pressBack()
  wait(5000)
}

In the meantime, I got a tip that there is an existing UiAutomator issue and workaround for it located in here: https://github.com/mobile-dev-inc/maestro/pull/1078/files

It seems that calling this function before trying to find any UiObject2 drastically increases chances of success, which makes me think that there is an ongoing caching problem:

private fun UiDevice.refreshAccessibilityCache() {
  try {
    waitForIdle(500)
    val uiAutomation = InstrumentationRegistry.getInstrumentation()
      .uiAutomation
    uiAutomation.serviceInfo = null
  } catch (e: Exception) {
    // no-op
  }
}

Setup:

• UiAutomator version - 2.3.0
• AGP - 8.4.1
• Gradle - 8.6

Test results - did run 10 iterations of each and counted UiObject2 related crashes that would happen if not caught:

• see attachment
• TL;DR accessibility cache reset removes all of the flakiness

Tested GMDs:

pixel6Api32Atd(com.android.build.api.dsl.ManagedVirtualDevice) {
  device = "Pixel 6"
  apiLevel = 32
  systemImageSource = "google-atd"
}
pixel6Api33Atd(com.android.build.api.dsl.ManagedVirtualDevice) {
  device = "Pixel 6"
  apiLevel = 33
  systemImageSource = "google-atd"
}
pixel6Api32(com.android.build.api.dsl.ManagedVirtualDevice) {
  device = "Pixel 6"
  apiLevel = 32
  systemImageSource = "google"
}
pixel6Api33(com.android.build.api.dsl.ManagedVirtualDevice) {
  device = "Pixel 6"
  apiLevel = 33
  systemImageSource = "google"
}