Voiceover Gets Trapped in Map with Multiple Markers [208842991]

Assigned

Bug

Status Update

No update yet.

Description

[Deleted User]

created issue #1

Dec 3, 2021 02:58PM

What is the incorrect behavior that you are experiencing?

When there are multiple markers present on a map that does not fill the entire screen, VoiceOver focus tends to get "stuck" in the map view and continues circling through the markers as the user swipes to the next element instead of leaving the map and focusing the next accessibility element after the map.

What should happen instead?

After hearing the last marker read, a user should be able to swipe to move VoiceOver focus out of the map to any accessibility elements that follow the map view.

Link to the Demo application that reproduces the problem:

See attached sample project.

Steps to reproduce the problem:

Replace the API Key in AppDelegate.swift
Build/run on a physical device.
Enable VoiceOver and begin swiping the VoiceOver cursor through the view. Notice that once VoiceOver focus enters the markers on the map, it continually loops through them and the user is trapped unless they know to manually select an accessibility element outside of the map.

Operating system version: Tested on iOS 15.0

Google Maps SDK for iOS version: 6.0.0

Hardware model: This sample project was tested on iPhone 11 Pro Max but the bug has been experienced in our production app on multiple current devices.

MarkerVoiceover.zip

83 MB

Download

RPReplay_Final1638543289.mp4

9 MB

Download

Comments

ma...@google.com <ma...@google.com> Dec 5, 2021 11:50PM

Assigned to ma...@google.com.

ma...@google.com <ma...@google.com> #2Dec 6, 2021 01:03AM

Thanks for reaching out. To investigate the problem, we require a few details. Could you please provide your GMS module versions, recent system logs and video of the issue.

You can find instructions for retrieving the versions and logs on this page. Let me know if you need any help with retrieving the logs.

ma...@google.com <ma...@google.com> Apr 28, 2022 12:14AM

Reassigned to ra...@google.com.

[Deleted User] <[Deleted User]> #3Jul 27, 2022 01:44PM

thank you! I will look at this as soon as I can.

al...@mkodo.com <al...@mkodo.com> #4Sep 7, 2022 08:05AM

hello,
I would assume the GMS module version is the google play service version that is running on debugging phone. that version is 25.08.32 (200300-731361394).

logcat logs (when I start the app):

2025-03-10 09:27:10.755 17848-17848 GHSAFM-3p-...inActivity com.google.homesampleapp.default I ====================================
Version 2.0.0-default
App GHSAFM-3p-ecosystem
====================================
2025-03-10 09:27:10.756 17848-17848 GHSAFM-3p-...inActivity com.google.homesampleapp.default D onCreate()
2025-03-10 09:27:10.757 17848-17848 GHSAFM-3p-...inActivity com.google.homesampleapp.default D lifecycleObservers [[com.google.homesampleapp.lifecycle.HalfSheetSuppressionObserver@b819bd1]]
2025-03-10 09:27:10.766 17848-17848 GHSAFM-3p-...em-UtilsKt com.google.homesampleapp.default D *** Preference Files ***
2025-03-10 09:27:10.839 17848-17848 ThreeFingerSwipe com.google.homesampleapp.default I mSwipeDistanceThreshold:18
2025-03-10 09:27:10.840 17848-17848 ThreeFingerSwipe com.google.homesampleapp.default I mMaxWidth = 720; mMaxHeight = 1491
2025-03-10 09:27:10.851 17848-17848 ThreeFingerSwipe com.google.homesampleapp.default I getPackageName = com.google.homesampleapp.default
2025-03-10 09:27:10.962 17848-17848 GHSAFM-3p-...inActivity com.google.homesampleapp.default D onStart()
2025-03-10 09:27:10.966 17848-17848 GHSAFM-3p-...onObserver com.google.homesampleapp.default D onStart()
2025-03-10 09:27:11.020 17848-17848 Compatibil...geReporter com.google.homesampleapp.default D Compat change id reported: 237531167; UID 10238; state: DISABLED
2025-03-10 09:27:11.040 17848-17848 OpenGLRenderer com.google.homesampleapp.default W Unknown dataspace 0
2025-03-10 09:27:11.110 17848-17848 Choreographer com.google.homesampleapp.default I Skipped 58 frames! The application may be doing too much work on its main thread.
2025-03-10 09:27:11.359 17848-17848 mpleapp.default com.google.homesampleapp.default W Method java.lang.Object androidx.compose.runtime.snapshots.SnapshotStateMap.mutate(kotlin.jvm.functions.Function1) failed lock verification and will run slower.
Common causes for lock verification issues are non-optimized dex code
and incorrect proguard optimizations.
2025-03-10 09:27:11.359 17848-17848 mpleapp.default com.google.homesampleapp.default W Method void androidx.compose.runtime.snapshots.SnapshotStateMap.update(kotlin.jvm.functions.Function1) failed lock verification and will run slower.
2025-03-10 09:27:11.360 17848-17848 mpleapp.default com.google.homesampleapp.default W Method boolean androidx.compose.runtime.snapshots.SnapshotStateMap.removeIf$runtime_release(kotlin.jvm.functions.Function1) failed lock verification and will run slower.
2025-03-10 09:27:11.789 17848-17902 mali_gralloc com.google.homesampleapp.default D register: id=2930000016c, handle=0xf654b0c0, importpid=-1, gRegisteredHandles=0
2025-03-10 09:27:11.793 17848-17902 mali_gralloc com.google.homesampleapp.default D register: id=2930000016d, handle=0xf654b7c0, importpid=-1, gRegisteredHandles=1
2025-03-10 09:27:11.794 17848-17902 mali_gralloc com.google.homesampleapp.default D register: id=2930000016e, handle=0xf654ba60, importpid=-1, gRegisteredHandles=2
2025-03-10 09:27:11.795 17848-17902 mali_gralloc com.google.homesampleapp.default D register: id=2930000016f, handle=0xf654bb40, importpid=-1, gRegisteredHandles=3
2025-03-10 09:27:12.284 17848-17848 mpleapp.default com.google.homesampleapp.default W Method boolean androidx.compose.runtime.snapshots.SnapshotStateList.conditionalUpdate(kotlin.jvm.functions.Function1) failed lock verification and will run slower.
2025-03-10 09:27:12.285 17848-17848 mpleapp.default com.google.homesampleapp.default W Method java.lang.Object androidx.compose.runtime.snapshots.SnapshotStateList.mutate(kotlin.jvm.functions.Function1) failed lock verification and will run slower.
2025-03-10 09:27:12.285 17848-17848 mpleapp.default com.google.homesampleapp.default W Method void androidx.compose.runtime.snapshots.SnapshotStateList.update(kotlin.jvm.functions.Function1) failed lock verification and will run slower.
2025-03-10 09:27:12.439 17848-17848 GHSAFM-3p-...posablesKt com.google.homesampleapp.default D MsgAlertDialog [null]
2025-03-10 09:27:12.863 17848-17848 GHSAFM-3p-...Repository com.google.homesampleapp.default D shouldShowHalfsheetNotification
2025-03-10 09:27:12.864 17848-17868 OpenGLRenderer com.google.homesampleapp.default I Davey! duration=2265ms; Flags=1, FrameTimelineVsyncId=129210, IntendedVsync=1395390399803, Vsync=1396038344715, InputEventId=0, HandleInputStart=1396041416078, AnimationStart=1396041427808, PerformTraversalsStart=1396041752770, DrawStart=1397575614077, FrameDeadline=1395411622025, FrameInterval=1396040116885, FrameStartTime=11171464, SyncQueued=1397611300115, SyncStart=1397745453692, IssueDrawCommandsStart=1397746579653, SwapBuffers=1397787823807, FrameCompleted=1397789712269, DequeueBufferDuration=25846, QueueBufferDuration=408769, GpuCompleted=1397789712269, SwapBuffersCompleted=1397788405576, DisplayPresentTime=0, CommandSubmissionCompleted=1397787823807,
2025-03-10 09:27:12.952 17848-17848 Compatibil...geReporter com.google.homesampleapp.default D Compat change id reported: 247079863; UID 10238; state: DISABLED
2025-03-10 09:27:12.952 17848-17848 GHSAFM-3p-...HomeScreen com.google.homesampleapp.default D HomeRoute [[]]
2025-03-10 09:27:12.956 17848-17848 GHSAFM-3p-...$HomeRoute com.google.homesampleapp.default D HomeScreen: LifecycleResumeEffect
2025-03-10 09:27:12.958 17848-17848 GHSAFM-3p-...$HomeRoute com.google.homesampleapp.default D intent [Intent { act=android.intent.action.MAIN cat=[android.intent.category.LAUNCHER] flg=0x10000000 cmp=com.google.homesampleapp.default/com.google.homesampleapp.MainActivity }]
2025-03-10 09:27:12.959 17848-17848 GHSAFM-3p-...$HomeRoute com.google.homesampleapp.default D Invocation: Main
2025-03-10 09:27:12.960 17848-17848 GHSAFM-3p-...eViewModel com.google.homesampleapp.default D subscribeToDevicesPeriodicUpdates()
2025-03-10 09:27:12.969 17848-17848 Choreographer com.google.homesampleapp.default I Skipped 160 frames! The application may be doing too much work on its main thread.
2025-03-10 09:27:12.982 17848-17909 ConnectionStatusConfig com.google.homesampleapp.default W Dynamic lookup for intent failed for action: com.google.android.gms.home.service.START
2025-03-10 09:27:12.991 17848-17909 GmsClient com.google.homesampleapp.default W unable to connect to service: com.google.android.gms.home.service.START on com.google.android.gms
2025-03-10 09:27:13.050 17848-17868 OpenGLRenderer com.google.homesampleapp.default I Davey! duration=1857ms; Flags=0, FrameTimelineVsyncId=129763, IntendedVsync=1396105386434, Vsync=1397892932194, InputEventId=0, HandleInputStart=1397900815307, AnimationStart=1397900831153, PerformTraversalsStart=1397936259269, DrawStart=1397936789692, FrameDeadline=1397813486785, FrameInterval=1397899770038, FrameStartTime=11172161, SyncQueued=1397958749884, SyncStart=1397958831961, IssueDrawCommandsStart=1397958919307, SwapBuffers=1397961135384, FrameCompleted=1397962792269, DequeueBufferDuration=17039, QueueBufferDuration=303923, GpuCompleted=1397962792269, SwapBuffersCompleted=1397961530461, DisplayPresentTime=0, CommandSubmissionCompleted=1397961135384,
2025-03-10 09:27:13.050 17848-17848 GHSAFM-3p-...iModelFlow com.google.homesampleapp.default D *** devicesListUiModelFlow changed ***
2025-03-10 09:27:13.174 17848-17848 GHSAFM-3p-...er$onStart com.google.homesampleapp.default E Error on suppressHalfSheetNotification (Ask Gemini)
com.google.android.gms.common.api.ApiException: 17: API: CommissioningClient.API is not available on this device. Connection failed with: ConnectionResult{statusCode=API_UNAVAILABLE, resolution=null, message=null}
at com.google.android.gms.common.internal.ApiExceptionUtil.fromStatus(com.google.android.gms:play-services-base@@18.2.0:3)
at com.google.android.gms.common.api.internal.ApiExceptionMapper.getException(com.google.android.gms:play-services-base@@18.2.0:1)
at com.google.android.gms.common.api.internal.zag.zad(com.google.android.gms:play-services-base@@18.2.0:1)
at com.google.android.gms.common.api.internal.zabq.zaE(com.google.android.gms:play-services-base@@18.2.0:7)
at com.google.android.gms.common.api.internal.zabq.zaD(com.google.android.gms:play-services-base@@18.2.0:2)
at com.google.android.gms.common.api.internal.zabq.zar(com.google.android.gms:play-services-base@@18.2.0:24)
at com.google.android.gms.common.api.internal.zabt.run(com.google.android.gms:play-services-base@@18.2.0:12)
at android.os.Handler.handleCallback(Handler.java:958)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loopOnce(Looper.java:205)
at android.os.Looper.loop(Looper.java:294)
at android.os.HandlerThread.run(HandlerThread.java:67)
2025-03-10 09:27:16.663 17848-17912 ProfileInstaller com.google.homesampleapp.default D Installing profile for com.google.homesampleapp.default

logcat logs (when I click the addDevice button):

2025-03-10 09:29:24.876 17848-17848 GHSAFM-3p-...sionDevice com.google.homesampleapp.default D onAddDeviceClick
2025-03-10 09:29:24.877 17848-17848 GHSAFM-3p-...eViewModel com.google.homesampleapp.default D unsubscribeToPeriodicUpdates()
2025-03-10 09:29:24.879 17848-17848 GHSAFM-3p-...meScreenKt com.google.homesampleapp.default D CommissionDevice: starting
2025-03-10 09:29:24.909 17848-17909 ConnectionStatusConfig com.google.homesampleapp.default W Dynamic lookup for intent failed for action: com.google.android.gms.home.service.START
2025-03-10 09:29:24.913 17848-17909 GmsClient com.google.homesampleapp.default W unable to connect to service: com.google.android.gms.home.service.START on com.google.android.gms
2025-03-10 09:29:24.978 17848-17848 GHSAFM-3p-...meScreenKt com.google.homesampleapp.default E com.google.android.gms.common.api.ApiException: 17: API: CommissioningClient.API is not available on this device. Connection failed with: ConnectionResult{statusCode=API_UNAVAILABLE, resolution=null, message=null} (Ask Gemini)
at com.google.android.gms.common.internal.ApiExceptionUtil.fromStatus(com.google.android.gms:play-services-base@@18.2.0:3)
at com.google.android.gms.common.api.internal.ApiExceptionMapper.getException(com.google.android.gms:play-services-base@@18.2.0:1)
at com.google.android.gms.common.api.internal.zag.zad(com.google.android.gms:play-services-base@@18.2.0:1)
at com.google.android.gms.common.api.internal.zabq.zaE(com.google.android.gms:play-services-base@@18.2.0:7)
at com.google.android.gms.common.api.internal.zabq.zaD(com.google.android.gms:play-services-base@@18.2.0:2)
at com.google.android.gms.common.api.internal.zabq.zar(com.google.android.gms:play-services-base@@18.2.0:24)
at com.google.android.gms.common.api.internal.zabt.run(com.google.android.gms:play-services-base@@18.2.0:12)
at android.os.Handler.handleCallback(Handler.java:958)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loopOnce(Looper.java:205)
at android.os.Looper.loop(Looper.java:294)
at android.os.HandlerThread.run(HandlerThread.java:67)

When I run the application on a emulator like the Pixel 9 Pro with api level 34, then the application works fine (only I can't use matter over an emulator).
hope this helps.

al...@mkodo.com <al...@mkodo.com> #5Apr 5, 2023 07:33AM

These are the videos of the problem (one is with the physical device and one is with the emulator)