Change theme
Help
Press space for more information.
Show links for this issue (Shortcut: i, l)
Copy issue ID
Previous Issue (Shortcut: k)
Next Issue (Shortcut: j)
Sign in to use full features.
Vote: I am impacted
Notification menu
Refresh (Shortcut: Shift+r)
Go home (Shortcut: u)
Pending code changes (auto-populated)
[ID: 558956]
View issue level access limits(Press Alt + Right arrow for more information)
Attachment actions
Unintended behavior
View staffing
Description
I was directed here by the Firebase support team. They claimed the issue is with Android Studio.
When running instrumentation tests via Android Studio, targeting a matrix of devices in Firebase Test Lab, the tests run to completion and are reported back as passing. When checking the test output via the Firebase web console, the tests failed, which is the expectation.
STEPS TO REPRODUCE:
1. Select Firebase Test Lab Device Matrix as the Deployment Target in the run configuration.
2. Select the Instrumentation tests to run and execute them.
3. Wait for the suite to complete against the Matrix
4. Compare results reported in Android Studio vs Firebase.
ATTACH SCREENSHOTS/RECORDINGS OF THE ISSUE
ATTACH LOG FILES (Select Help > Show Log in Files, or Show Log in Finder on a Mac)
Firebase output:
Uploads of APK and Videos:
------------------
IMPORTANT: Please read
all required information.
------------------
Studio Build:
Version of Gradle Plugin:
Version of Gradle:
Version of Java:
OS: