Assigned
Status Update
Comments
de...@antonsmirnov.name <de...@antonsmirnov.name> #2
AndroidManifest.xml has "requestLegacyExternalStorage" enabled:
<application
android:debuggable="false"
tools:ignore="HardcodedDebugMode"
tools:replace="android:debuggable"
android:requestLegacyExternalStorage="true"/>
<application
android:debuggable="false"
tools:ignore="HardcodedDebugMode"
tools:replace="android:debuggable"
android:requestLegacyExternalStorage="true"/>
de...@antonsmirnov.name <de...@antonsmirnov.name> #3
full log
de...@antonsmirnov.name <de...@antonsmirnov.name> #4
It's the same if running from cmd with gradle:
---
~/Documents/dev/src/jni-benchmarking (master) asmirnov
> ./gradlew :benchmarking:connectedCheck
> Task :calculator:externalNativeBuildRelease
Build calculator_armeabi-v7a
ninja: no work to do.
Build calculator_arm64-v8a
ninja: no work to do.
Build calculator_x86
ninja: no work to do.
Build calculator_x86_64
ninja: no work to do.
> Task :engine:externalNativeBuildRelease
Build libprotobuf-lite_armeabi-v7a
ninja: no work to do.
Build engine_armeabi-v7a
ninja: no work to do.
Build engine_arm64-v8a
ninja: no work to do.
Build libprotobuf-lite_arm64-v8a
ninja: no work to do.
Build engine_x86
ninja: no work to do.
Build libprotobuf-lite_x86
ninja: no work to do.
Build libprotobuf-lite_x86_64
ninja: no work to do.
Build engine_x86_64
ninja: no work to do.
> Task :lib:externalNativeBuildRelease
Build benchmark_armeabi-v7a
ninja: no work to do.
Build benchmark_arm64-v8a
ninja: no work to do.
Build benchmark_x86
ninja: no work to do.
Build benchmark_x86_64
ninja: no work to do.
> Task :benchmarking:connectedReleaseAndroidTest
06:52:22 V/ddms: execute: running am get-config
06:52:22 V/ddms: execute 'am get-config' on 'f524e0a9' : EOF hit. Read: -1
06:52:22 V/ddms: execute: returning
06:52:22 D/benchmarking-release-androidTest.apk: Uploading benchmarking-release-androidTest.apk onto device 'f524e0a9'
06:52:22 D/Device: Uploading file onto device 'f524e0a9'
06:52:22 D/ddms: Reading file permision of /Users/asmirnov/Documents/dev/src/jni-benchmarking/benchmarking/build/outputs/apk/androidTest/release/benchmarking-release-androidTest.apk as: rw-r--r--
06:52:22 V/ddms: execute: running pm install -r -t "/data/local/tmp/benchmarking-release-androidTest.apk"
06:52:25 V/ddms: execute 'pm install -r -t "/data/local/tmp/benchmarking-release-androidTest.apk"' on 'f524e0a9' : EOF hit. Read: -1
06:52:25 V/ddms: execute: returning
06:52:25 V/ddms: execute: running rm "/data/local/tmp/benchmarking-release-androidTest.apk"
06:52:25 V/ddms: execute 'rm "/data/local/tmp/benchmarking-release-androidTest.apk"' on 'f524e0a9' : EOF hit. Read: -1
06:52:25 V/ddms: execute: returning
06:52:25 I/RemoteAndroidTest: Running am instrument -w -r -e no-isolated-storage 1 -e androidx.benchmark.output.enable true com.eyeo.ctu.benchmarking.test/androidx.benchmark.junit4.AndroidBenchmarkRunner on Mi 9T - 10
06:52:25 V/ddms: execute: running am instrument -w -r -e no-isolated-storage 1 -e androidx.benchmark.output.enable true com.eyeo.ctu.benchmarking.test/androidx.benchmark.junit4.AndroidBenchmarkRunner
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: class=com.eyeo.ctu.CalculatorBenchmark
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: current=1
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: numtests=25
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: stream=
06:52:26 V/InstrumentationResultParser: com.eyeo.ctu.CalculatorBenchmark:
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: test=benchmarkCalculatorAdd_overJni
Starting 25 tests on Mi 9T - 10
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS_CODE: 1
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: class=com.eyeo.ctu.CalculatorBenchmark
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: current=1
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: numtests=25
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: ERRORS (not suppressed): ACTIVITY-MISSING
06:53:11 V/InstrumentationResultParser: (Suppressed errors: )
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: WARNING: Not using IsolationActivity via AndroidBenchmarkRunner
06:53:11 V/InstrumentationResultParser: AndroidBenchmarkRunner should be used to isolate benchmarks from interference
06:53:11 V/InstrumentationResultParser: from other visible apps. To fix this, add the following to your module-level
06:53:11 V/InstrumentationResultParser: build.gradle:
06:53:11 V/InstrumentationResultParser: android.defaultConfig.testInstrumentationRunner
06:53:11 V/InstrumentationResultParser: = "androidx.benchmark.junit4.AndroidBenchmarkRunner"
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: While you can suppress these errors (turning them into warnings)
06:53:11 V/InstrumentationResultParser: PLEASE NOTE THAT EACH SUPPRESSED ERROR COMPROMISES ACCURACY
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: // Sample suppression, in a benchmark module's build.gradle:
06:53:11 V/InstrumentationResultParser: android {
06:53:11 V/InstrumentationResultParser: defaultConfig {
06:53:11 V/InstrumentationResultParser: // Enable measuring on an emulator, or devices with low battery
06:53:11 V/InstrumentationResultParser: testInstrumentationRunnerArgument
06:53:11 V/InstrumentationResultParser: 'androidx.benchmark.suppressErrors', 'EMULATOR,LOW_BATTERY'
06:53:11 V/InstrumentationResultParser: }
06:53:11 V/InstrumentationResultParser: }
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.BenchmarkState.keepRunningInternal(BenchmarkState.kt:341)
06:53:11 V/InstrumentationResultParser: at com.eyeo.ctu.CalculatorBenchmark.benchmarkCalculatorAdd_overJni(CalculatorBenchmark.kt:57)
06:53:11 V/InstrumentationResultParser: at java.lang.reflect.Method.invoke(Native Method)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
06:53:11 V/InstrumentationResultParser: at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
06:53:11 V/InstrumentationResultParser: at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRule$applyInternal$1.invoke(BenchmarkRule.kt:196)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRule$applyInternal$1.invoke(BenchmarkRule.kt:76)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRuleKt$Statement$1.evaluate(BenchmarkRule.kt:247)
06:53:11 V/InstrumentationResultParser: at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:134)
06:53:11 V/InstrumentationResultParser: at org.junit.rules.RunRules.evaluate(RunRules.java:20)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.Suite.runChild(Suite.java:128)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.Suite.runChild(Suite.java:27)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
06:53:11 V/InstrumentationResultParser: at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
06:53:11 V/InstrumentationResultParser: at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
06:53:11 V/InstrumentationResultParser: at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56)
06:53:11 V/InstrumentationResultParser: at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:395)
06:53:11 V/InstrumentationResultParser: at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2204)
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: stream=
06:53:11 V/InstrumentationResultParser: Error in benchmarkCalculatorAdd_overJni(com.eyeo.ctu.CalculatorBenchmark):
06:53:11 V/InstrumentationResultParser: java.lang.AssertionError: ERRORS (not suppressed): ACTIVITY-MISSING
06:53:11 V/InstrumentationResultParser: (Suppressed errors: )
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: WARNING: Not using IsolationActivity via AndroidBenchmarkRunner
06:53:11 V/InstrumentationResultParser: AndroidBenchmarkRunner should be used to isolate benchmarks from interference
06:53:11 V/InstrumentationResultParser: from other visible apps. To fix this, add the following to your module-level
06:53:11 V/InstrumentationResultParser: build.gradle:
06:53:11 V/InstrumentationResultParser: android.defaultConfig.testInstrumentationRunner
06:53:11 V/InstrumentationResultParser: = "androidx.benchmark.junit4.AndroidBenchmarkRunner"
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: While you can suppress these errors (turning them into warnings)
06:53:11 V/InstrumentationResultParser: PLEASE NOTE THAT EACH SUPPRESSED ERROR COMPROMISES ACCURACY
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: // Sample suppression, in a benchmark module's build.gradle:
06:53:11 V/InstrumentationResultParser: android {
06:53:11 V/InstrumentationResultParser: defaultConfig {
06:53:11 V/InstrumentationResultParser: // Enable measuring on an emulator, or devices with low battery
06:53:11 V/InstrumentationResultParser: testInstrumentationRunnerArgument
06:53:11 V/InstrumentationResultParser: 'androidx.benchmark.suppressErrors', 'EMULATOR,LOW_BATTERY'
06:53:11 V/InstrumentationResultParser: }
06:53:11 V/InstrumentationResultParser: }
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.BenchmarkState.keepRunningInternal(BenchmarkState.kt:341)
06:53:11 V/InstrumentationResultParser: at com.eyeo.ctu.CalculatorBenchmark.benchmarkCalculatorAdd_overJni(CalculatorBenchmark.kt:57)
06:53:11 V/InstrumentationResultParser: at java.lang.reflect.Method.invoke(Native Method)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
06:53:11 V/InstrumentationResultParser: at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
06:53:11 V/InstrumentationResultParser: at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRule$applyInternal$1.invoke(BenchmarkRule.kt:196)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRule$applyInternal$1.invoke(BenchmarkRule.kt:76)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRuleKt$Statement$1.evaluate(BenchmarkRule.kt:247)
06:53:11 V/InstrumentationResultParser: at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:134)
06:53:11 V/InstrumentationResultParser: at org.junit.rules.RunRules.evaluate(RunRules.java:20)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.Suite.runChild(Suite.java:128)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.Suite.runChild(Suite.java:27)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
06:53:11 V/InstrumentationResultParser: at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
06:53:11 V/InstrumentationResultParser: at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
06:53:11 V/InstrumentationResultParser: at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56)
06:53:11 V/InstrumentationResultParser: at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:395)
06:53:11 V/InstrumentationResultParser: at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2204)
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: test=benchmarkCalculatorAdd_overJni
com.eyeo.ctu.CalculatorBenchmark > benchmarkCalculatorAdd_overJni[Mi 9T - 10] FAILED
java.lang.AssertionError: ERRORS (not suppressed): ACTIVITY-MISSING
(Suppressed errors: )
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS_CODE: -2
06:53:56 V/InstrumentationResultParser:
---
~/Documents/dev/src/jni-benchmarking (master) asmirnov
> ./gradlew :benchmarking:connectedCheck
> Task :calculator:externalNativeBuildRelease
Build calculator_armeabi-v7a
ninja: no work to do.
Build calculator_arm64-v8a
ninja: no work to do.
Build calculator_x86
ninja: no work to do.
Build calculator_x86_64
ninja: no work to do.
> Task :engine:externalNativeBuildRelease
Build libprotobuf-lite_armeabi-v7a
ninja: no work to do.
Build engine_armeabi-v7a
ninja: no work to do.
Build engine_arm64-v8a
ninja: no work to do.
Build libprotobuf-lite_arm64-v8a
ninja: no work to do.
Build engine_x86
ninja: no work to do.
Build libprotobuf-lite_x86
ninja: no work to do.
Build libprotobuf-lite_x86_64
ninja: no work to do.
Build engine_x86_64
ninja: no work to do.
> Task :lib:externalNativeBuildRelease
Build benchmark_armeabi-v7a
ninja: no work to do.
Build benchmark_arm64-v8a
ninja: no work to do.
Build benchmark_x86
ninja: no work to do.
Build benchmark_x86_64
ninja: no work to do.
> Task :benchmarking:connectedReleaseAndroidTest
06:52:22 V/ddms: execute: running am get-config
06:52:22 V/ddms: execute 'am get-config' on 'f524e0a9' : EOF hit. Read: -1
06:52:22 V/ddms: execute: returning
06:52:22 D/benchmarking-release-androidTest.apk: Uploading benchmarking-release-androidTest.apk onto device 'f524e0a9'
06:52:22 D/Device: Uploading file onto device 'f524e0a9'
06:52:22 D/ddms: Reading file permision of /Users/asmirnov/Documents/dev/src/jni-benchmarking/benchmarking/build/outputs/apk/androidTest/release/benchmarking-release-androidTest.apk as: rw-r--r--
06:52:22 V/ddms: execute: running pm install -r -t "/data/local/tmp/benchmarking-release-androidTest.apk"
06:52:25 V/ddms: execute 'pm install -r -t "/data/local/tmp/benchmarking-release-androidTest.apk"' on 'f524e0a9' : EOF hit. Read: -1
06:52:25 V/ddms: execute: returning
06:52:25 V/ddms: execute: running rm "/data/local/tmp/benchmarking-release-androidTest.apk"
06:52:25 V/ddms: execute 'rm "/data/local/tmp/benchmarking-release-androidTest.apk"' on 'f524e0a9' : EOF hit. Read: -1
06:52:25 V/ddms: execute: returning
06:52:25 I/RemoteAndroidTest: Running am instrument -w -r -e no-isolated-storage 1 -e androidx.benchmark.output.enable true com.eyeo.ctu.benchmarking.test/androidx.benchmark.junit4.AndroidBenchmarkRunner on Mi 9T - 10
06:52:25 V/ddms: execute: running am instrument -w -r -e no-isolated-storage 1 -e androidx.benchmark.output.enable true com.eyeo.ctu.benchmarking.test/androidx.benchmark.junit4.AndroidBenchmarkRunner
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: class=com.eyeo.ctu.CalculatorBenchmark
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: current=1
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: numtests=25
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: stream=
06:52:26 V/InstrumentationResultParser: com.eyeo.ctu.CalculatorBenchmark:
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: test=benchmarkCalculatorAdd_overJni
Starting 25 tests on Mi 9T - 10
06:52:26 V/InstrumentationResultParser: INSTRUMENTATION_STATUS_CODE: 1
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: class=com.eyeo.ctu.CalculatorBenchmark
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: current=1
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: id=AndroidJUnitRunner
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: numtests=25
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: stack=java.lang.AssertionError: ERRORS (not suppressed): ACTIVITY-MISSING
06:53:11 V/InstrumentationResultParser: (Suppressed errors: )
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: WARNING: Not using IsolationActivity via AndroidBenchmarkRunner
06:53:11 V/InstrumentationResultParser: AndroidBenchmarkRunner should be used to isolate benchmarks from interference
06:53:11 V/InstrumentationResultParser: from other visible apps. To fix this, add the following to your module-level
06:53:11 V/InstrumentationResultParser: build.gradle:
06:53:11 V/InstrumentationResultParser: android.defaultConfig.testInstrumentationRunner
06:53:11 V/InstrumentationResultParser: = "androidx.benchmark.junit4.AndroidBenchmarkRunner"
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: While you can suppress these errors (turning them into warnings)
06:53:11 V/InstrumentationResultParser: PLEASE NOTE THAT EACH SUPPRESSED ERROR COMPROMISES ACCURACY
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: // Sample suppression, in a benchmark module's build.gradle:
06:53:11 V/InstrumentationResultParser: android {
06:53:11 V/InstrumentationResultParser: defaultConfig {
06:53:11 V/InstrumentationResultParser: // Enable measuring on an emulator, or devices with low battery
06:53:11 V/InstrumentationResultParser: testInstrumentationRunnerArgument
06:53:11 V/InstrumentationResultParser: 'androidx.benchmark.suppressErrors', 'EMULATOR,LOW_BATTERY'
06:53:11 V/InstrumentationResultParser: }
06:53:11 V/InstrumentationResultParser: }
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.BenchmarkState.keepRunningInternal(BenchmarkState.kt:341)
06:53:11 V/InstrumentationResultParser: at com.eyeo.ctu.CalculatorBenchmark.benchmarkCalculatorAdd_overJni(CalculatorBenchmark.kt:57)
06:53:11 V/InstrumentationResultParser: at java.lang.reflect.Method.invoke(Native Method)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
06:53:11 V/InstrumentationResultParser: at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
06:53:11 V/InstrumentationResultParser: at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRule$applyInternal$1.invoke(BenchmarkRule.kt:196)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRule$applyInternal$1.invoke(BenchmarkRule.kt:76)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRuleKt$Statement$1.evaluate(BenchmarkRule.kt:247)
06:53:11 V/InstrumentationResultParser: at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:134)
06:53:11 V/InstrumentationResultParser: at org.junit.rules.RunRules.evaluate(RunRules.java:20)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.Suite.runChild(Suite.java:128)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.Suite.runChild(Suite.java:27)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
06:53:11 V/InstrumentationResultParser: at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
06:53:11 V/InstrumentationResultParser: at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
06:53:11 V/InstrumentationResultParser: at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56)
06:53:11 V/InstrumentationResultParser: at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:395)
06:53:11 V/InstrumentationResultParser: at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2204)
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: stream=
06:53:11 V/InstrumentationResultParser: Error in benchmarkCalculatorAdd_overJni(com.eyeo.ctu.CalculatorBenchmark):
06:53:11 V/InstrumentationResultParser: java.lang.AssertionError: ERRORS (not suppressed): ACTIVITY-MISSING
06:53:11 V/InstrumentationResultParser: (Suppressed errors: )
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: WARNING: Not using IsolationActivity via AndroidBenchmarkRunner
06:53:11 V/InstrumentationResultParser: AndroidBenchmarkRunner should be used to isolate benchmarks from interference
06:53:11 V/InstrumentationResultParser: from other visible apps. To fix this, add the following to your module-level
06:53:11 V/InstrumentationResultParser: build.gradle:
06:53:11 V/InstrumentationResultParser: android.defaultConfig.testInstrumentationRunner
06:53:11 V/InstrumentationResultParser: = "androidx.benchmark.junit4.AndroidBenchmarkRunner"
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: While you can suppress these errors (turning them into warnings)
06:53:11 V/InstrumentationResultParser: PLEASE NOTE THAT EACH SUPPRESSED ERROR COMPROMISES ACCURACY
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: // Sample suppression, in a benchmark module's build.gradle:
06:53:11 V/InstrumentationResultParser: android {
06:53:11 V/InstrumentationResultParser: defaultConfig {
06:53:11 V/InstrumentationResultParser: // Enable measuring on an emulator, or devices with low battery
06:53:11 V/InstrumentationResultParser: testInstrumentationRunnerArgument
06:53:11 V/InstrumentationResultParser: 'androidx.benchmark.suppressErrors', 'EMULATOR,LOW_BATTERY'
06:53:11 V/InstrumentationResultParser: }
06:53:11 V/InstrumentationResultParser: }
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.BenchmarkState.keepRunningInternal(BenchmarkState.kt:341)
06:53:11 V/InstrumentationResultParser: at com.eyeo.ctu.CalculatorBenchmark.benchmarkCalculatorAdd_overJni(CalculatorBenchmark.kt:57)
06:53:11 V/InstrumentationResultParser: at java.lang.reflect.Method.invoke(Native Method)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
06:53:11 V/InstrumentationResultParser: at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
06:53:11 V/InstrumentationResultParser: at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRule$applyInternal$1.invoke(BenchmarkRule.kt:196)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRule$applyInternal$1.invoke(BenchmarkRule.kt:76)
06:53:11 V/InstrumentationResultParser: at androidx.benchmark.junit4.BenchmarkRuleKt$Statement$1.evaluate(BenchmarkRule.kt:247)
06:53:11 V/InstrumentationResultParser: at androidx.test.rule.GrantPermissionRule$RequestPermissionStatement.evaluate(GrantPermissionRule.java:134)
06:53:11 V/InstrumentationResultParser: at org.junit.rules.RunRules.evaluate(RunRules.java:20)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.Suite.runChild(Suite.java:128)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.Suite.runChild(Suite.java:27)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
06:53:11 V/InstrumentationResultParser: at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
06:53:11 V/InstrumentationResultParser: at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
06:53:11 V/InstrumentationResultParser: at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
06:53:11 V/InstrumentationResultParser: at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56)
06:53:11 V/InstrumentationResultParser: at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:395)
06:53:11 V/InstrumentationResultParser: at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2204)
06:53:11 V/InstrumentationResultParser:
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS: test=benchmarkCalculatorAdd_overJni
com.eyeo.ctu.CalculatorBenchmark > benchmarkCalculatorAdd_overJni[Mi 9T - 10] FAILED
java.lang.AssertionError: ERRORS (not suppressed): ACTIVITY-MISSING
(Suppressed errors: )
06:53:11 V/InstrumentationResultParser: INSTRUMENTATION_STATUS_CODE: -2
06:53:56 V/InstrumentationResultParser:
Description
Version used: 1.0.0
Devices/Android versions reproduced on: Xiaomi Mi 9T
If this is a bug in the library, we would appreciate if you could attach:
- Sample project to trigger the issue.
- A screenrecord or screenshots showing the issue (if UI related).
---
benchmarking
---
2020-12-15 18:33:57.423 15600-15622/? E/THREAD_STATE: Thread[UiAutomation,5,main]
android.os.MessageQueue.nativePollOnce(Native Method)
android.os.MessageQueue.next(MessageQueue.java:336)
android.os.Looper.loop(Looper.java:181)
android.os.HandlerThread.run(HandlerThread.java:67)
Thread[HeapTaskDaemon,5,system]
Thread[MonitoringInstrumentation,5,main]
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Object.java:442)
java.lang.Object.wait(Object.java:568)
android.app.Instrumentation.startActivitySync(Instrumentation.java:527)
android.app.Instrumentation.startActivitySync(Instrumentation.java:465)
androidx.test.runner.MonitoringInstrumentation.access$201(MonitoringInstrumentation.java:100)
androidx.test.runner.MonitoringInstrumentation$4.call(MonitoringInstrumentation.java:480)
androidx.test.runner.MonitoringInstrumentation$4.call(MonitoringInstrumentation.java:477)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
java.lang.Thread.run(Thread.java:919)
Thread[Instr: androidx.benchmark.junit4.AndroidBenchmarkRunner,5,main]
dalvik.system.VMStack.getThreadStackTrace(Native Method)
java.lang.Thread.getStackTrace(Thread.java:1720)
java.lang.Thread.getAllStackTraces(Thread.java:1796)
androidx.test.runner.MonitoringInstrumentation.getThreadState(MonitoringInstrumentation.java:680)
androidx.test.runner.MonitoringInstrumentation.dumpThreadStateToOutputs(MonitoringInstrumentation.java:675)
androidx.test.runner.MonitoringInstrumentation.startActivitySync(MonitoringInstrumentation.java:487)
androidx.benchmark.IsolationActivity$Companion.launchSingleton(IsolationActivity.kt:145)
androidx.benchmark.junit4.AndroidBenchmarkRunner.waitForActivitiesToComplete(AndroidBenchmarkRunner.kt:80)
androidx.test.runner.AndroidJUnitRunner$1.run(AndroidJUnitRunner.java:452)
androidx.test.internal.runner.listener.ActivityFinisherRunListener.testStarted(ActivityFinisherRunListener.java:48)
org.junit.runner.notification.SynchronizedRunListener.testStarted(SynchronizedRunListener.java:49)
org.junit.runner.notification.RunNotifier$3.notifyListener(RunNotifier.java:121)
org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72)
org.junit.runner.notification.RunNotifier.fireTestStarted(RunNotifier.java:118)
org.junit.internal.runners.model.EachTestNotifier.fireTestStarted(EachTestNotifier.java:42)
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:323)
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
org.junit.runners.ParentRunner.run(ParentRunner.java:363)
org.junit.runners.Suite.runChild(Suite.java:128)
org.junit.runners.Suite.runChild(Suite.java:27)
org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
org.junit.runners.ParentRunner.run(ParentRunner.java:363)
org.junit.runner.JUnitCore.run(JUnitCore.java:137)
org.junit.runner.JUnitCore.run(JUnitCore.java:115)
androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56)
androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:395)
android.app.Instrumentation$InstrumentationThread.run(Inst
2020-12-15 18:33:57.425 15600-15622/? E/TestRunner: failed: Test mechanism
2020-12-15 18:33:57.425 15600-15622/? E/TestRunner: ----- begin exception -----
2020-12-15 18:33:57.426 15600-15622/? E/TestRunner: java.lang.RuntimeException: Could not launch intent Intent { act=android.intent.action.MAIN flg=0x30000000 cmp=com.eyeo.ctu.benchmarking.test/androidx.benchmark.IsolationActivity } within 45000 milliseconds. Perhaps the main thread has not gone idle within a reasonable amount of time? There could be an animation or something constantly repainting the screen. Or the activity is doing network calls on creation? See the threaddump logs. For your reference the last time the event queue was idle before your activity launch request was 1608039192419 and now the last time the queue went idle was: 1608039192419. If these numbers are the same your activity might be hogging the event queue.
at androidx.test.runner.MonitoringInstrumentation.startActivitySync(MonitoringInstrumentation.java:490)
at androidx.benchmark.IsolationActivity$Companion.launchSingleton(IsolationActivity.kt:145)
at androidx.benchmark.junit4.AndroidBenchmarkRunner.waitForActivitiesToComplete(AndroidBenchmarkRunner.kt:80)
at androidx.test.runner.AndroidJUnitRunner$1.run(AndroidJUnitRunner.java:452)
at androidx.test.internal.runner.listener.ActivityFinisherRunListener.testStarted(ActivityFinisherRunListener.java:48)
at org.junit.runner.notification.SynchronizedRunListener.testStarted(SynchronizedRunListener.java:49)
at org.junit.runner.notification.RunNotifier$3.notifyListener(RunNotifier.java:121)
at org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72)
at org.junit.runner.notification.RunNotifier.fireTestStarted(RunNotifier.java:118)
at org.junit.internal.runners.model.EachTestNotifier.fireTestStarted(EachTestNotifier.java:42)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:323)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at androidx.test.internal.runner.TestExecutor.execute(TestExecutor.java:56)
at androidx.test.runner.AndroidJUnitRunner.onStart(AndroidJUnitRunner.java:395)
at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:2204)
2020-12-15 18:33:57.426 15600-15622/? E/TestRunner: ----- end exception -----
2020-12-15 18:33:57.429 15600-15622/? I/GrantPermissionCallable: Permission: android.permission.WRITE_EXTERNAL_STORAGE is already granted!
2020-12-15 18:33:57.429 15600-15622/? I/GrantPermissionCallable: Permission: android.permission.READ_EXTERNAL_STORAGE is already granted!
2020-12-15 18:33:57.430 15600-15622/? D/Benchmark: -- Running com.eyeo.ctu.EngineBenchmark#testProtoMatches_buffer_wire --