IssueTracker

Stackoverflow question link

I haven't had any luck successfully running instrumentation tests against an R8 enabled (obfuscation, minification, resource shrinking) release build type in my application. When running the tests in Android Studio and within the adb shell, I receive the below error message. This is odd as I explicitly ignore obfuscation in the test proguard file.

2021-02-17 07:19:49.314 17681-17681/? E/AndroidRuntime: FATAL EXCEPTION: main
    Process: com.test.app.dev, PID: 17681
    java.lang.RuntimeException: Unable to instantiate instrumentation ComponentInfo{com.test.app.dev.test/androidx.test.runner.AndroidJUnitRunner}: java.lang.ClassNotFoundException: Didn't find class "androidx.test.runner.AndroidJUnitRunner" on path: DexPathList[[zip file "/system/framework/android.test.runner.jar", zip file "/system/framework/android.test.mock.jar", zip file "/data/app/com.test.app.dev.test-Q0rdaCrvNGnyiunUrGbnSA==/base.apk", zip file "/data/app/com.test.app.dev-YCTmDjPswxRkC74uucjXnQ==/base.apk"],nativeLibraryDirectories=[/system/lib64, /vendor/lib64, /system/product/lib64]]
        at android.app.ActivityThread.handleBindApplication(ActivityThread.java:6395)
        at android.app.ActivityThread.access$1300(ActivityThread.java:219)
        at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1859)
        at android.os.Handler.dispatchMessage(Handler.java:107)
        at android.os.Looper.loop(Looper.java:214)
        at android.app.ActivityThread.main(ActivityThread.java:7356)
        at java.lang.reflect.Method.invoke(Native Method)
        at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:492)
        at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:930)
     Caused by: java.lang.ClassNotFoundException: Didn't find class "androidx.test.runner.AndroidJUnitRunner" on path: DexPathList[[zip file "/system/framework/android.test.runner.jar", zip file "/system/framework/android.test.mock.jar", zip file "/data/app/com.test.app.dev.test-Q0rdaCrvNGnyiunUrGbnSA==/base.apk", zip file "/data/app/com.test.app.dev-YCTmDjPswxRkC74uucjXnQ==/base.apk"],nativeLibraryDirectories=[/system/lib64, /vendor/lib64, /system/product/lib64]]
        at dalvik.system.BaseDexClassLoader.findClass(BaseDexClassLoader.java:196)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:379)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:312)
        at android.app.ActivityThread.handleBindApplication(ActivityThread.java:6391)
        at android.app.ActivityThread.access$1300(ActivityThread.java:219) 
        at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1859) 
        at android.os.Handler.dispatchMessage(Handler.java:107) 
        at android.os.Looper.loop(Looper.java:214) 
        at android.app.ActivityThread.main(ActivityThread.java:7356) 
        at java.lang.reflect.Method.invoke(Native Method) 
        at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:492) 
        at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:930) 
    	Suppressed: java.lang.NoClassDefFoundError: Failed resolution of: Landroidx/test/runner/MonitoringInstrumentation;
        at java.lang.VMClassLoader.findLoadedClass(Native Method)
        at java.lang.ClassLoader.findLoadedClass(ClassLoader.java:738)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:363)
        		... 10 more
     Caused by: java.lang.ClassNotFoundException: androidx.test.runner.MonitoringInstrumentation
        		... 13 more

Has anyone had luck getting this to work? I'd imagine this is a common use case as it is ideal to have automated tests run against the variant of the application that is released to users. Here is what I've tried so far in my gradle setup:

app/build.gradle

    buildTypes {
        release {
            minifyEnabled true
            shrinkResources true
            proguardFiles getDefaultProguardFile(
                    'proguard-android-optimize.txt'),
                    'proguard-rules.pro'
            testProguardFiles 'proguard-rules-instrum.pro'
            signingConfig signingConfigs.release
        }
    }

    defaultConfig {
        minSdkVersion rootProject.minSdkVersion
        targetSdkVersion rootProject.targetSdkVersion
        versionCode rootProject.versionCode
        versionName rootProject.versionName

        testInstrumentationRunner "androidx.test.runner.AndroidJUnitRunner"
        consumerProguardFiles 'consumer-rules.pro'
        testInstrumentationRunnerArguments clearPackageData: 'true'

        javaCompileOptions {
            annotationProcessorOptions {
                arguments += ["room.schemaLocation": "$projectDir/schemas".toString()]
            }
        }
        testBuildType 'release'
    }

proguard-rules-instrum.pro

-dontshrink
-dontoptimize
-dontobfuscate

-keep class com.blwolfe.android.trailwinner.* { *; }
-keep class androidx.test.runner.AndroidJUnitRunner.* { *; }
-keep class androidx.test.runner.MonitoringInstrumentation.* { *; }
-keep class androidx.test.runner.MonitoringInstrumentation.* { *; }

Built the apks for instrumentation by running...

./gradlew app:assembleDevRelease app:assembleDevReleaseAndroidTest

Note: dev is a build flavor I use in the app.

Finally run the instrumentation tests on adb...

adb shell CLASSPATH=$(pm path androidx.test.services) app_process / androidx.test.services.shellexecutor.ShellMain am instrument -r -w -e targetInstrumentation com.test.app.dev.test/androidx.test.runner.AndroidJUnitRunner -e clearPackageData true   -e package com.test.app -e debug false androidx.test.orchestrator/androidx.test.orchestrator.AndroidTestOrchestrator

Note, this command executes the tests just fine when running against the debug build type of the dev flavor.