We are trying to generate Baseline Profiles for our application using the BaselineProfiles plugin and since we want to generate it on our CI/CD pipelines we are exploring Gradle Managed devices.

As there is an already existing issue where Gradle Managed devices fail to setup on Linux machines, we are exploring the new feature of using Firebase Test Lab devices as Gradle Managed devices.

I am following the performance sample app and included the changes mentioned for running tests on Firebase Test Lab devices as Gradle Managed device. When the task generateBaselineProfile runs locally, Baseline Profiles are generated correctly. However, when run on the FTL configured device, tests are running successfully, but the profiles are not generated and I see this message in the output:

No baseline profile rules were generated for the variant `release`.
This is most likely because there are no instrumentation test for it. If this
is not intentional check that tests for this variant exist in the `baselineProfile`
dependency module.

Comparing the logs from local and FTL, I could see that the profiles are generated in a directory different than the task tries to extract from:

05-26 09:23:41.425: D/Benchmark(9473): Reference profile location: /data/misc/profiles/ref/com.example.macrobenchmark.target/primary.prof
...
05-26 09:23:41.545: D/Benchmark(9473): APK Path: /data/app/~~kpdhuDgDtK4xTg_DWXX1nQ==/com.example.macrobenchmark.target-NvgEVbxIsGXC8BzbuvHGrg==/base.apk
05-26 09:23:41.545: D/Benchmark(9473): Converting to human readable profile format
05-26 09:23:41.545: D/Benchmark(9473): Using profile location: /data/misc/profiles/ref/com.example.macrobenchmark.target/primary.prof
...
05-26 09:23:41.844: D/Benchmark(9473): Using profile location: /data/misc/profiles/cur/0/com.example.macrobenchmark.target/primary.prof
...
05-26 09:23:44.174: D/Benchmark(9473): Pull Baseline Profile with: `adb pull "/storage/emulated/0/Android/media/com.example.benchmark.baselinprofile/ComposeActivityBaselineProfileGenerator_profileGenerator-baseline-prof-2023-05-26-16-23-43.txt" .`
05-26 09:23:44.266: D/Benchmark(9473): Total Run Time Ns: 37069762291
05-26 09:23:44.268: D/Benchmark(9473): Killing process com.example.macrobenchmark.target

When run locally, I can see that it is using the same location from which it is later extracted:

2023-05-27 00:17:09.432  7983-8002  Benchmark               com...mple.benchmark.baselinprofile  D  additionalTestOutputDir=/sdcard/Android/media/com.example.benchmark.baselinprofile/additional_test_output
...
2023-05-27 00:17:09.448  7983-8002  Benchmark               com...mple.benchmark.baselinprofile  D  Usable output directory: /storage/emulated/0/Android/media/com.example.benchmark.baselinprofile
2023-05-27 00:17:09.449  7983-8002  Benchmark               com...mple.benchmark.baselinprofile  D  Output Directory: /sdcard/Android/media/com.example.benchmark.baselinprofile/additional_test_output
2023-05-27 00:17:40.452  7983-8002  Benchmark               com...mple.benchmark.baselinprofile  D  Copying /storage/emulated/0/Android/media/com.example.benchmark.baselinprofile/LoginBaselineProfileGenerator_profileGenerator-baseline-prof.txt to /sdcard/Android/media/com.example.benchmark.baselinprofile/additional_test_output/LoginBaselineProfileGenerator_profileGenerator-baseline-prof.txt
2023-05-27 00:17:40.462  7983-8002  Benchmark               com...mple.benchmark.baselinprofile  D  Pull Baseline Profile with: `adb pull "/storage/emulated/0/Android/media/com.example.benchmark.baselinprofile/LoginBaselineProfileGenerator_profileGenerator-baseline-prof-2023-05-26-18-47-40.txt" .`
2023-05-27 00:17:40.467  7983-8002  Benchmark               com...mple.benchmark.baselinprofile  D  Copying /storage/emulated/0/Android/media/com.example.benchmark.baselinprofile/LoginBaselineProfileGenerator_profileGenerator-baseline-prof-2023-05-26-18-47-40.txt to /sdcard/Android/media/com.example.benchmark.baselinprofile/additional_test_output/LoginBaselineProfileGenerator_profileGenerator-baseline-prof-2023-05-26-18-47-40.txt
2023-05-27 00:17:40.475  7983-8002  Benchmark               com...mple.benchmark.baselinprofile  D  Total Run Time Ns: 10786612088

Setup:

Android Studio Hedgehog | 2023.1.1 Canary 5

Build #AI-231.7864.76.2311.10195651, built on May 25, 2023

Runtime version: 17.0.6+0-17.0.6b829.9-10027231 aarch64

AGP 8.2.0-alpha05

Benchmark 1.2.0-alpha13

Could the copying be an issue?

I have attached the performance sample app code with the changes. Run it in the above configuration with FTL setup and should see a similar output.