[AGP] :app:collectDebugDependencies failed with message is too big (2326853975 bytes) to fit in memory [393834321]

Fixed

Bug

Status Update

No update yet.

Description

kn...@gmail.com

created issue #1

Feb 2, 2025 04:24PM

DESCRIBE THE ISSUE IN DETAIL:

Recently, our CI/CD started to crash uploading symbols to crashlytics with a message like this:

Execution failed for task ':app:collectDebugDependencies'.
> File /path/to/file/aar-containing-so-with-symbols-1.0.0.aar is too big (XXXXXXXXXX bytes) to fit in memory.

After a little digging, I found that the function readBytes from kotlin stdlib which is used in task PerModuleReportDependenciesTask throws such an exception if third-party aar file (I may not be exact here) is larger than 2 gigabytes.

@DisableCachingByDefault
@BuildAnalyzer(primaryTaskCategory = TaskCategory.BUNDLE_PACKAGING)
abstract class PerModuleReportDependenciesTask : NonIncrementalTask() {

	// omitted code

    private fun getFileDigest(file: File): ByteString {
        return ByteString.copyFrom(MessageDigest.getInstance("SHA-256").digest(file.readBytes()))
		                                                                    ^ throw error
    }
}

In our case we were able to get around problem by additionally configuring PerModuleReportDependenciesTask and filtering input files by size.

I made MCVE to reproduce bug, below I will describe how to reproduce bug

STEPS TO REPRODUCE:

git clone git@github.com:IosephKnecht/agp-fit-in-memory-bug.git or download directly from attachment
./gradlew :feature-1:debugMavenPublishFake
./gradlew :app:assembleDebug

Studio Build: Android Studio Ladybug Feature Drop | 2024.2.2

Version of Gradle Plugin: 8.6.1

Version of Gradle: 8.7

Version of Java: openjdk 17.0.13 2024-10-15

OS: Ubuntu 24.04.1 LTS

agp-fit-in-memory-bug-master.zip

67 KB

Download

Comments

cm...@google.com <cm...@google.com> Feb 3, 2025 05:18PM

Assigned to an...@google.com.

je...@google.com <je...@google.com> Feb 4, 2025 05:32PM

Reassigned to wf...@google.com.

wf...@google.com <wf...@google.com> Feb 5, 2025 04:59PM

Accepted by wf...@google.com.

wf...@google.com <wf...@google.com> #2Feb 6, 2025 09:29AM

Marked as fixed.

Thanks for the feedback. To help us troubleshoot this issue further, we will need more information. Please share detailed reproduction steps and as much as possible of the following information when it applies if you haven’t already:

1. Android Studio version and OS type and version
2. Screenshots or videos of the issue
3. idea.log file (select Help > Show Log in Finder / Explorer)
4. Thread dumps if the issue is a freezing or non-responding UI.

For more information on what’s needed and how to obtain this information please read the guide at

https://developer.android.com/studio/report-bugs#studio-bugs

kn...@gmail.com <kn...@gmail.com> #3Feb 7, 2025 08:22AM

Please find the required data below: Android Studio version: Android Studio Ladybug Feature Drop | 2024.2.2 OS type and version: Microsoft Windows 10 Pro (10.0.19045 Build 19045)

I didn't have screenshots now. The issue I faced is that, when changing some code in the XML file, it take more time to reflect in the preview than usual. And sometimes, after opening the project, the preview takes more time to load and shows a loader with message 'Initializing'.

an...@google.com <an...@google.com> #4Feb 13, 2025 06:52PM

There is a frequent exception logged as a warning, in conjunction with "Recomputed N fields for..." logging (sometimes duplicated for the same fqn? see the 464 fields below):

2025-01-09 18:20:05,404 [28441383]   INFO - #o.j.a.a.InnerRClassBase - Recomputed 987 fields for ResourceRepositoryInnerRClass{fqn=com.sensei.engrow.R.string, repository=AppResourceRepository@709C7B72}
2025-01-09 18:20:19,922 [28455901]   INFO - #com.android.ddmlib - Device 'motorola-moto_g52-ZD22262ND3' jdwp process '17149' is now known as pkg='com.sensei.engrow.alpha.ro.debug' (proc='com.sensei.engrow.alpha.ro.debug')
2025-01-09 18:23:02,900 [28618879]   INFO - #o.j.a.a.InnerRClassBase - Recomputed 464 fields for ResourceRepositoryInnerRClass{fqn=com.sensei.engrow.R.layout, repository=AppResourceRepository@709C7B72}
2025-01-09 18:23:02,906 [28618885]   INFO - #o.j.a.a.InnerRClassBase - Recomputed 464 fields for ResourceRepositoryInnerRClass{fqn=com.sensei.engrow.R.layout, repository=AppResourceRepository@573BFD3D}
2025-01-09 18:23:02,908 [28618887]   INFO - #o.j.a.a.InnerRClassBase - Recomputed 169 fields for ResourceRepositoryInnerRClass{fqn=com.sensei.engrow.test.R.layout, repository=TestAppResourceRepository@13D0D7B5}
2025-01-09 18:23:03,284 [28619263]   INFO - #c.i.d.JVMResponsivenessMonitor - JVM responsiveness: {avg: 2520.7322222222224, 50%: 1900, 99%: 15303, 99.9%: 26911, max: 35327 }ns, x{3600 measurements}
2025-01-09 18:23:20,756 [28636735]   WARN - #o.j.k.i.b.p.ModuleInfoProvider - Could not find correct module information
org.jetbrains.kotlin.utils.KotlinExceptionWithAttachments: Analyzing element of type class com.intellij.psi.impl.source.PsiJavaFileImpl in non-physical file of type class com.intellij.psi.impl.source.PsiJavaFileImpl
	at org.jetbrains.kotlin.idea.base.projectStructure.ModuleInfoProvider.collectByElement(ModuleInfoProvider.kt:193)
	at org.jetbrains.kotlin.idea.base.projectStructure.ModuleInfoProvider.access$collectByElement(ModuleInfoProvider.kt:73)
	at org.jetbrains.kotlin.idea.base.projectStructure.ModuleInfoProvider$collect$1.invoke(ModuleInfoProvider.kt:108)
	at org.jetbrains.kotlin.idea.base.projectStructure.ModuleInfoProvider$collect$1.invoke(ModuleInfoProvider.kt:107)
	at org.jetbrains.kotlin.idea.base.util.SeqKt$seq$$inlined$Sequence$1.iterator(Sequences.kt:682)
	at org.jetbrains.kotlin.idea.base.projectStructure.ModuleInfoProviderKt$unwrap$1$iterator$1.<init>(ModuleInfoProvider.kt:488)
	at org.jetbrains.kotlin.idea.base.projectStructure.ModuleInfoProviderKt$unwrap$1.iterator(ModuleInfoProvider.kt:487)
	at kotlin.sequences.SequencesKt___SequencesKt.firstOrNull(_Sequences.kt:167)
	at org.jetbrains.kotlin.idea.base.projectStructure.ModuleInfoProviderUtils.firstOrNull(ModuleInfoProviderUtils.kt:43)

I suspect the non-physical PsiJavaFileImpl is an R class. I found https://youtrack.jetbrains.com/issue/KTIJ-12550/Exception-during-completion-of-unimported-R-classes-in-Android-Studio-3.3-and-3.4 in which the exception message included the fully-qualified class name, and it was one of our light R classes.

As for preview rendering, I tried opening four layout files from Signal-Android and the majority of time is spent in reflection:

Eugene, do you know which JBR has the fix for https://bugs.openjdk.org/browse/JDK-8318563?

Issue 393834321