dev_appserver.py crashes with "ImportError: No module named py27_urlquote" [200817325]

Fixed

Bug

Status Update

No update yet.

Description

mi...@353solutions.com

created issue #1

Sep 23, 2021 06:35AM

This will create a public issue which anybody can view and comment on.

Please provide as much information as possible. At least, this should include a description of your issue and steps to reproduce the problem. If possible please provide a summary of what steps or workarounds you have already tried, and any docs or articles you found (un)helpful.

Problem you have encountered:

Running dev_appserver.py app.yaml on a Go project I see the following error:

Traceback (most recent call last):
  File "/opt/gcloud/google-cloud-sdk/platform/google_appengine/dev_appserver.py", line 109, in <module>
    _run_file(__file__, globals())
  File "/opt/gcloud/google-cloud-sdk/platform/google_appengine/dev_appserver.py", line 103, in _run_file
    _execfile(_PATHS.script_file(script_name), globals_)
  File "/opt/gcloud/google-cloud-sdk/platform/google_appengine/dev_appserver.py", line 83, in _execfile
    execfile(fn, scope)
  File "/opt/gcloud/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/devappserver2.py", line 44, in <module>
    from google.appengine.tools.devappserver2 import dispatcher
  File "/opt/gcloud/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/dispatcher.py", line 43, in <module>
    from google.appengine.tools.devappserver2 import module
  File "/opt/gcloud/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/module.py", line 39, in <module>
    import py27_urlquote
ImportError: No module named py27_urlquote

What you expected to happen:

I expected to see my application running locally.

Steps to reproduce:

Other information (workarounds you have tried, documentation consulted, etc):

Comments

am...@google.com <am...@google.com> #2Sep 23, 2021 12:43PM

Assigned to gc...@google.com.

This looks like a regression from AGP 3.4 to AGP 3.5. Ian, can you have a first look?

jw...@gmail.com <jw...@gmail.com> #3Sep 28, 2021 12:36PM

Thank you very much for the reproduction project! It does indeed reproduce the issue locally. The issue appears to be the compiler failing to rewrite the invocation to a public static interface method to target the companion class created while desugaring interface methods. I'll follow up in this issue thread once more information is available and a fix is found.

mi...@gmail.com <mi...@gmail.com> #4Sep 28, 2021 03:26PM

Reassigning to Ivan as this is looking like a build issue and I'm not sure if the project configuration needs changing or there is an error in the build system.

Running:

./gradlew :quickstartKotlin:assembleDebug --info

yields output with:
<snip>/.gradle/caches/transforms-2/files-2.1/a4e476e9d975337caa4d7a965148dce1/video-android-4.2.0/jars/classes.jar: D8: Type `org.webrtc.EglBase` was not found, it is required for default or static interface methods desugaring of `void com.twilio.video.EglBaseProvider.<init>()`

More info:

The application has a dependency on com.twilio:video-android:4.2.0 and it appears to include a copy of webrtc somehow. Found it locally in .gradle/caches/transforms-2/files-2.1/HASH/video-android-4.2.0/jars/libs/libwebrtc.jar

The definition of type com.twilio.video.EglBaseProvider in video-android-4.2.0 has an <init> with a static invoke to EglBase::create.

The interface org.webrtc.EglBase is defined in libwebrtc.jar

Outside of gradle, putting libwebrtc.jar in the program path or the classpath when compiling with D8 and a min-api to desugar default interface methods, the call to EglBase::create is correctly rewritten to EglBase$-CC::create.

vb...@gmail.com <vb...@gmail.com> #5Oct 6, 2021 10:31AM

As a workaround you can add "android.enableDexingArtifactTransform.desugaring=false" to gradle.properties.

In Android Gradle Plugin 3.5 we started dexing and desugaring using Gradle artifact transforms. This allows us to use Gradle caching and parallelism. The way we set up desugaring classpath is by using dependencies information from the POM file. In this case, "video-android-4.2.0" packages libwebrtc.jar inside the AAR and we fail to add those files to desugaring classpath. D8 is unable to resolve types and to rewrite invocation to the generated companion class.

di...@google.com <di...@google.com> #6Oct 26, 2022 10:28AM

Marked as fixed, reassigned to gc...@google.com.

Note, I am facing the same issue in an app that uses a library, lets call it libraryB, that make use of webrtc but I don't include webrtc.jar in libraryB, as I use implementation configuration for libraryB. I then generates an AAR of it and import this AAR as a module to make use of it on final app. Therefore in app's build.gradle file I also import webrtc as implementation.

I have attached an android project so you can reproduce this case. webrtclibAAR module is an AAR file generated by running gradle assemble task on webrtclib module

ka...@gmail.com <ka...@gmail.com> #7Oct 26, 2022 10:33AM

Continuing my last comment:

Also I've noticed that uploading libraryB to a Nexus Server instead of using AAR as a module works properly

Message last modified on Oct 26, 2022 10:34AM

Issue 200817325