linux-aarch64 emulator crashing after qt 6.5.3 update [331001280]

Fixed

Bug

Status Update

No update yet.

Description

ru...@gmail.com

created issue #1

Mar 24, 2024 12:26PM

DESCRIBE THE ISSUE IN DETAIL:

The latest linux-aarch64 emulators from https://ci.android.com/ crash for me with the following output

INFO    | Storing crashdata in: /tmp/android-rudolfs/emu-crash-35.1.1.db, detection is enabled for process: 3715
INFO    | Android emulator version 35.1.1.0 (build_id 11594639) (CL:N/A)
INFO    | Found systemPath /opt/android-sdk//system-images/android-33/google_apis/arm64-v8a/
ERROR: ld.so: object '/opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libfreetype.so.6' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object '/opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libfreetype.so.6' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
INFO    | Storing crashdata in: /tmp/android-rudolfs/emu-crash-35.1.1.db, detection is enabled for process: 3715
INFO    | Duplicate loglines will be removed, if you wish to see each individual line launch with the -log-nofilter flag.
*** buffer overflow detected ***: terminated
[3726:3726:20240324,122430.904753:ERROR file_io_posix.cc:144] open /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq: No such file or directory (2)
[3726:3726:20240324,122430.904857:ERROR file_io_posix.cc:144] open /sys/devices/system/cpu/cpu0/cpufreq/scaling_max_freq: No such file or directory (2)
Aborted (core dumped)

and following stack trace:

Thread 1 "qemu-system-aar" received signal SIGABRT, Aborted.
[Switching to Thread 0xfffff7f564c0 (LWP 2847)]
__pthread_kill_implementation (threadid=281474841797824, signo=signo@entry=6, no_tid=no_tid@entry=0) at ./nptl/pthread_kill.c:44
44	./nptl/pthread_kill.c: No such file or directory.
(gdb) bt
#0  __pthread_kill_implementation (threadid=281474841797824, signo=signo@entry=6, no_tid=no_tid@entry=0)
    at ./nptl/pthread_kill.c:44
#1  0x0000fffff555f254 in __pthread_kill_internal (signo=6, threadid=<optimized out>) at ./nptl/pthread_kill.c:78
#2  0x0000fffff551a67c in __GI_raise (sig=sig@entry=6) at ../sysdeps/posix/raise.c:26
#3  0x0000fffff5507130 in __GI_abort () at ./stdlib/abort.c:79
#4  0x0000fffff5553308 in __libc_message (action=action@entry=do_abort, fmt=fmt@entry=0xfffff5632928 "*** %s ***: terminated\n")
    at ../sysdeps/posix/libc_fatal.c:155
#5  0x0000fffff55d5a28 in __GI___fortify_fail (msg=msg@entry=0xfffff56328c0 "buffer overflow detected")
    at ./debug/fortify_fail.c:26
#6  0x0000fffff55d41b4 in __GI___chk_fail () at ./debug/chk_fail.c:28
#7  0x0000fffff55d4e50 in __vswprintf_chk (s=<optimized out>, maxlen=<optimized out>, flag=<optimized out>, 
    slen=<optimized out>, format=<optimized out>, ap=...) at ./debug/vswprintf_chk.c:28
#8  0x0000aaaaab8ad090 in ?? ()
#9  0x0000aaaaab424a50 in ?? ()
#10 0x0000fffff62c34d4 in qt_message_output(QtMsgType, QMessageLogContext const&, QString const&) ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#11 0x0000fffff62d1454 in QDebug::~QDebug() () from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#12 0x0000fffff63abbd8 in ?? () from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#13 0x0000fffff63a70f0 in QFactoryLoader::update() ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#14 0x0000fffff63a7520 in QFactoryLoader::QFactoryLoader(char const*, QString const&, Qt::CaseSensitivity) ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#15 0x0000fffff5b31bb8 in QPlatformIntegrationFactory::keys(QString const&) ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#16 0x0000fffff5afe310 in ?? () from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#17 0x0000fffff5b019d8 in QGuiApplicationPrivate::createPlatformIntegration() ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#18 0x0000fffff5b02248 in QGuiApplicationPrivate::createEventDispatcher() ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#19 0x0000fffff633333c in QCoreApplicationPrivate::init() ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#20 0x0000fffff5b054bc in QGuiApplicationPrivate::init() ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#21 0x0000fffff69fdf94 in QApplicationPrivate::init() ()
   from /opt/android-sdk/emulator-35.1.1.0/lib64/qt/lib/libQt6WidgetsAndroidEmu.so.6
#22 0x0000aaaaab42549c in ?? ()
#23 0x0000aaaaab943fb4 in ?? ()

while my own debug build from emu-master-dev seems to behave similarly, it actually gives some errors about missing xcb plugin:

INFO    | Storing crashdata in: /tmp/android-rudolfs/emu-crash-35.1.1.db, detection is enabled for process: 3664
INFO    | Android emulator version 35.1.1.0 (build_id standalone-0) (CL:N/A)
INFO    | Found systemPath /opt/android-sdk//system-images/android-33/google_apis/arm64-v8a/
ERROR: ld.so: object '/home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libfreetype.so.6' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
ERROR: ld.so: object '/home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libfreetype.so.6' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
INFO    | Storing crashdata in: /tmp/android-rudolfs/emu-crash-35.1.1.db, detection is enabled for process: 3664
INFO    | Duplicate loglines will be removed, if you wish to see each individual line launch with the -log-nofilter flag.
INFO    | Debug: checking directory path "/home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/plugins/platforms" ... ((null):0, (null))
INFO    | Debug: checking directory path "/home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/qemu/linux-aarch64/platforms" ... ((null):0, (null))
INFO    | Debug: checking directory path "/home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/plugins" ... ((null):0, (null))
INFO    | Warning: Could not find the Qt platform plugin "xcb" in "/home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/plugins" ((null):0, (null))
Fatal: This application failed to start because no Qt platform plugin could be initialized. Reinstalling the application may fix this problem.
 ((null):0, (null))
INFO    | Fatal: This application failed to start because no Qt platform plugin could be initialized. Reinstalling the application may fix this problem.
 ((null):0, (null))
[3676:3676:20240324,121857.521414:ERROR file_io_posix.cc:144] open /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq: No such file or directory (2)
[3676:3676:20240324,121857.521511:ERROR file_io_posix.cc:144] open /sys/devices/system/cpu/cpu0/cpufreq/scaling_max_freq: No such file or directory (2)
Aborted (core dumped)

and then also fails with SIGABRT:

Thread 1 "qemu-system-aar" received signal SIGABRT, Aborted.
__pthread_kill_implementation (threadid=281474841792576, signo=signo@entry=6, no_tid=no_tid@entry=0) at ./nptl/pthread_kill.c:44
44	./nptl/pthread_kill.c: No such file or directory.
(gdb) bt
#0  __pthread_kill_implementation (threadid=281474841792576, signo=signo@entry=6, no_tid=no_tid@entry=0)
    at ./nptl/pthread_kill.c:44
#1  0x0000fffff4a5f254 in __pthread_kill_internal (signo=6, threadid=<optimized out>) at ./nptl/pthread_kill.c:78
#2  0x0000fffff4a1a67c in __GI_raise (sig=sig@entry=6) at ../sysdeps/posix/raise.c:26
#3  0x0000fffff4a07130 in __GI_abort () at ./stdlib/abort.c:79
#4  0x0000fffff57f99f4 in qAbort() ()
   from /home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#5  0x0000fffff57f9f7c in QMessageLogger::fatal(char const*, ...) const ()
   from /home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#6  0x0000fffff503ef68 in ?? ()
   from /home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#7  0x0000fffff50419d8 in QGuiApplicationPrivate::createPlatformIntegration() ()
   from /home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#8  0x0000fffff5042248 in QGuiApplicationPrivate::createEventDispatcher() ()
   from /home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#9  0x0000fffff587333c in QCoreApplicationPrivate::init() ()
   from /home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libQt6CoreAndroidEmu.so.6
#10 0x0000fffff50454bc in QGuiApplicationPrivate::init() ()
   from /home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libQt6GuiAndroidEmu.so.6
#11 0x0000fffff5f3df94 in QApplicationPrivate::init() ()
   from /home/rudolfs/emulator-linux_aarch64-debug-emu-master-dev-7e9efaa5ec1d6e0b8d128d5abb7993723d2f1e48/lib64/qt/lib/libQt6WidgetsAndroidEmu.so.6
#12 0x0000aaaaab8ad59c in ?? ()
#13 0x0000aaaaac185b74 in ?? ()
#14 0x0000aaaaac185a54 in ?? ()
#15 0x0000aaaaab2676fc in ?? ()
#16 0x0000fffff4a073fc in __libc_start_call_main (main=main@entry=0xaaaaab261e98, argc=argc@entry=11, 
    argv=argv@entry=0xffffffffe948) at ../sysdeps/nptl/libc_start_call_main.h:58
#17 0x0000fffff4a074cc in __libc_start_main_impl (main=0xaaaaab261e98, argc=11, argv=0xffffffffe948, init=<optimized out>, 
    fini=<optimized out>, rtld_fini=<optimized out>, stack_end=<optimized out>) at ../csu/libc-start.c:392

Looking at this changeset (https://android-review.googlesource.com/c/platform/prebuilts/android-emulator-build/qt/+/2976235) does show that all those plugins were removed during the qt 6.5.3 prebuilts update so the crash seems logical. Thus i have the following questions:

at this point is there any way to get a recent working linux-arch64 emulator or is it in an overall broken state? I quickly checked and the 35-1-release and 34-x-release branches all seem to be updated to 6.5.3 and I also need the proxy fix done in here (https://issuetracker.google.com/issues/314614435) so very old branches do no really work. What are my options here?
Is there a way to prebuild qt 6.5.3 for me for it to be compatible with what the emulator expects and use those binaries?

STEPS TO REPRODUCE:

Run any recent linux-aarch64 emulator from ci.android.com and observer SIGABRT

ATTACH SCREENSHOTS/RECORDINGS OF THE ISSUE

ATTACH LOG FILES (Select Help > Show Log in Files, or Show Log in Finder on a Mac)

IMPORTANT: Please read https://developer.android.com/studio/report-bugs.html carefully and supply all required information.

Studio Build: Version of Gradle Plugin: Version of Gradle: Version of Java: OS:

Comments

rk...@google.com <rk...@google.com> Mar 25, 2024 05:18PM

Assigned to jo...@google.com.

jo...@google.com <jo...@google.com> #2Apr 1, 2024 04:57PM

Thanks for the report.

I've reproduced the same crash on my raspberry pi. I'll drop a local build of emulator here for you to try once I fix it.

ru...@gmail.com <ru...@gmail.com> #3Apr 2, 2024 02:35PM

Thanks:)

ru...@gmail.com <ru...@gmail.com> #4Apr 2, 2024 06:11PM

Could you maybe also clarify - the prebuilt Qt binaries in the prebuilts repo are just a stock Qt build or are the any patches to them? Just curious if this ever happens again, could I theoretically just build the same qt version from sources and use it, or is there more to it? I saw that the transition to qt 6.5.3 added the AndroidEmu suffixes for all dynamic libraries, so I assume there is at least that nuance.

jo...@google.com <jo...@google.com> #5Apr 2, 2024 06:30PM

Re #4, it is a stock Qt build. You can see the configure arguments in external/qemu/.../qt.py.

To build Qt, our buildbots run something like this:

./prebuilts/python/linux-x86/bin/python3 tools/buildSrc/servers/build_tools.py --out_dir <your-own-out-dir>/out-prebuilts --dist_dir <your-own-dist-dir>/dist/12345678 --build-id 12345678 --prebuilts

There is an argument in Qt's configure script to add that AndroidEmu suffix (-qtlibinfix AndroidEmu).

ru...@gmail.com <ru...@gmail.com> #6Apr 2, 2024 07:02PM

Thank you very much for the clarification.

ru...@gmail.com <ru...@gmail.com> #7Apr 11, 2024 02:06PM

I saw this change: https://android-review.googlesource.com/c/platform/external/qemu/+/3021223, and yeah, this does fix the crash, but does not address the root cause of the problem - the missing xcb plugin on aarch64. Is there a plan to update the Qt prebuilts for aarch64 with that or should I assume that I'll need to compile it mysel?

jo...@google.com <jo...@google.com> #8Apr 11, 2024 02:29PM

We are currently working to update the Qt prebuilts for linux-aarch64. Hopefully will have something for you to try out within the next week.

ru...@gmail.com <ru...@gmail.com> #9Apr 11, 2024 02:41PM

Thank you very much for the update.

ru...@gmail.com <ru...@gmail.com> #10Apr 24, 2024 12:46PM

Hi, any news on qt 6.5.3 aarch64 update?

jo...@google.com <jo...@google.com> #11May 10, 2024 07:35PM

Hi, I have a local emulator build with updated Qt6 prebuilts. Could you please try and let me know if it works? Thanks!

emu-linux-aarch64.zip

534 MB

Download

ru...@gmail.com <ru...@gmail.com> #12May 10, 2024 08:12PM

I immediately get /lib/aarch64-linux-gnu/libc.so.6: version GLIBC_2.36' not found (required by /home/appetizer/emulator/lib64/libstdc++.so.6)` - most likely this was compiled on a newer system? I am on ubuntu 22.04 which has glibc 2.35 but i can try upgrading to 22.10

jo...@google.com <jo...@google.com> #13May 10, 2024 08:18PM

Hmm, I used a docker image based on ubuntu focal. The GLIBC version on it is 2.31. Maybe we are distributing a different libstdc++.so.6.

Could you try replacing the libstdc++.so.6 in /home/appetizer/emulator/lib64/ with the one in your sysroot (located probably in /lib/aarch64-linux-gnu).

In the meantime, I'll update the emulator prebuilt.

ru...@gmail.com <ru...@gmail.com> #14May 10, 2024 08:26PM

I was trying to validate what is going on in the background and yeah glibc 2.36 is pulled in by libstdc++:

./emulator: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.36' not found (required by /home/appetizer/emulator/./lib64/libstdc++.so.6)
		libc.so.6 (GLIBC_2.36) => not found

The version from your build seemes to have GLIBCXX_3.4.42 macro, where as the last one I had laying around from ci.google.com had GLIBCXX_3.4.28. Ok, ill try to replace it with the sysrooted one.

ru...@gmail.com <ru...@gmail.com> #15May 10, 2024 08:34PM

Replacing libstdc++ with the sysrooted one did work, emulator seems to be working, thank you very much - this is much snappier than the arhaic arm version I was using.

Btw when trying to shut it down via the power button on the side bar i got:

INFO    | Warning: QMetaObject::connectSlotsByName: No matching signal for on_rgbcSensorValueWidget_valueChanged() ((null):0, (null))
INFO    | Warning: QMetaObject::connectSlotsByName: No matching signal for on_posture_valueChanged(int) ((null):0, (null))
WARNING | UpdateCheck: Failure: Error
ERROR   | Error reading vhal json

but well that is most likely a separate issue.

I'll be eagerly awaiting an official build, but the main problem seems to be solved - the window comes up and seems to work so seem that the qt prebuilts are ok:) Does this also then mean that all emulator 35.x releases (x86_64 as well) will have the libstdc++ version bump?

jo...@google.com <jo...@google.com> #16May 11, 2024 03:55PM

Does this also then mean that all emulator 35.x releases (x86_64 as well) will have the libstdc++ version bump?

Only the linux-aarch64 target uses libstdc++ (all other targets ship with libc++). Also, the libstdc++ version we ship will not change from the current 34.x and 35.x releases; my local build had a newer version of libstdc++, but the buildbot used to build the release builds did not change.

ru...@gmail.com <ru...@gmail.com> #17May 11, 2024 05:42PM

Thanks for the clarification - I double checked that myself today and yeah the latest aarch64 build from ci.android.com had older libstdc++ than your build. So everything seems great, thanks for the help here. Are the qt prebuilts merged in already?

jo...@google.com <jo...@google.com> #18May 11, 2024 05:54PM

Not merged yet, but if you like to try locally, you can try these two patches: https://r.android.com/3083865, https://r.android.com/3083486

Message last modified on May 11, 2024 05:54PM

ru...@gmail.com <ru...@gmail.com> #19May 11, 2024 05:59PM

Ok,thanks a lot:)

jo...@google.com <jo...@google.com> May 14, 2024 06:06PM

Marked as fixed.