Status Update
Comments
ed...@google.com <ed...@google.com> #2
I am not sure I understand the use case. how can the benchmark be code to real world scenario when it's not possible to do right now ? which scenario is it ?
In any case, since this would be for benchmarking, this would clearly not be available through the public DSL. We should find a semi-private way of doing this (maybe the private variant API object could offer that functionality for instance or a property).
yu...@google.com <yu...@google.com>
yu...@google.com <yu...@google.com> #3
We want benchmarks to measure code after Progaurd / R8, but it's not possible to turn that on for androidTests in library modules at the moment (to my knowledge?)
Benchmarks are also a public facing thing, but we have a plugin to help configure gradle builds for our users, so if support for this ends up in a private API, we could try to keep those usages localized to our code perhaps.
ed...@google.com <ed...@google.com> #4
Any update on the status of this request and when it can be supported?
Thanks,
Amanda
er...@google.com <er...@google.com> #5
this is not part of our OKR at this point so we are not talking soon. at first glance, we would need to simulate usage patterns to minify against and such, this seems substantial amount of work. there are not a lot of library module that have android tests, most only rely on unit-tests.
how important is this ? we are out of PM right now but I suspect the next step will be to negotiate with J. Eason and xav@ to scale a priority level.
er...@google.com <er...@google.com>
dr...@google.com <dr...@google.com>
sa...@google.com <sa...@google.com> #6
This is a high priority request for Compose, to enable their benchmarks to measure release accurate performance. (Micro) Benchmarks are library modules, as they don't need the complexity of multi-apk tests - they're self measuring APKs that depend on libraries. (d.android.com/benchmark)
there are not a lot of library module that have android tests, most only rely on unit-tests.
To clarify, this is for com.android.library
modules, not jars - I'd expect most of those to use android tests (all of the libraries in jetpack for example do).
we would need to simulate usage patterns to minify against and such, this seems substantial amount of work
Simulate usage patterns? I don't understand - the dev can themselves provide a keep rule for test infra / classes if necessary. Long term, keep rules should be provided by test libraries.
dr...@google.com <dr...@google.com>
ny...@google.com <ny...@google.com> #7
We've been experimenting with ways to work around this for Compose. Performance results from R8 seem significantly different, and would enable us to measure much more accurately. I've tried to come up with a workaround using a com.android.app module, and while it almost works (and we can get measurements), it's extremely hacky and doesn't let us run tests anymore via Studio:
Description
TLDR: Better Bug detected a Java crash issue in com.united.mobile.android.
What
Crash signature
CrashID: 3209194292499744094
View field metrics about this crash in below Android Performance Console links:
User experience
What type of issue is this?
Crash
What was the effect of this issue on your device usage, such as lost time or work?
High
When
Time and frequency
When did this happen?
Dec 09, 2024 03:37:14 AM GMT+00:00
How often has this happened?
Every time
Where
Component
Originating component: Android > Android OS & Apps > App compatibility (87178)
Build and device data
- Build Number: google/tegu/tegu:15/BD4A.240925.092/12753740:userdebug/dev-keys
(Note: It is the build when sending this report. For exact build reference, please see the attached bugreport.)
- Serial Number: 49171JEBF00661
- Hardware Revision: PVT1.0
Related apps
United Airlines
com.united.mobile.android
Version 3544 (4.2.23)
Not system app
Related process
com.united.mobile.android
Debugging information
Google Play services
com.google.android.gms
Version 244932035 (24.49.32 (260400-702776308))
System App (Updated)
Android System WebView
com.google.android.webview
Version 677810433 (131.0.6778.104)
System App (Updated)
Network operator: vodafone UK
SIM operator: Vodafone
Filed by go/betterbug. Version (Updated): 2.46-betterbug.internal_20241023_RC05 (PRODUCTION)
Issue detected by Better Bug.
Logs
Auto detected stacktrace: