Fixed
Status Update
Comments
ap...@google.com <ap...@google.com> #2
Automatic regression verification started for measurement:
ChromiumPerf/mac-m2-pro-perf/blink_perf.css/NestingIdentInvalidValue/NestingIdentInvalidValue.html
Verification workflow id: projects/62121018386/locations/us-central1/workflows/sandwich-verification-workflow-prod/executions/a6b905ed-9343-4d2b-a994-55556a5aa8bd
ChromiumPerf/mac-m2-pro-perf/blink_perf.css/NestingIdentInvalidValue/NestingIdentInvalidValue.html
Verification workflow id: projects/62121018386/locations/us-central1/workflows/sandwich-verification-workflow-prod/executions/a6b905ed-9343-4d2b-a994-55556a5aa8bd
pr...@google.com <pr...@google.com> #3
🥪 Regression verification projects/62121018386/locations/us-central1/workflows/sandwich-verification-workflow-prod/executions/a6b905ed-9343-4d2b-a994-55556a5aa8bd job 15f2fce2e10000 for test: ChromiumPerf/mac-m2-pro-perf/blink_perf.css/NestingIdentInvalidValue/NestingIdentInvalidValue.html
reproduced the regression with statistic: {'control_median': 13.009999999962748, 'lower': 10.344712166063431, 'p_value': 1.862645149230957e-09, 'treatment_median': 14.409999999776481, 'upper': 11.095673438085797}.
Proceed to bisection.
reproduced the regression with statistic: {'control_median': 13.009999999962748, 'lower': 10.344712166063431, 'p_value': 1.862645149230957e-09, 'treatment_median': 14.409999999776481, 'upper': 11.095673438085797}.
Proceed to bisection.
Description
Was reported that sailfish 26 was reporting benchmarks as non AOT, despite them being AOT compiled, dump output:
The newline inside the word status is a shell printing error which doesn't appear to affect on-device shell commands.
Looks like our parsing is too strict, will fix.