GAE Runtime for Python 1.9.76 Breaks dev_appserver.py [117145272]

Fixed

Bug

Status Update

No update yet.

Description

bj...@datatheorem.io

created issue #1

Oct 2, 2018 09:13PM

After updating to the Python (2.7) extensions for GAE to version 1.9.76, I am no longer able to run my code with dev_appserver.py:

```
$ dev_appserver.py --host localhost --api_port 65100 --admin_port 8000 --specified_service_ports default:8080,private:8081 public_services/public.yaml private_services/private.yaml
Traceback (most recent call last):
File "/Users/wsorvis/google-cloud-sdk/platform/google_appengine/dev_appserver.py", line 96, in <module>
_run_file(__file__, globals())
File "/Users/wsorvis/google-cloud-sdk/platform/google_appengine/dev_appserver.py", line 90, in _run_file
execfile(_PATHS.script_file(script_name), globals_)
File "/Users/wsorvis/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/devappserver2.py", line 617, in <module>
main()
File "/Users/wsorvis/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/devappserver2.py", line 605, in main
dev_server.start(options)
File "/Users/wsorvis/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/devappserver2.py", line 266, in start
env_variables=parsed_env_variables)
File "/Users/wsorvis/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/application_configuration.py", line 957, in __init__
env_variables)
File "/Users/wsorvis/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/application_configuration.py", line 140, in __init__
self._config_path)
File "/Users/wsorvis/google-cloud-sdk/platform/google_appengine/google/appengine/tools/devappserver2/application_configuration.py", line 518, in _parse_configuration
with open(configuration_path) as f:
IOError: [Errno 2] No such file or directory: 'public_services/public.yaml'
```

I examined a diff between the previous version and the latest version updated by gcloud, and I see a suspicious looking chdir:

```
$ diff -ru .install/.backup/platform/google_appengine/wrapper_util.py platform/google_appengine/wrapper_util.py
--- .install/.backup/platform/google_appengine/wrapper_util.py 1980-01-01 00:00:00.000000000 -0800
+++ platform/google_appengine/wrapper_util.py 1980-01-01 00:00:00.000000000 -0800
@@ -17,6 +17,7 @@
"""Finds the directory and target script name for App Engine SDK scripts."""

import os
+import subprocess
import sys

@@ -114,7 +115,16 @@

- self.grpc_path = os.path.join(dir_path, 'lib', 'grpcio-1.9.1')
+
+ grpc_importable = False
+ grpc_path = os.path.join(dir_path, 'lib', 'grpcio-1.9.1')
+ if os.path.exists(grpc_path):
+ os.chdir(grpc_path)
+
+
+ grpc_importable = not subprocess.call(
+ [sys.executable, '-c', 'import grpc'], stderr=subprocess.PIPE)
+ os.chdir(os.path.join('..', '..'))

self.v1_extra_paths = [
@@ -149,8 +159,9 @@
os.path.join(dir_path, 'lib', 'concurrent'),
os.path.join(dir_path, 'lib', 'ipaddr'),
os.path.join(dir_path, 'lib', 'portpicker'),
- self.grpc_path,
]
+ if grpc_importable:
+ self.api_server_extra_paths.append(grpc_path)

@@ -243,8 +254,9 @@
os.path.join(dir_path, 'lib', 'jinja2-2.6'),
os.path.join(dir_path, 'lib', 'webob-1.2.3'),
os.path.join(dir_path, 'lib', 'webapp2-2.5.1'),
- self.grpc_path,
]
+ if grpc_importable:
+ devappserver2_paths.append(grpc_path)
```

It looks as if part of the new grpc check chdir's to the grpcio directory, does a check, then it chdir's to "../.." (which would be the top-level directory for the GAE runtime for Python 2.7) instead of returning to the original working directory, so when I use relative paths to my services' app.yaml files, it fails.

Comments

vp...@vivekpuri.com <vp...@vivekpuri.com> #2Oct 3, 2018 12:01AM

agreed, i have 4/64 version and i have this shit bug.

ha...@pwc.com <ha...@pwc.com> #3Oct 3, 2018 02:17AM

4/64 same here...

ja...@monks.com <ja...@monks.com> #4Oct 3, 2018 04:27PM

+1

4/64 global version - black

to...@gmail.com <to...@gmail.com> #5Oct 3, 2018 05:05PM

4/64 same it's abysmal

am...@google.com <am...@google.com> #6Oct 3, 2018 07:36PM

Assigned to gc...@google.com.

Same in Mi A2 4/64 with Emmc Micron

ak...@gmail.com <ak...@gmail.com> #7Oct 4, 2018 12:03AM

4/64 same here...

jr...@gmail.com <jr...@gmail.com> #8Oct 5, 2018 03:58AM

I have mtp slow speed very slow like 700kb per sec
Im very sad about buying xiaomi a2

kn...@google.com <kn...@google.com> #9Oct 5, 2018 07:28PM

4/64 micron vendor. Slow write speed and can't transfer a'a movie into my mi a2 because it would take 30/40 minutes!

bj...@datatheorem.io <bj...@datatheorem.io> #10Oct 5, 2018 08:38PM

Same issue here with two Xiaomi Mi A2 4/64 black and gold. Can't clear Chrome cache unless I want an unresponsive system for 5 minutes or so. Also with AndroBench and 512 MB file size I get frezees and low write speeds (60-70 MB/s) while I can get faster writes (220-230 MB/s) with small 64 MB file size.
The issue went away right after a factory reset of the phone and appeared again after the night.

ja...@bbva.com <ja...@bbva.com> #11Oct 8, 2018 02:47PM

Confirm that!

[Deleted User] <[Deleted User]> #12Oct 8, 2018 04:04PM

Chrome crashes and reboots phone everytime I clear the large cache. Hope a fix soon!

Message last modified on Oct 8, 2018 04:04PM

ja...@gmail.com <ja...@gmail.com> #13Oct 8, 2018 04:11PM

Fingerprint sensor and smart-lock problem, I have only since the October update, previously worked the A2 (6/128) absolutely easily. I have temporarily disabled both Smart Lock and Lock Screen. Result: The device behaves as before the two October updates.

kn...@google.com <kn...@google.com> #14Oct 8, 2018 04:51PM

Fingerprint FPC issue Is not solved. The Little CPU stucks at 1401 MHz after a couple of times using the FPC sensor to unlock the device. You have to restart the device to back the min frequency to 633 MHz.
.
Many users report this issue.
.
Pls solve this issue. It's very annoying.

da...@propertytaxservices.com <da...@propertytaxservices.com> #15Oct 9, 2018 02:36AM

4/64GB

I flashed MIUI and this bug wasn't present there so it's obviously a software issue.

kk...@google.com <kk...@google.com> #16Oct 9, 2018 06:12PM

Same here

mi...@gmail.com <mi...@gmail.com> #17Oct 9, 2018 08:31PM

Yes I flashed miui i can confirm there is no reading / writing issue is there ... this is completely software issue

ak...@gmail.com <ak...@gmail.com> #18Oct 9, 2018 08:43PM

Same here, I'm afraid this won't get fixed if it doesn't make the headlines on android news sites like the CPU bug did.

And I doubt this tracker is the right place to report issues like this. The CPU bug at least got confirmed on Xiaomi forums by their employe.

kk...@google.com <kk...@google.com> #19Oct 9, 2018 09:08PM

We will try and we will find the right way. It's better than nothing. For CPU bug they started Issue tracker like this, then they made that to headlines

Message last modified on Oct 9, 2018 09:09PM

ak...@gmail.com <ak...@gmail.com> #20Oct 9, 2018 09:20PM

I have this issue

mi...@gmail.com <mi...@gmail.com> #21Oct 9, 2018 09:48PM

I have shitty benchmark results as well, but when clearing cache the phone just freezes for a few secs and then everything goes back to normal.

da...@propertytaxservices.com <da...@propertytaxservices.com> #22Oct 10, 2018 04:50AM

Same issue, once I clean cache and device is even not responding for unlock button. I tried to unlock and then I see bootscreen, but without prompting the PIN. Idk what it was, but some ROM operations make a huge impact to the system stability and almost always freeze the phone.

mi...@gmail.com <mi...@gmail.com> #23Oct 10, 2018 07:16AM

Agreed! Please fix it

kk...@google.com <kk...@google.com> #24Oct 10, 2018 11:09PM

Marked as fixed, reassigned to kk...@google.com.

4/64gb model. Having problems with large files and clearing chrome cache makes my device unresponsive.
I bought this phone because of Android one, but now it seems, that miui is better.

he...@gmail.com <he...@gmail.com> #25Oct 11, 2018 04:55PM

Thank you for reporting this issue. For us to further investigate this issue, please provide the following additional information:

Android bug report
After reproducing the issue, press the volume up, volume down, and power button simultaneously. This will capture a bug report on your device in the “bug reports” directory. Attach the bug report file to this issue.

Alternate method:
After reproducing the issue, navigate to developer settings, ensure ‘USB debugging’ is enabled, then enable ‘Bug report shortcut’. To take bug report, hold the power button and select the ‘Take bug report’ option.

Frequency
How frequently does this issue occur? (e.g 100% of the time, 10% of the time)

NOTE: Please upload the files to Google Drive and share the folder to android-bugreport@google.com, then share the link here.

kk...@google.com <kk...@google.com> #26Oct 11, 2018 05:49PM

Agreed. 4/64 gold. Fix it.

he...@gmail.com <he...@gmail.com> #27Oct 11, 2018 09:00PM

Thanks for the response.

This one is with running speed test app:

https://drive.google.com/file/d/1LfiEJrSQTLdB-bNw6ft4kWc3wHoylRTf/view?usp=drive_web (bugreport-jasmine-OPM1.171019.011-2018-10-23-10-48-16.zip)

This one is without running any app:

https://drive.google.com/file/d/11_YBAjM_S28UQhGtvB4qB3fnwlPTFWXc/view?usp=drive_web (bugreport-jasmine-OPM1.171019.011-2018-10-23-11-01-58.zip)

And about frequently, it happens all the time (100%). I can say that there is no problem when we do a Factory reset. But after few hours or one or two days, the bug appears again and eMMc writing and reading getting unstable. even without installing any application.

When we are trying to clear Chromes cache, the device starts to clearing cache. For 50 MB it takes about 30 sec time and device loses its response.

Because of this bug, the device always has some lags and touch problem. Cause internal memory has a low speed and more important than that, has an unstable speed, because its start benchmark with a good speed after few secs getting stuck, start again, the stuck! so when the device wants to read or write some bug files or too many files, the devices lose response on touch and sometimes getting a soft reboot automatically.

P.S: If you want I can send u more Bug report files in various conditions.

he...@gmail.com <he...@gmail.com> #28Oct 11, 2018 09:07PM

Link of Drive folder:

https://drive.google.com/open?id=1gGuRKW4YGRxVrclAVfkMFINBr3wrWJ1m

he...@gmail.com <he...@gmail.com> #29Oct 11, 2018 09:15PM

I am also constantly facing this issue super slow write speed when file is big
when i tried to clear chrome cache device freezed and i have to long press power button to force reboot
please look into it as soon as possible

he...@gmail.com <he...@gmail.com> #30Oct 11, 2018 10:41PM

I also have this

issue 4

/64 black model. .write read speed is not stable pls fix this asap

vi...@gmail.com <vi...@gmail.com> #31Oct 12, 2018 08:54PM

I concur with the people above...

mi...@gmail.com <mi...@gmail.com> #32Nov 15, 2018 10:18PM

4/32 gold - same

sc...@gmail.com <sc...@gmail.com> #33Nov 15, 2018 10:37PM

Not only are not 64GB, there are users using the device with 128GB that face the same problems. My 64's suffer from the same.