Status Update
No update yet.
Comments
ma...@google.com
ma...@google.com
ar...@tummee.com
ar...@gmail.com
ar...@gmail.com
mu...@gmail.com
ar...@gmail.com
Can somebody tell the exact metric for memory based autoscaling
ma...@gmail.com
Just to add up to the above thread, we are also facing the issues mentioned above. However some of our logging errors also include a deadline exceeded error, where the google cloud logging library fails to submit a batch of logs. Here is an example for the above:
Failed to submit 10 logs
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/grpc/_channel.py", line 1160, in __call__
return _end_unary_response_blocking(state, call, False, None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/grpc/_channel.py", line 1003, in _end_unary_response_blocking
raise _InactiveRpcError(state) # pytype: disable=not-instantiable
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2024-02-15T04:49:06.644899178+00:00"}"
Then it further says that the above exception was the result of the following exception:
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/google/api_core/timeout.py", line 120, in func_with_timeout
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/google/api_core/grpc_helpers.py", line 78, in error_remapped_callable
raise exceptions.from_grpc_error(exc) from exc
google.api_core.exceptions.DeadlineExceeded: 504 Deadline Exceeded
Is there a solution to prevent this issue?
ka...@google.com
Hello,
According to the
Please note that the Issue Tracker is primarily meant for reporting bugs and requesting new features. If you have any additional issues or concerns, please don’t hesitate to create a new thread on the
Description
Hello Google Cloud Support,
We have recently migrated our application from Python 2 to Python 3 on Google App Engine and are encountering a recurring issue related to logging. Despite the application's functionality appearing unaffected, our error console consistently reports problems with submitting logs. This issue seems to be happening in the background but it is causing concerns regarding the reliability and integrity of our logging process, which is critical to us for analytics and security.
Error Details:
The error we are seeing is as follows:
"Failed to submit 10 logs"
And the traceback includes:
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/google/api_core/grpc_helpers.py", line 79, in error_remapped_callable return callable_(*args, **kwargs)
File "/layers/google.python.pip/pip/lib/python3.11/site-packages/grpc/_channel.py", line 1160, in __call__
return _end_unary_response_blocking(state, call, False, None)
(See Image for more extensive trace)
FYI: We now have over 2,500+ occurrences of the issue in less than 2 days!!!
What we expected to happen: No issues with submitting logs
Steps to reproduce: Unknown
Other information (workarounds we have tried, documentation consulted, etc):
1. Try to identify if these errors occur when hitting particular endpoint - could not identify as errors keep happening all around, every minute and are not associated with any request log
2. We ensure to use latest cloud SDK CLI version while deploying (459.0.0)
3. We ensured to use the gcloud beta command
4. There is a Github thread for a similar error which says the issue got fixed back in 2017, however other people have faced this issue again as mentioned in comments
We are seeking assistance in diagnosing and resolving this issue.
Is there are any known issues with logging in GAE applications post Python 3 migration?
Your prompt attention to this matter would be greatly appreciated.
Additional Information:
Environment: Google App Engine
Runtime: Python 3.11
appengine-python-standard>=0.2.3
google-cloud-logging==3.8.0
Thank you for your assistance.
Best regards,
Aryaman