Assigned
Status Update
No update yet.
Comments
va...@google.com
ar...@google.com
Hello,
Thanks for the feature request!
This has been forwarded to the Cloud Data flow Engineering Team so that they may evaluate it. Note that there are no ETA's or guarantees of implementation for feature requests. All communication regarding this feature request is to be done here.
Description
Please describe your requested enhancement. Good feature requests will solve common problems or enable new use cases.
What you would like to accomplish: Requesting Google product team to change the logging level of the below error message from WARNING to ERROR. That way team is notified of the production impact.
We also need this logging capability at each Dataflow level. We dont want
to implement it across the board on all Dataflow jobs.
*WARNING message:*
message: "spch-storeorder-oms-valdtd-xml-bqtokafka | Failed to send
message. Error: KafkaTimeoutError: Batch for
TopicPartition(topic='ESED_StoreOrder_GCP', partition=0) containing 8
record(s) expired: 122 seconds have passed since last attempt plus backoff
time"
portability_worker_id: "sdk-0-0"
thread: "kafka-python-producer-706-network-thread"
worker: "spch-storeorder-oms-valdt-02021606-fy8d-harness-c49k"
}
What is the Business Impact you are facing?
: Applications are not able to receive messages timely that leads to loss of
sales impact