Assigned
Status Update
No update yet.
Comments
va...@google.com
ds...@google.com
Hi , Could you please clarify the issue description or share any screen shot of the problem where you are facing issue ?
ni...@strivr.com
Hi, its a feature request. Can you change it to feature request?
I am requesting a dataproc image version that supports spark 3.4
https://cloud.google.com/dataproc/docs/concepts/versioning/dataproc-release-2.2
I am requesting a dataproc image version that supports spark 3.4
ds...@google.com
Hello,
Thank you for reaching out to us with your request.
We have duly noted your feedback and will thoroughly validate it. While we cannot provide an estimated time of implementation or guarantee the fulfillment of the feature request , please be assured that your input is highly valued. Your feedback enables us to enhance our products and services.
Description
Please provide as much information as possible. At least, this should include a description of your issue and steps to reproduce the problem. If possible please provide a summary of what steps or workarounds you have already tried, and any docs or articles you found (un)helpful.
Problem you have encountered:
None of the GA release has spark 3.4 support. they all only support spark 3.5
We currently have a dependency on spark 3.4 have we can not upgrade to spark 3.5 because of open issues in spark 3.5 that is affecting our internal project development. when spark fixes those issues we can upgrade to 3.5. meanwhile we still need to use spark 3.4 We have been using dataproc 2.2.0-RC3-debian11 release and were hoping to have a GA release that support 3.4
What you expected to happen:
Dataproc image version to go from spark 3.3 to 3.4 and not skip directly to 3.5
Steps to reproduce:
NA
Other information (workarounds you have tried, documentation consulted, etc):