Change theme
Help
Press space for more information.
Show links for this issue (Shortcut: i, l)
Copy issue ID
Previous Issue (Shortcut: k)
Next Issue (Shortcut: j)
Sign in to use full features.
Vote: I am impacted
Notification menu
Refresh (Shortcut: Shift+r)
Go home (Shortcut: u)
Pending code changes (auto-populated)
View issue level access limits(Press Alt + Right arrow for more information)
Issue affecting a 3rd party
View staffing
Description
The issue resides with the Dataproc autoscaling clusters. The secondary worker nodes were not provisioned with local SSDs when min_instances is set to 0. The issue arises only on ephemeral cluster and not in a regular cluster. They are working fine when min_instance is set to 1 in the configuration.
Expectations:
The secondary worker nodes should be provisioned with local SSDs when min-instance is set to 0.The problem lies in the Dataproc API. It will be updated so that it can handle the secondaryWorkerConfig correctly.