Assigned
Status Update
No update yet.
Default access
View
Expanded Access
--
--
--
Issue 347984085
To resolve internal dependency(dataflow bigquery connector) so that it can deal with large volume of the job(like billion rows and over)
Feature Request
Description
This will create a public issue which anybody can view and comment on.
Problem you have encountered: There is a internal dependency(dataflow bigquery connector) that can not deal with large volume of the prediction jobs.
What you expected to happen: Customer would like to process over billion rows using BQ connector and requesting for this feature to be delivered
Steps to reproduce: try to score more than a billion rows using Bigquery connector.
Other information (workarounds you have tried, documentation consulted, etc): Proposed workaround is to run batch predictions with small chunks (< 800 million rows)