IssueTracker

This feature request has been forwarded to the Vertex AI Batch predictions product management team so that they may evaluate it. There is no timeline or implementation guarantee for feature requests. All communication regarding this feature request is to be done here.

What you would like to accomplish

When using Batch predictions, I would like to be able to output predicted class probabilities, in addition to predicted classes.

How this might work

When configuring batch predictions, add a flag that would output class probabilities.

Context

A workaround for this in Online Predictions is to use a custom container and call .predict_proba() on a model directly, using custom code.

However, this doesn't work for Batch predictions, for which predictions are not calling the custom container via Vertex AI Endpoint, and it is calling the model directly (1.).

The code snippet in (2.) demonstrates that the batch prediction call happens to the model object aiplatform.Model via .batch_predict() method.

The API reference for aiplatform.Model (3.) lists all methods supported by this class, and it only supports .batch_predict() method which outputs classes and not probabilities.

References

1. https://cloud.google.com/vertex-ai/docs/predictions/batch-predictions#:~:text=You%20request%20batch%20predictions%20directly%20from%20the%20model%20resource%3B%20you%20don%27t%20need%20to%20deploy%20the%20model%20to%20an%20endpoint.
2. https://cloud.google.com/vertex-ai/docs/predictions/batch-predictions#api
3. https://cloud.google.com/python/docs/reference/aiplatform/latest/google.cloud.aiplatform.Model#google_cloud_aiplatform_Model_batch_predict