Assigned
Status Update
No update yet.
Comments
ne...@motivesoftware.com
This would be what is currently replica count, right?
Right now, I see it for the N1 machine types, but it's not available for the mls1 (legacy) machine types. The latter are the only ones that support custom predictions, so we are lacking visibility on what's going here.
Any updates on this?
Thanks!
Right now, I see it for the N1 machine types, but it's not available for the mls1 (legacy) machine types. The latter are the only ones that support custom predictions, so we are lacking visibility on what's going here.
Any updates on this?
Thanks!
Description
What you would like to accomplish:
It would be nice to have the ability to check the number of the nodes on which a model version is running. This would help anticipate the costs and choose the appropriate scaling (manual, auto, number of nodes).
How this might work:
There could be a diagram in the model version page among the current ones for Predictions, Requests and Latency.