IssueTracker

The current Docker Engine of Cloud Build is version 20.10.24 [1]. This version is quite old lacking some of the features and vulnerability patches introduced in newer versions.

Problem you have encountered:
When attempting to run a build where the base image is zstd compressed an error is recieved. Support for zstd compression was added in version 23 of docker [2].

There is a docker cloud builder version tagged as 24.0.9. However, when using this builder it only updates the docker client to version 24.0.9 but the server remains at version 20.10.24.


What you expected to happen:
For Cloud Build to use a more up to date docker version.

Additionally, it should use containerd storage backend not the docker one so buildx and docker can share the same cache and support multi-arch image storage.

Steps to reproduce:
1. Compress image using zstd compressed layers and push to Artifact Registry.
2. Initiate Cloud Build using the above image.
3. Receive error "failed to register layer: Error processing tar file(exit status 1): archive/tar: invalid tar header"


Other information (workarounds you have tried, documentation consulted, etc):

[1] https://cloud.google.com/build/docs/overview#docker
[2] https://docs.docker.com/engine/release-notes/23.0/#2300:~:text=support%20for%20pulling-,zstd,-compressed%20layers