Allow mirroring repositories from Github via API [73122477]

Assigned

Feature Request

Status Update

No update yet.

Description

jm...@zendesk.com

created issue #1

Feb 9, 2018 11:37PM

My organization has 1,000+ Github repositories, and we want to mirror a significant number of them to GSR. Currently, the only way to do that is to use GCP Console (the web ui) to select repositories one by one, by pointing and clicking. This is a tedious process for hundreds of repos.

I would like a method to:

* securely upload github credentials to Google, either using KMS or some other mechanism
* send an API request that specifies a reference to those credentials, and the name of the github repo
* that endpoint would trigger a workflow that authenticates with github, sets up the webhook, and pulls the repo to GSR

Then I could build scripts or automation to set up the mirroring, rather than needing to manually point and click on things.

Comments

kh...@google.com <kh...@google.com> #2Feb 10, 2018 04:22AM

Assigned to gc...@google.com.

Thank you for opening this feature request. I've forwarded this request to our engineering team for evaluation. Any future updates and a resolution will be posted on this thread.

[Deleted User] <[Deleted User]> #3Mar 24, 2018 04:49PM

A relevant change in GitHub's API seems to be the addition of GitHub Apps which you can authorize at the organization level.

Having the option to authorize an entire organization seems like it would provide a few benefits to people using Source Repositories:
* Individual repository deploy keys would no longer be needed, since an authorized app can have be granted git read access
* Apps can use a single webhook to receive repository change notifications
* Enable programmatic mirroring of new repos because user-level authorization would no longer be required

de...@gmail.com <de...@gmail.com> #4Sep 27, 2020 01:51AM

I'm in the same boat here. Managing 1000+ bitbucket projects and having to link them all manually in the UI is a pain!

er...@solera.com <er...@solera.com> #5Jan 20, 2021 12:59PM

same here, except we try to mirror BitBucket Cloud repos. Being able to do this in an automated way would be desirable.

[Deleted User] <[Deleted User]> #6Jan 20, 2021 01:08PM

It would be nice to be able to automate these mirroring.

[Deleted User] <[Deleted User]> #7Sep 29, 2021 06:29AM

I have the same case here. We manage hundreds of repositories, and we have to mirror them manually. That would be nice if this could be done automatically.

[Deleted User] <[Deleted User]> #8Oct 21, 2021 11:39AM

Same here, we would like every developer to be able to deploy its own 'staging' envoirement into the actual cloud for testing and debugging. We use bitbucket for source, and terraform for the automation.

an...@gmail.com <an...@gmail.com> #9Dec 5, 2021 05:52PM

Please expose this to the API, currently have all our infrastructure automated through Terraform except manually mirroring the GitHub repo

co...@lucemhealth.com <co...@lucemhealth.com> #10Jul 20, 2022 09:15PM

Any update on this?

hl...@google.com <hl...@google.com> #11Nov 11, 2022 05:18PM

Currently there are no plans to add an API for mirror setup.

pa...@gmail.com <pa...@gmail.com> #12Feb 7, 2023 12:38AM

JW, why wouldn't there be any plans to do this? It seems like one of the first things you would want to do and like such a massive and fundamental hole in the automation infrastructure of anyone planning to use automated cloud builds with mirrored repositories.

[Deleted User] <[Deleted User]> #13Jun 7, 2023 09:08AM

Bumping this - I'd love to build out a terraform provider for this as it's a bit of a pain to manually manage this when we manage the rest of our GCP and Github by config.

vi...@gemone.com <vi...@gemone.com> #14Aug 7, 2023 08:04AM

We would also love this! One of our only steps that are not in terraform..