In Progress

Bug

Status Update

No update yet.

Description

da...@recursion.com

created issue #1

Aug 7, 2023 03:12PM

This will create a public issue which anybody can view and comment on.

Please provide as much information as possible. At least, this should include a description of your issue and steps to reproduce the problem. If possible please provide a summary of what steps or workarounds you have already tried, and any docs or articles you found (un)helpful.

Problem you have encountered:

What I would like to do is use standard tooling like libyear but pointed at our private PyPI server (I plan to fork or contribute to this library to make the url configurable) so we can also scan our internal packages. The problem is this and other tools are meant to work with the public PyPI, so it would be nice if Artifact Registry would provide compatibility with PyPI warehouse's API. Specifically, I'd like to pull package metadata as json from the /simple/<project> endpoint as described here: https://peps.python.org/pep-0691/#project-detail, or using the legacy /json endpoint.

What you expected to happen:

I'd like a good way to be able to read metadata from a PyPI package without needing to download a wheel every time and inspecting that. Ideally, I would want something that works the same way as public PyPI and not utilize custom gcloud commands because doing so makes our solution less compatible with OSS.

Steps to reproduce:

I am going to steal some code from my DoIT rep who was able to reproduce the problem:

derrick@cloudshell:~ (airflow-talk)$ curl --header "Authorization: Bearer $(gcloud auth print-access-token)" https://us-central1-python.pkg.dev/airflow-talk/quickstart-python-repo/simple/sampleproject/

<!DOCTYPE html>
<html>
 <head>
  <title> Links for sampleproject </title>
 </head>
 <body>
  <h1> Links for sampleproject </h1>

        <a href="https://us-central1-python.pkg.dev/airflow-talk/quickstart-python-repo/sampleproject/sampleproject-2.0.0-py3-none-any.whl">sampleproject-2.0.0-py3-none-any.whl</a><br/>

 </body>
</html>


derrick@cloudshell:~ (airflow-talk)$ curl --header "Authorization: Bearer $(gcloud auth print-access-token)" https://us-central1-python.pkg.dev/airflow-talk/quickstart-python-repo/simple/

<!DOCTYPE html>
<html lang=en>
  <meta charset=utf-8>
  <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
  <title>Error 404 (Not Found)!!1</title>
  <style>
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
  </style>
  <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
  <p><b>404.</b> <ins>That’s an error.</ins>
  <p>  <ins>That’s all we know.</ins>
  
  
derrick@cloudshell:~ (airflow-talk)$ curl --header "Authorization: Bearer $(gcloud auth print-access-token)" --header "Accept: application/json" https://us-central1-python.pkg.dev/airflow-talk/quickstart-python-repo/pypi/sampleproject/json

<!DOCTYPE html>
<html lang=en>
  <meta charset=utf-8>
  <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
  <title>Error 404 (Not Found)!!1</title>
  <style>
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
  </style>
  <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
  <p><b>404.</b> <ins>That’s an error.</ins>
  <p>  <ins>That’s all we know.</ins>
  
  
derrick@cloudshell:~ (airflow-talk)$ curl --header "Authorization: Bearer $(gcloud auth print-access-token)" --header "Accept: application/json" https://us-central1-python.pkg.dev/airflow-talk/quickstart-python-repo/pypi/sampleproject/2.0.0/json

<!DOCTYPE html>
<html lang=en>
  <meta charset=utf-8>
  <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
  <title>Error 404 (Not Found)!!1</title>
  <style>
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/logos/errorpage/error_logo-150x54-2x.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
  </style>
  <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
  <p><b>404.</b> <ins>That’s an error.</ins>
  <p>  <ins>That’s all we know.</ins>

Other information (workarounds you have tried, documentation consulted, etc):

My workaround that I have not developed yet, would be to use a combination of downloading a package from Artifact Registry and optionally building a wheel if it is a source distribution and then using wheel-inspect to grab dependencies and other metadata for analysis.

Comments

da...@recursion.com <da...@recursion.com> #2Aug 7, 2023 03:18PM

I have forwarded this request to the engineering team. We will update this issue with any progress updates and a resolution.

Best Regards,
Josh Moyer
Google Cloud Platform Support

va...@google.com <va...@google.com> Aug 8, 2023 07:17AM

Assigned to ku...@google.com.

ku...@google.com <ku...@google.com> Aug 9, 2023 04:57AM

Status: New

mi...@kognic.com <mi...@kognic.com> #3Jan 26, 2024 03:31PM

This is not only useful for IP addresses, but also for many other resources. I understand that names are currently used as identifiers, so this request is probably not trivial to implement. Maybe distinguishing between a (numeric, automatically generated) identifier and a (textual) label is the way to go?

li...@google.com <li...@google.com> #4Jul 2, 2024 06:09PM

Is it any hope? We have migrated our IP address to the server with different role, and now the name of this IP address resource doesn't match its role at all. It seems to be trivial enough to momentary reserve static IP address of the old named resource, drop resource, and immediately recreate it with the new name and the old IP address.

ri...@google.com <ri...@google.com> Aug 19, 2024 05:23PM

Accepted by ri...@google.com.

IssueTracker

PyPI Warehouse API Support

Status Update

Description

Problem you have encountered:

What you expected to happen:

Steps to reproduce:

Other information (workarounds you have tried, documentation consulted, etc):

Comments

da...@recursion.com <da...@recursion.com> #2Aug 7, 2023 03:18PM

va...@google.com <va...@google.com> Aug 8, 2023 07:17AM

ku...@google.com <ku...@google.com> Aug 9, 2023 04:57AM

mi...@kognic.com <mi...@kognic.com> #3Jan 26, 2024 03:31PM

li...@google.com <li...@google.com> #4Jul 2, 2024 06:09PM

ri...@google.com <ri...@google.com> Aug 19, 2024 05:23PM

Issue 294779274

Description

Problem you have encountered:

What you expected to happen:

Steps to reproduce:

Other information (workarounds you have tried, documentation consulted, etc):

Issue summary

Comments

da...@recursion.com <da...@recursion.com> #2Aug 7, 2023 03:18PM

va...@google.com <va...@google.com> Aug 8, 2023 07:17AM

ku...@google.com <ku...@google.com> Aug 9, 2023 04:57AM

mi...@kognic.com <mi...@kognic.com> #3Jan 26, 2024 03:31PM

li...@google.com <li...@google.com> #4Jul 2, 2024 06:09PM

ri...@google.com <ri...@google.com> Aug 19, 2024 05:23PM

Add comment

Issue metadata