IssueTracker

Having Apache Livy installed in Dataproc, the user is unable to see or access the session from the UI. Furthermore, looking at the process [2] and public documentation [3-4],  it is stated that Livy is accessible from the UI/Component Gateway, as an example, “Component Gateway can be used to access REST APIs, such as Apache Hadoop YARN and Apache Livy, and history servers.”  it seems like the users should be able to see the same session from the UI.”

However, for the moment, it seems that the only possible way of accessing Apache Livy under component gateway is through programmatic approach [3]. Would it be possible for the Apache Livy to be implemented under the UI/component gateway?

Reference:
[1] KNIME Google Cloud Integration User Guide > Google Dataproc > Cluster Setup with Livy (external site):
https://docs.knime.com/2021-06/google_cloud_integration_user_guide/index.html#overview

[2] Running Livy Server (external site):
https://dassum.medium.com/apache-livy-a-rest-interface-for-apache-spark-f435540e26a9#:~:text=clean%20package%20%2DDskipTsets-,Running%20Livy%20Server,-In%20order%20to

[3]
https://cloud.google.com/dataproc/docs/concepts/accessing/dataproc-gateways#considerations

[4]
https://cloud.google.com/dataproc/docs/concepts/accessing/dataproc-gateways#use_component_gateway_urls_to_access_web_interfaces

[5] Dataproc > Dataproc Component Gateway > Programmatically using HTTP APIs through Component Gateway:
https://cloud.google.com/dataproc/docs/concepts/accessing/dataproc-gateways#programmatically_using_http_apis_through_component_gateway
Your Analysis