IssueTracker

Please describe your requested enhancement. Good feature requests will solve common problems or enable new use cases.

What you would like to accomplish:  All the organisation logs (200+ projects) are exported to a sink to BigQuery [1]. We'd like to be able to delete the logs of non-prod projects cost wise efficient.

How this might work: Being able to cluster the sink's partitioned table on project ID would reduce scanning costs [2].


If applicable, reasons why alternative solutions are not sufficient: Setting expiration date [3] to the whole table is slightly reducing the BigQuery storage costs.


Other information (workarounds you have tried, documentation consulted, etc):


[1] https://cloud.google.com/logging/docs/export/bigquery#partition-table-organization

[2] https://cloud.google.com/bigquery/docs/clustered-tables

[3] https://cloud.google.com/bigquery/docs/best-practices-storage#use_the_expiration_settings_to_remove_unneeded_tables_and_partitions