This will create a feature request which anybody can view and comment on.

Please describe your requested enhancement. Good feature requests will solve common problems or enable new use cases.

What you would like to accomplish:

I would like to Filter log JsonPayloads entries such that I can exclude these entries from the jsonPayload is the query result.

How this might work:

Add an exclusion criteria or function that allow excluding these entries from the result. Consider a jsonPayload where I don't want to show the diagnosticInfo from it in the result. I would want to add something like the following to the query:

AND EXCLUDE jsonPayload.queryResult.diagnosticInfo

If applicable, reasons why alternative solutions are not sufficient:

For my usecase I have logs coming from Dialogflow CX which are not configurable and I need them in a BigQuery dataset. The log router fails as some of these logs are too deeply nested for BigQuery. (Specifically a certain part of the jsonPayload which is not needed)

An alternate feature request solution would be to allow editing of the BigQuery schema or forcing the too deeply nested fields as a JSON or STRING type column.

I could route logs to pub/sub and create a streaming pipeline to exclude these parts of the jsonPayload, but this complicates the project and is less maintainable.

The Dialogflow CX native BigQuery export functionality is not sufficient as that cannot cross project boundaries.

I think this feature could help more people which have limited control over the logs written but want to export it to BQ.

Other information (workarounds you have tried, documentation consulted, etc):

• DialogFlow has no configuration options.
• Cloud logging queries only allow you to exclude full log entries currently