Log Explorer - Improper Log Parsing

[david-sailplan]

I have a Flink job running in a dataproc cluster. It's exporting logs to Log Explorer but I don't think Log Explorer is parsing these logs properly. The timestamp for the logs differ from the timestamp in the message (and the received timestamp) and seems to be trailing by several hours. Additionally, the severity is DEFAULT rather than INFO (or ERROR, WARNING, etc).

I have modified the following cluster settings in order to get log outputs from the job to be exported at all

dataproc:dataproc.logging.stackdriver.job.driver.enable=true

dataproc:dataproc.logging.stackdriver.job.yarn.container.enable=true

EXAMPLE:

{
  "jsonPayload": {
    "message": "2024-04-24 16:56:53,467 INFO  [censored]"
  },
  "timestamp": "2024-04-24T15:21:13.858773723Z",
  "labels": {
  },
  "receiveTimestamp": "2024-04-24T16:56:53.789646310Z"
}