Trying to run a few simple CSV -> BigQuery jobs and the jobs keep failing with the error
Spark program 'phase-1' failed with error: Application application_1709039989238_0002 finished with failed status. Please check the system logs for more details.
Looking at the system logs there are various errors associated with connections to messaging services such as this Wrangler log message
DEBUG [MessagingMetricsCollectionService:i.c.c.m.c.MessagingMetricsCollectionService@175] - Failed to publish metrics to TMS due to Service 'messaging.service' is not available. Please wait until it is up and running.. Will be retried in 1000 ms.
In the runtime logs there ar e numerous Connection Refused errors associated with the AbstractMessagingPollingService.
Any ideas how to fix this?