I am submitting a job to Dataproc batches (Serverless) , We are charged thousands of dollars for clod logging. I tries setting the properties but no luck. Any help or pointers would be greatly appreciated.
You can specify what types of logs you want to be sent from Dataproc to Cloud Logging.
There is a price ingestion while using Cloud Logging, additionally there is a price from stored Logs for more than 30 days.
If you have more questions about the quotas you can contact Billing Support.