Document creates failing with Status(StatusCode="Aborted", Detail="Too much contention on these docu

[joshrice]

So over time, we have been getting this below error but as of a couple of days ago, it has really ramped up.  I don't believe we are anywhere near 10,000 writes a second my math has it much lower than that but no real place to see and no mention of a quota.  This happens when we are creating the document for the first time and the documents are not updated more than once after they are made.

Any thoughts on what the issue may be or a better way to see if we are hitting the quotas?  Also, looking at the number of errors this is happening across an hour it is in the hundreds (use to be in the tens).

This is a C# container running in google GCP Kubernetes engine if that help at all.

Status(StatusCode="Aborted", Detail="Too much contention on these documents. Please try again.")

at Google.Api.Gax.Grpc.ApiCallRetryExtensions.<>c__DisplayClass0_0`2.<<WithRetry>b__0>d.MoveNext()
--- End of stack trace from previous location ---
at Google.Cloud.Firestore.WriteBatch.CommitAsync(ByteString transactionId, CancellationToken cancellationToken)
at Google.Cloud.Firestore.DocumentReference.SetAsync(Object documentData, SetOptions options, CancellationToken cancellationToken)

[osvaldolopez]

Take a look at this and this other Stackoverflow cases that look similar to your issue and let me  know if it was useful. On the other side, consider using Firestore logging as described here.