How to figure out where all of my API requests are coming from?

[sweetsummerschi]

Hi, 

I'm using a 3rd-party service called stitchdata.com to get my Analytics 360 data into BigQuery. Recently, we've been getting a lot of errors stating that the number of API requests per day are being exceeded. Before requesting to increase quota, I'd like to understand where all of my API requests are coming from and the amount of API that I use daily, since it does not make sense if it's just from Stitch. 

If anyone has any suggestions not related to my question, you're welcome as well.

The errors are like below:

HTTP-error-code: 429, Error: {'code': 429, 'message': "Quota exceeded for quota metric 'Requests' and limit 'Requests per day' of service 'analyticsreporting.googleapis.com' for consumer 'project_number:1234'.", 'status': 'RESOURCE_EXHAUSTED', 'details': [{'@type': 'type.googleapis.com/google.rpc.ErrorInfo', 'reason': 'RATE_LIMIT_EXCEEDED', 'domain': 'googleapis.com', 'metadata': {'quota_location': 'global', 'service': 'analyticsreporting.googleapis.com', 'quota_limit_value': '1000000', 'quota_metric': 'analyticsreporting.googleapis.com/analytics_default_requests', 'consumer': 'projects/1234', 'quota_limit': 'AnalyticsDefaultRequestsPerDayPerProject'}}, {'@type': 'type.googleapis.com/google.rpc.Help', 'links': [{'description': 'Request a higher quota limit.', 'url': 'https://cloud.google.com/docs/quota#requesting_higher_quota'}]}]}, Message: API rate limit exceeded, please retry after some time.

[lsolatorio]

Hi @sweetsummerschi, 

Welcome and thank you for reaching out to our community.

I get that you wanted to understand what's driving your quota or limit exhaustion, one quick way is by checking the logs since Google Cloud keeps a record of all the activities in your project, it can assist you in identifying your essential quota or limit usage.

Please also consider exploring the "View and manage quotas" and the "Monitor and alert with quota metrics" documents as they are good alternatives relevant to your scenario, they can help you determine why you are getting the Error 429 message in BigQuery.

Hope you gained insights from this.

[Nicolas_Wyrwa]

@sweetsummerschi We see the same error in Stitchdata. It looks like you obfuscated the actual project number in the error message. Can you confirm that the actual one ends with 506168?
We were not able to find this project number in our Google Cloud Account. Did you?

[sweetsummerschi]

Hi Nicolas,

That's true! The project number was 880015506168. I couldn't be able to find a project with this number either. There must be something wrong with Stitch.

[Nicolas_Wyrwa]

Hey, thanks for the fast response. I also think so. So far I failed to convince the support, that it's an issue only Stitch can solve. I'll link them to this conversation. Maybe that helps.

[sweetsummerschi]

I also only got the “contact google” message from Stitch. It’s been a
challenge to work with their support team to be honest.

[Nicolas_Wyrwa]

Same for me, feels like they don't even care to read the messages. I only joined my team recently, but they told me that the Stitch support was way better before the multiple acquisitions they went through... but I guess these times are not coming back 😕

[SanketK]

One way to identify a common requester is as follows:
- Open Google Cloud Console.
- Go to Logs Explorer> Filter using log name "cloudaudit.googleapis.com/activity">Filter using service name "apikeys.google.com"

- In the results section you would be able to see the requester via "RequestMetadata" section.

- There you can see the IP and agent details of the requesting VM/device.

[Flyshadowing]

Hi,

We experienced a similar issue so far so was wondering if you were able to solve the issue!