On prem Apigee edge Handling traffic and timeout issues.

[Girish123]

When there is a tremendous load of API calls coming to Apigee, how is that load managed in Apigee? Does API traffic “queue” up, waiting for a thread in the message processor/router, and when a thread is available, begins processing?  How does timeout settings work when this happens?  Does the clock start at the moment of “queuing” and could potentially time out before it ever gets a thread to be processed? 

[Hilda_Arteaga]

Hi @Girish123 

Thanks for sharing your question, we reviewed this internally and what you are asking for is not possible since there is no queuing. Please keep in mind that at the end of the day, it's a server that can take requests to process, so if it's loaded, it will get a 5xx.

For specific monitoring requests, you need to size the getaway correctly to handle or manage loads.

You can find more details and best practices in the following operational guidelines: https://docs.apigee.com/private-cloud/v4.52.02/monitoring-best-practices