Getting error “RESOURCE_EXHAUSTED: namespace count limit exceeded” in staging env but not in prod env. The value for maxConcurrentWorkflowTaskPollers is defined as 80 and maxConcurrentActivityTaskPollers is also defined as 80. And the
frontend.namespaceCount is set s 20000. And frontend has 5 instances.
However, when checking the number of polls (from
service_pending_requests metrics) based on this post, we find the
service_pending_requests is around 300, which is far lower than 20000 we set.
Can someone please explain what causes “too many concurrent polls for workflow/activity tasks” in this situation? Thanks