Do you have ingress/load balancing for your frontend pods? Maybe this old post is still relevant?
Is there any recommendation to verify for readiness of all the temporal services during deployment
What version of k8s are you using? I believe since 1.2.4 you no longer would need grpc-health-probe to health check each service and it supports grpc directly for liveness/readiness (see here for more info)