2024/05/24 06:01:40 WARN Failed to poll for task. Namespace ingests TaskQueue workflow-tasks WorkerID 1@cas-jammer-bugbash-cas-6b84cf8c5c-7g2cm@ WorkerType ActivityWorker Error upstream connect error or disconnect/reset before headers. retried and the latest reset reason: connection failure
Same logs getting printed for about more than 2 hours…
2024/05/24 08:05:53 WARN Failed to poll for task. Namespace ingests TaskQueue workflow-tasks WorkerID 1@cas-jammer-bugbash-cas-6b84cf8c5c-7g2cm@ WorkerType ActivityWorker Error upstream connect error or disconnect/reset before headers. retried and the latest reset reason: connection failure
My doubt is temporal golang sdk client had not been erroring out and failing silently if it remained disconnected from temporal for long, however the same client was able to dispatch the workflow. When the worker process was restarted, this got resolved on its own. Also please suggest if we can capture this in anyway (like metrics) and can be acted upon.