Hi Team,
Have around 10 activities running in a workflow. Each activity making some gRPC calls to other services & making some DB updates.
Sometimes I’m getting these errors.
Would be helpful if anyone has idea on this
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType ActivityWorker Error closing transport due to: connection error: desc = “error reading from server: EOF”, received prior goaway: code: NO_ERROR, debug data: “max_age”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType WorkflowWorker Error closing transport due to: connection error: desc = “error reading from server: EOF”, received prior goaway: code: NO_ERROR, debug data: “graceful_stop”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType ActivityWorker Error closing transport due to: connection error: desc = “error reading from server: EOF”, received prior goaway: code: NO_ERROR, debug data: “graceful_stop”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType WorkflowWorker Error closing transport due to: connection error: desc = “error reading from server: EOF”, received prior goaway: code: NO_ERROR, debug data: “max_age”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-gbdxr@ WorkerType ActivityWorker Error closing transport due to: connection error: desc = “error reading from server: EOF”, received prior goaway: code: NO_ERROR, debug data: “graceful_stop”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g4nc7@ WorkerType WorkflowWorker Error closing transport due to: connection error: desc = “error reading from server: EOF”, received prior goaway: code: NO_ERROR, debug data: “graceful_stop”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g4nc7@ WorkerType ActivityWorker Error closing transport due to: connection error: desc = “error reading from server: EOF”, received prior goaway: code: NO_ERROR, debug data: “graceful_stop”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-gbdxr@ WorkerType WorkflowWorker Error closing transport due to: connection error: desc = “error reading from server: EOF”, received prior goaway: code: NO_ERROR, debug data: “graceful_stop”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-gbdxr@ WorkerType WorkflowWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-gbdxr@ WorkerType ActivityWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType WorkflowWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g4nc7@ WorkerType WorkflowWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g4nc7@ WorkerType ActivityWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:35 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType ActivityWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:38 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g4nc7@ WorkerType ActivityWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: no route to host”
2024/03/08 11:21:38 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g4nc7@ WorkerType WorkflowWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: no route to host”
2024/03/08 11:21:38 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType ActivityWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: no route to host”
2024/03/08 11:21:39 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType WorkflowWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: no route to host”
2024/03/08 11:21:42 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType ActivityWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:43 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g4nc7@ WorkerType WorkflowWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:43 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g8qjq@ WorkerType WorkflowWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”
2024/03/08 11:21:43 WARN Failed to poll for task. Namespace orchestrator-ns TaskQueue OFFLINE_TASK_QUEUE WorkerID 1@orchestrator-consumer-7f85c5c85-g4nc7@ WorkerType ActivityWorker Error last connection error: connection error: desc = “transport: Error while dialing: dial tcp 172.20.249.100:7233: connect: connection refused”