Workflow processing encountered fatal error and must shut down - TonicError

Community Support
1

Hi,

The worker encountered this fatal error resulting in a shutdown. Can anyone provide any insights into what a “TonicError” is? It looks like it is attempting to establish an external connection. The worker wasn’t performing any activity and had been idle for many hours.

Details:

  • TEMPORAL_VERSION=1.27.0
  • TYPESCRIPT_SDK=“^1.13.0”
  • Running behind a corporate proxy server.

{“application”:“workers-email”,“buildId”:“8188”,“buildNumber”:“20250930.6”,“env”:“staging”,“host”:“workers-email”,“label”:“worker”,“level”:“error”,“message”:“Workflow processing encountered fatal error and must shut down TonicError(Status { code: PermissionDenied, message: “Request unauthorized.”, details: b"\x08\x07\x12\x15Request unauthorized.\x1aJ\nHtype.googleapis.com/temporal.api.errordetails.v1.PermissionDeniedFailure", metadata: MetadataMap { headers: {“content-type”: “application/grpc”} }, source: None })”,“module”:“default”,“packageVersion”:“1.1.2”,“pid”:18,“sdkComponent”:“core”,“target”:“temporal_sdk_core::worker::workflow::workflow_stream”,“timestamp”:1759215253203}

2

Due to a recent change, I noticed the worker wasn’t refreshing connection api key. This obviously has this type of impact / feedback via the API. Hopefully in the 24hrs this problem will no longer occur.

3

Hi,

are you still facing this issue? is this for Temporal Cloud? is so please open a ticket https://temporalsupport.zendesk.com/

Antonio

4

Hi Antonio,

This was for on-premise installation. Once I resolved why the Azure token wasn’t being refreshed it resolved itself.

Thanks

1 Like