Deploy temporal through k8s having error: standard_init_linux.go:219: exec user process caused: exec format error

Community Support
1

Hi,
I am trying to deploy temporal through k8s, and got error when the pods try to initiate:

pod/temporal3-admintools-9f666bb96-6c4q5 0/1 CrashLoopBackOff 8 16m
pod/temporal3-frontend-6ff9f9d567-65p42 1/1 Running 0 16m
pod/temporal3-history-69fc57b797-bmqt7 0/1 CrashLoopBackOff 8 16m
pod/temporal3-matching-594fcb8bd6-whhmh 1/1 Running 0 16m
pod/temporal3-web-5bc749c748-4n9bm 1/1 Running 0 16m
pod/temporal3-worker-8648fbdc8c-tn55l 0/1 CrashLoopBackOff 8 16m

this is the error message: # standard_init_linux.go:219: exec user process caused: exec format error

The failed pods are not always worker, history, and admintools. Sometimes they are able to initiate, sometimes just failed

2

looks like a underlying k8s / docker / runtime issue

could you provide the following info:

k8s version
docker version
image used for k8s

3

kubectl version
Client Version: version.Info{Major:“1”, Minor:“15”, GitVersion:“v1.15.5”, GitCommit:“20c265fef0741dd71a66480e35bd69f18351daea”, GitTreeState:“clean”, BuildDate:“2019-10-15T19:16:51Z”, GoVersion:“go1.12.10”, Compiler:“gc”, Platform:“darwin/amd64”}
Server Version: version.Info{Major:“1”, Minor:“19”, GitVersion:“v1.19.6”, GitCommit:“fbf646b339dc52336b55d8ec85c181981b86331a”, GitTreeState:“clean”, BuildDate:“2020-12-18T12:01:36Z”, GoVersion:“go1.15.5”, Compiler:“gc”, Platform:“linux/amd64”}

why docker version matters? the docker images are from temporal

4

good to have all possible info since the issue looks like runtime / os / docker / k8s related

5

hmm, i guess that depends on what docker version temporal used to build the images?

BTW we use ami-09daf517b181d8bae

6

i was not able to find the ami-09daf517b181d8bae can you double check it is a public image?

7

can you also verify that host OS is x64 / amd64, not arm, for example?

UPDATE: In my case the error happened because the k8s nodes were running arm64 OS and I could not see any listing for arm64 for autoscalers v1.18 image. So chalking that to be the likely cause.

ref: standard_init_linux.go:211: exec user process caused "exec format error" · Issue #3502 · kubernetes/autoscaler · GitHub