Frontend Error Namespace Id: "" not found

Community Support
1

Getting Error that namespace ID not found, but the ID is present in the cassandra database

{"level":"error","ts":"2021-09-01T07:46:30.614Z","msg":"PollActivityTaskQueue failed.","service":"frontend","wf-task-queue-name":"geoCodingTask","value":"1m9.999718269s","error":"namespace ID: 9a20c040-d832-4289-8b32-97b941309bf3 not found","logging-call-at":"workflowHandler.go:1059","stacktrace":"go.temporal.io/server/common/log.(*zapLogger).Error\n
\t/temporal/common/log/zap_logger.go:136\ngo.temporal.io/server/service/frontend.(*WorkflowHandler).PollActivityTaskQueue\n\t
/temporal/service/frontend/workflowHandler.go:1059\ngo.temporal.io/server/service/frontend.(*DCRedirectionHandlerImpl).PollActivityTaskQueue.func2\n\t
/temporal/service/frontend/dcRedirectionHandler.go:502\n
go.temporal.io/server/service/frontend.(*NoopRedirectionPolicy).WithNamespaceRedirect\n\t
/temporal/service/frontend/dcRedirectionPolicy.go:118\ngo.temporal.io/server/service/frontend.(*DCRedirectionHandlerImpl).PollActivityTaskQueue\n\t
/temporal/service/frontend/dcRedirectionHandler.go:498\n
go.temporal.io/api/workflowservice/v1._WorkflowService_PollActivityTaskQueue_Handler.func1\n\t/go/pkg/mod/go.temporal.io/api@v1.4.1-0.20210420220407-6f00f7f98373/workflowservice/v1/service.pb.go:1138\ngo.temporal.io/server/common/authorization.(*interceptor).Interceptor\n\t/temporal/common/authorization/interceptor.go:147\ngoogle.golang.org/grpc.getChainUnaryHandler.func1\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:1058\ngo.temporal.io/server/common/rpc/interceptor.(*NamespaceCountLimitInterceptor).Intercept\n\t/temporal/common/rpc/interceptor/namespace_count_limit.go:90\n
google.golang.org/grpc.getChainUnaryHandler.func1\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:1058\ngo.temporal.io/server/common/rpc/interceptor.(*NamespaceRateLimitInterceptor).Intercept\n\t/temporal/common/rpc/interceptor/namespace_rate_limit.go:89\n
google.golang.org/grpc.getChainUnaryHandler.func1\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:1058\ngo.temporal.io/server/common/rpc/interceptor.(*RateLimitInterceptor).Intercept\n\t
/temporal/common/rpc/interceptor/rate_limit.go:79\ngoogle.golang.org/grpc.getChainUnaryHandler.func1\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:1058\ngo.temporal.io/server/common/rpc/interceptor.(*TelemetryInterceptor).Intercept\n\t/temporal/common/rpc/interceptor/telemetry.go:113\ngoogle.golang.org/grpc.getChainUnaryHandler.func1\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:1058\ngo.temporal.io/server/common/rpc.ServiceErrorInterceptor\n\t
/temporal/common/rpc/grpc.go:105\ngoogle.golang.org/grpc.chainUnaryServerInterceptors.func1\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:1044\n
go.temporal.io/api/workflowservice/v1._WorkflowService_PollActivityTaskQueue_Handler\n\t
/go/pkg/mod/go.temporal.io/api@v1.4.1-0.20210420220407-6f00f7f98373/workflowservice/v1/service.pb.go:1140\n
google.golang.org/grpc.(*Server).processUnaryRPC\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:1217\n
google.golang.org/grpc.(*Server).handleStream\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:1540\n
google.golang.org/grpc.(*Server).serveStreams.func1.2\n\t
/go/pkg/mod/google.golang.org/grpc@v1.37.0/server.go:878"}
2

Can you provide more info like what you are doing when this error happens, what server version you are using, and anything else that could help answer this question?

You can see your namespace id with tctl command tctl namespace desc, does it match up with the id in the error you show?

3

Server Version:- 1.9.2
The error is occurring after a workflow is registered. According to UI no workers are being registered, but the worker registration process is done. The same process is working on other environment.

Yes the namespace Id is same as in the logs

4

Some More Context:-
Stopping the workers stops this issue, seems like it is happening when worker is trying to poll the task queue

5

hello - was this resolved? we’re seeing the same issue and it breaks worker polling: NOT_FOUND: Namespace id "xxxxxx-xxxxx-xxxxx-xxxxx-xxxxxxxxxxxx" not found

6

What server version are you running?

7

thanks for the response. we’re on image 1.13.0 - but i’ll see to continue the conversation in the other thread: NOT_FOUND: Namespace id "xxxxxx-xxxxx-xxxxx-xxxxx-xxxxxxxxxxxx" not found - #2 by Artem_Kazakov