Clarification on worker properties in Java SDK

poojabhutada · June 8, 2022, 1:23pm

Hi,

As per below recommendation from Worker tuning guide, point 3 states maxConcurrentWorkflowTaskExecutionSize should be significantly less than maxConcurrentWorkflowTaskPollers.

But, the default values of these flags as per Java SDK is as below :
DEFAULT_MAX_CONCURRENT_WORKFLOW_TASK_EXECUTION_SIZE = 200;
DEFAULT_MAX_CONCURRENT_WORKFLOW_TASK_POLLERS = 2;

github.com

temporalio/sdk-java/blob/master/temporal-sdk/src/main/java/io/temporal/worker/WorkerOptions.java

/*
 * Copyright (C) 2022 Temporal Technologies, Inc. All Rights Reserved.
 *
 * Copyright (C) 2012-2016 Amazon.com, Inc. or its affiliates. All Rights Reserved.
 *
 * Modifications copyright (C) 2017 Uber Technologies, Inc.
 *
 * Licensed under the Apache License, Version 2.0 (the "License");
 * you may not use this material except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *   http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */

This file has been truncated. show original

Above default values seem to be contradicting with the point mentioned in worker tuning guide.
Is this correct or am I missing anything? Please explain.

tihomir · June 8, 2022, 2:45pm

Yes you are correct, nice catch!
It should be

maxConcurrentWorkflowTaskExecutionSize should be significantly >= maxConcurrentWorkflowTaskPollers . And maxConcurrentActivityExecutionSize should be significantly >= maxConcurrentActivityTaskPollers

The sentence that comes after, namely The number of pollers should always be lower than the number of executors is correct, so just typo in the “<=”.
We are updating this page to fix the issue, will link PR and commit here for you. Thanks again.

poojabhutada · June 8, 2022, 2:57pm

@tihomir Great…thanks for the clarification!!
Also, is there any max limit for these properties?

tihomir · June 8, 2022, 4:16pm

For pollers, on the server side you have frontend.namespaceCount for frontend per namespace concurrent poller count limit, default is 1200

Will check on the other ones and get back to you.

poojabhutada · June 8, 2022, 4:28pm

This frontend.namespaceCount includes workflow and activity pollers…both…right?

tihomir · June 8, 2022, 4:56pm

This frontend.namespaceCount includes workflow and activity pollers…both…right?

Yes all concurrent pollers, workflow and activity ones.

Regarding maxConcurrentWorkflowTaskPollers, maxConcurrentActivityTaskPollers, would follow advice in note of the worker tuning guide here, as well as drawbacks section.

Poller counts > 10 typically don’t make much sense to set for most scenarios.

poojabhutada · June 9, 2022, 4:58am

@tihomir The note section in worker tuning guide for “Poller Count” refers to maxConcurrentWorkflowTaskPollers and maxConcurrentActivityTaskPollers ?

tihomir · June 9, 2022, 2:41pm

Yes you are correct.

Topic		Replies	Views
What are the recommended settings for workflow and activity pollers count? Developer Corner general-impl	0	2886	August 8, 2022
What are recommended values for workflowLocal/workflow/activity poll thread counts? Community Support java-sdk	4	1358	March 22, 2023
Difference between concurrent taskPollers and taskExecutionSize Community Support general-impl	9	592	June 8, 2022
Workflow Performance with Java SDK Community Support java-sdk	1	399	February 20, 2023
Clarification regarding creation of worker threads Community Support java-sdk , general-impl	4	1488	July 4, 2022

Clarification on worker properties in Java SDK

Related Topics