Could I know the significance of taskQueuePartitions in presence of high load on a single task Queue? From @maxim ’s talk on How to Design a workflow engine from first principles , I inferred that a single task queue must reside on a single shard (which is why local transfer queues exist…to transfer…

I think there is some terminology confusion. Temporal history service divides workflow id space into numHistoryShards shards. Each shard contains a transfer queue. This queue implements an outbox pattern as tasks are inserted into it using the same transaction that updates the workflow state. Task…

Scaling Task Queues | Correlation between numHistoryShards, taskQueuePartitions, number of matching service hosts

Community Support

maxim January 13, 2023, 7:45pm 6

You have to configure 100 partitions to support 10k tasks per second.

Estimating the right configuration values of the temporal services

Topic		Replies	Views
Temporal framework performance evaluation Community Support performance	6	1884	August 20, 2022
Validation of app architecture using temporal Community Support go-sdk	10	1155	October 18, 2021
Workflow Performance with Java SDK Community Support java-sdk	1	402	February 20, 2023
Async and sync matching flow Community Support matching-service	6	2650	October 14, 2021
Tuning Temporal setup for better performance Community Support cassandra , performance , kubernetes	5	6842	November 13, 2021

Scaling Task Queues | Correlation between numHistoryShards, taskQueuePartitions, number of matching service hosts

Related Topics