Completed Workflows not replicating in multi-cluster set-up when one of cluster is Rebuilt

Community Support Server Deployment
1

We have a current set-up of Multi Cluster temporal with XDC replication enabled. We have a situation where we need to rebuild both the clusters. We have all namespaces active in one cluster and rebuilding the other one, however after building the cluster succesfully, we are unable to replicate the completed workflows from primary to secondary. We need to replicate the completed workflows also due to our internal customers need completed workflows as well for various reasons. Please could you let us know how is this achievable?

We are currently on temporal server version 1.21.5

2

We have the same need from our developers. and curious if there is any way to achieve this :eyes:

@tihomir I see you replied under several other multi-cluster replication threads, not sure if you can help here?

3

There is internal force-replication workflow that you could use, it would list all workflows on selected namespace (open and closed) and replicate them.

Think way to start it is manually, something like

tctl --ns temporal-system wf start --tq default-worker-tq --wt force-replication --input '{ "Namespace": "<namespace>", "ConcurrentActivityCount": 4, "OverallRps": 80}'

1 Like