Hi Team
We have more than 5k Virtual machines, we want to run few commands using ssh on all VMs in parallel and get the results, last time you have have advised to run worflow with small set of VMs and seperate activity queue for each vm so that even if few VMs not reachable we will be able to complete for all running VMs.
How is results for 5k instances can be combined?
How many workflow, child workflow, activities are needed to complete these
last time you have have advised to run worflow with small set of VMs and seperate activity queue for each vm so that even if few VMs not reachable we will be able to complete for all running VMs.
It appears that the last time I assumed that you wanted to run a batch job and host an activity worker on each VM. I recommended activity queue per VM to be able to route activities to be executed by a worker residing at that VM.
It looks like in this case you use SSH to execute commands. So there is no need to use per VM task queue. You can have a separate pool of activity workers that run commands over SSH and use a single task queue.
You need to think if you indeed need to run all 5k in parallel. If you don’t, then you can model it as a batch job using the iterator or the sliding window pattern.
If you want to run all 5k in parallel, you need to create a tree of workflows. The top-level parent creates 100 children. And each child creates 50 children that run commands.
ok thank you, will try that