AWS EC2 Deploy - How Do We Configure Deploy Regarding IP/DNS

Community Support
1

Gotten a little familiar with the RingPop mechanism after digging into the SDK a bit. We are a bit concerned though on how we get nodes gossiping with each other when deploying each service of temporal as its own instance inside of ASGs.

The problem for us is that everything here is driven more by DNS than IP addresses - since IP addresses are dynamic. Due to some technical restrictions, we sort of have to start deploying this way vs. a kubernetes deployment in EKS.

Since IPs are non-static, how can we do this properly so that Temporal Cluster can see each of its nodes other? When dynamic auto-scaling kicks in, how would new nodes be incorporated into the fold (broadcasting)?

Is a service discovery system mandatory?

I am sure its something simple I just haven’t come across but it seems that there have been a few user related issues around this.

IP Addresses that were recycled end up being used in another cluster for example: Prevent incorrect service discovery with multiple Temporal clusters · Issue #1234 · temporalio/temporal · GitHub.

Again not an issue if driven by DNS, just need an example I guess if this is actually supported.

2

Since IPs are non-static, how can we do this properly so that Temporal Cluster can see each of its nodes other? When dynamic auto-scaling kicks in, how would new nodes be incorporated into the fold (broadcasting)?

This works fine out of the box. Each node registers itself with the DB and then the list of the nodes in the DB is used as seeds for the gossip. So adding and removing nodes works fine.

IP Addresses that were recycled end up being used in another cluster for example

Recycling IP addresses can indeed cause problems. But as you pointed out the issue #1234 tracks this and we are going to provide a solution to the edge case.

1 Like
3

Ah I see, so just getting each node with its role configured connected to the Database should sort itself out. I guess I was leaning to heavily on the DOCKER run command as an example with the csv IP addresses.

Edit:
Also dug into the code, a few of the RPC Addresses have comments stating that DNS / hostname works fine, so I think that was the last of my devops-y fears alleviated.