Hi all,
Can anyone help us come up with a calculated number of numHistoryShards setting in Temporal which is immutable?
For total 3 workflows:
Our Temporal TPS: 30/s
Our TPS is low but our waits schedules are high
Wf pauses at the rate of 12/s
Wf pause average: 3 months
Wf resumes at the rate of: 3/s
For 1 workflow:
At a time there are 89M journeys waiting in the system
Size of each waiting journey in DB → 4-8KB → ~360-715 GB
Assuming our retention policy for finished workflows is 15 days
Size of each finished run in DB → ~40-80 KB → ~0.6-1.2TB
Total raw storage for 1 wf → ~1–2 TB
Total raw storage for 3 wfs → ~3-6 TB (At a time, we’ll clean up in 15 days)
Any recommendation on numHistoryShards setting in Temporal for these 3 workflows?
In future we can extend it to handle at least 2 more workflows with similar scale