Temporal docker overlay2 size eating up disk space

We have self hosted temporal using docker in which overlay2 eating up all disk space. Most of it is consumed by tmp
What is a best way to clean up these?
How can we limit /tmp directory in container to not grow after certain limit

1.1G	/var/lib/docker/overlay2/0183deb4da996bcd53058cac1e1ae2e61362376d4aa4275305780bff821b3af4
1.1G	/var/lib/docker/overlay2/1e16248c8c3dac3bb3201167935b8f8192cc7b46caa1f4b748fee2d0d76fd224
4.1G	/var/lib/docker/overlay2/0b59410f7d15f081a45622224d9cc1aa85ad02c6faaf80a40f3c467efd9a4044
1.1G	/var/lib/docker/overlay2/f50792061634b45c7255c931d3433ddd7710a494ee1aebe76c028da042ae75d2
5.3G	/var/lib/docker/overlay2/fa29f5232f77ce4c86c3cf90e1b2cada5dbd08623c88fdad0e5fcaba9ad74c9c
4.1G	/var/lib/docker/overlay2/691d4a92461ec65a4e09163f7b9fe7fdf09a40c4c8cda04c463410b2862b37bd
sudo du -cha --max-depth=1 /var/lib/docker/overlay2/691d4a92461ec65a4e09163f7b9fe7fdf09a40c4c8cda04c463410b2862b37bd/merged | grep -E "G"
2.0G	/var/lib/docker/overlay2/691d4a92461ec65a4e09163f7b9fe7fdf09a40c4c8cda04c463410b2862b37bd/merged/tmp
2.2G	/var/lib/docker/overlay2/691d4a92461ec65a4e09163f7b9fe7fdf09a40c4c8cda04c463410b2862b37bd/merged
2.2G	total
sudo ls /var/lib/docker/overlay2/691d4a92461ec65a4e09163f7b9fe7fdf09a40c4c8cda04c463410b2862b37bd/merged/tmp
temporal_archival  temporal_vis_archival