The Workflow and Activity input and output are quite large for our scenario. With other parameters, we also exchange JSONs that are approximately 60KB. When we tried to execute 1000 concurrent Workflow per second, the Cassandra cluster became the bottleneck.
We tried to solve the problem by using the compressed objects (using GZIPInputStream/GZIPOutputStream) as input and output for Workflow and Activity. It solves the problem, but when we access the Temporal Web UI, it shows only the initial few characters of the Base64 encoded
With this, it becomes difficult to know the input/output during debugging.
- Is there any API that can return the entire input/output for a Workflow?
- If not, can we retrieve it from Cassandra?
Once we get the entire
byte, we can write a utility to display decompressed content.