Option to exclude arguments from EventHistory

Community Support
1

Hello there,

first of all I have to say that I am having a blast building workflows using Temporal. So thank you for that.

However, I also want to migrate a few legacy implementations to Temporal workflows. There is quite a lot of data transferred between activities, so I chose to use local activities there. Now I saw in another thread [Optimize history records for a workflow with all local activities - #2 by maxim](Java SDK related response) that, at least in the Java SDK, there is the possibility to exclude arguments in the history markers. I could not find this option in the Python SDK https://python.temporal.io/temporalio.workflow.LocalActivityConfig.html. Is it not implemented here or do I have to do the configuration at another place?

Edit: Another thread seems to indicate that, indeed, this option does not exist in all SDKs (/t/increasing-throughput-for-local-activities/7147/2)

2

Have you considered routing all your normal activity requests to the same host using a worker specific task queue?

3

That seems like a promising approach. I will look into it, thank you.

4

@maxim Sorry to necro this thread.

We have a BatchFileUpload workflow which executes multiple upload(content: bytes) activities in parralel. We’d like to exclude the raw byte content from the history. Currently, we have implemented it as local activities, but the problem would be the same using worker specific task queues.

Is it possible to strip attributes selectively using interceptors?
As a workaround, could we implement the worker using a SDK which supports LocalActivityOptions.doNotIncludeArgumentsIntoMarker?

5

You can use a custom DataConverter that performs whatever transformation of the input/output objects.