Consume temporal io events

Community Support
1

Hi Everyone,
We want our microservice to capture workflow executions history from the Temporal.
Is there any way to subscribe on temporal.io events or build a kind of change data capture process?

2

It is not directly supported. What is the use case?

3

@maxim We are using Temporal.io as orchestrator for our data pipelines/integrations. We have to build our own UI and add some integrations management domain logic, so we have to build an “integration-manager” microservice that will provide an API for the UI and should encapsulate that logic and should be able to communicate with an orchestrator(Temporal.io). Finally user should be able to manage integrations/workflows, to do crud operations, run the workflow, see the execution progress, history, statuses, errors, etc.

4

I see. What features are missing to implement all the required logic for “integration-manager” without the data capture?

5

I think we can implement everything by using Temporal SDK, for example, poll workflow history by schedule or we can even create activities that will emit our own events.
I was just wondering if there are any more elegant options.

6

My question is more about which features in Temporal APIs and SDKs are missing that require the data capture workaround?

7

I will get back to you if I find something missing.
One more question: I am trying to list workflow executions:

ListWorkflowExecutionsRequest req = ListWorkflowExecutionsRequest
.newBuilder()
.setNamespace(“default”)
.build();
ListWorkflowExecutionsResponse res = service.blockingStub().listWorkflowExecutions(req);

and getting: INVALID_ARGUMENT: Operation not support. Please use on ElasticSearch
Is ElasticSearch mandatory for this operation?

8

Yes, listWorkflowExecutions requires ES.

9

Is there a way to receive an event rather than querying for events? Since workers can listen for events on queues, it seems there may be a way to listen (without reacting or handling) to all events. Is that possible?

10

@SusanEnneking Please start a new topic as your question is not related to this one directly.

1 Like