My use case is as follows :-
- I am capturing huge amount of data(mostly relating to user activity) over an API , Here I am talking about 100K Requests per second
- I need to process this data , processing involves
a. validations
b. Some Normalisations
c. Data manipulations. - Then I need to sink this data to a DB (which may additionally requires schema updates , if required as we want to maintain only one Table )
Shall I opt for temporal to solve my use case?? As I need to keep track of failed events at any stage so that I can reflow the data which is failed