Hi! I have a question about Temporal worker scalability, feel free to point me to the docs if something already exists around this. I have a case where I need to fan out a large number of activities (thousands) of the same type, in a single workflow invokation, and I do so using the Java SDK, someth…

Hi, Will this immediately enqueue all these tasks to the task queue? Yes, all of these tasks will be enqueued immediately If I only have a single worker, can the worker process these in parallel, or will they be sequential? It looks like DEFAULT_MAX_CONCURRENT_ACTIVITY_EXECUTION_SIZE is 200 by…

Thank you for your answer! After digging in further, I think one of the issues is that the max number of polling threads is set to 5 by default. This explains, I think, why for example if I see 200 activities scheduled simultaneously, I don’t see an equivalent 200 activities started simultaneously.…

Also, consider using local activities for very short tasks.

Question about Temporal worker starvation + scalability

Community Support

tihomir January 26, 2022, 2:57pm 4

Take a look at this thread as well as answer in this one. Think it will provide further help.

Topic		Replies	Views
Maximum Concurrent Activities Within a Workflow Community Support python-sdk , activity , server	1	2848	August 22, 2024
Use-cases and questions Community Support	4	3393	January 5, 2021
Order for picking scheduled workflow/activity task Community Support go-sdk , matching-service , task-queue , worker	4	1822	July 19, 2022
Workflow Timeouts with Activities Remaining in Scheduled State Under High Load Community Support java-sdk	1	46	June 24, 2026
Clarification: combination max_concurrent_activities and start_to_close_timeout Community Support	17	1917	August 27, 2024

Question about Temporal worker starvation + scalability

Related topics