I have several separate microservices deployed, all of which will connect to Temporal and act as activity workers. I’m curious what strategies people might recommend for knowing when to scale those services? In a previous iteration of this project, these microservices were polling from AWS SQS. Our…

Temporal doesn’t expose number of tasks in a task queue. The reason that it is very non trivial to calculate as each task has an independent queuing timeout. Temporal exposes Schedule to Start task latency metric which can be used to autoscale. Without backlog its value is close to 0. When tasks st…

Is this the stats_counts.temporal.schedule_to_start_timeout.* metric (using statsd as an example)? If so, does that metric only get logged when the request has timed out vs. was just slow to start? Can this metric be reported on a per task queue basis or is it only at the namespace level?

Any updates on this ? @keelerm84 have you solved this ?

We have schedule to start latency recorded on SDK. For example, sdk-go record for activity: [image] constants.go?L46:67 https://sourcegraph.com/github.com/temporalio/sdk-go The workflow version is also available as WorkflowTaskScheduleToStartLatency in the sa…

[image] I only found workflow_type=“archivalWorkflow” and workflow_type=“temporal_sys_tq_scanner_workflow” on my prometheus on the temporal_activity_schedule_to_start_latency_bucket metrics.

Ahh I see, can you reference me schedule to start latency metrics on php-sdk ? I can’t find it.

@maxim similar question, does go sdk support schedule to start latency metrics? Only see service side metrics but no sdk side’s metrics, not sure if it is not supported or my setup has issues.

Yes, it is supported. You have to initialize the reporter when creating a worker. See the metrics sample.

Strategies for Scaling AWS Services

Community Support

Yimin_Chen July 22, 2021, 3:49pm 7

The metrics that I referenced above is SDK side of metrics. I think what you are looking at is server side metrics.

Topic		Replies	Views
Suggested metrics to autoscale Temporal workers on Community Support general-impl , metrics , kubernetes	9	8754	January 3, 2024
Scaling temporal worker Community Support	3	854	September 24, 2025
Activity start schedule latency value is extremely large Community Support python-sdk , metrics	4	909	September 14, 2023
What are the best metrics to autoscale each cluster service on? Community Support	5	946	May 8, 2023
How to monitor ScheduleToStart latency Community Support metrics	10	2388	February 28, 2022

Strategies for Scaling AWS Services

Related topics