WorkflowTaskTimedOut (ScheduleToStart) and delay in execution

I can see the task queue name random for the first task schedule.

This is an artifact of workflow caching. See this post that explains it in detail.

  • reducing the MaximumInterval the RetryPolicy for the WorkflowOptions and ActivityOptions will reduce the impact right?

No. RetryPolicy has nothing to do with the inability of workers to process a backlog of workflow tasks quickly.

will check the scalability issue you have mentioned. do you have any suggestions specifically for temporal for scalability? because this is not push-based, we are using flex env GCP?

Add more worker processes.