Multiple Worker Entities in a single Worker Process in Python

Lokendra_Singh · March 24, 2024, 4:25pm

Docs suggest that

Many SDKs support the ability to have multiple Worker Entities in a single Worker Process.

Need some help in implementing this with python-sdk.
Also is it possible to have workflow & worker inside same process. From what I’ve understood python worker worker.run() are sent into infinite retry loop, blocking other operations

maxim · March 24, 2024, 6:00pm

temporalio/samples-python/blob/main/worker_specific_task_queues/worker.py

import asyncio
import logging  # noqa
import random
from typing import List
from uuid import UUID

from temporalio import activity
from temporalio.client import Client
from temporalio.worker import Worker

from worker_specific_task_queues import tasks

interrupt_event = asyncio.Event()


async def main():
    # Uncomment the line below to see logging
    # logging.basicConfig(level=logging.INFO)

    # Comment line to see non-deterministic functionality

This file has been truncated. show original

Topic		Replies	Views
Worker Process with multiple Worker Entities, how to? Community Support typescript-sdk	1	1122	June 10, 2023
Is it possible or sane to have one worker handle one (or at least a few) workflows at a time? Community Support general-impl	1	205	May 21, 2024
Worker processes with multiple worker entities polling on different queues Community Support go-sdk	5	1301	May 23, 2024
Multi workers instances Community Support java-sdk	4	545	August 30, 2021
Creating multiple workers in the same process Community Support go-sdk	13	1607	August 7, 2024

Multiple Worker Entities in a single Worker Process in Python

Related topics