Multiple Worker Entities in a single Worker Process in Python

Lokendra_Singh · March 24, 2024, 4:25pm

Docs suggest that

Many SDKs support the ability to have multiple Worker Entities in a single Worker Process.

Need some help in implementing this with python-sdk.
Also is it possible to have workflow & worker inside same process. From what I’ve understood python worker worker.run() are sent into infinite retry loop, blocking other operations

maxim · March 24, 2024, 6:00pm

temporalio/samples-python/blob/main/worker_specific_task_queues/worker.py

import asyncio
import logging  # noqa
import random
from typing import List
from uuid import UUID

from temporalio import activity
from temporalio.client import Client
from temporalio.worker import Worker

from worker_specific_task_queues import tasks

interrupt_event = asyncio.Event()


async def main():
    # Uncomment the line below to see logging
    # logging.basicConfig(level=logging.INFO)

    # Comment line to see non-deterministic functionality

This file has been truncated. show original

Topic		Replies	Views
Creating multiple workers in the same process Community Support go-sdk	10	273	March 14, 2024
C# / dotnet workflow worker with Python Community Support python-sdk , dotnet-sdk	2	405	March 31, 2023
Running each workflow as a different process Community Support java-sdk , use-case-validation	2	1194	July 21, 2020
How to get all runs for a given workflow execution Community Support python-sdk	1	206	February 1, 2024
Handling rollback & compensation by using Python SDK Community Support python-sdk , general-impl	1	432	December 13, 2022

Multiple Worker Entities in a single Worker Process in Python

Related Topics