Merge pull request #100 from FlorianLB/feat-custom-queue-name-per-message

Dynamic queue name for all brokers

Author: chandr-andr

README.md

@@ -189,3 +189,17 @@ scheduler = TaskiqScheduler(broker, [array_source])
 ```
 
 During startup the scheduler will try to migrate schedules from an old source to a new one. Please be sure to specify different prefixe just to avoid any kind of collision between these two.
+
+
+## Dynamic queue names
+
+
+Brokers supports dynamic queue names, allowing you to specify different queues when kicking tasks. This is useful for routing tasks to specific queues based on runtime conditions, such as priority levels, tenant isolation, or environment-specific processing.
+
+Simply pass the desired queue name as message's label when kicking a task to override the broker's default queue configuration.
+
+```python
+@broker.task(queue_name="low_priority")
+async def low_priority_task() -> None:
+    print("I don't mind waiting a little longer")
+```

taskiq_redis/redis_broker.py

@@ -251,9 +251,10 @@ async def kick(self, message: BrokerMessage) -> None:
 
         :param message: message to append.
         """
+        queue_name = message.labels.get("queue_name") or self.queue_name
         async with Redis(connection_pool=self.connection_pool) as redis_conn:
             await redis_conn.xadd(
-                self.queue_name,
+                queue_name,
                 {b"data": message.message},
                 maxlen=self.maxlen,
                 approximate=self.approximate,

taskiq_redis/redis_sentinel_broker.py

@@ -230,9 +230,10 @@ async def kick(self, message: BrokerMessage) -> None:
 
         :param message: message to append.
         """
+        queue_name = message.labels.get("queue_name") or self.queue_name
         async with self._acquire_master_conn() as redis_conn:
             await redis_conn.xadd(
-                self.queue_name,
+                queue_name,
                 {b"data": message.message},
                 maxlen=self.maxlen,
                 approximate=self.approximate,