Skip to content

Commit 7924dab

Browse files
committed
add consumer groups
1 parent 2e822de commit 7924dab

File tree

1 file changed

+24
-0
lines changed

1 file changed

+24
-0
lines changed

modules/deploy/pages/redpanda/manual/resilience/shadowing.adoc

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -247,6 +247,30 @@ acl_filters:
247247
host: "*" # Any host
248248
----
249249

250+
==== Consumer group filtering and behavior
251+
252+
Consumer group filters determine which consumer groups have their offsets replicated to the shadow cluster. By default, all consumer groups are replicated unless you specify filters.
253+
254+
[,yaml]
255+
----
256+
consumer_offset_sync_options:
257+
enabled: true
258+
interval: "30s"
259+
group_filters:
260+
- pattern_type: "PREFIX"
261+
filter_type: "INCLUDE"
262+
name: "prod-consumer-" # Include production consumer groups
263+
- pattern_type: "LITERAL"
264+
filter_type: "EXCLUDE"
265+
name: "test-consumer-group" # Exclude specific test groups
266+
----
267+
268+
**Important consumer group considerations:**
269+
270+
**Avoid name conflicts:** If you plan to consume data from the shadow cluster, do not use the same consumer group names as those used on the source cluster. While this won't break shadow linking, it can impact your RPO/RTO because conflicting group names may interfere with offset replication and consumer resumption during disaster recovery.
271+
272+
**Offset clamping:** When Redpanda replicates consumer group offsets from the source cluster, offsets are automatically "clamped" during the commit process. If a replicated offset is above the high watermark (HWM) of the shadow partition, Redpanda clamps the offset to the shadow partition's HWM. This ensures offsets remain valid and prevents consumers from seeking beyond available data on the shadow cluster.
273+
250274
==== Schema Registry synchronization
251275

252276
Shadowing can replicate Schema Registry data by shadowing the `_schemas` system topic. When enabled, this provides byte-for-byte replication of schema definitions, versions, and compatibility settings.

0 commit comments

Comments
 (0)