You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/cloud/manage/jan2025_faq/_snippets/_clickpipes_faq.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -54,7 +54,7 @@ This corresponds to **0.25** ClickHouse compute units (1 unit = 8 GiB RAM, 2 vCP
54
54
55
55
Yes, ClickPipes for streaming can be scaled both horizontally and vertically.
56
56
Horizontal scaling adds more replicas to increase throughput, while vertical scaling increases the resources (CPU and RAM) allocated to each replica to handle more intensive workloads.
57
-
Both can be done via the UI during the creation of the ClickPipe or later in the editing mode under "Settings" -> "Advanced Settings" -> "Scaling"
57
+
This can be configured during ClickPipe creation, or at any other point under **Settings** -> **Advanced Settings** -> **Scaling**.
Copy file name to clipboardExpand all lines: docs/integrations/data-ingestion/clickpipes/kafka/04_best_practices.md
+10-10Lines changed: 10 additions & 10 deletions
Original file line number
Diff line number
Diff line change
@@ -133,17 +133,17 @@ the ClickPipe will automatically restart the consumer and continue processing me
133
133
134
134
### Benchmarks {#benchmarks}
135
135
136
-
Below are some informal benchmarks for ClickPipes for Kafka that can be used get a general idea of ClickPipes performance. It is important to know that many factors can impact performance including message size, data types, and data format. Your mileage may vary, and what we show here is not a guarantee of performance.
136
+
Below are some informal benchmarks for ClickPipes for Kafka that can be used get a general idea of the baseline performance. It's important to know that many factors can impact performance, including message size, data types, and data format. Your mileage may vary, and what we show here is not a guarantee of actual performance.
137
137
138
138
Benchmark details:
139
+
139
140
- We used production ClickHouse Cloud services with enough resources to ensure that throughput was not bottlenecked by the insert processing on the ClickHouse side.
140
141
- The ClickHouse Cloud service, the Kafka cluster (Confluent Cloud), and the ClickPipe were all running in the same region (`us-east-2`).
141
-
- The ClickPipe was configured with a single replica.
142
-
- The sample data included nested data with a mix of UUID, String, and Int datatypes.
143
-
- Other datatypes, such as Floats, Decimals, and DateTime types may be less performant.
144
-
- There was no appreciable difference in performance between compressed and uncompressed data.
145
-
146
-
| Replica Size | Message Size | Data Format | Throughput |
- The ClickPipe was configured with a single L-sized replica (4 GiB of RAM and 1 vCPU).
143
+
- The sample data included nested data with a mix of `UUID`, `String`, and `Int` datatypes. Other datatypes, such as `Float`, `Decimal`, and `DateTime`, may be less performant.
144
+
- There was no appreciable difference in performance using compressed and uncompressed data.
145
+
146
+
| Replica Size | Message Size | Data Format | Throughput |
Copy file name to clipboardExpand all lines: docs/integrations/data-ingestion/clickpipes/kafka/05_faq.md
+9Lines changed: 9 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -55,6 +55,15 @@ No, the ClickPipes for Kafka is designed for reading data from Kafka topics, not
55
55
Yes, if the brokers are part of the same quorum they can be configured together delimited with `,`.
56
56
</details>
57
57
58
+
<details>
59
+
60
+
<summary>Can ClickPipes replicas be scaled?</summary>
61
+
62
+
Yes, ClickPipes for streaming can be scaled both horizontally and vertically.
63
+
Horizontal scaling adds more replicas to increase throughput, while vertical scaling increases the resources (CPU and RAM) allocated to each replica to handle more intensive workloads.
64
+
This can be configured during ClickPipe creation, or at any other point under **Settings** -> **Advanced Settings** -> **Scaling**.
Copy file name to clipboardExpand all lines: docs/integrations/data-ingestion/clickpipes/kinesis.md
+2-3Lines changed: 2 additions & 3 deletions
Original file line number
Diff line number
Diff line change
@@ -161,10 +161,9 @@ If you have specific low-latency requirements, please [contact us](https://click
161
161
162
162
### Scaling {#scaling}
163
163
164
-
ClickPipes for Kinesis is designed to scale horizontally. By default, we create a consumer group with one consumer.
165
-
This can be changed with the scaling controls in the ClickPipe details view.
164
+
ClickPipes for Kinesis is designed to scale both horizontally and vertically. By default, we create a consumer group with one consumer. This can be configured during ClickPipe creation, or at any other point under **Settings** -> **Advanced Settings** -> **Scaling**.
166
165
167
-
ClickPipes provides a high-availability with an availability zone distributed architecture.
166
+
ClickPipes provides high-availability with an availability zone distributed architecture.
168
167
This requires scaling to at least two consumers.
169
168
170
169
Regardless number of running consumers, fault tolerance is available by design.
0 commit comments