Skip to content
Merged
Show file tree
Hide file tree
Changes from 9 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 17 additions & 7 deletions docs/cloud/manage/billing.md
Original file line number Diff line number Diff line change
Expand Up @@ -454,12 +454,12 @@

#### What does the ClickPipes pricing structure look like? {#what-does-the-clickpipes-pricing-structure-look-like}

It consists of two dimensions
It consists of two dimensions:

- **Compute**: Price per unit per hour
- **Compute**: Price **per unit per hour**.
Compute represents the cost of running the ClickPipes replica pods whether they actively ingest data or not.
It applies to all ClickPipes types.
- **Ingested data**: per GB pricing
- **Ingested data**: Price **per GB**.
The ingested data rate applies to all streaming ClickPipes
(Kafka, Confluent, Amazon MSK, Amazon Kinesis, Redpanda, WarpStream, Azure Event Hubs)
for the data transferred via the replica pods. The ingested data size (GB) is charged based on bytes received from the source (uncompressed or compressed).
Expand All @@ -472,17 +472,27 @@

#### What is the default number of replicas and their size? {#what-is-the-default-number-of-replicas-and-their-size}

Each ClickPipe defaults to 1 replica that is provided with 2 GiB of RAM and 0.5 vCPU.
This corresponds to **0.25** ClickHouse compute units (1 unit = 8 GiB RAM, 2 vCPUs).
Each ClickPipe defaults to 1 replica that is provided with 512 MiB of RAM and 0.125 vCPU (XS).
This corresponds to **0.0625** ClickHouse compute units (1 unit = 8 GiB RAM, 2 vCPUs).

#### What are the ClickPipes public prices? {#what-are-the-clickpipes-public-prices}

- Compute: \$0.20 per unit per hour (\$0.05 per replica per hour)
- Compute: \$0.20 per unit per hour (\$0.0125 per replica per hour for the default replica size)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tpanetti: we can keep this as is to make the OOTB price clear and then include the pricing table (❤️) with the per-size price in case a user chooses to scale.

- Ingested data: \$0.04 per GB

The price for the Compute dimension depends on the **number** and **size** of replica(s) in a ClickPipe. The default replica size can be adjusted using vertical scaling, and each replica size is priced as follows:

Check warning on line 483 in docs/cloud/manage/billing.md

View workflow job for this annotation

GitHub Actions / vale

ClickHouse.BadPlurals

Rewrite '(s)' to be plural without parentheses.

| Replica Size | Compute Units | RAM | vCPU | Price per Hour |
|----------------------------|---------------|---------|--------|----------------|
| Extra Small (XS) (default) | 0.0625 | 512 MiB | 0.125. | $0.0125 |
| Small (S) | 0.125 | 1 GiB | 0.25 | $0.025 |
| Medium (M) | 0.25 | 2 GiB | 0.5 | $0.05 |
| Large (L) | 0.5 | 4 GiB | 1.0 | $0.10 |
| Extra Large (XL) | 1.0 | 8 GiB | 2.0 | $0.20 |

#### How does it look in an illustrative example? {#how-does-it-look-in-an-illustrative-example}

The following examples assume a single replica unless explicitly mentioned.
The following examples assume a single M-sized replica, unless explicitly mentioned.

<table><thead>
<tr>
Expand Down
8 changes: 4 additions & 4 deletions docs/cloud/manage/jan2025_faq/_snippets/_clickpipes_faq.md
Original file line number Diff line number Diff line change
Expand Up @@ -52,9 +52,9 @@ This corresponds to **0.25** ClickHouse compute units (1 unit = 8 GiB RAM, 2 vCP

<summary>Can ClickPipes replicas be scaled?</summary>

ClickPipes for streaming can be scaled horizontally
by adding more replicas each with a base unit of **0.25** ClickHouse compute units.
Vertical scaling is also available on demand for specific use cases (adding more CPU and RAM per replica).
Yes, ClickPipes for streaming can be scaled both horizontally and vertically.
Horizontal scaling adds more replicas to increase throughput, while vertical scaling increases the resources (CPU and RAM) allocated to each replica to handle more intensive workloads.
Both can be done via the UI during the creation of the ClickPipe or later in the editing mode under "Settings" -> "Advanced Settings" -> "Scaling"

</details>

Expand Down Expand Up @@ -142,4 +142,4 @@ The philosophy behind ClickPipes pricing is
to cover the operating costs of the platform while offering an easy and reliable way to move data to ClickHouse Cloud.
From that angle, our market analysis revealed that we are positioned competitively.

</details>
</details>
Original file line number Diff line number Diff line change
Expand Up @@ -130,3 +130,20 @@ This requires scaling to at least two consumers.
Regardless number of running consumers, fault tolerance is available by design.
If a consumer or its underlying infrastructure fails,
the ClickPipe will automatically restart the consumer and continue processing messages.

### Benchmarks {#benchmarks}

Below are some informal benchmarks for ClickPipes for Kafka that can be used get a general idea of ClickPipes performance. It is important to know that many factors can impact performance including message size, data types, and data format. Your mileage may vary, and what we show here is not a guarantee of performance.

Benchmark details:
- We used production ClickHouse Cloud services with enough resources to ensure that throughput was not bottlenecked by the insert processing on the ClickHouse side.
- The ClickHouse Cloud service, the Kafka cluster (Confluent Cloud), and the ClickPipe were all running in the same region (`us-east-2`).
- The ClickPipe was configured with a single replica.
- The sample data included nested data with a mix of UUID, String, and Int datatypes.
- Other datatypes, such as Floats, Decimals, and DateTime types may be less performant.
- There was no appreciable difference in performance between compressed and uncompressed data.

| Replica Size | Message Size | Data Format | Throughput |
|---------------|-----------|-------------|-----------|
| 1vcpu/4gb | 1.6kb | JSON | 63mb/s |
| 1vcpu/4gb | 1.6kb | AVRO | 99mb/s |
Loading