Update CloudPrem doc

Author: fmassot

content/en/cloudprem/_index.md

@@ -12,20 +12,23 @@ private: true
 
 Datadog CloudPrem is a self-hosted log management solution that enables cost-effective log ingestion, processing, indexing, and search capabilities within your own infrastructure. Built to meet data residency, stringent security, and high-volume requirements, CloudPrem integrates with the Datadog platform to provide log analysis, visualization, and alerting — all while keeping your log data at rest within your infrastructure boundaries.
 
+## Key features
+
+- **Self-hosted**: Deploy CloudPrem within your own infrastructure and keep your logs on your object storage
+- **Cost-effective**: Reduce log management infra costs while maintaining full observability
+- **Scalable**: Horizontally scalable architecture to handle high-volume log ingestion
+- **Integrated in Datadog**
+
 ## Get started
 
+Follow these steps to deploy and configure CloudPrem:
+
 {{< whatsnext >}}
-   {{< nextlink href="/cloudprem/installation/" >}}Install CloudPrem and Send Logs with the Agent {{< /nextlink >}}
-   {{< nextlink href="/cloudprem/ingress/" >}}Configure CloudPrem Ingress{{< /nextlink >}}
-   {{< nextlink href="/cloudprem/aws_config" >}}Configure AWS{{< /nextlink >}}
-   {{< nextlink href="/cloudprem/processing/" >}}Configure CloudPrem Log Processing{{< /nextlink >}}
-   {{< nextlink href="/cloudprem/cluster/" >}}Learn more about Cluster Sizing and Operations{{< /nextlink >}}
-   {{< nextlink href="/cloudprem/architecture/" >}}Learn more about CloudPrem Architecture{{< /nextlink >}}   
+   {{< nextlink href="/cloudprem/overview/" >}}Overview{{< /nextlink >}}
+   {{< nextlink href="/cloudprem/install/" >}}Install CloudPrem{{< /nextlink >}}
+   {{< nextlink href="/cloudprem/ingest-logs/" >}}Set up Log Ingestion{{< /nextlink >}}
+      {{< nextlink href="/cloudprem/configure/" >}}Configure CloudPrem{{< /nextlink >}}
+   {{< nextlink href="/cloudprem/manage/" >}}Manage and Monitor{{< /nextlink >}}
+   {{< nextlink href="/cloudprem/supported-features/" >}}Supported Features{{< /nextlink >}}
    {{< nextlink href="/cloudprem/troubleshooting/" >}}Troubleshooting{{< /nextlink >}}
 {{< /whatsnext >}}
-
-
-[1]: https://kubernetes-sigs.github.io/aws-load-balancer-controller/latest/deploy/installation/
-[2]: /cloudprem/installation/
-[3]: /cloudprem/processing/
-[4]: /cloudprem/architecture/

content/en/cloudprem/configure/_index.md

@@ -0,0 +1,17 @@
+---
+title: Configure CloudPrem
+description: Learn how to configure and customize your CloudPrem deployment for optimal performance and security
+private: true
+---
+
+## Overview
+
+After installing CloudPrem, you need to [configure your Datadog account](datadog-account/), and optionally adjust the [cluster size](cluster-sizing/), configure [ingress](ingress/) and/or [processing](processing/).
+
+## Next steps
+
+{{< whatsnext >}}
+   {{< nextlink href="./datadog-account/" >}}Configure your Datadog account{{< /nextlink >}}
+   {{< nextlink href="./ingest-logs/" >}}Send logs to CloudPrem{{< /nextlink >}}
+   {{< nextlink href="../manage/" >}}Monitor CloudPrem{{< /nextlink >}}
+{{< /whatsnext >}}

content/en/cloudprem/cluster.md renamed to content/en/cloudprem/configure/cluster-sizing.md

@@ -1,29 +1,16 @@
 ---
-title: Cluster Sizing and Operations
-description: Learn about cluster sizing, scaling, monitoring, and maintenance for CloudPrem
+title: Cluster Sizing
+description: Learn about cluster sizing for CloudPrem
 private: true
 further_reading:
-- link: "/cloudprem/"
-  tag: "Documentation"
-  text: "CloudPrem Overview"
-- link: "/cloudprem/installation/"
-  tag: "Documentation"
-  text: "Install CloudPrem and Send Logs with the Agent"
-- link: "/cloudprem/ingress/"
+- link: "/cloudprem/configure/ingress/"
   tag: "Documentation"
   text: "Configure CloudPrem Ingress"
-- link: "/cloudprem/aws_config"
-  tag: "Documentation"
-  text: "Configure AWS"
-- link: "/cloudprem/processing/"
   tag: "Documentation"
   text: "Configure CloudPrem Log Processing"
-- link: "/cloudprem/architecture/"
+- link: "/cloudprem/overview/architecture/"
   tag: "Documentation"
   text: "Learn more about CloudPrem Architecture"
-- link: "/cloudprem/troubleshooting/"
-  tag: "Documentation"
-  text: "Troubleshooting"
 ---
 
 <div class="alert alert-warning">CloudPrem is in Preview.</div>

content/en/cloudprem/configure/datadog-account.md

@@ -0,0 +1,29 @@
+---
+title: Configure your Datadog account
+description: Set up your Datadog account to access CloudPrem logs
+private: true
+further_reading:
+- link: "/cloudprem/ingest-logs/datadog-agent/"
+  tag: "Documentation"
+  text: "Set up log ingestion with Datadog Agent"
+- link: "/cloudprem/configure/ingress/"
+  tag: "Documentation"
+  text: "Configure CloudPrem Ingress"
+- link: "/cloudprem/manage/"
+  tag: "Documentation"
+  text: "Manage and Monitor CloudPrem"
+---
+
+You need to reach out to [Datadog support](/help/) and give the public DNS of your CloudPrem cluster so that you can search into CloudPrem logs from Datadog UI.
+
+### Searching your CloudPrem logs in the Logs Explorer
+
+After your Datadog account is configured, you are ready to search into the `cloudprem` index by typing it in the search bar or selecting it in facets.
+
+**Note**: You cannot query CloudPrem indexes alongside other indexes. Additionally, Flex Logs are not supported with CloudPrem indexes.
+
+{{< img src="/cloudprem/installation/filter_index_cloudprem.png" alt="Screenshot of the Logs Explorer interface showing how to filter logs by selecting the cloudprem index in the facets panel" style="width:70%;" >}}
+
+## Further reading
+
+{{< partial name="whats-next/whats-next.html" >}}

content/en/cloudprem/ingress.md renamed to content/en/cloudprem/configure/ingress.md

@@ -6,28 +6,23 @@ further_reading:
 - link: "/cloudprem/"
   tag: "Documentation"
   text: "CloudPrem Overview"
-- link: "/cloudprem/installation/"
+- link: "/cloudprem/install/"
   tag: "Documentation"
-  text: "Install CloudPrem and Send Logs with the Agent"
-- link: "/cloudprem/aws_config"
+  text: "Install CloudPrem"
+- link: "/cloudprem/install/aws_config/"
   tag: "Documentation"
-  text: "Configure AWS"
-- link: "/cloudprem/processing/"
+  text: "AWS Configuration Prerequisites"
+- link: "/cloudprem/configure/"
   tag: "Documentation"
-  text: "Configure CloudPrem Log Processing"
-- link: "/cloudprem/cluster/"
+  text: "Configure CloudPrem"
+- link: "/cloudprem/ingest-logs/"
   tag: "Documentation"
-  text: "Learn more about Cluster Sizing and Operations"
-- link: "/cloudprem/architecture/"
+  text: "Set up Log Ingestion"
+- link: "/cloudprem/manage/"
   tag: "Documentation"
-  text: "Learn more about CloudPrem Architecture"
-- link: "/cloudprem/troubleshooting/"
-  tag: "Documentation"
-  text: "Troubleshooting"
+  text: "Manage and Monitor"
 ---
 
-<div class="alert alert-warning">CloudPrem is in Preview.</div>
-
 ## Overview
 
 Ingress is a critical component of your CloudPrem deployment. The Helm chart automatically creates two ingress configurations called public ingress and internal ingress. If the AWS Load Balancer Controller is installed on the cluster, it provisions one ALB per ingress configuration. Each load balancer can be further configured using ingress annotations.
@@ -46,7 +41,7 @@ The public ingress is essential for enabling Datadog's control plane and query s
 
 This setup ensures that only authenticated Datadog services can access the CloudPrem cluster while maintaining secure encrypted communication end-to-end.
 
-{{< img src="/cloudprem/ingress/public_ingress.png" alt="Diagram showing CloudPrem public ingress architecture with Datadog services connecting through an internet-facing AWS ALB using mTLS authentication to access the CloudPrem gRPC API" style="width:100%;" >}}
+{{< img src="/cloudprem/images/public_ingress.png" alt="Diagram showing CloudPrem public ingress architecture with Datadog services connecting through an internet-facing AWS ALB using mTLS authentication to access the CloudPrem gRPC API" style="width:100%;" >}}
 
 ### IP Allowlisting
 
@@ -61,7 +56,7 @@ curl -X GET "https://ip-ranges.datadoghq.eu/" \
 
 The internal ingress enables log ingestion from Datadog Agents and other log collectors within your environment through HTTP.
 
-{{< img src="/cloudprem/ingress/internal_ingress.png" alt=" Internal ingress with ALB provisioned by Helm chart" style="width:100%;" >}}
+{{< img src="/cloudprem/images/internal_ingress.png" alt=" Internal ingress with ALB provisioned by Helm chart" style="width:100%;" >}}
 
 By default, the chart creates an internal AWS Application Load Balancer (ALB) to route HTTP traffic to the appropriate CloudPrem services based on the requested API endpoint path. However, if you prefer to use your own ingress controller (such as HAProxy, NGINX, or Traefik), you can disable the default internal ALB and configure your controller with the following routing rules:
 
@@ -117,7 +112,7 @@ rules:
 
 ```
 
-{{< img src="/cloudprem/ingress/internal_ingress_nginx_controller.png" alt="CloudPrem internal ingress configuration using NGINX ingress controller showing path routing to indexer, metastore, and searcher services" style="width:100%;" >}}
+{{< img src="/cloudprem/images/internal_ingress_nginx_controller.png" alt="CloudPrem internal ingress configuration using NGINX ingress controller showing path routing to indexer, metastore, and searcher services" style="width:100%;" >}}
 
 ## Further reading
 

content/en/cloudprem/processing.md renamed to content/en/cloudprem/configure/processing.md

@@ -3,25 +3,10 @@ title: Processing Configuration
 description: Learn how to configure your processing pipelines in CloudPrem
 private: true
 further_reading:
-- link: "/logs/log_configuration/processors/"
-  tag: "Documentation"
-  text: "Datadog Log Management Processors"
-- link: "/cloudprem/"
-  tag: "Documentation"
-  text: "CloudPrem Overview"
-- link: "/cloudprem/installation/"
+- link: "/cloudprem/install/"
   tag: "Documentation"
   text: "Install CloudPrem and Send Logs with the Agent"
-- link: "/cloudprem/ingress/"
-  tag: "Documentation"
-  text: "Configure CloudPrem Ingress"
-- link: "/cloudprem/aws_config"
-  tag: "Documentation"
-  text: "Configure AWS"
-- link: "/cloudprem/cluster/"
-  tag: "Documentation"
-  text: "Learn more about Cluster Sizing and Operations"
-- link: "/cloudprem/architecture/"
+- link: "/cloudprem/overview/architecture/"
   tag: "Documentation"
   text: "Learn more about CloudPrem Architecture"
 - link: "/cloudprem/troubleshooting/"

content/en/cloudprem/ingest-logs/_index.md

@@ -0,0 +1,32 @@
+---
+title: Set up Log Ingestion
+description: Configure log sources to send data to your CloudPrem deployment
+private: true
+---
+
+<div class="alert alert-warning">CloudPrem is in Preview.</div>
+
+## Overview
+
+After installing and configuring CloudPrem, you need to set up log ingestion to start sending log data from your applications and infrastructure. CloudPrem supports multiple ingestion methods to accommodate different architectures and requirements.
+
+## Log ingestion methods
+
+Choose the appropriate ingestion method based on your infrastructure and requirements:
+
+{{< whatsnext >}}
+   {{< nextlink href="/cloudprem/ingest-logs/datadog-agent/" >}}Datadog Agent{{< /nextlink >}}
+   {{< nextlink href="/cloudprem/ingest-logs/observability-pipelines/" >}}Observability Pipelines{{< /nextlink >}}
+   {{< nextlink href="/cloudprem/ingest-logs/rest-api/" >}}REST API Integration{{< /nextlink >}}
+{{< /whatsnext >}}
+
+## Next steps
+
+After setting up log ingestion:
+
+1. **Configure Datadog account** - Register your CloudPrem deployment with Datadog support
+2. **Set up monitoring** - Add [monitoring and alerts](../manage/) for your deployment
+
+## Further reading
+
+{{< partial name="whats-next/whats-next.html" >}}