Skip to content

Conversation

@pperiyasamy
Copy link
Member

@pperiyasamy pperiyasamy commented Feb 25, 2025

This PR updates IPsec E2E to test NAT-T implemented with PR: openshift/cluster-network-operator#2573.
Note: This requires a new CI lane to test IPsec NAT-T "Always" encapsulation option.

This PR also adds an e2e tests to ensure ovnk managed pod traffic (EW traffic) is always working across nodes when ovn-ipsec-host daemonset goes for multiple reboots.

/assign @martinkennelly

@openshift-ci openshift-ci bot requested review from JoelSpeed and knobunc February 25, 2025 14:31
@openshift-ci openshift-ci bot added the vendor-update Touching vendor dir or related files label Feb 25, 2025
@openshift-merge-robot openshift-merge-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Mar 2, 2025
@martinkennelly
Copy link
Contributor

/lgtm

I assume you need another PR in release for the lanes?

@openshift-merge-robot openshift-merge-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Mar 7, 2025
@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Mar 7, 2025
@martinkennelly
Copy link
Contributor

which job here executes the ipsec code? I want to have a look at the logs.

@martinkennelly
Copy link
Contributor

/hold

Want to see the e2e logs.

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Mar 12, 2025
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Mar 19, 2025
@pperiyasamy
Copy link
Member Author

/test e2e-aws-ovn-ipsec-serial

@pperiyasamy
Copy link
Member Author

pperiyasamy commented Mar 19, 2025

/lgtm

I assume you need another PR in release for the lanes?

yes @martinkennelly , we need another CI lane to test nat-t changes.

you can currently look at e2e-aws-ovn-ipsec-serial lane (https://prow.ci.openshift.org/job-history/gs/test-platform-results/pr-logs/directory/pull-ci-openshift-origin-main-e2e-aws-ovn-ipsec-serial) for ipsec test results.

@pperiyasamy pperiyasamy changed the title Update IPsec e2e test to validate NAT-T encapsulation option CORENET-5668: Update IPsec e2e test to validate NAT-T encapsulation option Apr 4, 2025
@openshift-ci-robot
Copy link

openshift-ci-robot commented Apr 4, 2025

@pperiyasamy: This pull request references CORENET-5668 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.19.0" version, but no target version was set.

In response to this:

This PR updates IPsec E2E to test NAT-T implemented with PR: openshift/cluster-network-operator#2573.
Note: This requires a new CI lane to test IPsec NAT-T "Always" encapsulation option.

This PR also adds an e2e tests to ensure ovnk managed pod traffic (EW traffic) is always working across nodes when ovn-ipsec-host daemonset goes for multiple reboots.

/assign @martinkennelly

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Apr 4, 2025
@martinkennelly
Copy link
Contributor

/lgtm
I assume you need another PR in release for the lanes?

yes @martinkennelly , we need another CI lane to test nat-t changes.

you can currently look at e2e-aws-ovn-ipsec-serial lane (https://prow.ci.openshift.org/job-history/gs/test-platform-results/pr-logs/directory/pull-ci-openshift-origin-main-e2e-aws-ovn-ipsec-serial) for ipsec test results.

why do you need another lane just for nat-t? cant you include it in the existing ipsec lane?

@martinkennelly
Copy link
Contributor

martinkennelly commented Apr 7, 2025

/test e2e-aws-ovn-ipsec-serial

infra failure

@pperiyasamy above you said this test needed a new lane but i see you also testing ipsec serial ? where can i see this test your adding?

@pperiyasamy
Copy link
Member Author

pperiyasamy commented Apr 7, 2025

why do you need another lane just for nat-t? cant you include it in the existing ipsec lane?

when we try to enable nat-t in the existing ipsec lane, then there will another rollout of ovnkube-node deployment which introduce network disturbance for EW traffic during rollout, monitor events would show up again.
so adding new CI lane to test NAT-T at here: #29563
just running ipsec serial lane to see if PR doesn't cause any trouble for existing ipsec tests.

@pperiyasamy
Copy link
Member Author

/test e2e-aws-ovn-ipsec-serial

infra failure

@martinkennelly The failure in the run is being fixed with the bug https://issues.redhat.com/browse/OCPBUGS-54295 and we discussed about it with nmstate team (https://redhat-internal.slack.com/archives/CP7329Z5Z/p1744011607371099).

@openshift-merge-robot openshift-merge-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Apr 23, 2025
@openshift-trt
Copy link

openshift-trt bot commented Apr 23, 2025

Job Failure Risk Analysis for sha: e03cab7

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (104) are below the historical average (1461): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-vsphere-ovn IncompleteTests
Tests for this run (16) are below the historical average (2960): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-vsphere-ovn-etcd-scaling IncompleteTests
Tests for this run (16) are below the historical average (1597): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-vsphere-ovn-upi IncompleteTests
Tests for this run (16) are below the historical average (2841): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: e03cab7

Job Name New Test Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-ipsec-serial High - "[sig-network][Feature:IPsec] IPsec resilience when using openshift ovn-kubernetes check pod traffic is working across nodes [apigroup:config.openshift.io] [Suite:openshift/network/ipsec]" is a new test that was not present in all runs against the current commit.
pull-ci-openshift-origin-main-e2e-aws-ovn-ipsec-serial High - "[sig-network][Feature:IPsec] IPsec resilience when using openshift ovn-kubernetes check pod traffic is working across nodes after ipsec daemonset restart [apigroup:config.openshift.io] [Suite:openshift/network/ipsec]" is a new test that was not present in all runs against the current commit.

New tests seen in this PR at sha: e03cab7

  • "[sig-network][Feature:IPsec] IPsec resilience when using openshift ovn-kubernetes check pod traffic is working across nodes [apigroup:config.openshift.io] [Suite:openshift/network/ipsec]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[sig-network][Feature:IPsec] IPsec resilience when using openshift ovn-kubernetes check pod traffic is working across nodes after ipsec daemonset restart [apigroup:config.openshift.io] [Suite:openshift/network/ipsec]" [Total: 2, Pass: 2, Fail: 0, Flake: 0]

@pperiyasamy pperiyasamy force-pushed the nat-t-e2e branch 2 times, most recently from b2b8fe2 to db7ea4a Compare April 24, 2025 09:23
@openshift-merge-robot openshift-merge-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Apr 24, 2025
@pperiyasamy
Copy link
Member Author

/test e2e-aws-ovn-ipsec-serial

1 similar comment
@pperiyasamy
Copy link
Member Author

/test e2e-aws-ovn-ipsec-serial

@pperiyasamy
Copy link
Member Author

/retest-required

@martinkennelly
Copy link
Contributor

/unhold

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jun 18, 2025
@dgoodwin
Copy link
Contributor

/approve

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jun 18, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, martinkennelly, pperiyasamy

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jun 18, 2025
@pperiyasamy
Copy link
Member Author

/retest-required

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 140c672 and 2 for PR HEAD 6c4a40a in total

1 similar comment
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 140c672 and 2 for PR HEAD 6c4a40a in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD bea636f and 1 for PR HEAD 6c4a40a in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD bea636f and 2 for PR HEAD 6c4a40a in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 14f4646 and 1 for PR HEAD 6c4a40a in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 044b484 and 0 for PR HEAD 6c4a40a in total

@openshift-ci-robot
Copy link

/hold

Revision 6c4a40a was retested 3 times: holding

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jun 22, 2025
@pperiyasamy
Copy link
Member Author

/hold cancel

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jun 23, 2025
@pperiyasamy
Copy link
Member Author

/retest-required

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 8c15d68 and 2 for PR HEAD 6c4a40a in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 9c4f2ae and 1 for PR HEAD 6c4a40a in total

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jun 23, 2025

@pperiyasamy: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-metal-ipi-serial db7ea4a link false /test e2e-metal-ipi-serial
ci/prow/e2e-gcp-fips-serial db7ea4a link false /test e2e-gcp-fips-serial
ci/prow/e2e-metal-ipi-serial-ovn-ipv6 db7ea4a link false /test e2e-metal-ipi-serial-ovn-ipv6
ci/prow/e2e-aws-ovn-serial-publicnet db7ea4a link true /test e2e-aws-ovn-serial-publicnet
ci/prow/e2e-gcp-fips-serial-2of2 6c4a40a link false /test e2e-gcp-fips-serial-2of2
ci/prow/okd-e2e-gcp 6c4a40a link false /test okd-e2e-gcp
ci/prow/e2e-azure-ovn-etcd-scaling 6c4a40a link false /test e2e-azure-ovn-etcd-scaling
ci/prow/e2e-aws-ovn-kube-apiserver-rollout 6c4a40a link false /test e2e-aws-ovn-kube-apiserver-rollout
ci/prow/e2e-hypershift-conformance 6c4a40a link false /test e2e-hypershift-conformance
ci/prow/e2e-gcp-ovn-etcd-scaling 6c4a40a link false /test e2e-gcp-ovn-etcd-scaling
ci/prow/e2e-gcp-fips-serial-1of2 6c4a40a link false /test e2e-gcp-fips-serial-1of2
ci/prow/4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback 6c4a40a link false /test 4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback
ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout 6c4a40a link false /test e2e-metal-ipi-ovn-kube-apiserver-rollout
ci/prow/e2e-aws-ovn-etcd-scaling 6c4a40a link false /test e2e-aws-ovn-etcd-scaling
ci/prow/e2e-azure-ovn-upgrade 6c4a40a link false /test e2e-azure-ovn-upgrade
ci/prow/e2e-vsphere-ovn-dualstack-primaryv6 6c4a40a link false /test e2e-vsphere-ovn-dualstack-primaryv6
ci/prow/e2e-aws-disruptive 6c4a40a link false /test e2e-aws-disruptive
ci/prow/e2e-aws-ovn-single-node 6c4a40a link false /test e2e-aws-ovn-single-node
ci/prow/e2e-gcp-disruptive 6c4a40a link false /test e2e-gcp-disruptive
ci/prow/e2e-metal-ipi-serial-ovn-ipv6-2of2 6c4a40a link false /test e2e-metal-ipi-serial-ovn-ipv6-2of2
ci/prow/e2e-vsphere-ovn-etcd-scaling 6c4a40a link false /test e2e-vsphere-ovn-etcd-scaling
ci/prow/e2e-gcp-ovn-rt-upgrade 6c4a40a link false /test e2e-gcp-ovn-rt-upgrade
ci/prow/e2e-aws-ovn-serial-publicnet-1of2 6c4a40a link false /test e2e-aws-ovn-serial-publicnet-1of2

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD dd7a2a8 and 0 for PR HEAD 6c4a40a in total

@openshift-merge-bot openshift-merge-bot bot merged commit 2969e75 into openshift:main Jun 24, 2025
42 of 60 checks passed
@pperiyasamy
Copy link
Member Author

/cherry-pick release-4.19

@openshift-cherrypick-robot

@pperiyasamy: new pull request created: #29944

In response to this:

/cherry-pick release-4.19

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. vendor-update Touching vendor dir or related files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants