Skip to content

Conversation

@sdodson
Copy link
Member

@sdodson sdodson commented Sep 9, 2025

Reverts #656

@openshift-ci-robot openshift-ci-robot added jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Sep 9, 2025
@openshift-ci-robot
Copy link
Contributor

@sdodson: This pull request references Jira Issue OCPBUGS-61224, which is invalid:

  • expected the bug to target the "4.21.0" version, but no target version was set

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Reverts #656

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@sdodson
Copy link
Member Author

sdodson commented Sep 9, 2025

/payload-job ?

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 9, 2025

@sdodson: it appears that you have attempted to use some version of the payload command, but your comment was incorrectly formatted and cannot be acted upon. See the docs for usage info.

@openshift-ci openshift-ci bot requested review from frobware and rikatz September 9, 2025 12:49
@sdodson
Copy link
Member Author

sdodson commented Sep 9, 2025

/payload-job periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade 10

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 9, 2025

@sdodson: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/87cc1c80-8d7b-11f0-943a-c4b0ace5758d-0

@rikatz
Copy link
Member

rikatz commented Sep 9, 2025

/cc @rohara
As this is reverting a change you did, I think it would be good to take a look into it

@openshift-ci openshift-ci bot requested a review from rohara September 9, 2025 13:25
@candita
Copy link
Contributor

candita commented Sep 9, 2025

/test e2e-aws-serial

I haven't seen this error before. Commatrix not our feature.

: [sig-network][Feature:commatrix][apigroup:config.openshift.io][Serial] generated communication matrix should be equal to documented communication matrix [Suite:openshift/conformance/serial] expand_less 10s
{ fail [github.com/openshift/origin/test/extended/networking/commatrix.go:210]: non-documented open ports found:
Ingress,TCP,10357,openshift-kube-apiserver,openshift-kube-apiserver-healthz,kube-apiserver,kube-apiserver-check-endpoints,master,false

Expected
<[]types.ComDetails | len:1, cap:1>:
- container: kube-apiserver-check-endpoints
direction: Ingress
namespace: openshift-kube-apiserver
nodeRole: master
optional: false
pod: kube-apiserver
port: 10357
protocol: TCP
service: openshift-kube-apiserver-healthz
to be empty}

@sdodson
Copy link
Member Author

sdodson commented Sep 9, 2025

/payload-job periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade 10

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 9, 2025

@sdodson: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/82742bc0-8dd4-11f0-8d4d-321d5ad45b16-0

@candita
Copy link
Contributor

candita commented Sep 10, 2025

/payload-job periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade 10

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 10, 2025

@candita: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/c3050840-8dfb-11f0-9385-6c0e6019b8fb-0

@dgoodwin
Copy link
Contributor

/payload-aggregate periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade 10

This is the command for multiple runs I believe.

With this kind of thing we need to be super precise examining the results, we're looking for a very specific pattern of disruption, new connections going down, during node update, to all three ingress related backends, image-registry, oauth, and console, usually about 14-18 seconds total for each.

I do not see the pattern in these runs above so far, but I think we're facing a 3-4% fail rate so it's going to be tough to be sure we've fixed it.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 10, 2025

@dgoodwin: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/a4908c00-8e36-11f0-88aa-dcb3a9818144-0

@sdodson
Copy link
Member Author

sdodson commented Sep 10, 2025

/payload-aggregate periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade 10

I think also if we want to be 90% sure that we've figured out that this is fixed we need something like > 40 runs without the error assuming it manifested approximately 5% of the time prior. So queue another 10, don't want to go too wide all at once.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 10, 2025

@sdodson: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-azure-ovn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/47ad0d90-8e65-11f0-816b-63bb9a5b21d3-0

@sdodson
Copy link
Member Author

sdodson commented Sep 11, 2025

/jira refresh

@openshift-ci-robot openshift-ci-robot added jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. and removed jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Sep 11, 2025
@openshift-ci-robot
Copy link
Contributor

@sdodson: This pull request references Jira Issue OCPBUGS-61224, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.21.0) matches configured target version for branch (4.21.0)
  • bug is in the state New, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @ShudiLi

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@sdodson sdodson added approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. labels Sep 11, 2025
@openshift-ci openshift-ci bot requested a review from ShudiLi September 11, 2025 13:03
@sdodson
Copy link
Member Author

sdodson commented Sep 11, 2025

/verified by reviewing 20 runs where the coredump is not observed

@sdodson
Copy link
Member Author

sdodson commented Sep 11, 2025

/cherry-pick release-4.20

@openshift-cherrypick-robot

@sdodson: once the present PR merges, I will cherry-pick it on top of release-4.20 in a new PR and assign it to you.

In response to this:

/cherry-pick release-4.20

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-ci-robot openshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Sep 11, 2025
@openshift-ci-robot
Copy link
Contributor

@sdodson: This PR has been marked as verified by reviewing 20 runs where the coredump is not observed.

In response to this:

/verified by reviewing 20 runs where the coredump is not observed

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 11, 2025

[APPROVALNOTIFIER] This PR is APPROVED

Approval requirements bypassed by manually added approval.

This pull-request has been approved by:

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sdodson
Copy link
Member Author

sdodson commented Sep 11, 2025

/tide refresh

@sdodson sdodson added px-approved Signifies that Product Support has signed off on this PR docs-approved Signifies that Docs has signed off on this PR labels Sep 11, 2025
@sdodson
Copy link
Member Author

sdodson commented Sep 11, 2025

/tide refresh

@sdodson
Copy link
Member Author

sdodson commented Sep 11, 2025

/override ci/prow/e2e-agnostic

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 11, 2025

@sdodson: Overrode contexts on behalf of sdodson: ci/prow/e2e-agnostic

In response to this:

/override ci/prow/e2e-agnostic

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 11, 2025

@sdodson: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@sdodson sdodson added the qe-approved Signifies that QE has signed off on this PR label Sep 11, 2025
@openshift-ci-robot
Copy link
Contributor

@sdodson: This pull request references Jira Issue OCPBUGS-61224, which is valid.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.21.0) matches configured target version for branch (4.21.0)
  • bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @ShudiLi

In response to this:

Reverts #656

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@sdodson sdodson merged commit 2bc8169 into master Sep 11, 2025
10 of 13 checks passed
@openshift-ci-robot
Copy link
Contributor

@sdodson: Jira Issue OCPBUGS-61224: Some pull requests linked via external trackers have merged:

The following pull request, linked via external tracker, has not merged:

All associated pull requests must be merged or unlinked from the Jira bug in order for it to move to the next state. Once unlinked, request a bug refresh with /jira refresh.

Jira Issue OCPBUGS-61224 has not been moved to the MODIFIED state.

This PR is marked as verified. If the remaining PRs listed above are marked as verified before merging, the issue will automatically be moved to VERIFIED after all of the changes from the PRs are available in an accepted nightly payload.

In response to this:

Reverts #656

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@sdodson
Copy link
Member Author

sdodson commented Sep 11, 2025

/cherry-pick release-4.20

@openshift-cherrypick-robot

@sdodson: new pull request created: #674

In response to this:

/cherry-pick release-4.20

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-cherrypick-robot

@sdodson: new pull request could not be created: failed to create pull request against openshift/router#release-4.20 from head openshift-cherrypick-robot:cherry-pick-672-to-release-4.20: status code 422 not one of [201], body: {"message":"Validation Failed","errors":[{"resource":"PullRequest","code":"custom","message":"A pull request already exists for openshift-cherrypick-robot:cherry-pick-672-to-release-4.20."}],"documentation_url":"https://docs.github.com/rest/pulls/pulls#create-a-pull-request","status":"422"}

In response to this:

/cherry-pick release-4.20

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. docs-approved Signifies that Docs has signed off on this PR jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. px-approved Signifies that Product Support has signed off on this PR qe-approved Signifies that QE has signed off on this PR verified Signifies that the PR passed pre-merge verification criteria

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants