Skip to content

feat: Change epp and conformance to use v1 type InferencePool #1118

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 85 commits into from
Jul 22, 2025

Conversation

capri-xiyue
Copy link
Contributor

Change epp and conformance to use v1 type InferencePool

@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Jul 7, 2025
@k8s-ci-robot k8s-ci-robot requested review from danehans and liu-cong July 7, 2025 22:02
@k8s-ci-robot k8s-ci-robot added the needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. label Jul 7, 2025
@k8s-ci-robot
Copy link
Contributor

Hi @capri-xiyue. Thanks for your PR.

I'm waiting for a kubernetes-sigs member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@k8s-ci-robot k8s-ci-robot added the size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. label Jul 7, 2025
@capri-xiyue
Copy link
Contributor Author

This PR is based on #1116

@capri-xiyue
Copy link
Contributor Author

/assign @robscott

@capri-xiyue capri-xiyue changed the title feat: Change epp and conformance to use v1 type InferencePool [WIP] feat: Change epp and conformance to use v1 type InferencePool Jul 7, 2025
@k8s-ci-robot k8s-ci-robot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jul 7, 2025
@capri-xiyue
Copy link
Contributor Author

Not ready to review until #1116 is merged

@kfswain
Copy link
Collaborator

kfswain commented Jul 7, 2025

/ok-to-test

@k8s-ci-robot k8s-ci-robot added ok-to-test Indicates a non-member PR verified by an org member that is safe to test. and removed needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Jul 7, 2025
@capri-xiyue
Copy link
Contributor Author

/retest

@kfswain
Copy link
Collaborator

kfswain commented Jul 17, 2025

/approve
/lgtm

Lets keep the hold until we finish the v0.5 rollout, but looks great otherwise! Thanks Xiyue!

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 17, 2025
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: capri-xiyue, kfswain

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jul 17, 2025
@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 18, 2025
@capri-xiyue
Copy link
Contributor Author

/unhold

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jul 21, 2025
@capri-xiyue
Copy link
Contributor Author

/hold until #1116 get merged

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jul 21, 2025
@kfswain
Copy link
Collaborator

kfswain commented Jul 21, 2025

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 21, 2025
@k8s-ci-robot k8s-ci-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed lgtm "Looks good to me", indicates that a PR is ready to be merged. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. labels Jul 21, 2025
@robscott
Copy link
Member

Thanks @capri-xiyue!

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 22, 2025
@capri-xiyue
Copy link
Contributor Author

/unhold

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jul 22, 2025
@k8s-ci-robot k8s-ci-robot merged commit 0d1b385 into kubernetes-sigs:main Jul 22, 2025
9 checks passed
kfswain pushed a commit to kfswain/llm-instance-gateway that referenced this pull request Jul 31, 2025
…etes-sigs#1118)

* rename x-k8s to apix and add v1 InferencePool to api/v1

* changed epp and conformance test to support v1

* fixed duplicate import

* changed docker file

* updated docker file

* fixed naming collision

* added fake approved annotation

* try to fix unit tests

* fixed typo

* added annotation

* fixed annotation

* fixed integration test

* fixed e2e test

* change manifests

* added rbac

* Update api/v1/inferencepool_types.go

Co-authored-by: Rob Scott <[email protected]>

* Apply suggestions from code review

Co-authored-by: Rob Scott <[email protected]>

* use v1 type in v1alpha2

* clean unused depdendency

* fixed code generator error

* revert back

* merge bob's change

* upadted code-gen

* remove deep copy needs

* use codegen

* tried all alias

* push local changes

* changed inferencepoollist not to use v1.InferencePoolList

* changed comments

* fixed presubmit

* change to v1 ip

* revert to corev1 objectreference

* revert back to corev1 objectreference

* change crd

* remove crd

* manually add x-k8s.io inferencepool

* revert crd

* revert to workable version

* Revert "added rbac"

This reverts commit c01cbc8.

* run generator

* re-run generate

* revert to workable

* revert to workable version

* fixed test

* test

* revert it back to originall workable version

* change to use v1alpha2 back

* resolve merge conflicts

* fixed typo

* fixed typo

* fixed pipeline

* fixed boilerplate

Signed-off-by: Xiyue Yu <[email protected]>

* changed unused code

* fixed pipeline:

* fixed missing dependecny update

* updated missing dependency

* fixed imports

* fixed change

* fixed format

* merge to v1-inferencepool

* fixed integration test

* fixed import

* change to install scheme

* fixed import

* change back to main image

* fixed import issue

* fixed format

---------

Signed-off-by: Xiyue Yu <[email protected]>
Co-authored-by: Rob Scott <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants