Skip to content

Conversation

aidint
Copy link

@aidint aidint commented Sep 15, 2025

What changes are proposed in this pull request?

This PR adds support for querying an individual model in the serving endpoints as documented here.

  • WHAT changes are being made in the PR?
    It adds served-models to the url used for the query requests if served_model_name is provided.
  • WHY are these changes needed?
    While querying an individual model behind a serving endpoint is supported by rest api, it is not supported by the sdk. This limits users flexibility in serving multiple models in one endpoint. I raised this problem in this issue.

How is this tested?

I tested this with an endpoint in a private databricks workspace.

Describe any tests you have done; especially if test tests are not part of
the unit tests (e.g. local tests).

I couldn't find any test case for the query methods, therefore the answer is N/A.

Copy link

Please ensure that the NEXT_CHANGELOG.md file is updated with any relevant changes.
If this is not necessary for your PR, please include the following in your PR description:
NO_CHANGELOG=true
and rerun the job.

Copy link

If integration tests don't run automatically, an authorized user can run them manually by following the instructions below:

Trigger:
go/deco-tests-run/sdk-py

Inputs:

  • PR number: 1044
  • Commit SHA: 0fba34c9ff53b99cbfd78a3fef98c43b5fd0ef94

Checks will be approved automatically on success.

@aidint
Copy link
Author

aidint commented Sep 15, 2025

@hectorcast-db can you please help me with this PR?

@aidint
Copy link
Author

aidint commented Sep 19, 2025

@rauchy can you please review this pull request?

@hectorcast-db
Copy link
Contributor

Hi @aidint
Thanks for reaching out and the PR.
Unfortunately, we cannot merge this PR. The code for services is auto generated, so any manual change will be automatically reverted.
I will forward this to the team so they can update their configuration upstream.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants