Skip to content

Conversation

@fx147
Copy link
Contributor

@fx147 fx147 commented Oct 21, 2025

Summary

This PR adds the DataDependency v1alpha1 API definitions and generated client code to the volcano.sh/apis repository as part of the CRD migration from volcano-global.

Changes

  • API Definitions: Added DataDependency CRD definitions under pkg/apis/datadependency/v1alpha1/

    • types.go: Core DataSource and DataSourceClaim types
    • doc.go: Package documentation and API group definition
    • register.go: Scheme registration and GroupVersionKind setup
    • zz_generated.deepcopy.go: Generated DeepCopy methods
  • Generated Client Code: Added complete client-go style generated code

    • pkg/client/clientset/versioned/: Typed clientset for DataDependency APIs
    • pkg/client/informers/externalversions/: Shared informer factory and informers
    • pkg/client/listers/datadependency/v1alpha1/: Listers for efficient local caching

API Group Details

  • Group: datadependency.volcano.sh
  • Version: v1alpha1
  • Resources:
    • DataSource: Represents cached query results for data-aware scheduling
    • DataSourceClaim: Represents claims for data sources with specific requirements

Migration Context

This is part of the broader effort to separate API definitions from the main volcano-global repository to improve modularity and reusability. The DataDependency API enables data-aware scheduling capabilities in Volcano.

Breaking Changes

None - this is a new addition to the apis repository.

Dependencies

feature: implement data-aware dependency scheduling framework with Amoro plugin supportFeature/dsc controller
This PR should be merged before updating volcano-global to use the new API location.

@volcano-sh-bot
Copy link
Collaborator

Welcome @fx147!

It looks like this is your first PR to volcano-sh/apis.

Thank you, and welcome to Volcano. 😃

@gemini-code-assist
Copy link

Summary of Changes

Hello @fx147, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request integrates the new DataDependency v1alpha1 API into the volcano.sh/apis repository, along with all necessary generated client code. This foundational work is essential for enabling data-aware scheduling capabilities within Volcano and represents a significant step in refactoring API definitions into a dedicated repository, enhancing the overall architecture and reusability of components.

Highlights

  • New DataDependency API: Introduced the DataDependency v1alpha1 API, defining DataSource and DataSourceClaim resources for data-aware scheduling in Volcano.
  • Generated Client Code: Added comprehensive client-go style generated code, including clientsets, informers, and listers, for the new DataDependency APIs.
  • CRD Migration: This change is part of a broader effort to migrate CRD definitions from the volcano-global repository to volcano.sh/apis for improved modularity.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces the DataDependency v1alpha1 API, along with its generated client code. The changes are well-structured and follow standard practices for adding new APIs to a Kubernetes-style project. I've identified a few areas for improvement, primarily related to consistency in the API type definitions in pkg/apis/datadependency/v1alpha1/types.go to enhance clarity and prevent potential issues. Specifically, I've pointed out inconsistencies in JSON tags and comments versus field types. Additionally, a minor documentation update in pkg/apis/datadependency/v1alpha1/doc.go is suggested for accuracy. The rest of the changes, including the client generation and refactoring of existing code, look good.

@JesseStutler
Copy link
Member

@fx147 Please resolve conflicts and check gemini's review opinion

@fx147 fx147 force-pushed the feature/add-datadependency-api branch from 0d1af85 to e02492f Compare October 21, 2025 12:29
@fx147 fx147 force-pushed the feature/add-datadependency-api branch 2 times, most recently from d2c14c9 to fb4334b Compare October 23, 2025 08:43
@JesseStutler
Copy link
Member

@fx147 Please squash your commits into only one clean commit

@JesseStutler
Copy link
Member

/approve

@volcano-sh-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: JesseStutler

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

fx147 added 2 commits October 28, 2025 13:34
Add API definitions for the datadependency v1alpha1 API group:
- DataSource: represents a cached query result for data sources in federated environment
- DataSourceClaim: represents a claim for data source resources

Signed-off-by: FanXu <[email protected]>
- Generate deepcopy methods for DataSource and DataSourceClaim types
- Generate clientset, informers, listers and apply configurations
- Update existing client utilities to support datadependency API group

Signed-off-by: FanXu <[email protected]>
@fx147 fx147 force-pushed the feature/add-datadependency-api branch from fb4334b to b258027 Compare October 28, 2025 05:38
@wangyang0616
Copy link
Member

/lgtm

@volcano-sh-bot volcano-sh-bot merged commit 46d20c0 into volcano-sh:master Oct 28, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants