Integration: KAI Scheduler

[EkinKarabulut]

Why are these changes needed?

This adds the integration to KAI Scheduler.

What has been done?

• Integrate KAI Scheduler as a supported batch scheduler.
• Add KAI scheduler plugin integration.
• Provide sample YAMLs demonstrating KAI integration, including GPU sharing and gang scheduling.
• Update Helm chart values and documentation.
• Add tests for KAI scheduler functionality.

Checks

• I've made sure the tests are passing.
• Testing Strategy
  • Unit tests
  • Manual tests

[kevin85421]

@EkinKarabulut would you mind fixing the conflict? Thanks.

[fscnick]

It looks like the queue definition using by other yaml files. Could the content of this file put into other yaml files which are using KAI together? It might benefit the end user to apply easily like other yaml files under samples.

[troychiu]

I think either way would work as long as we have a clear documentation.

[troychiu]

This is awesome. The example works great. Thank you for the contribution!
Just one small comment. Do you mind running the pre-commit (pre-commit run)?