Add CoreWeave Cluster Autoscaler provider (#8332)

* initial commit

* Add coreweave manager and node pools using unstructure
Add provider unit tests
coverage = 68.7%
run go fmt
update comments on coreweave files
change const to unexported
Add boilerplate header
Remove unused function from manager
Add coreave tag exclusion from the build_all

* address comments and feedbacks

* use the shared *rest.Config from the autoscaler's logic

* update the comments for clouProvider in charts values file

* update charts README with coreweave cloudProvider

Author: keedya

charts/cluster-autoscaler/Chart.yaml

@@ -11,4 +11,4 @@ name: cluster-autoscaler
 sources:
   - https://github.com/kubernetes/autoscaler/tree/master/cluster-autoscaler
 type: application
-version: 9.49.0
+version: 9.50.0

charts/cluster-autoscaler/README.md

@@ -454,7 +454,7 @@ vpa:
 | civoClusterID | string | `""` | Cluster ID for the Civo cluster. Required if `cloudProvider=civo` |
 | civoRegion | string | `""` | Region for the Civo cluster. Required if `cloudProvider=civo` |
 | cloudConfigPath | string | `""` | Configuration file for cloud provider. |
-| cloudProvider | string | `"aws"` | The cloud provider where the autoscaler runs. Currently only `gce`, `aws`, `azure`, `magnum`, `clusterapi` and `civo` are supported. `aws` supported for AWS. `gce` for GCE. `azure` for Azure AKS. `magnum` for OpenStack Magnum, `clusterapi` for Cluster API. `civo` for Civo Cloud. |
+| cloudProvider | string | `"aws"` | The cloud provider where the autoscaler runs. Currently only `gce`, `aws`, `azure`, `magnum`, `clusterapi`, `civo` and `coreweave` are supported. `aws` supported for AWS. `gce` for GCE. `azure` for Azure AKS. `magnum` for OpenStack Magnum, `clusterapi` for Cluster API. `civo` for Civo Cloud. `coreweave` for CoreWeave. |
 | clusterAPICloudConfigPath | string | `"/etc/kubernetes/mgmt-kubeconfig"` | Path to kubeconfig for connecting to Cluster API Management Cluster, only used if `clusterAPIMode=kubeconfig-kubeconfig or incluster-kubeconfig` |
 | clusterAPIConfigMapsNamespace | string | `""` | Namespace on the workload cluster to store Leader election and status configmaps |
 | clusterAPIKubeconfigSecret | string | `""` | Secret containing kubeconfig for connecting to Cluster API managed workloadcluster Required if `cloudProvider=clusterapi` and `clusterAPIMode=kubeconfig-kubeconfig,kubeconfig-incluster or incluster-kubeconfig` |

charts/cluster-autoscaler/templates/clusterrole.yaml

@@ -6,6 +6,17 @@ metadata:
 {{ include "cluster-autoscaler.labels" . | indent 4 }}
   name: {{ template "cluster-autoscaler.fullname" . }}
 rules:
+{{- if (eq .Values.cloudProvider "coreweave") }}
+  - apiGroups:
+    - "compute.coreweave.com"
+    resources:
+    - nodepools
+    verbs:
+    - get
+    - list
+    - patch
+    - update
+{{- end }}
   - apiGroups:
       - ""
     resources:

charts/cluster-autoscaler/values.yaml

@@ -133,10 +133,11 @@ civoRegion: ""
 cloudConfigPath: ""
 
 # cloudProvider -- The cloud provider where the autoscaler runs.
-# Currently only `gce`, `aws`, `azure`, `magnum`, `clusterapi` and `civo` are supported.
+# Currently only `gce`, `aws`, `azure`, `magnum`, `clusterapi`, `civo` and `coreweave` are supported.
 # `aws` supported for AWS. `gce` for GCE. `azure` for Azure AKS.
 # `magnum` for OpenStack Magnum, `clusterapi` for Cluster API.
 # `civo` for Civo Cloud.
+# `coreweave` for CoreWeave.
 cloudProvider: aws
 
 # clusterAPICloudConfigPath -- Path to kubeconfig for connecting to Cluster API Management Cluster, only used if `clusterAPIMode=kubeconfig-kubeconfig or incluster-kubeconfig`

cluster-autoscaler/README.md

@@ -23,6 +23,7 @@ You should also take a look at the notes and "gotchas" for your specific cloud p
 * [Civo](./cloudprovider/civo/README.md)
 * [CloudStack](./cloudprovider/cloudstack/README.md)
 * [ClusterAPI](./cloudprovider/clusterapi/README.md)
+* [CoreWeave](./cloudprovider/coreweave/README.md)
 * [DigitalOcean](./cloudprovider/digitalocean/README.md)
 * [Exoscale](./cloudprovider/exoscale/README.md)
 * [Equinix Metal](cloudprovider/equinixmetal/README.md#notes)

cluster-autoscaler/cloudprovider/builder/builder_all.go

@@ -1,5 +1,5 @@
-//go:build !gce && !aws && !azure && !kubemark && !alicloud && !magnum && !digitalocean && !clusterapi && !huaweicloud && !ionoscloud && !linode && !hetzner && !bizflycloud && !brightbox && !equinixmetal && !oci && !vultr && !tencentcloud && !scaleway && !externalgrpc && !civo && !rancher && !volcengine && !baiducloud && !cherry && !cloudstack && !exoscale && !kamatera && !ovhcloud && !kwok && !utho
-// +build !gce,!aws,!azure,!kubemark,!alicloud,!magnum,!digitalocean,!clusterapi,!huaweicloud,!ionoscloud,!linode,!hetzner,!bizflycloud,!brightbox,!equinixmetal,!oci,!vultr,!tencentcloud,!scaleway,!externalgrpc,!civo,!rancher,!volcengine,!baiducloud,!cherry,!cloudstack,!exoscale,!kamatera,!ovhcloud,!kwok,!utho
+//go:build !gce && !aws && !azure && !kubemark && !alicloud && !magnum && !digitalocean && !clusterapi && !huaweicloud && !ionoscloud && !linode && !hetzner && !bizflycloud && !brightbox && !equinixmetal && !oci && !vultr && !tencentcloud && !scaleway && !externalgrpc && !civo && !rancher && !volcengine && !baiducloud && !cherry && !cloudstack && !exoscale && !kamatera && !ovhcloud && !kwok && !utho && !coreweave
+// +build !gce,!aws,!azure,!kubemark,!alicloud,!magnum,!digitalocean,!clusterapi,!huaweicloud,!ionoscloud,!linode,!hetzner,!bizflycloud,!brightbox,!equinixmetal,!oci,!vultr,!tencentcloud,!scaleway,!externalgrpc,!civo,!rancher,!volcengine,!baiducloud,!cherry,!cloudstack,!exoscale,!kamatera,!ovhcloud,!kwok,!utho,!coreweave
 
 /*
 Copyright 2018 The Kubernetes Authors.
@@ -31,6 +31,7 @@ import (
 	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider/civo"
 	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider/cloudstack"
 	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider/clusterapi"
+	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider/coreweave"
 	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider/digitalocean"
 	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider/equinixmetal"
 	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider/exoscale"
@@ -87,6 +88,7 @@ var AvailableCloudProviders = []string{
 	cloudprovider.RancherProviderName,
 	cloudprovider.VolcengineProviderName,
 	cloudprovider.UthoProviderName,
+	cloudprovider.CoreWeaveProviderName,
 }
 
 // DefaultCloudProvider is GCE.
@@ -157,6 +159,8 @@ func buildCloudProvider(opts config.AutoscalingOptions,
 		return volcengine.BuildVolcengine(opts, do, rl)
 	case cloudprovider.UthoProviderName:
 		return utho.BuildUtho(opts, do, rl)
+	case cloudprovider.CoreWeaveProviderName:
+		return coreweave.BuildCoreWeave(opts, do, rl)
 	}
 	return nil
 }

cluster-autoscaler/cloudprovider/builder/builder_coreweave.go

@@ -0,0 +1,39 @@
+//go:build coreweave
+// +build coreweave
+
+/*
+Copyright 2025 The Kubernetes Authors.
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+    http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+*/
+
+package builder
+
+import (
+	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider"
+	"k8s.io/autoscaler/cluster-autoscaler/cloudprovider/coreweave"
+	"k8s.io/autoscaler/cluster-autoscaler/config"
+	"k8s.io/client-go/informers"
+)
+
+// AvailableCloudProviders supported by the cloud provider builder.
+var AvailableCloudProviders = []string{
+	cloudprovider.CoreWeaveProviderName,
+}
+
+// DefaultCloudProvider for coreweave-only build is coreweave.
+const DefaultCloudProvider = cloudprovider.CoreWeaveProviderName
+
+func buildCloudProvider(opts config.AutoscalingOptions, do cloudprovider.NodeGroupDiscoveryOptions, rl *cloudprovider.ResourceLimiter, _ informers.SharedInformerFactory) cloudprovider.CloudProvider {
+	return coreweave.BuildCoreWeave(opts, do, rl)
+}

cluster-autoscaler/cloudprovider/cloud_provider.go

@@ -44,6 +44,8 @@ const (
 	CherryServersProviderName = "cherryservers"
 	// CloudStackProviderName gets the provider name of cloudstack
 	CloudStackProviderName = "cloudstack"
+	// CoreWeaveProviderName gets the provider name of coreweave
+	CoreWeaveProviderName = "coreweave"
 	// ClusterAPIProviderName gets the provider name of clusterapi
 	ClusterAPIProviderName = "clusterapi"
 	// DigitalOceanProviderName gets the provider name of digitalocean

cluster-autoscaler/cloudprovider/coreweave/OWNERS

@@ -0,0 +1,7 @@
+maintainers:
+- keedya
+- ddymko
+
+
+labels:
+- area/provider/coreweave

cluster-autoscaler/cloudprovider/coreweave/README.md

@@ -0,0 +1,89 @@
+# Cluster Autoscaler for CoreWeave
+
+The Cluster Autoscaler for CoreWeave automatically adjusts the size of your Kubernetes cluster by adding or removing nodes in CoreWeave NodePools based on pending workloads and resource utilization.
+
+## Configuration
+
+### Cloud config
+
+The CoreWeave provider does not require a separate cloud config file. All configuration is managed via Kubernetes CoreWeave NodePool resource and standard Cluster Autoscaler flags.
+
+## Behavior
+
+- The autoscaler monitors unschedulable pods and scales NodePools up or down as needed.
+- Minimum and maximum NodePools sizes are configured via the CoreWeave NodePool custom resources.
+
+## Development
+
+To build and test the CoreWeave provider
+
+1. **Build the `cluster-autoscaler` binary:**
+    ```sh
+    make build-in-docker
+    ```
+
+To build and test the CoreWeave provider in k8s:
+
+1. **Build the `cluster-autoscaler` docker image:**
+    ```sh
+    REGISTRY=gcr.io/k8s-staging-autoscaling TAG=dev make make-image
+    ```
+
+2. **Push the Docker image to your registry:**
+    ```sh
+    REGISTRY=gcr.io/k8s-staging-autoscaling TAG=dev make push-image
+    ```
+
+## Usage
+
+To enable the CoreWeave provider, set the following flag when running the autoscaler:
+
+```sh
+./cluster-autoscaler --cloud-provider=coreweave
+```
+## Usage with Helm Charts
+
+When deploying the Cluster Autoscaler for CoreWeave using the provided Helm chart, you can customize its behavior using the `extraArgs` section in your `values.yaml` file.  
+These arguments are passed directly to the Cluster Autoscaler container.
+
+## Helm Chart Deployment
+
+You can deploy the Cluster Autoscaler for CoreWeave using the official Helm chart.  
+Below are the basic steps:
+
+1. **Add the Helm repository (if not already added):**
+    ```sh
+    helm repo add autoscaler https://kubernetes.github.io/autoscaler
+    helm repo update
+    ```
+
+2. **Customize your `values.yaml`:** (Replace image.repository and image.tag below with your registry and the tag you chose)
+    - Set `cloudProvider: coreweave`
+    - Set `autoDiscovery.clusterName: cluster.local`
+    - Set `image.tag: dev`
+    - Set `image.repository: gcr.io/k8s-staging-autoscaling/cluster-autoscaler-arm64`
+    - Set any desired `extraArgs` as shown [parameters](../../FAQ.md#what-are-the-parameters-to-ca)
+    - Optionally adjust resources, tolerations, nodeSelector, etc.
+
+3. **Install or upgrade the chart:**
+    ```sh
+    helm upgrade --install cluster-autoscaler autoscaler/cluster-autoscaler \
+      --namespace kube-system \
+      -f values.yaml
+    ```
+
+4. **Verify deployment:**
+    ```sh
+    kubectl -n kube-system get pods -l app.kubernetes.io/name=coreweave-cluster-autoscaler
+    ```
+
+For more advanced configuration, refer to the [values.yaml](../../../charts/cluster-autoscaler/values.yaml) in this repository.
+
+
+## Contributing
+
+Contributions are welcome! Please open issues or pull requests for bug fixes, improvements, or new features.
+
+## License
+
+This project is licensed under the Apache 2.0 License.