Service(Closed) error

[nilgoyette]

HI all. I'm getting a Service(Closed) error when trying to create a lease. There's curiously not much information about that error on google, except for its AI auto-answer, and it's not really useful... I did find a hint in one of the discussions

NB: If the controller is making more calls than we are handling in the scenario,
you then typically see a KubeError(Service(Closed(()))) from the reconciler.

but I'm not even sure what this sentence means :|

Here's what I'm doing

let rt = tokio::runtime::Runtime::new().unwrap();
let namespace = "ploy-devel-andiploy-44-3zss0r";

rt.spawn(async move {
    let client = kube::Client::try_default().await.unwrap();
    let leases: kube::Api<Lease> = kube::Api::namespaced(client, namespace);
    let lease = Lease {
        metadata: ObjectMeta {
            name: Some(lease_name.to_string()),
            namespace: Some(namespace.to_string()),
            ..ObjectMeta::default()
        },
        spec: Some(k8s_openapi::api::coordination::v1::LeaseSpec {
            lease_duration_seconds: Some(15),
            ... all other members are None ...
        }),
    };
    let pp = PostParams::default();
    leases.create(&pp, &lease).await.unwrap();

My app panics at the last line, with a

called `Result::unwrap()` on an `Err` value: Service(Closed)

It's not clear to me how a service can be "closed". I executed a shell in the pod and ran this command

curl --cacert ... -H "Authorization: Bearer ... \
  https://kubernetes.default.svc/apis/coordination.k8s.io/v1/namespaces/ploy-devel-andiploy-44-3zss0r/leases

It does return something

{
  "kind": "LeaseList",
  "apiVersion": "coordination.k8s.io/v1",
  "metadata": {
    "resourceVersion": "137169703"
  },
  "items": [
    {
      "metadata": {
        "name": "ploy-launcher-lease",
        "namespace": "ploy-devel-andiploy-44-3zss0r",
        "uid": "2c6c0e9a-85f3-4230-8571-acc4d0b3a798",
        "resourceVersion": "137129331",
        "creationTimestamp": "2025-09-08T14:34:23Z",
        "labels": {
          "app.kubernetes.io/managed-by": "Helm"
        },
        "annotations": {
          "meta.helm.sh/release-name": "ploy",
          "meta.helm.sh/release-namespace": "ploy-devel-andiploy-44-3zss0r"
        },
        "managedFields": [
          {
            "manager": "helm",
            "operation": "Update",
            "apiVersion": "coordination.k8s.io/v1",
            "time": "2025-09-08T14:34:23Z",
            "fieldsType": "FieldsV1",
            "fieldsV1": {
              "f:metadata": {
                "f:annotations": {
                  ".": {},
                  "f:meta.helm.sh/release-name": {},
                  "f:meta.helm.sh/release-namespace": {}
                },
                "f:labels": {
                  ".": {},
                  "f:app.kubernetes.io/managed-by": {}
                }
              },
              "f:spec": {
                "f:holderIdentity": {}
              }
            }
          }
        ]
      },
      "spec": {
        "holderIdentity": "NA"
      }
    }
  ]
}

It looks like something valid and un-closed! Then I deleted the ploy-launcher-lease lease using a -X DELETE and retried running the pod. Same error. But the previous command told me that there's no lease, which is normal because I deleted it.

At that point, I'm not sure what to try. What does Service(Closed) mean and how can I fix it?

(Yes, I'm using the just-released v2. I was getting the same error before that version too)

[nilgoyette]

It seems that this error is not strictly related to k8s, but to my tokyo runtime (main wasn't async) which was getting destroyed too fast.

[clux]

Thanks for updating this. I had never seen this.