Since #5014, the Binary provisioning feature is enabled by default. We added a smoke test for running k6 with this feature disabled. However, it only tests a command under very specific conditions.
It would be convenient to run multiple test cases (if not all, with the feature disabled)