Make Windows runner backend production ready

Add support for Windows Server Core 2019 and friends.

- windows/servercore:ltsc2019
- windows/nanoserver:1809

Author: amotl

CHANGES.rst

@@ -11,6 +11,10 @@ in progress
 - Improve platform guards and naming things
 - Improve central command invocation function
 - Improve documentation
+- Make Windows runner subsystem production ready.
+- Add support for Windows Server Core 2019 and friends, like
+  ``windows/servercore:ltsc2019``, ``windows/nanoserver:1809``, or
+  ``eclipse-temurin:17-jdk``.
 
 
 2022-05-20 0.2.0

README.rst

@@ -109,6 +109,13 @@ another one for Windows.
   `systemd-nspawn`_. Provisioning of additional software is performed using the
   native package manager of the corresponding Linux distribution.
 
+- For running Windows operating systems containers, Racker uses `Vagrant`_,
+  `Docker`_, and `Windows Docker Machine`_. The virtual machine base image is
+  acquired from `Vagrant Cloud`_, container images are acquired from the
+  `Microsoft Container Registry`_. For provisioning additional software, the
+  `Chocolatey`_ package manager is used. All of cmd, PowerShell and Bash are
+  pre-installed on the container images.
+
 
 Operating system coverage
 -------------------------
@@ -132,6 +139,11 @@ Linux
 - SUSE SLES 15 and BCI:latest
 - Ubuntu LTS 20 and 22 (focal, jammy)
 
+Windows
+.......
+- Windows Server Core LTSC 2016, 2019, and 2022
+- Windows Nano Server 1809 and LTSC 2022
+
 
 Prior art
 ---------
@@ -212,7 +224,7 @@ Racker
 The ``racker`` program aims to resemble the semantics of Docker by providing a
 command line interface compatible with the ``docker`` command.
 
-::
+Linux examples::
 
     # Invoke the vanilla Docker `hello-world` image.
     # FIXME: Does not work yet.
@@ -244,6 +256,42 @@ command line interface compatible with the ``docker`` command.
     time echo "hello world" | racker run -it --rm fedora:37 cat /dev/stdin > hello
     cat hello
 
+Windows examples::
+
+    # Windows OS images, mostly LTSC (Long-Term Servicing Channel).
+    # Please note the download sizes.
+    # Nanoserver: 250 MB, Servercore: 6 GB, Servercore with Java: 7 GB, Windows: 15 GB
+
+    # Launch an interactive command prompt (cmd, PowerShell or Bash).
+    racker --verbose run -it --rm --platform=windows/amd64 mcr.microsoft.com/windows/servercore:ltsc2019-amd64 powershell
+
+    # Launch a single command.
+    racker --verbose run --rm --platform=windows/amd64 mcr.microsoft.com/windows/servercore:ltsc2019-amd64 -- 'powershell -Command {echo "Hello, world."}'
+    racker --verbose run --rm --platform=windows/amd64 mcr.microsoft.com/windows/servercore:ltsc2019-amd64 'sh -c "echo Hello, world."'
+
+    # Inquire system information.
+    racker run --rm --platform=windows/amd64 mcr.microsoft.com/windows/servercore:ltsc2019-amd64 wmic os get caption
+    racker run --rm --platform=windows/amd64 mcr.microsoft.com/windows/servercore:ltsc2019-amd64 'powershell -Command Get-ComputerInfo'
+
+    # Use stdin and stdout, with time keeping.
+    time racker --verbose run --rm --platform=windows/amd64 mcr.microsoft.com/windows/nanoserver:1809-amd64 cmd /C echo "Hello, world." > hello
+    cat hello
+
+    # Invoke a Java command prompt (JShell) with different Java versions.
+    racker run -it --rm --platform=windows/amd64 openjdk:18-windowsservercore-1809 jshell
+    racker run -it --rm --platform=windows/amd64 eclipse-temurin:18-jdk jshell
+    System.out.println("OS: " + System.getProperty("os.name") + ", version " + System.getProperty("os.version"))
+    System.out.println("Java: " + System.getProperty("java.vendor") + ", version " + System.getProperty("java.version"))
+    /exit
+
+    # Windows Nano Server.
+    racker --verbose run -it --rm --platform=windows/amd64 mcr.microsoft.com/windows/nanoserver:1809-amd64 cmd
+    racker --verbose run --rm --platform=windows/amd64 mcr.microsoft.com/windows/nanoserver:1809-amd64 cmd /C echo Hello, world.
+
+    # Full Windows.
+    racker --verbose run -it --rm --platform=windows/amd64 mcr.microsoft.com/windows:1809-amd64 cmd
+
+
 
 Postroj
 =======

doc/cratedb.rst

@@ -1,12 +1,52 @@
-#########################
-Using postroj for CrateDB
-#########################
+#######################################
+Using Racker and Postroj for CrateDB CI
+#######################################
 
 .. note::
 
     This is still a work in progress.
 
 
+*************
+Prerequisites
+*************
+
+When creating the "Windows Docker Machine" virtual machine, the program will
+configure it to use 6 VPUs and 6144 MB system memory.
+
+In order to adjust those values, use these environment variables before
+invoking the later commands::
+
+    export RACKER_VM_VCPUS=12
+    export RACKER_VM_MEMORY=8192
+
+If you want to adjust the values after the initial deployment, you will have to
+reset the "Windows Docker Machine" installation directory. For example, it is:
+
+- On Linux: ``/root/.local/state/racker/windows-docker-machine``
+- On macOS: ``/Users/amo/Library/Application Support/racker/windows-docker-machine``
+
+
+
+**********
+racker run
+**********
+
+Purpose: Invoke programs in a Java/OpenJDK environment, within a
+virtualized/dockerized Windows installation.
+
+Run the CrateDB test suite on OpenJDK 18 (Eclipse Temurin)::
+
+    time racker run --rm --platform=windows/amd64 eclipse-temurin:18-jdk \
+        "sh -c 'mkdir /c/src; cd /c/src; git clone https://github.com/crate/crate --depth=1; cd crate; ./gradlew --no-daemon --parallel -PtestForks=2 :server:test -Dtests.crate.run-windows-incompatible=false --stacktrace'"
+
+Invoke a Java command prompt (JShell) with OpenJDK 18::
+
+    racker run -it --rm --platform=windows/amd64 eclipse-temurin:18-jdk jshell
+    System.out.println("OS: " + System.getProperty("os.name") + ", version " + System.getProperty("os.version"))
+    System.out.println("Java: " + System.getProperty("java.vendor") + ", version " + System.getProperty("java.version"))
+
+
 ****************
 postroj pkgprobe
 ****************

doc/winrunner.rst

@@ -1,6 +1,6 @@
-#################
-postroj winrunner
-#################
+##############
+Windows runner
+##############
 
 .. note::
 
@@ -11,25 +11,22 @@ postroj winrunner
 About
 *****
 
-- https://github.com/PyTables/PyTables/pull/872#issuecomment-773535041
-
+Launch an interactive command prompt (cmd, PowerShell or Bash) within a Windows
+environment or invoke programs non-interactively.
 
-********
-Synopsis
-********
-::
+References
+==========
 
-    # Basic usage.
-    postroj invoke --system=windows-1809 -- cmd /C echo hello
+- https://github.com/PyTables/PyTables/pull/872#issuecomment-773535041
 
 
 *****
 Setup
 *****
 ::
 
-    # Install VirtualBox, Vagrant and Docker.
-    brew install virtualbox docker vagrant
+    # Install VirtualBox, Vagrant, and Docker.
+    brew install virtualbox vagrant docker
 
     # Install Windows VM with Docker environment.
     git clone https://github.com/StefanScherer/windows-docker-machine
@@ -47,6 +44,38 @@ Setup
 Usage
 *****
 
+Basic usage::
+
+    racker run --rm --platform=windows/amd64 mcr.microsoft.com/windows/servercore:ltsc2019-amd64 \
+        cmd /C echo "Hello, world."
+
+Install software packages using `Chocolatey`_::
+
+    racker run -it --rm --platform=windows/amd64 mcr.microsoft.com/windows/servercore:ltsc2019-amd64 \
+        powershell
+    Set-ExecutionPolicy Bypass -Scope Process -Force; [System.Net.ServicePointManager]::SecurityProtocol = [System.Net.ServicePointManager]::SecurityProtocol -bor 3072; iex ((New-Object System.Net.WebClient).DownloadString('https://community.chocolatey.org/install.ps1'))
+    choco install --yes git
+    Install-ChocolateyPath -PathToInstall "$($env:SystemDrive)\Program Files\Git\bin"
+
+
+*************
+Miscellaneous
+*************
+
+Manipulating ``PATH``
+=====================
+
+Display the content of the ``PATH`` environment variable::
+
+    echo %PATH%
+    (Get-ItemProperty 'HKLM:\SYSTEM\CurrentControlSet\Control\Session Manager\Environment' -Name Path).Path
+
+Set the content of the ``PATH`` environment variable::
+
+    setx PATH "$env:path;$($env:SystemDrive)\Program Files\Git\bin" -m
+    [Environment]::SetEnvironmentVariable("Path", $env:Path + ";$($env:SystemDrive)\Program Files\Git\bin", "Machine")
+
+
 Which shell spawns faster?
 ==========================
 ::
@@ -79,3 +108,5 @@ Terminate an environment::
     docker --context=2019-box ps
     docker --context=2019-box stop 5e2fe406ccbc
 
+
+.. _Chocolatey: https://chocolatey.org/

postroj/cli.py

@@ -4,7 +4,7 @@
 
 import click
 
-from postroj import pkgprobe, runner, selftest, winrunner
+from postroj import pkgprobe, selftest
 from postroj.api import pull_multiple_images, pull_single_image
 from postroj.registry import list_images
 from postroj.util import boot
@@ -48,6 +48,5 @@ def cli_pull(ctx: click.Context, name: str, pull_all: bool = False):
 
 cli.add_command(cmd=cli_list_images, name="list-images")
 cli.add_command(cmd=cli_pull, name="pull")
-cli.add_command(cmd=runner.invoke, name="invoke")
 cli.add_command(cmd=pkgprobe.main, name="pkgprobe")
 cli.add_command(cmd=selftest.selftest_main, name="selftest")

postroj/runner.py

@@ -0,0 +1,20 @@
+# Provision a Windows operating system image with additional software.
+# Automatically installs the open source version of the Chocolatey package manager.
+# By default, it installs `git`, `curl`, and `wget`.
+
+ARG BASE_IMAGE
+
+FROM ${BASE_IMAGE}
+
+# Install the Chocolatey package manager.
+RUN powershell -Command Set-ExecutionPolicy Bypass -Scope Process -Force; [System.Net.ServicePointManager]::SecurityProtocol = [System.Net.ServicePointManager]::SecurityProtocol -bor 3072; iex ((New-Object System.Net.WebClient).DownloadString('https://community.chocolatey.org/install.ps1'))
+
+# Install essential and convenience programs.
+# TODO: Verify that the right `curl` program has priority within the program search path.
+RUN choco install --yes git curl wget
+
+# Make `bash` (from Git Bash, MINGW64) available on the program search path.
+RUN powershell ([Environment]::SetEnvironmentVariable('Path', $env:Path + ';' + $($env:SystemDrive) + '\Program Files\Git\bin', 'Machine'))
+
+# Display the program search path.
+RUN powershell echo \"(Get-ItemProperty 'HKLM:\SYSTEM\CurrentControlSet\Control\Session Manager\Environment' -Name Path).Path\"