Minikube with driver "new Virtualization Framework" on Apple M1

[cscetbon]

As more and more people are thinking of moving to Minikube to replace "Docker For Mac" some work to enable virtualization on it should be a priority to get them onboard. Hyperkit being deprecated going with the new Virtualization Framework which uses higher API and is supposed to be easier to use probably makes more sense

See https://github.com/Code-Hex/vz

[cscetbon]

Did someone start any work on this somewhere that could be used as a base or needs to be completed ?

[afbjorklund]

Currently containerd (lima) uses QEMU and podman (machine) uses QEMU, but there is room for more hypervisor drivers.

• https://medium.com/nttlabs/containerd-and-lima-39e0b64d2a59

• https://www.redhat.com/sysadmin/podman-mac-machine-architecture

The main issue is actually not the CPU virtualization, at least not anymore. The problem is the network, especially VPN...

[cscetbon]

@afbjorklund but as Minikube already supports hyperkit I thought it should be easier to start from there and migrate it to the new framework which is supposed to be simple and support everything that is already supported.

[afbjorklund]

Yes, as far as I know both HyperKit and VpnKit are still Open Source even if Docker's new libraries might not be.

• https://github.com/moby/hyperkit

• https://github.com/moby/vpnkit

But it doesn't work on aarch64 (yet?)

[afbjorklund]

migrate it to the new framework

What "new framework" are you talking about here ?

Apple's low-level system libraries need another layer on top, before they can be used by something like minikube. The examples showed QEMU.

[cscetbon]

migrate it to the new framework

What "new framework" are you talking about here ?

https://developer.apple.com/documentation/virtualization

The new one that deprecates hyperkit and there is a go binding for it at https://github.com/Code-Hex/vz

[afbjorklund]

Okay thanks, we will need someone to turn that into a "driver" for the libmachine framework:

https://github.com/docker/machine/blob/master/libmachine/drivers/drivers.go

[cscetbon]

@afbjorklund You mean writing something like https://github.com/kubernetes/minikube/tree/master/pkg/drivers/hyperkit, right ? Also do you know why the hyperkit doesn't work on M1 atm ?

[afbjorklund]

@afbjorklund You mean writing something like https://github.com/kubernetes/minikube/tree/master/pkg/drivers/hyperkit, right ?

Right (you will notice it imports the libmachine framework)

There is also an old driver for QEMU.

Also do you know why the hyperkit doesn't work on M1 atm ?

Same reason as VirtualBox, I suppose. No arm64 support.

See moby/hyperkit#303 (comment)

[cscetbon]

As you need help, @yoelb and I can tackle it

[riaz7se]

Any reference or links to follow for installing minikube on M1 using Apple Virtualization framework?
pls suggest