Update csi driver and other components

[iuriaranda]

This updates the csi-driver to the latest version, and syncs the versions of the other components with the ones defined in the upstream azurefile-csi chart.

The csi-attacher component has been removed from the upstream chart, see kubernetes-sigs/azurefile-csi-driver#1664 . Should it be removed from here as well? I couldn't find any info on why it was removed nor if it should be replaced by something else. For now I've bumped the version to the latest release. I've ported all the relevant upstream changes, including the csi-attacher removal.

As per https://github.com/giantswarm/giantswarm/issues/30774

[vxav]

According to this cherrypick:

cleanup: remove csi-attacher config, ControllerPublishVolume capability is removed starting from v1.29.1

kubernetes-sigs/azurefile-csi-driver#1468
kubernetes-sigs/azurefile-csi-driver#1467

It seems that this capability is the job of the attacher container.
https://github.com/kubernetes-csi/external-attacher?tab=readme-ov-file#csi-attacher

The external-attacher is a sidecar container that attaches volumes to nodes by calling ControllerPublish and ControllerUnpublish functions of CSI drivers. It is necessary because internal Attach/Detach controller running in Kubernetes controller-manager does not have any direct interfaces to CSI drivers.

I don't know enough about the inner workings of CSI drivers to comment further though 😄.

---

However we are not on 1.29 yet. Is there a way to tie a release to Kubernetes version compatibility somehow?

EDIT: The table says Kubernetes 1.21+. Maybe we just don't need this thing then. A test will tell

[vxav]

I'm not familiar with that repo but I would assume that we also need to update the manifests to 1.30.2.

[iuriaranda]

It seems that this capability is the job of the attacher container.

That's precisely the container that has been removed from the upstream chart 🤔

However we are not on 1.29 yet. Is there a way to tie a release to Kubernetes version compatibility somehow?

EDIT: The table says Kubernetes 1.21+. Maybe we just don't need this thing then. A test will tell

When they mention that "ControllerPublishVolume capability is removed starting from v1.29.1" they are referring to the Azurefile CSI driver version I think, not the k8s one. In any case, as you mentioned, all CSI versions are compatible starting from k8s 1.21 so we should be good.

I'm not familiar with that repo but I would assume that we also need to update the manifests to 1.30.2.

Ok so our chart should match the upstream one as much as possible, while keeping our own customisations I assume? I'll see to port all changes then.

Maybe someone from @giantswarm/team-phoenix can chime in regarding what to do with the external-attacher sidecar?

[iuriaranda]

I've tested this by creating a new cluster and updating the CSI helm release to this dev version. I've created a pod with an azurefile PVC and everything works as expected