Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to Hyperkube v1.14+. #88

Merged
merged 2 commits into from
Apr 16, 2020

Conversation

margamanterola
Copy link
Contributor

@margamanterola margamanterola commented Apr 15, 2020

Adapt our existing kubernetes test to newer versions

Starting from Docker 19.03, we need a newer version of Kubernetes or our deployment doesn't work. So we switch to testing newer k8s versions.

This includes updating quite a few Kubernetes flags that were deprecated since the old version we were using, to use the new names and formats (some flags were renamed, others had to be moved to config files, others don't exist anymore). Supporting different Kubernetes versions also means adding some conditional behavior for commands that changed along the way.

This commit also switches to the hyperkube images provided by gcr.io instead of the ones provided by quay.io, as those were discontinued. To get this to work we need to prepend the ACI with docker:// and set the --insecure-options=image option (See coreos/coreos-kubernetes#583)

It also updates the environment variables in the service files to the non-deprecated ones wanted by kubelet-wrapper.

And it adds a few plog messages while setting up to make the kola output more helpful.

How to run

  • Build kola with this change
  • bin/kola run --basename=new-kube --gce-image=marga-test-2466-0-0 --gce-json-key=gce-service-account.json --parallel=4 --platform=gce -d -k --remove=false --torcx-manifest=torcx_manifest.json google.kubernetes.basic.docker.v1.16.8 google.kubernetes.basic.docker.v1.18.0 google.kubernetes.basic.docker.v1.14.10

Testing done

I've run the command listed above and it passed for all three versions of Hyperkube (after a lot of tweaking the setup...)

Fixes: flatcar/Flatcar#79

Starting from Docker 19.03, we need a newer version of Kubernetes or our
deployment doesn't work. So we switch to testing newer k8s versions.

This includes updating quite a few Kubernetes flags that were deprecated
since the old version we were using, to use the new names and formats.

Supporting different Kubernetes versions also means adding some
conditional behavior for commands that changed along the way.

This commit also switches to the hyperkube images provided by gcr.io
instead of the ones provided by quay.io, as those were discontinued. To
get this to work we need to prepend the ACI with docker:// and set the
--insecure-options=image option (See coreos/coreos-kubernetes#583)

It also updates the environment variables in the service files to the
non-deprecated ones wanted by kubelet-wrapper.

And it adds a few plog messages while setting up to make the kola output
more helpful.
@margamanterola margamanterola requested a review from a team April 15, 2020 17:27
Copy link
Member

@pothos pothos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess we can remove the ExcludeChannels: []string{"alpha", "edge"}, line again? You tested with Alpha, it would be good to test the other channels, too.

@pothos
Copy link
Member

pothos commented Apr 16, 2020

I tested on Stable and it passed 👍

You have to run gofmt again for the last commit.

@margamanterola margamanterola force-pushed the marga-kinvolk/update-k8s-test branch from fef4786 to 3d22d5e Compare April 16, 2020 11:12
@margamanterola
Copy link
Contributor Author

Applied gofmt, sorry about that, I'll make sure I add this as a hook in my editor so I don't forget.

@margamanterola margamanterola merged commit f9e8fcd into flatcar-master Apr 16, 2020
@margamanterola margamanterola deleted the marga-kinvolk/update-k8s-test branch April 16, 2020 13:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Kola test google.kubernetes.basic.docker.v1.3.4_coreos.0 fails with new Alpha release
3 participants