Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow to use minishift > v1.13.0 #53

Closed

Conversation

lslebodn
Copy link

minishift v.1.13.0 change storage driver for docker from device mapper
to overlay2. And therefore it hit a bug with wrong SELinux label of files
in /var/lib/docker

This is a workaround for images which does not have the fix
minishift/minishift-centos-iso#216
minishift/minishift-centos-iso#217

Copy link
Member

@arilivigni arilivigni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't we also increase the defaults:
dkvm_version: v0.7.0
minishift_version: v1.12.0

@lslebodn lslebodn force-pushed the docker_selinux_workaround branch from 6999ddc to d148a27 Compare June 19, 2018 13:57
@lslebodn
Copy link
Author

Shouldn't we also increase the defaults:
dkvm_version: v0.7.0
minishift_version: v1.12.0

I can bump versions

We would need to use v1.17.0 due to issue with oc login -u system:admin minishift/minishift#2107

I will test never version of dkvm_version

Lukas Slebodnik added 4 commits June 19, 2018 17:14
minishift v.1.13.0 change storage driver for docker from device mapper
to overlay2. And therefore it hit a bug with wrong SELinux label of files
in /var/lib/docker

This is a workaround for images which does not have a fix
minishift/minishift-centos-iso#216
minishift/minishift-centos-iso#217

This commit might be reverted after some time when
standard/default images would contain correct SELinux labeling.
It was released on on Apr 17, 2017
Never versions of minishift have some bugfixes + new features.
ATM, latest version is v1.18.0 but there is and issue with
login to minishift as system:admin.
minishift/minishift#2107

There might be workarounds with using custom addons
but it would break assumptions in existing pipelines
minishift v1.12.0 and v1.13.0 did not support options configuration
options skip-check-openshift-version and skip-check-openshift-release

Drop these check after increasing default version of minishift
(it might be complicated to support such old versions in future)
@lslebodn lslebodn force-pushed the docker_selinux_workaround branch from d148a27 to fc29ab2 Compare June 19, 2018 15:16
@lslebodn
Copy link
Author

I tested with CVP pipeline + overriden minishift version (v1.14.0, v1.15.0, v1.16.0, v1.17.0, v1.18.0)
Passed for me. I hope changes would not break other pipelines :-)

@lslebodn lslebodn changed the title Allow to use minishift >= v1.13.0 Allow to use minishift > v1.13.0 Jun 19, 2018
@@ -79,7 +79,7 @@ contra-env-setup/playbooks/group_vars/all/global.yml

### Minishift setup options
* setup_minishift: Setup a minishift cluster : default=true
* minishift_version: Minishift version to use : default=v1.12.0
* minishift_version: Minishift version to use : default=v1.17.0
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can't support this as the default until we update the Custom CentOS ISO or we need to change the default CentOS ISO from minishift. I vote for the former since that will break others.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe it should work, because the MR also contains the Workaround for wrong SELinux context (which was the issue with newer versions of minishift). If we upgrade the CentOS image, then this workaround should no longer be needed.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, that's main purpose of the 1st patch.
Allow to use v.1.17 with current default ISO.

The commit message even say that it can be reverted later when default ISO have right SELinux labeling

@@ -16,11 +16,11 @@ force_repo_clone: true
contra_env_setup_dir: "{{ ansible_env.HOME }}/.contra-env-setup"

# Docker KVM version
dkvm_version: v0.7.0
dkvm_version: v0.10.0
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will this driver work with 1.12.0 of minishift?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will need to test with 1.12.0 but then we will need to drop the patch if we want to still support v1.12.0

fc29ab2

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bumping v0.10.0 is not enough because since 0.10.0 docker-machine-driver-kvm does not exist.
There are more versions with "distribution suffix" after name
e.g. docker-machine-driver-kvm-{centos7,alpine3.4,alpine3.5,ubuntu14.04,ubuntu16.04}

Previously it passed for me because I already had /usr/local/bin/docker-machine-driver-kvm on testing machines


## minishift values
# minishift version
minishift_version: v1.12.0
minishift_version: v1.17.0
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can't support this as the default until we update the Custom CentOS ISO or we need to change the default CentOS ISO from minishift. I vote for the former since that will break others.

@arilivigni
Copy link
Member

@lslebodn this is blocked then until I update the custom CentOS ISO since that will affect others. At the moment I think you can override all values and run the setup anyways correct?

@psiroky
Copy link

psiroky commented Jun 19, 2018

Yes, AFAIK, this is not blocking us. We can override both the minishift version and the centos image URL.

@arilivigni
Copy link
Member

@psiroky @lslebodn excellent I am working on the updates based on the minishift CentOS ISO. Once I have it in place I may ask you guys run it through some testing.

@lslebodn
Copy link
Author

@arilivigni,
BTW if you prefer support v,1,12 I am fine with removing the patch "Drop support for older versions of minishift". But I would need to test dkvm version as you requested.

Just let me know :-)

@arilivigni
Copy link
Member

@lslebodn instead of the newer driver can you test the iso I sent to you in a separate email thread. I want to see if this works then we can move the defaults ahead which would be great.

Thoughts?

@scoheb
Copy link
Contributor

scoheb commented Jun 19, 2018

I can take a stab at it tonight and report back..

@scoheb
Copy link
Contributor

scoheb commented Jun 20, 2018

so with both your new iso version @arilivigni and the version @psiroky put in his MR, I get the error that the first Jenkins deployment fails with:

error: update acceptor rejected jenkins-1: watch closed before Until timeout
--> Error listing events for replication controller jenkins-1: Get https://172.30.0.1:443/api/v1/namespaces/cvp/events?fieldSelector=involvedObject.namespace%3Dcvp%2CinvolvedObject.kind%3DReplicationController%2CinvolvedObject.uid%3Db0dda34e-7427-11e8-bdac-52540041768f%2CinvolvedObject.name%3Djenkins-1: dial tcp 172.30.0.1:443: getsockopt: connection refused 

but a second manual re-deploy works.

I am using minishift_version: v1.17.0

@arilivigni
Copy link
Member

@scoheb What branch of our private project did you use. I am using master. It worked for me the first time and than failed somewhere different for me.

Also did you use v1.17.0 with the the general minishift iso https://github.com/minishift/minishift-centos-iso/releases/download/v1.10.0/minishift-centos7.iso?

@arilivigni
Copy link
Member

@scoheb worked for me with the sample project not the project_repo we care about more.

@psiroky
Copy link

psiroky commented Jun 20, 2018

I am getting the same error as Scott:

error: update acceptor rejected jenkins-1: watch closed before Until timeout
--> Error listing events for replication controller jenkins-1: Get https://172.30.0.1:443/api/v1/namespaces/cvp/events?fieldSelector=involvedObject.namespace%3Dcvp%2CinvolvedObject.kind%3DReplicationController%2CinvolvedObject.uid%3Db0dda34e-7427-11e8-bdac-52540041768f%2CinvolvedObject.name%3Djenkins-1: dial tcp 172.30.0.1:443: getsockopt: connection refused

Looking into it now.

@arilivigni
Copy link
Member

@lslebodn can this PR be closed now?

@alexellis
Copy link

I'm hitting this issue, please could you give a work-around? Is there a minishift binary I can download to to make this work?

@arilivigni
Copy link
Member

override the defaults:
minishift_version: v1.17.0
minishift_iso: https://github.com/minishift/minishift-centos-iso/releases/download/v1.10.0/minishift-centos7.iso

I also am working on another PR for an updated CentOS Image with libvirt

@alexellis
Copy link

I'm not sure where I should put those versions.. are you referring to a config file or a CLI flag to minishift? I just type in minishift start

@arilivigni
Copy link
Member

@alexellis the options on the command line -e minishift_version=v1.17.0 or in a file that you pass either way standard ansible passing of values

@arilivigni
Copy link
Member

@alexellis this PR should explain things better #57

@arilivigni arilivigni closed this Jun 22, 2018
@arilivigni
Copy link
Member

@alexellis v1.1.17 should address this now completely

@alexellis
Copy link

@arilivigni thanks for following up, that sounds great. I'll give it a shot.

@alexellis
Copy link

alexellis commented Jun 25, 2018

What's the best way to update to this minishift start -e minishift_version=v1.1.17?

I get this error using the suggested env-var flag for minikube start: unknown shorthand flag: 'e' in -e`

I don't think I'm typing this in right, but don't know how to configure it either.

The only flag I can seem to override is --iso-url=

Downgraded CLI manually on my Mac:

minishift v1.17.0+f974f0c

Set override URL:

minishift start --vm-driver=virtualbox --cpus=4 --memory=4GB --iso-url=minishift version ; minishift start --vm-driver=virtualbox --cpus=4 --memory=4GB --iso-url=https://s3.amazonaws.com/continuous-infra/minishift/iso/minishift.iso

Will let you know how this goes.

@arilivigni
Copy link
Member

These are values passed to the contra-env-setup not the minishift command. Maybe you just want to use minishift directly for what you want to do.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants