Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Make ci system read-only on the git work tree #17423

Merged
merged 4 commits into from
Nov 20, 2019

Conversation

maflcko
Copy link
Member

@maflcko maflcko commented Nov 8, 2019

Running the ci completely in a docker, without leaving any traces on the host system is not possible right now because the ccache and depends dir needs to be propagated back and picked up by the host for caching.

Fixes #17372

@fanquake fanquake added the Tests label Nov 8, 2019
@maflcko maflcko force-pushed the 1911-ciRo branch 2 times, most recently from 4abda24 to fa7e764 Compare November 8, 2019 23:21
@DrahtBot
Copy link
Contributor

DrahtBot commented Nov 9, 2019

The following sections might be updated with supplementary metadata relevant to reviewers and maintainers.

Conflicts

Reviewers, this pull request conflicts with the following ones:

If you consider this pull request important, please also help to review the conflicting pull requests. Ideally, start with the one that should be merged first.

@JeremyRubin
Copy link
Contributor

Concept Ack!

@laanwj
Copy link
Member

laanwj commented Nov 10, 2019

I know nothing about docker but Concept ACK, making things that can be made read-only read-only tends to be a good idea both for determinism and to avoid build steps generating clutter in unexpected places.

@maflcko
Copy link
Member Author

maflcko commented Nov 20, 2019

This should be easy to review. All it does it add some DOCKER_EXEC, which means "execute everything that follows in this line in our docker thing". Also, it mounts the source dir readonly into the docker.

@laanwj
Copy link
Member

laanwj commented Nov 20, 2019

@JeremyRubin you brought this up, can you please give a tested ACK?

@maflcko
Copy link
Member Author

maflcko commented Nov 20, 2019

It was on my list of thing to improve either way. A code review should be sufficient, it is really straightforward. (And travis is testing it to some extend already)

@JeremyRubin
Copy link
Contributor

Testing now...

Looks like you still need to run a make distclean before running? Would there be any reason to not have travis (now that it's RO on host) run make distclean first in case it's a dirty dir?

@JeremyRubin
Copy link
Contributor

tested ACK fa7523d

Ran make distclean and FILE_ENV=ci/test/00_setup_env_amd64_trusty.sh ./ci/test_run_all.sh

and was able to re-run

./autogen.sh && ./configure && make without hitting permissions errors.

Would prefer, as noted, if the distclean could happen in the copied dir.

maflcko pushed a commit that referenced this pull request Nov 20, 2019
fa7523d ci: Extend docs (MarcoFalke)
fa493ef ci: Make ci system read-only on the git work tree (MarcoFalke)
fab1333 ci: Remove git from required packages on host (MarcoFalke)
fa00393 ci: Make all filesystem operations inside docker (MarcoFalke)

Pull request description:

  Running the ci completely in a docker, without leaving any traces on the host system is not possible right now because the ccache and depends dir needs to be propagated back and picked up by the host for caching.

  Fixes #17372

ACKs for top commit:
  JeremyRubin:
    tested ACK fa7523d

Tree-SHA512: 4bce1a0f883bcbdb34abf409bdbc80d420c5da2045d2f9c5536ac433f9e5b490f23df084546c8c049f688b487572bbfc4f9c4029e9e672f4d9279739d066ed2e
@maflcko maflcko merged commit fa7523d into bitcoin:master Nov 20, 2019
@maflcko
Copy link
Member Author

maflcko commented Nov 20, 2019

Thanks for testing. I've merged this and left the suggestion as a follow up, see #17544.

@maflcko maflcko deleted the 1911-ciRo branch November 20, 2019 21:45
sidhujag pushed a commit to syscoin/syscoin that referenced this pull request Nov 21, 2019
fa7523d ci: Extend docs (MarcoFalke)
fa493ef ci: Make ci system read-only on the git work tree (MarcoFalke)
fab1333 ci: Remove git from required packages on host (MarcoFalke)
fa00393 ci: Make all filesystem operations inside docker (MarcoFalke)

Pull request description:

  Running the ci completely in a docker, without leaving any traces on the host system is not possible right now because the ccache and depends dir needs to be propagated back and picked up by the host for caching.

  Fixes bitcoin#17372

ACKs for top commit:
  JeremyRubin:
    tested ACK fa7523d

Tree-SHA512: 4bce1a0f883bcbdb34abf409bdbc80d420c5da2045d2f9c5536ac433f9e5b490f23df084546c8c049f688b487572bbfc4f9c4029e9e672f4d9279739d066ed2e
sidhujag pushed a commit to syscoin-core/syscoin that referenced this pull request Nov 10, 2020
fa7523d ci: Extend docs (MarcoFalke)
fa493ef ci: Make ci system read-only on the git work tree (MarcoFalke)
fab1333 ci: Remove git from required packages on host (MarcoFalke)
fa00393 ci: Make all filesystem operations inside docker (MarcoFalke)

Pull request description:

  Running the ci completely in a docker, without leaving any traces on the host system is not possible right now because the ccache and depends dir needs to be propagated back and picked up by the host for caching.

  Fixes bitcoin#17372

ACKs for top commit:
  JeremyRubin:
    tested ACK fa7523d

Tree-SHA512: 4bce1a0f883bcbdb34abf409bdbc80d420c5da2045d2f9c5536ac433f9e5b490f23df084546c8c049f688b487572bbfc4f9c4029e9e672f4d9279739d066ed2e
@bitcoin bitcoin locked as resolved and limited conversation to collaborators Dec 16, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improve Running CI Locally
5 participants