Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow custom package installations #3

Closed
djw8605 opened this issue Aug 16, 2013 · 0 comments
Closed

Allow custom package installations #3

djw8605 opened this issue Aug 16, 2013 · 0 comments
Assignees
Milestone

Comments

@djw8605
Copy link
Member

djw8605 commented Aug 16, 2013

GridR needs to allow for custom package installation on remote nodes.

User solution

When the user initializes GridR:

> grid.init(service="bosco.direct", localTmpDir="tmp", 
   remotePackages=c("<path to package.tar.gz>", "<package2>", "<package3>"))

The packages listed in the remotePackages argument will be sent with the jobs and installed on the remote cluster. They will automatically be available in the R environment.

Proposed Solution

A proposed solution is for the user to provide source packages to be installed on the remote nodes. This can be done in the grid.init function call. The modifications would need to be:

  • Modify R-bootstrap.py to specify custom packages.
    • Will also need to install the custom packages on the worker node.
  • Modify grid.init to take custom package locations and save them to a variable.
  • Modify grid.apply and batch function to send the packages to the remote cluster and set the argumetns to R-bootstrap.py correctly.
@ghost ghost assigned djw8605 Aug 16, 2013
djw8605 added a commit that referenced this issue Aug 28, 2013
djw8605 added a commit that referenced this issue Aug 28, 2013
djw8605 added a commit that referenced this issue Aug 30, 2013
@djw8605 djw8605 closed this as completed Aug 30, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant