Skip to content

Latest commit

 

History

History
81 lines (58 loc) · 2.25 KB

how-to-setup-dev-box.md

File metadata and controls

81 lines (58 loc) · 2.25 KB

Setup dev-box

Install docker on your server

dev-box is a docker container used to boot up or/and maintain a PAI cluster. For convenience, we provide a prebuild Docker image on Docker Hub.

Use prebuild dev-box image

# Pull the dev-box image from Docker Hub
sudo docker pull docker.io/openpai/dev-box

# Run your dev-box
# Assume the path of custom-hadoop-binary-path in your service-configuration is /pathHadoop,
#   and the path of your cluster-configuration is /pathConfiguration.
# By now, you can leave it as it is, we only mount those two directories into docker container for later usage.
sudo docker run -itd \
        -e COLUMNS=$COLUMNS -e LINES=$LINES -e TERM=$TERM \
        -v /var/lib/docker:/var/lib/docker \
        -v /var/run/docker.sock:/var/run/docker.sock \
        -v /pathHadoop:/pathHadoop \
        -v /pathConfiguration:/cluster-configuration  \
        --pid=host \
        --privileged=true \
        --net=host \
        --name=dev-box \
        docker.io/openpai/dev-box

# Working in your dev-box
sudo docker exec -it dev-box /bin/bash
cd /pai/pai-management

# Now you are free to configure your cluster and run PAI commands...

Or build dev-box docker image on your own

Build dev-box on the latest code

# clone our repo first.
git clone https://github.com/Microsoft/pai.git

# Go into the workdir.
cd pai/pai-management/

# Build your dev-box.
sudo docker build -t dev-box .

Start your dev-box container

  • Suppose the path of custom-hadoop-binary-path in your service-configuration is /pathHadoop
  • Suppose the directory path of your cluster-configuration is /pathConfiguration. Note: Don't change the configuration file name！
# Run your dev-box
sudo docker run -itd \
        -e COLUMNS=$COLUMNS -e LINES=$LINES -e TERM=$TERM \
        -v /var/lib/docker:/var/lib/docker \
        -v /var/run/docker.sock:/var/run/docker.sock \
        -v /pathHadoop:/pathHadoop \
        -v /pathConfiguration:/cluster-configuration  \
        --pid=host \
        --privileged=true \
        --net=host \
        --name=dev-box \
        dev-box

# Working in your dev-box
sudo docker exec -it dev-box /bin/bash
cd /pai/pai-management

# Now you are free to configure your cluster and run PAI commands...