Create README-summit.md

README-summit.md

@@ -0,0 +1,103 @@
+# SUMMIT Installation guide
+
+This document describes the instalation on summit. 
+The instalition is first described in detail and then an abbreviated 
+instalation with a Makefile is provided.
+
+Notation:
+
+* `login$` denotes the login node
+* `compute$` donates a compute node
+
+## Details
+
+### Activites on the login node
+
+```bash
+login$ module purge
+login$ module load gcc/9.3.0
+login$ module load spectrum-mpi/10.4.0.3-20210112
+login$ module load python/3.8-anaconda3
+```
+
+Next check the python version 
+
+```bash
+login$ which python
+> /sw/summit/python/3.8/anaconda3/2020.07-rhel8/bin/python
+login$ python -V
+> Python 3.8.3
+```
+
+Now create a venv called `CYLON` in the home directory and activate it
+
+```bash
+login$ python -m venv ~/CYLON
+login$ source ~/CYLON/bin/activate
+```
+
+```bash
+login$ which python
+> ~/CYLON/bin/python
+login$ python -V
+> Python 3.8.3
+```
+
+Update pip and install pytest:
+
+```bash
+login$ pip install pip -U
+login$ pip install pytest
+```
+
+Checkout the cylon code
+
+```bash
+cd ~git clone https://github.com/cylondata/cylon.git
+```
+
+Now we obtain two interactive compute nodes
+
+```bash
+login$ bsub -Is -W 0:30 -nnodes 2 -P gen150_bench $SHELL
+```
+
+After you get them you will be in a compute node
+
+### Activities on the compute node
+
+```bash
+compute$ module purge
+compute$ module load gcc/9.3.0
+compute$ module load spectrum-mpi/10.4.0.3-20210112
+compute$ module load python/3.8-anaconda3
+compute$ source ~/CYLON/bin/activate
+compute$ export CC=`which gcc`
+compute$ export CXX=`which g++`
+compute$ export ARROW_DEFAULT_MEMORY_POOL=system
+compute$ CC=gcc MPICC=mpicc pip install --no-binary mpi4py install mpi4py
+compute$ pip install pytest-mpi
+compute$ pip install cmake
+compute$ pip install numpy
+compute$ ./build.sh -pyenv ~/CYLON -bpath $(pwd)/build --cpp --test --cmake-flags "-DMPI_C_COMPILER=$(which mpicc) -DMPI_CXX_COMPILER=$(which mpicxx)" -j 4
+```
+
+The compilation will take some time. After it is completed you can conduct a test with
+
+```bash
+compute$ cd ~/cylon/build
+compute$ jsrun -n 1 -c 4 -a 1 ./build/bin/join_example m n 1000 0.9
+```
+
+If everything is ok, you will see at the end of the test output
+
+```
+...
+================================================
+All tests passed (66 assertions in 4 test cases)
+```
+
+
+### Running batch scripts
+
+Please note that the module load and the source of the CYLON venv must be at the beginning of each batsch script you want to use cylon in.