Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gcc problem? #914

Open
an2tong1xm opened this issue Jul 16, 2020 · 7 comments
Open

gcc problem? #914

an2tong1xm opened this issue Jul 16, 2020 · 7 comments

Comments

@an2tong1xm
Copy link

Hi, I am using the docker to build apex, but it looks like there are some errors. The following is the log:

docker run -it pytorch/pytorch:nightly-devel-cuda10.0-cudnn7
root@d7d63fc19a08:/workspace# ls
root@d7d63fc19a08:/workspace# git clone https://github.com/NVIDIA/apex
Cloning into 'apex'...
remote: Enumerating objects: 7335, done.
remote: Total 7335 (delta 0), reused 0 (delta 0), pack-reused 7335
Receiving objects: 100% (7335/7335), 13.87 MiB | 10.92 MiB/s, done.
Resolving deltas: 100% (4957/4957), done.
Checking connectivity... done.
root@d7d63fc19a08:/workspace# ls
apex
root@d7d63fc19a08:/workspace# cd apex
root@d7d63fc19a08:/workspace/apex# pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./
/opt/conda/lib/python3.6/site-packages/pip/_internal/commands/install.py:244: UserWarning: Disabling all use of wheels due to the use of --build-options / --global-options / --install-options.
cmdoptions.check_install_build_global(options)
Created temporary directory: /tmp/pip-ephem-wheel-cache-10o__3f5
Created temporary directory: /tmp/pip-req-tracker-p21bodb5
Created requirements tracker '/tmp/pip-req-tracker-p21bodb5'
Created temporary directory: /tmp/pip-install-hjqxll2p
Processing /workspace/apex
Created temporary directory: /tmp/pip-req-build-pbv0owsm
Added file:///workspace/apex to build tracker '/tmp/pip-req-tracker-p21bodb5'
Running setup.py (path:/tmp/pip-req-build-pbv0owsm/setup.py) egg_info for package from file:///workspace/apex
Running command python setup.py egg_info

Warning: Torch did not find available GPUs on this system.
 If your intention is to cross-compile, this is not an error.
By default, Apex will cross-compile for Pascal (compute capabilities 6.0, 6.1, 6.2),
Volta (compute capability 7.0), and Turing (compute capability 7.5).
If you wish to cross-compile for a single specific architecture,
export TORCH_CUDA_ARCH_LIST="compute capability" before running setup.py.



torch.__version__  = 1.2.0.dev20190626


running egg_info
creating pip-egg-info/apex.egg-info
writing pip-egg-info/apex.egg-info/PKG-INFO
writing dependency_links to pip-egg-info/apex.egg-info/dependency_links.txt
writing top-level names to pip-egg-info/apex.egg-info/top_level.txt
writing manifest file 'pip-egg-info/apex.egg-info/SOURCES.txt'
reading manifest file 'pip-egg-info/apex.egg-info/SOURCES.txt'
writing manifest file 'pip-egg-info/apex.egg-info/SOURCES.txt'
/tmp/pip-req-build-pbv0owsm/setup.py:51: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
  warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")

Source in /tmp/pip-req-build-pbv0owsm has version 0.1, which satisfies requirement apex==0.1 from file:///workspace/apex
Removed apex==0.1 from file:///workspace/apex from build tracker '/tmp/pip-req-tracker-p21bodb5'
Skipping bdist_wheel for apex, due to binaries being disabled for it.
Installing collected packages: apex
Created temporary directory: /tmp/pip-record-qeg_9yet
Running command /opt/conda/bin/python -u -c 'import setuptools, tokenize;file='"'"'/tmp/pip-req-build-pbv0owsm/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-qeg_9yet/install-record.txt --single-version-externally-managed --compile

Warning: Torch did not find available GPUs on this system.
 If your intention is to cross-compile, this is not an error.
By default, Apex will cross-compile for Pascal (compute capabilities 6.0, 6.1, 6.2),
Volta (compute capability 7.0), and Turing (compute capability 7.5).
If you wish to cross-compile for a single specific architecture,
export TORCH_CUDA_ARCH_LIST="compute capability" before running setup.py.



torch.__version__  = 1.2.0.dev20190626


/tmp/pip-req-build-pbv0owsm/setup.py:51: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
  warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")
No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'

Compiling cuda extensions with
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2018 NVIDIA Corporation
Built on Sat_Aug_25_21:08:01_CDT_2018
Cuda compilation tools, release 10.0, V10.0.130
from /usr/local/cuda/bin

running install
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.6
creating build/lib.linux-x86_64-3.6/apex
copying apex/__init__.py -> build/lib.linux-x86_64-3.6/apex
creating build/lib.linux-x86_64-3.6/apex/fp16_utils
copying apex/fp16_utils/loss_scaler.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
copying apex/fp16_utils/fp16util.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
copying apex/fp16_utils/__init__.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
copying apex/fp16_utils/fp16_optimizer.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
creating build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/wrap.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/utils.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/__version__.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/__init__.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/handle.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/_amp_state.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/_initialize.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/scaler.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/rnn_compat.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/amp.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/compat.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/_process_optimizer.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/frontend.py -> build/lib.linux-x86_64-3.6/apex/amp
copying apex/amp/opt.py -> build/lib.linux-x86_64-3.6/apex/amp
creating build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/__init__.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/optimized_sync_batchnorm.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/multiproc.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/distributed.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/LARC.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/optimized_sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.6/apex/parallel
copying apex/parallel/sync_batchnorm.py -> build/lib.linux-x86_64-3.6/apex/parallel
creating build/lib.linux-x86_64-3.6/apex/contrib
copying apex/contrib/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib
creating build/lib.linux-x86_64-3.6/apex/reparameterization
copying apex/reparameterization/__init__.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
copying apex/reparameterization/weight_norm.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
copying apex/reparameterization/reparameterization.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
creating build/lib.linux-x86_64-3.6/apex/RNN
copying apex/RNN/__init__.py -> build/lib.linux-x86_64-3.6/apex/RNN
copying apex/RNN/cells.py -> build/lib.linux-x86_64-3.6/apex/RNN
copying apex/RNN/RNNBackend.py -> build/lib.linux-x86_64-3.6/apex/RNN
copying apex/RNN/models.py -> build/lib.linux-x86_64-3.6/apex/RNN
creating build/lib.linux-x86_64-3.6/apex/pyprof
copying apex/pyprof/__init__.py -> build/lib.linux-x86_64-3.6/apex/pyprof
creating build/lib.linux-x86_64-3.6/apex/mlp
copying apex/mlp/__init__.py -> build/lib.linux-x86_64-3.6/apex/mlp
copying apex/mlp/mlp.py -> build/lib.linux-x86_64-3.6/apex/mlp
creating build/lib.linux-x86_64-3.6/apex/normalization
copying apex/normalization/__init__.py -> build/lib.linux-x86_64-3.6/apex/normalization
copying apex/normalization/fused_layer_norm.py -> build/lib.linux-x86_64-3.6/apex/normalization
creating build/lib.linux-x86_64-3.6/apex/multi_tensor_apply
copying apex/multi_tensor_apply/__init__.py -> build/lib.linux-x86_64-3.6/apex/multi_tensor_apply
copying apex/multi_tensor_apply/multi_tensor_apply.py -> build/lib.linux-x86_64-3.6/apex/multi_tensor_apply
creating build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/__init__.py -> build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/fused_novograd.py -> build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/fused_sgd.py -> build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/fused_lamb.py -> build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/fused_adagrad.py -> build/lib.linux-x86_64-3.6/apex/optimizers
copying apex/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.6/apex/optimizers
creating build/lib.linux-x86_64-3.6/apex/amp/lists
copying apex/amp/lists/torch_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
copying apex/amp/lists/__init__.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
copying apex/amp/lists/functional_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
copying apex/amp/lists/tensor_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
creating build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/fast_self_multihead_attn_norm_add_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/mask_softmax_dropout_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/fast_encdec_multihead_attn_norm_add_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/self_multihead_attn.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/self_multihead_attn_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/fast_encdec_multihead_attn_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/encdec_multihead_attn.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/encdec_multihead_attn_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/fast_self_multihead_attn_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
creating build/lib.linux-x86_64-3.6/apex/contrib/groupbn
copying apex/contrib/groupbn/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/groupbn
copying apex/contrib/groupbn/batch_norm.py -> build/lib.linux-x86_64-3.6/apex/contrib/groupbn
creating build/lib.linux-x86_64-3.6/apex/contrib/xentropy
copying apex/contrib/xentropy/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/xentropy
copying apex/contrib/xentropy/softmax_xentropy.py -> build/lib.linux-x86_64-3.6/apex/contrib/xentropy
creating build/lib.linux-x86_64-3.6/apex/contrib/sparsity
copying apex/contrib/sparsity/sparse_masklib.py -> build/lib.linux-x86_64-3.6/apex/contrib/sparsity
copying apex/contrib/sparsity/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/sparsity
copying apex/contrib/sparsity/asp.py -> build/lib.linux-x86_64-3.6/apex/contrib/sparsity
creating build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/distributed_fused_lamb.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/fused_sgd.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/distributed_fused_adam.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/fused_lamb.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/distributed_fused_adam_v2.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/distributed_fused_adam_v3.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/fp16_optimizer.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
copying apex/contrib/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
creating build/lib.linux-x86_64-3.6/apex/pyprof/nvtx
copying apex/pyprof/nvtx/nvmarker.py -> build/lib.linux-x86_64-3.6/apex/pyprof/nvtx
copying apex/pyprof/nvtx/__init__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/nvtx
creating build/lib.linux-x86_64-3.6/apex/pyprof/parse
copying apex/pyprof/parse/db.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
copying apex/pyprof/parse/__init__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
copying apex/pyprof/parse/parse.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
copying apex/pyprof/parse/nvvp.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
copying apex/pyprof/parse/kernel.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
copying apex/pyprof/parse/__main__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
creating build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/blas.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/recurrentCell.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/conv.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/misc.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/embedding.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/prof.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/__init__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/index_slice_join_mutate.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/reduction.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/activation.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/pointwise.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/pooling.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/dropout.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/convert.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/linear.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/utility.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/loss.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/usage.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/softmax.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/output.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/base.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/randomSample.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/data.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/optim.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/normalization.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
copying apex/pyprof/prof/__main__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
running build_ext
building 'apex_C' extension
creating build/temp.linux-x86_64-3.6
creating build/temp.linux-x86_64-3.6/csrc
gcc -pthread -B /opt/conda/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c csrc/flatten_unflatten.cpp -o build/temp.linux-x86_64-3.6/csrc/flatten_unflatten.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=apex_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
g++ -pthread -shared -B /opt/conda/compiler_compat -L/opt/conda/lib -Wl,-rpath=/opt/conda/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.6/csrc/flatten_unflatten.o -o build/lib.linux-x86_64-3.6/apex_C.cpython-36m-x86_64-linux-gnu.so
building 'amp_C' extension
gcc -pthread -B /opt/conda/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/amp_C_frontend.cpp -o build/temp.linux-x86_64-3.6/csrc/amp_C_frontend.o -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_sgd_kernel.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_sgd_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_scale_kernel.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_scale_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_axpby_kernel.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_axpby_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_l2norm_kernel.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_l2norm_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_lamb_stage_1.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb_stage_1.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_lamb_stage_2.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb_stage_2.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_adam.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_adam.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_adagrad.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_adagrad.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_novograd.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/multi_tensor_lamb.cu -o build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
g++ -pthread -shared -B /opt/conda/compiler_compat -L/opt/conda/lib -Wl,-rpath=/opt/conda/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.6/csrc/amp_C_frontend.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_sgd_kernel.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_scale_kernel.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_axpby_kernel.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_l2norm_kernel.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb_stage_1.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb_stage_2.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_adam.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_adagrad.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_novograd.o build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb.o -L/usr/local/cuda/lib64 -lcudart -o build/lib.linux-x86_64-3.6/amp_C.cpython-36m-x86_64-linux-gnu.so
building 'syncbn' extension
gcc -pthread -B /opt/conda/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/syncbn.cpp -o build/temp.linux-x86_64-3.6/csrc/syncbn.o -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/welford.cu -o build/temp.linux-x86_64-3.6/csrc/welford.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
g++ -pthread -shared -B /opt/conda/compiler_compat -L/opt/conda/lib -Wl,-rpath=/opt/conda/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.6/csrc/syncbn.o build/temp.linux-x86_64-3.6/csrc/welford.o -L/usr/local/cuda/lib64 -lcudart -o build/lib.linux-x86_64-3.6/syncbn.cpython-36m-x86_64-linux-gnu.so
building 'fused_layer_norm_cuda' extension
gcc -pthread -B /opt/conda/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/layer_norm_cuda.cpp -o build/temp.linux-x86_64-3.6/csrc/layer_norm_cuda.o -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
/usr/local/cuda/bin/nvcc -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/layer_norm_cuda_kernel.cu -o build/temp.linux-x86_64-3.6/csrc/layer_norm_cuda_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -maxrregcount=50 -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
g++ -pthread -shared -B /opt/conda/compiler_compat -L/opt/conda/lib -Wl,-rpath=/opt/conda/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.6/csrc/layer_norm_cuda.o build/temp.linux-x86_64-3.6/csrc/layer_norm_cuda_kernel.o -L/usr/local/cuda/lib64 -lcudart -o build/lib.linux-x86_64-3.6/fused_layer_norm_cuda.cpython-36m-x86_64-linux-gnu.so
building 'mlp_cuda' extension
gcc -pthread -B /opt/conda/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/lib/python3.6/site-packages/torch/include -I/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/opt/conda/include/python3.6m -c csrc/mlp.cpp -o build/temp.linux-x86_64-3.6/csrc/mlp.o -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=mlp_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option '-Wstrict-prototypes' is valid for C/ObjC but not for C++
In file included from csrc/mlp.cpp:2:0:
/opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/torch.h:14:4: warning: #warning DEPRECATE_MESSAGE [-Wcpp]
 #  warning DEPRECATE_MESSAGE
    ^
csrc/mlp.cpp: In function 'std::vector<at::Tensor> mlp_forward(int, int, std::vector<at::Tensor>)':
csrc/mlp.cpp:56:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   for (int i = 0; i < num_layers; i++) {
                     ^
csrc/mlp.cpp:65:68: warning: narrowing conversion of 'reserved_size' from 'long unsigned int' to 'long int' inside { } [-Wnarrowing]
   auto reserved_space = at::empty({reserved_size}, inputs[0].type());
                                                                    ^
csrc/mlp.cpp:65:68: warning: narrowing conversion of 'reserved_size' from 'long unsigned int' to 'long int' inside { } [-Wnarrowing]
In file included from /opt/conda/lib/python3.6/site-packages/torch/include/ATen/ATen.h:9:0,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                 from csrc/mlp.cpp:1:
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:70:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:54: error: expected primary-expression before '>' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:56: error: expected primary-expression before ')' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:69: error: expected primary-expression before '>' token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                     ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:71: error: expected primary-expression before ')' token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:36: error: expected primary-expression before '>' token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:38: error: expected primary-expression before ')' token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:30: error: expected primary-expression before '>' token
         out.data_ptr<scalar_t>(),
                              ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:32: error: expected primary-expression before ')' token
         out.data_ptr<scalar_t>(),
                                ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:41: error: expected primary-expression before '>' token
         reserved_space.data_ptr<scalar_t>(),
                                         ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:43: error: expected primary-expression before ')' token
         reserved_space.data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:70:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:54: error: expected primary-expression before '>' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:56: error: expected primary-expression before ')' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:69: error: expected primary-expression before '>' token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                     ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:71: error: expected primary-expression before ')' token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:36: error: expected primary-expression before '>' token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:38: error: expected primary-expression before ')' token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:30: error: expected primary-expression before '>' token
         out.data_ptr<scalar_t>(),
                              ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:32: error: expected primary-expression before ')' token
         out.data_ptr<scalar_t>(),
                                ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:41: error: expected primary-expression before '>' token
         reserved_space.data_ptr<scalar_t>(),
                                         ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:43: error: expected primary-expression before ')' token
         reserved_space.data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:70:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:54: error: expected primary-expression before '>' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:56: error: expected primary-expression before ')' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:69: error: expected primary-expression before '>' token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                     ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:71: error: expected primary-expression before ')' token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:36: error: expected primary-expression before '>' token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:38: error: expected primary-expression before ')' token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:30: error: expected primary-expression before '>' token
         out.data_ptr<scalar_t>(),
                              ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:32: error: expected primary-expression before ')' token
         out.data_ptr<scalar_t>(),
                                ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:41: error: expected primary-expression before '>' token
         reserved_space.data_ptr<scalar_t>(),
                                         ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:43: error: expected primary-expression before ')' token
         reserved_space.data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp: In function 'std::vector<at::Tensor> mlp_backward(int, int, at::Tensor, std::vector<at::Tensor>, std::vector<at::Tensor>)':
csrc/mlp.cpp:113:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   for (int i = 0; i < num_layers; i++) {
                     ^
csrc/mlp.cpp:119:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   for (int i = 0; i < inputs.size(); i++) {
                     ^
In file included from /opt/conda/lib/python3.6/site-packages/torch/include/ATen/ATen.h:9:0,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /opt/conda/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                 from csrc/mlp.cpp:1:
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:125:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:54: error: expected primary-expression before '>' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:56: error: expected primary-expression before ')' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:129:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < inputs.size(); i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:57: error: expected primary-expression before '>' token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                         ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:59: error: expected primary-expression before ')' token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of '(work_size / sizeof (scalar_t))' from 'long unsigned int' to 'long int' inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of '(work_size / sizeof (scalar_t))' from 'long unsigned int' to 'long int' inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:36: error: expected primary-expression before '>' token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:38: error: expected primary-expression before ')' token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:43: error: expected primary-expression before '>' token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:45: error: expected primary-expression before ')' token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                             ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:46: error: expected primary-expression before '>' token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                              ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:48: error: expected primary-expression before ')' token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                                ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:43: error: expected primary-expression before '>' token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:45: error: expected primary-expression before ')' token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                             ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:37: error: expected primary-expression before '>' token
         work_space.data_ptr<scalar_t>(),
                                     ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:39: error: expected primary-expression before ')' token
         work_space.data_ptr<scalar_t>(),
                                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:125:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:54: error: expected primary-expression before '>' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:56: error: expected primary-expression before ')' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:129:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < inputs.size(); i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:57: error: expected primary-expression before '>' token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                         ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:59: error: expected primary-expression before ')' token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of '(work_size / sizeof (scalar_t))' from 'long unsigned int' to 'long int' inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of '(work_size / sizeof (scalar_t))' from 'long unsigned int' to 'long int' inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:36: error: expected primary-expression before '>' token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:38: error: expected primary-expression before ')' token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:43: error: expected primary-expression before '>' token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:45: error: expected primary-expression before ')' token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                             ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:46: error: expected primary-expression before '>' token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                              ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:48: error: expected primary-expression before ')' token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                                ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:43: error: expected primary-expression before '>' token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:45: error: expected primary-expression before ')' token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                             ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:37: error: expected primary-expression before '>' token
         work_space.data_ptr<scalar_t>(),
                                     ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:39: error: expected primary-expression before ')' token
         work_space.data_ptr<scalar_t>(),
                                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:125:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:54: error: expected primary-expression before '>' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:56: error: expected primary-expression before ')' token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:129:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < inputs.size(); i++) {
                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:57: error: expected primary-expression before '>' token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                         ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:59: error: expected primary-expression before ')' token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of '(work_size / sizeof (scalar_t))' from 'long unsigned int' to 'long int' inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of '(work_size / sizeof (scalar_t))' from 'long unsigned int' to 'long int' inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:36: error: expected primary-expression before '>' token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:38: error: expected primary-expression before ')' token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:43: error: expected primary-expression before '>' token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:45: error: expected primary-expression before ')' token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                             ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:46: error: expected primary-expression before '>' token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                              ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:48: error: expected primary-expression before ')' token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                                ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:43: error: expected primary-expression before '>' token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                           ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:45: error: expected primary-expression before ')' token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                             ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:37: error: expected primary-expression before '>' token
         work_space.data_ptr<scalar_t>(),
                                     ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:39: error: expected primary-expression before ')' token
         work_space.data_ptr<scalar_t>(),
                                       ^
/opt/conda/lib/python3.6/site-packages/torch/include/ATen/Dispatch.h:12:12: note: in definition of macro 'AT_PRIVATE_CASE_TYPE'
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro 'AT_DISPATCH_FLOATING_TYPES_AND_HALF'
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
error: command 'gcc' failed with exit status 1

Running setup.py install for apex ... error
Cleaning up...
Removing source in /tmp/pip-req-build-pbv0owsm
Removed build tracker '/tmp/pip-req-tracker-p21bodb5'
ERROR: Command "/opt/conda/bin/python -u -c 'import setuptools, tokenize;file='"'"'/tmp/pip-req-build-pbv0owsm/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-qeg_9yet/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-req-build-pbv0owsm/
Exception information:
Traceback (most recent call last):
File "/opt/conda/lib/python3.6/site-packages/pip/_internal/cli/base_command.py", line 178, in main
status = self.run(options, args)
File "/opt/conda/lib/python3.6/site-packages/pip/_internal/commands/install.py", line 414, in run
use_user_site=options.use_user_site,
File "/opt/conda/lib/python3.6/site-packages/pip/_internal/req/init.py", line 58, in install_given_reqs
**kwargs
File "/opt/conda/lib/python3.6/site-packages/pip/_internal/req/req_install.py", line 951, in install
spinner=spinner,
File "/opt/conda/lib/python3.6/site-packages/pip/_internal/utils/misc.py", line 776, in call_subprocess
% (command_desc, proc.returncode, cwd))
pip._internal.exceptions.InstallationError: Command "/opt/conda/bin/python -u -c 'import setuptools, tokenize;file='"'"'/tmp/pip-req-build-pbv0owsm/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-qeg_9yet/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-req-build-pbv0owsm/
1 location(s) to search for versions of pip:

@sidak
Copy link

sidak commented Jul 22, 2020

Hi! I am facing exactly the same issue. Were you able to resolve this? (My pytorch version is 1.2.0+cu92 and cuda is 9.2.148)
Thanks! :)

@drinkmooon
Copy link

The same issue too,with pytorch=1.2.0+cu100 and cuda is 10.0.1.
Will it help if i change gcc version?

@Stonesjtu
Copy link

Stonesjtu commented Aug 7, 2020

My build failed on gcc-7.3.0, but works well on gcc-6.4.0. Any comment here?

The error message seems like glibc making some internal changes:


[10/11] /mnt/lustre/cm/shared/global/src/dev/cuda/10.1/bin/nvcc -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/pytho[3022/4827]
ackages/torch/include/torch/csrc/api/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/TH -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/includ
e/THC -I/mnt/lustre/cm/shared/global/src/dev/cuda/10.1/include -I/mnt/lustre/aifs/home/kys08/miniconda3/include/python3.7m -c -c /tmp/pip-req-build-b7uxqzsj/csrc/multi_tensor_novograd.cu -o /tmp/pip-req-build-b7u
xqzsj/build/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"
'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=sm_75 -std
=c++14
    FAILED: /tmp/pip-req-build-b7uxqzsj/build/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o
    /mnt/lustre/cm/shared/global/src/dev/cuda/10.1/bin/nvcc -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/
torch/include/torch/csrc/api/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/TH -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/THC -I
/mnt/lustre/cm/shared/global/src/dev/cuda/10.1/include -I/mnt/lustre/aifs/home/kys08/miniconda3/include/python3.7m -c -c /tmp/pip-req-build-b7uxqzsj/csrc/multi_tensor_novograd.cu -o /tmp/pip-req-build-b7uxqzsj/bu
ild/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lin$
info -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=sm_75 -std=c++14
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc: In instantiation of ‘static std::basic_string<_CharT, _Traits, _Alloc>::_Rep* std::basic_string<_CharT, _Traits, _Alloc>
::_Rep::_S_create(std::basic_string<_CharT, _Traits, _Alloc>::size_type, std::basic_string<_CharT, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc
 = std::allocator<char16_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsigned int]’:
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:578:28:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator
, const _Alloc&, std::forward_iterator_tag) [with _FwdIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5033:20:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct_aux(_InIterator, _InItera
tor, const _Alloc&, std::__false_type) [with _InIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5054:24:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator,
 const _Alloc&) [with _InIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:656:134:   required from ‘std::basic_string<_CharT, _Traits, _Alloc>::basic_string(const _CharT*, std::basic_string<_Char
T, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsign
ed int]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:6676:95:   required from here
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:1067:16: error: cannot call member function ‘void std::basic_string<_CharT, _Traits, _Alloc>::_Rep::_M_set_sharable() [wi
th _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’ without object
           __p->_M_set_sharable();
           ~~~~~~~~~^~
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc: In instantiation of ‘static std::basic_string<_CharT, _Traits, _Alloc>::_Rep* std::basic_string<_CharT, _Traits, _Alloc>
::_Rep::_S_create(std::basic_string<_CharT, _Traits, _Alloc>::size_type, std::basic_string<_CharT, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc
 = std::allocator<char32_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsigned int]’:
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:578:28:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator
, const _Alloc&, std::forward_iterator_tag) [with _FwdIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5033:20:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct_aux(_InIterator, _InItera
tor, const _Alloc&, std::__false_type) [with _InIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5054:24:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator,
 const _Alloc&) [with _InIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:656:134:   required from ‘std::basic_string<_CharT, _Traits, _Alloc>::basic_string(const _CharT*, std::basic_string<_Char
T, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsign
ed int]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:6681:95:   required from here
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:1067:16: error: cannot call member function ‘void std::basic_string<_CharT, _Traits, _Alloc>::_Rep::_M_set_sharable() [wi
th _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’ without object

@Stonesjtu
Copy link

Probably related to this thread: pytorch/vision#1893

@ShirleyLoveGIS
Copy link

same problem

CUDA 10.0, gcc version 5.4.0 (GCC), pytorch 1.1.0
solved by git checkout f3a960f80244cf9e80558ab30f7f7e8cbf03c0a0
refer to #gcc version issue #944

`
Created temporary directory: /tmp/pip-ephem-wheel-cache-ax445sxb
Created temporary directory: /tmp/pip-req-tracker-eqjwagpv
Created requirements tracker '/tmp/pip-req-tracker-eqjwagpv'
Created temporary directory: /tmp/pip-install-btu4enwl
Processing /home/shirley.zxy/opt/apex
Created temporary directory: /tmp/pip-req-build-rtl8rlix
Added file:///home/shirley.zxy/opt/apex to build tracker '/tmp/pip-req-tracker-eqjwagpv'
Running setup.py (path:/tmp/pip-req-build-rtl8rlix/setup.py) egg_info for package from file:///home/shirley.zxy/opt/apex
Running command python setup.py egg_info

torch.__version__  = 1.1.0


running egg_info
creating pip-egg-info/apex.egg-info
writing pip-egg-info/apex.egg-info/PKG-INFO
writing dependency_links to pip-egg-info/apex.egg-info/dependency_links.txt
writing top-level names to pip-egg-info/apex.egg-info/top_level.txt
writing manifest file 'pip-egg-info/apex.egg-info/SOURCES.txt'
reading manifest file 'pip-egg-info/apex.egg-info/SOURCES.txt'
writing manifest file 'pip-egg-info/apex.egg-info/SOURCES.txt'
/tmp/pip-req-build-rtl8rlix/setup.py:67: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
  warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")

Source in /tmp/pip-req-build-rtl8rlix has version 0.1, which satisfies requirement apex==0.1 from file:///home/shirley.zxy/opt/apex
Removed apex==0.1 from file:///home/shirley.zxy/opt/apex from build tracker '/tmp/pip-req-tracker-eqjwagpv'
Skipping bdist_wheel for apex, due to binaries being disabled for it.
Installing collected packages: apex
Created temporary directory: /tmp/pip-record-ci9ovh87
Running command /home/shirley.zxy/opt/anaconda3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-rtl8rlix/setup.py'"'"'; file='"'"'/tmp/pip-req-build-rtl8rlix/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-ci9ovh87/install-record.txt --single-version-externally-managed --compile

torch.__version__  = 1.1.0


/tmp/pip-req-build-rtl8rlix/setup.py:67: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
  warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")

Compiling cuda extensions with
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2018 NVIDIA Corporation
Built on Sat_Aug_25_21:08:01_CDT_2018
Cuda compilation tools, release 10.0, V10.0.130
from /usr/local/cuda-10.0/bin

running install
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.7
creating build/lib.linux-x86_64-3.7/apex
copying apex/__init__.py -> build/lib.linux-x86_64-3.7/apex
creating build/lib.linux-x86_64-3.7/apex/multi_tensor_apply
copying apex/multi_tensor_apply/multi_tensor_apply.py -> build/lib.linux-x86_64-3.7/apex/multi_tensor_apply
copying apex/multi_tensor_apply/__init__.py -> build/lib.linux-x86_64-3.7/apex/multi_tensor_apply
creating build/lib.linux-x86_64-3.7/apex/RNN
copying apex/RNN/cells.py -> build/lib.linux-x86_64-3.7/apex/RNN
copying apex/RNN/RNNBackend.py -> build/lib.linux-x86_64-3.7/apex/RNN
copying apex/RNN/__init__.py -> build/lib.linux-x86_64-3.7/apex/RNN
copying apex/RNN/models.py -> build/lib.linux-x86_64-3.7/apex/RNN
creating build/lib.linux-x86_64-3.7/apex/mlp
copying apex/mlp/mlp.py -> build/lib.linux-x86_64-3.7/apex/mlp
copying apex/mlp/__init__.py -> build/lib.linux-x86_64-3.7/apex/mlp
creating build/lib.linux-x86_64-3.7/apex/fp16_utils
copying apex/fp16_utils/loss_scaler.py -> build/lib.linux-x86_64-3.7/apex/fp16_utils
copying apex/fp16_utils/fp16_optimizer.py -> build/lib.linux-x86_64-3.7/apex/fp16_utils
copying apex/fp16_utils/fp16util.py -> build/lib.linux-x86_64-3.7/apex/fp16_utils
copying apex/fp16_utils/__init__.py -> build/lib.linux-x86_64-3.7/apex/fp16_utils
creating build/lib.linux-x86_64-3.7/apex/parallel
copying apex/parallel/sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.7/apex/parallel
copying apex/parallel/sync_batchnorm.py -> build/lib.linux-x86_64-3.7/apex/parallel
copying apex/parallel/optimized_sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.7/apex/parallel
copying apex/parallel/distributed.py -> build/lib.linux-x86_64-3.7/apex/parallel
copying apex/parallel/__init__.py -> build/lib.linux-x86_64-3.7/apex/parallel
copying apex/parallel/optimized_sync_batchnorm.py -> build/lib.linux-x86_64-3.7/apex/parallel
copying apex/parallel/multiproc.py -> build/lib.linux-x86_64-3.7/apex/parallel
copying apex/parallel/LARC.py -> build/lib.linux-x86_64-3.7/apex/parallel
creating build/lib.linux-x86_64-3.7/apex/contrib
copying apex/contrib/__init__.py -> build/lib.linux-x86_64-3.7/apex/contrib
creating build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/handle.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/_initialize.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/compat.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/_amp_state.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/frontend.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/wrap.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/rnn_compat.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/amp.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/opt.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/__init__.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/utils.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/__version__.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/scaler.py -> build/lib.linux-x86_64-3.7/apex/amp
copying apex/amp/_process_optimizer.py -> build/lib.linux-x86_64-3.7/apex/amp
creating build/lib.linux-x86_64-3.7/apex/optimizers
copying apex/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.7/apex/optimizers
copying apex/optimizers/fused_adagrad.py -> build/lib.linux-x86_64-3.7/apex/optimizers
copying apex/optimizers/fused_sgd.py -> build/lib.linux-x86_64-3.7/apex/optimizers
copying apex/optimizers/__init__.py -> build/lib.linux-x86_64-3.7/apex/optimizers
copying apex/optimizers/fused_novograd.py -> build/lib.linux-x86_64-3.7/apex/optimizers
copying apex/optimizers/fused_lamb.py -> build/lib.linux-x86_64-3.7/apex/optimizers
creating build/lib.linux-x86_64-3.7/apex/normalization
copying apex/normalization/__init__.py -> build/lib.linux-x86_64-3.7/apex/normalization
copying apex/normalization/fused_layer_norm.py -> build/lib.linux-x86_64-3.7/apex/normalization
creating build/lib.linux-x86_64-3.7/apex/pyprof
copying apex/pyprof/__init__.py -> build/lib.linux-x86_64-3.7/apex/pyprof
creating build/lib.linux-x86_64-3.7/apex/reparameterization
copying apex/reparameterization/weight_norm.py -> build/lib.linux-x86_64-3.7/apex/reparameterization
copying apex/reparameterization/__init__.py -> build/lib.linux-x86_64-3.7/apex/reparameterization
copying apex/reparameterization/reparameterization.py -> build/lib.linux-x86_64-3.7/apex/reparameterization
creating build/lib.linux-x86_64-3.7/apex/contrib/sparsity
copying apex/contrib/sparsity/__init__.py -> build/lib.linux-x86_64-3.7/apex/contrib/sparsity
copying apex/contrib/sparsity/sparse_masklib.py -> build/lib.linux-x86_64-3.7/apex/contrib/sparsity
copying apex/contrib/sparsity/asp.py -> build/lib.linux-x86_64-3.7/apex/contrib/sparsity
creating build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/fused_sgd.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/distributed_fused_adam_v2.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/fp16_optimizer.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/distributed_fused_adam_v3.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/__init__.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/distributed_fused_adam.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/fused_lamb.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
copying apex/contrib/optimizers/distributed_fused_lamb.py -> build/lib.linux-x86_64-3.7/apex/contrib/optimizers
creating build/lib.linux-x86_64-3.7/apex/contrib/xentropy
copying apex/contrib/xentropy/softmax_xentropy.py -> build/lib.linux-x86_64-3.7/apex/contrib/xentropy
copying apex/contrib/xentropy/__init__.py -> build/lib.linux-x86_64-3.7/apex/contrib/xentropy
creating build/lib.linux-x86_64-3.7/apex/contrib/groupbn
copying apex/contrib/groupbn/batch_norm.py -> build/lib.linux-x86_64-3.7/apex/contrib/groupbn
copying apex/contrib/groupbn/__init__.py -> build/lib.linux-x86_64-3.7/apex/contrib/groupbn
creating build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/fast_self_multihead_attn_func.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/fast_encdec_multihead_attn_norm_add_func.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/encdec_multihead_attn.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/encdec_multihead_attn_func.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/mask_softmax_dropout_func.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/fast_self_multihead_attn_norm_add_func.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/self_multihead_attn.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/fast_encdec_multihead_attn_func.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/__init__.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
copying apex/contrib/multihead_attn/self_multihead_attn_func.py -> build/lib.linux-x86_64-3.7/apex/contrib/multihead_attn
creating build/lib.linux-x86_64-3.7/apex/amp/lists
copying apex/amp/lists/tensor_overrides.py -> build/lib.linux-x86_64-3.7/apex/amp/lists
copying apex/amp/lists/torch_overrides.py -> build/lib.linux-x86_64-3.7/apex/amp/lists
copying apex/amp/lists/functional_overrides.py -> build/lib.linux-x86_64-3.7/apex/amp/lists
copying apex/amp/lists/__init__.py -> build/lib.linux-x86_64-3.7/apex/amp/lists
creating build/lib.linux-x86_64-3.7/apex/pyprof/parse
copying apex/pyprof/parse/__main__.py -> build/lib.linux-x86_64-3.7/apex/pyprof/parse
copying apex/pyprof/parse/nvvp.py -> build/lib.linux-x86_64-3.7/apex/pyprof/parse
copying apex/pyprof/parse/db.py -> build/lib.linux-x86_64-3.7/apex/pyprof/parse
copying apex/pyprof/parse/kernel.py -> build/lib.linux-x86_64-3.7/apex/pyprof/parse
copying apex/pyprof/parse/__init__.py -> build/lib.linux-x86_64-3.7/apex/pyprof/parse
copying apex/pyprof/parse/parse.py -> build/lib.linux-x86_64-3.7/apex/pyprof/parse
creating build/lib.linux-x86_64-3.7/apex/pyprof/nvtx
copying apex/pyprof/nvtx/nvmarker.py -> build/lib.linux-x86_64-3.7/apex/pyprof/nvtx
copying apex/pyprof/nvtx/__init__.py -> build/lib.linux-x86_64-3.7/apex/pyprof/nvtx
creating build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/misc.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/utility.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/embedding.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/prof.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/reduction.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/normalization.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/loss.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/randomSample.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/__main__.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/blas.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/recurrentCell.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/pooling.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/softmax.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/convert.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/base.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/optim.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/output.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/dropout.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/data.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/__init__.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/usage.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/index_slice_join_mutate.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/activation.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/linear.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/conv.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
copying apex/pyprof/prof/pointwise.py -> build/lib.linux-x86_64-3.7/apex/pyprof/prof
running build_ext
building 'apex_C' extension
creating build/temp.linux-x86_64-3.7
creating build/temp.linux-x86_64-3.7/csrc
gcc -pthread -B /home/shirley.zxy/opt/anaconda3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/flatten_unflatten.cpp -o build/temp.linux-x86_64-3.7/csrc/flatten_unflatten.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=apex_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
g++ -pthread -shared -B /home/shirley.zxy/opt/anaconda3/compiler_compat -L/home/shirley.zxy/opt/anaconda3/lib -Wl,-rpath=/home/shirley.zxy/opt/anaconda3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.7/csrc/flatten_unflatten.o -o build/lib.linux-x86_64-3.7/apex_C.cpython-37m-x86_64-linux-gnu.so
building 'amp_C' extension
gcc -pthread -B /home/shirley.zxy/opt/anaconda3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/amp_C_frontend.cpp -o build/temp.linux-x86_64-3.7/csrc/amp_C_frontend.o -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_sgd_kernel.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_sgd_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_scale_kernel.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_scale_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_axpby_kernel.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_axpby_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_l2norm_kernel.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_l2norm_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_lamb_stage_1.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_lamb_stage_1.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_lamb_stage_2.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_lamb_stage_2.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_adam.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_adam.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_adagrad.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_adagrad.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_novograd.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/multi_tensor_lamb.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_lamb.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
g++ -pthread -shared -B /home/shirley.zxy/opt/anaconda3/compiler_compat -L/home/shirley.zxy/opt/anaconda3/lib -Wl,-rpath=/home/shirley.zxy/opt/anaconda3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.7/csrc/amp_C_frontend.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_sgd_kernel.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_scale_kernel.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_axpby_kernel.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_l2norm_kernel.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_lamb_stage_1.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_lamb_stage_2.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_adam.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_adagrad.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o build/temp.linux-x86_64-3.7/csrc/multi_tensor_lamb.o -L/usr/local/cuda-10.0/lib64 -lcudart -o build/lib.linux-x86_64-3.7/amp_C.cpython-37m-x86_64-linux-gnu.so
building 'syncbn' extension
gcc -pthread -B /home/shirley.zxy/opt/anaconda3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/syncbn.cpp -o build/temp.linux-x86_64-3.7/csrc/syncbn.o -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/welford.cu -o build/temp.linux-x86_64-3.7/csrc/welford.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
g++ -pthread -shared -B /home/shirley.zxy/opt/anaconda3/compiler_compat -L/home/shirley.zxy/opt/anaconda3/lib -Wl,-rpath=/home/shirley.zxy/opt/anaconda3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.7/csrc/syncbn.o build/temp.linux-x86_64-3.7/csrc/welford.o -L/usr/local/cuda-10.0/lib64 -lcudart -o build/lib.linux-x86_64-3.7/syncbn.cpython-37m-x86_64-linux-gnu.so
building 'fused_layer_norm_cuda' extension
gcc -pthread -B /home/shirley.zxy/opt/anaconda3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/layer_norm_cuda.cpp -o build/temp.linux-x86_64-3.7/csrc/layer_norm_cuda.o -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
/usr/local/cuda-10.0/bin/nvcc -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/layer_norm_cuda_kernel.cu -o build/temp.linux-x86_64-3.7/csrc/layer_norm_cuda_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --compiler-options '-fPIC' -maxrregcount=50 -O3 --use_fast_math -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
g++ -pthread -shared -B /home/shirley.zxy/opt/anaconda3/compiler_compat -L/home/shirley.zxy/opt/anaconda3/lib -Wl,-rpath=/home/shirley.zxy/opt/anaconda3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-x86_64-3.7/csrc/layer_norm_cuda.o build/temp.linux-x86_64-3.7/csrc/layer_norm_cuda_kernel.o -L/usr/local/cuda-10.0/lib64 -lcudart -o build/lib.linux-x86_64-3.7/fused_layer_norm_cuda.cpython-37m-x86_64-linux-gnu.so
building 'mlp_cuda' extension
gcc -pthread -B /home/shirley.zxy/opt/anaconda3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/TH -I/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda-10.0/include -I/home/shirley.zxy/opt/anaconda3/include/python3.7m -c csrc/mlp.cpp -o build/temp.linux-x86_64-3.7/csrc/mlp.o -O3 -DVERSION_GE_1_1 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=mlp_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
In file included from csrc/mlp.cpp:2:0:
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/torch.h:7:2: warning: #warning "Including torch/torch.h for C++ extensions is deprecated. Please include torch/extension.h" [-Wcpp]
 #warning \
  ^
csrc/mlp.cpp: In function ‘std::vector<at::Tensor> mlp_forward(int, int, std::vector<at::Tensor>)’:
csrc/mlp.cpp:56:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   for (int i = 0; i < num_layers; i++) {
                     ^
csrc/mlp.cpp:65:68: warning: narrowing conversion of ‘reserved_size’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
   auto reserved_space = at::empty({reserved_size}, inputs[0].type());
                                                                    ^
csrc/mlp.cpp:65:68: warning: narrowing conversion of ‘reserved_size’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
In file included from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/ATen.h:9:0,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
                 from csrc/mlp.cpp:1:
csrc/mlp.cpp: In lambda function:
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:84:52: warning: ‘c10::ScalarType detail::scalar_type(const at::DeprecatedTypeProperties&)’ is deprecated [-Wdeprecated-declarations]
     at::ScalarType _st = ::detail::scalar_type(TYPE);                        \
                                                    ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:47:23: note: declared here
 inline at::ScalarType scalar_type(const at::DeprecatedTypeProperties &t) {
                       ^
In file included from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/ATen.h:9:0,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
                 from csrc/mlp.cpp:1:
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:70:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:54: error: expected primary-expression before ‘>’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:56: error: expected primary-expression before ‘)’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:69: error: expected primary-expression before ‘>’ token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                     ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:71: error: expected primary-expression before ‘)’ token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:36: error: expected primary-expression before ‘>’ token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:38: error: expected primary-expression before ‘)’ token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:30: error: expected primary-expression before ‘>’ token
         out.data_ptr<scalar_t>(),
                              ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:32: error: expected primary-expression before ‘)’ token
         out.data_ptr<scalar_t>(),
                                ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:41: error: expected primary-expression before ‘>’ token
         reserved_space.data_ptr<scalar_t>(),
                                         ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:43: error: expected primary-expression before ‘)’ token
         reserved_space.data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:70:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:54: error: expected primary-expression before ‘>’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:56: error: expected primary-expression before ‘)’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:69: error: expected primary-expression before ‘>’ token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                     ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:71: error: expected primary-expression before ‘)’ token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:36: error: expected primary-expression before ‘>’ token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:38: error: expected primary-expression before ‘)’ token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:30: error: expected primary-expression before ‘>’ token
         out.data_ptr<scalar_t>(),
                              ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:32: error: expected primary-expression before ‘)’ token
         out.data_ptr<scalar_t>(),
                                ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:41: error: expected primary-expression before ‘>’ token
         reserved_space.data_ptr<scalar_t>(),
                                         ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:43: error: expected primary-expression before ‘)’ token
         reserved_space.data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:70:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:54: error: expected primary-expression before ‘>’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:71:56: error: expected primary-expression before ‘)’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:69: error: expected primary-expression before ‘>’ token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                     ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:73:71: error: expected primary-expression before ‘)’ token
         b_ptr.push_back(inputs[i + 1 + num_layers].data_ptr<scalar_t>());
                                                                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:36: error: expected primary-expression before ‘>’ token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:77:38: error: expected primary-expression before ‘)’ token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:30: error: expected primary-expression before ‘>’ token
         out.data_ptr<scalar_t>(),
                              ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:84:32: error: expected primary-expression before ‘)’ token
         out.data_ptr<scalar_t>(),
                                ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:41: error: expected primary-expression before ‘>’ token
         reserved_space.data_ptr<scalar_t>(),
                                         ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp:85:43: error: expected primary-expression before ‘)’ token
         reserved_space.data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:67:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
   ^
csrc/mlp.cpp: In function ‘std::vector<at::Tensor> mlp_backward(int, int, at::Tensor, std::vector<at::Tensor>, std::vector<at::Tensor>)’:
csrc/mlp.cpp:113:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   for (int i = 0; i < num_layers; i++) {
                     ^
csrc/mlp.cpp:119:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   for (int i = 0; i < inputs.size(); i++) {
                     ^
In file included from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/ATen.h:9:0,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
                 from csrc/mlp.cpp:1:
csrc/mlp.cpp: In lambda function:
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:84:52: warning: ‘c10::ScalarType detail::scalar_type(const at::DeprecatedTypeProperties&)’ is deprecated [-Wdeprecated-declarations]
     at::ScalarType _st = ::detail::scalar_type(TYPE);                        \
                                                    ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:47:23: note: declared here
 inline at::ScalarType scalar_type(const at::DeprecatedTypeProperties &t) {
                       ^
In file included from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/ATen.h:9:0,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
                 from csrc/mlp.cpp:1:
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:125:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:54: error: expected primary-expression before ‘>’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:56: error: expected primary-expression before ‘)’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:129:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < inputs.size(); i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:57: error: expected primary-expression before ‘>’ token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                         ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:59: error: expected primary-expression before ‘)’ token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:36: error: expected primary-expression before ‘>’ token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:38: error: expected primary-expression before ‘)’ token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:43: error: expected primary-expression before ‘>’ token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:45: error: expected primary-expression before ‘)’ token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                             ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:46: error: expected primary-expression before ‘>’ token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                              ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:48: error: expected primary-expression before ‘)’ token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                                ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:43: error: expected primary-expression before ‘>’ token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:45: error: expected primary-expression before ‘)’ token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                             ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:37: error: expected primary-expression before ‘>’ token
         work_space.data_ptr<scalar_t>(),
                                     ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:39: error: expected primary-expression before ‘)’ token
         work_space.data_ptr<scalar_t>(),
                                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:125:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:54: error: expected primary-expression before ‘>’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:56: error: expected primary-expression before ‘)’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:129:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < inputs.size(); i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:57: error: expected primary-expression before ‘>’ token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                         ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:59: error: expected primary-expression before ‘)’ token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:36: error: expected primary-expression before ‘>’ token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:38: error: expected primary-expression before ‘)’ token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:43: error: expected primary-expression before ‘>’ token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:45: error: expected primary-expression before ‘)’ token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                             ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:46: error: expected primary-expression before ‘>’ token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                              ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:48: error: expected primary-expression before ‘)’ token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                                ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:43: error: expected primary-expression before ‘>’ token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:45: error: expected primary-expression before ‘)’ token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                             ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:37: error: expected primary-expression before ‘>’ token
         work_space.data_ptr<scalar_t>(),
                                     ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:39: error: expected primary-expression before ‘)’ token
         work_space.data_ptr<scalar_t>(),
                                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp: In lambda function:
csrc/mlp.cpp:125:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < num_layers; i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:54: error: expected primary-expression before ‘>’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:126:56: error: expected primary-expression before ‘)’ token
       w_ptr.push_back(inputs[i + 1].data_ptr<scalar_t>());
                                                        ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:129:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
     for (int i = 0; i < inputs.size(); i++) {
                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:57: error: expected primary-expression before ‘>’ token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                         ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:130:59: error: expected primary-expression before ‘)’ token
       outputs_ptr.push_back(outputs[i].data_ptr<scalar_t>());
                                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:137:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
     auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
                                            ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:36: error: expected primary-expression before ‘>’ token
         inputs[0].data_ptr<scalar_t>(),
                                    ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:140:38: error: expected primary-expression before ‘)’ token
         inputs[0].data_ptr<scalar_t>(),
                                      ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:43: error: expected primary-expression before ‘>’ token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:141:45: error: expected primary-expression before ‘)’ token
         fprop_outputs[0].data_ptr<scalar_t>(),
                                             ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:46: error: expected primary-expression before ‘>’ token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                              ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:147:48: error: expected primary-expression before ‘)’ token
         grad_o.contiguous().data_ptr<scalar_t>(),
                                                ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:43: error: expected primary-expression before ‘>’ token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                           ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:148:45: error: expected primary-expression before ‘)’ token
         fprop_outputs[1].data_ptr<scalar_t>(),
                                             ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:37: error: expected primary-expression before ‘>’ token
         work_space.data_ptr<scalar_t>(),
                                     ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
csrc/mlp.cpp:149:39: error: expected primary-expression before ‘)’ token
         work_space.data_ptr<scalar_t>(),
                                       ^
/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:11:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE’
     return __VA_ARGS__();                          \
            ^
csrc/mlp.cpp:123:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
   AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
   ^
error: command 'gcc' failed with exit status 1

Running setup.py install for apex ... error
Cleaning up...
Removing source in /tmp/pip-req-build-rtl8rlix
Removed build tracker '/tmp/pip-req-tracker-eqjwagpv'
ERROR: Command errored out with exit status 1: /home/shirley.zxy/opt/anaconda3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-rtl8rlix/setup.py'"'"'; file='"'"'/tmp/pip-req-build-rtl8rlix/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-ci9ovh87/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.
Exception information:
Traceback (most recent call last):
File "/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 188, in main
status = self.run(options, args)
File "/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 407, in run
use_user_site=options.use_user_site,
File "/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/pip/_internal/req/init.py", line 58, in install_given_reqs
**kwargs
File "/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 959, in install
spinner=spinner,
File "/home/shirley.zxy/opt/anaconda3/lib/python3.7/site-packages/pip/_internal/utils/misc.py", line 931, in call_subprocess
raise InstallationError(exc_msg)
pip._internal.exceptions.InstallationError: Command errored out with exit status 1: /home/shirley.zxy/opt/anaconda3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-rtl8rlix/setup.py'"'"'; file='"'"'/tmp/pip-req-build-rtl8rlix/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-ci9ovh87/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.
1 location(s) to search for versions of pip:

@Billijk
Copy link

Billijk commented Nov 16, 2020

My build failed on gcc-7.3.0, but works well on gcc-6.4.0. Any comment here?

The error message seems like glibc making some internal changes:


[10/11] /mnt/lustre/cm/shared/global/src/dev/cuda/10.1/bin/nvcc -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/pytho[3022/4827]
ackages/torch/include/torch/csrc/api/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/TH -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/includ
e/THC -I/mnt/lustre/cm/shared/global/src/dev/cuda/10.1/include -I/mnt/lustre/aifs/home/kys08/miniconda3/include/python3.7m -c -c /tmp/pip-req-build-b7uxqzsj/csrc/multi_tensor_novograd.cu -o /tmp/pip-req-build-b7u
xqzsj/build/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"
'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=sm_75 -std
=c++14
    FAILED: /tmp/pip-req-build-b7uxqzsj/build/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o
    /mnt/lustre/cm/shared/global/src/dev/cuda/10.1/bin/nvcc -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/
torch/include/torch/csrc/api/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/TH -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/THC -I
/mnt/lustre/cm/shared/global/src/dev/cuda/10.1/include -I/mnt/lustre/aifs/home/kys08/miniconda3/include/python3.7m -c -c /tmp/pip-req-build-b7uxqzsj/csrc/multi_tensor_novograd.cu -o /tmp/pip-req-build-b7uxqzsj/bu
ild/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lin$
info -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=sm_75 -std=c++14
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc: In instantiation of ‘static std::basic_string<_CharT, _Traits, _Alloc>::_Rep* std::basic_string<_CharT, _Traits, _Alloc>
::_Rep::_S_create(std::basic_string<_CharT, _Traits, _Alloc>::size_type, std::basic_string<_CharT, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc
 = std::allocator<char16_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsigned int]’:
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:578:28:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator
, const _Alloc&, std::forward_iterator_tag) [with _FwdIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5033:20:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct_aux(_InIterator, _InItera
tor, const _Alloc&, std::__false_type) [with _InIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5054:24:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator,
 const _Alloc&) [with _InIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:656:134:   required from ‘std::basic_string<_CharT, _Traits, _Alloc>::basic_string(const _CharT*, std::basic_string<_Char
T, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsign
ed int]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:6676:95:   required from here
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:1067:16: error: cannot call member function ‘void std::basic_string<_CharT, _Traits, _Alloc>::_Rep::_M_set_sharable() [wi
th _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’ without object
           __p->_M_set_sharable();
           ~~~~~~~~~^~
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc: In instantiation of ‘static std::basic_string<_CharT, _Traits, _Alloc>::_Rep* std::basic_string<_CharT, _Traits, _Alloc>
::_Rep::_S_create(std::basic_string<_CharT, _Traits, _Alloc>::size_type, std::basic_string<_CharT, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc
 = std::allocator<char32_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsigned int]’:
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:578:28:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator
, const _Alloc&, std::forward_iterator_tag) [with _FwdIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5033:20:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct_aux(_InIterator, _InItera
tor, const _Alloc&, std::__false_type) [with _InIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5054:24:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator,
 const _Alloc&) [with _InIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:656:134:   required from ‘std::basic_string<_CharT, _Traits, _Alloc>::basic_string(const _CharT*, std::basic_string<_Char
T, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsign
ed int]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:6681:95:   required from here
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:1067:16: error: cannot call member function ‘void std::basic_string<_CharT, _Traits, _Alloc>::_Rep::_M_set_sharable() [wi
th _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’ without object

This works! I tried to downgrade my gcc to gcc-6.5.0 and successfully installed apex. I am using Cuda 10.1 and Pytorch 1.6.0.

@Yudezhi
Copy link

Yudezhi commented Dec 18, 2020

My build failed on gcc-7.3.0, but works well on gcc-6.4.0. Any comment here?

The error message seems like glibc making some internal changes:


[10/11] /mnt/lustre/cm/shared/global/src/dev/cuda/10.1/bin/nvcc -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/pytho[3022/4827]
ackages/torch/include/torch/csrc/api/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/TH -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/includ
e/THC -I/mnt/lustre/cm/shared/global/src/dev/cuda/10.1/include -I/mnt/lustre/aifs/home/kys08/miniconda3/include/python3.7m -c -c /tmp/pip-req-build-b7uxqzsj/csrc/multi_tensor_novograd.cu -o /tmp/pip-req-build-b7u
xqzsj/build/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"
'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=sm_75 -std
=c++14
    FAILED: /tmp/pip-req-build-b7uxqzsj/build/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o
    /mnt/lustre/cm/shared/global/src/dev/cuda/10.1/bin/nvcc -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/
torch/include/torch/csrc/api/include -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/TH -I/mnt/lustre/aifs/home/kys08/miniconda3/lib/python3.7/site-packages/torch/include/THC -I
/mnt/lustre/cm/shared/global/src/dev/cuda/10.1/include -I/mnt/lustre/aifs/home/kys08/miniconda3/include/python3.7m -c -c /tmp/pip-req-build-b7uxqzsj/csrc/multi_tensor_novograd.cu -o /tmp/pip-req-build-b7uxqzsj/bu
ild/temp.linux-x86_64-3.7/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lin$
info -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=sm_75 -std=c++14
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc: In instantiation of ‘static std::basic_string<_CharT, _Traits, _Alloc>::_Rep* std::basic_string<_CharT, _Traits, _Alloc>
::_Rep::_S_create(std::basic_string<_CharT, _Traits, _Alloc>::size_type, std::basic_string<_CharT, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc
 = std::allocator<char16_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsigned int]’:
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:578:28:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator
, const _Alloc&, std::forward_iterator_tag) [with _FwdIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5033:20:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct_aux(_InIterator, _InItera
tor, const _Alloc&, std::__false_type) [with _InIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5054:24:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator,
 const _Alloc&) [with _InIterator = const char16_t*; _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:656:134:   required from ‘std::basic_string<_CharT, _Traits, _Alloc>::basic_string(const _CharT*, std::basic_string<_Char
T, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsign
ed int]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:6676:95:   required from here
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:1067:16: error: cannot call member function ‘void std::basic_string<_CharT, _Traits, _Alloc>::_Rep::_M_set_sharable() [wi
th _CharT = char16_t; _Traits = std::char_traits<char16_t>; _Alloc = std::allocator<char16_t>]’ without object
           __p->_M_set_sharable();
           ~~~~~~~~~^~
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc: In instantiation of ‘static std::basic_string<_CharT, _Traits, _Alloc>::_Rep* std::basic_string<_CharT, _Traits, _Alloc>
::_Rep::_S_create(std::basic_string<_CharT, _Traits, _Alloc>::size_type, std::basic_string<_CharT, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc
 = std::allocator<char32_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsigned int]’:
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:578:28:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator
, const _Alloc&, std::forward_iterator_tag) [with _FwdIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5033:20:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct_aux(_InIterator, _InItera
tor, const _Alloc&, std::__false_type) [with _InIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:5054:24:   required from ‘static _CharT* std::basic_string<_CharT, _Traits, _Alloc>::_S_construct(_InIterator, _InIterator,
 const _Alloc&) [with _InIterator = const char32_t*; _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:656:134:   required from ‘std::basic_string<_CharT, _Traits, _Alloc>::basic_string(const _CharT*, std::basic_string<_Char
T, _Traits, _Alloc>::size_type, const _Alloc&) [with _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>; std::basic_string<_CharT, _Traits, _Alloc>::size_type = long unsign
ed int]’
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.h:6681:95:   required from here
    /mnt/lustre/cm/shared/global/src/dev/gcc/7.3.0/include/c++/7.3.0/bits/basic_string.tcc:1067:16: error: cannot call member function ‘void std::basic_string<_CharT, _Traits, _Alloc>::_Rep::_M_set_sharable() [wi
th _CharT = char32_t; _Traits = std::char_traits<char32_t>; _Alloc = std::allocator<char32_t>]’ without object

helps a lot. Mine is 20.04, cuda10.1 , pytorch 1.7.1 , gcc g++ as yours

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants