Self-Attention PPO Pytorch

I was inspired by this paper which described few methods to approach for Attention for Reinforcement Learning.
I decided that it will be best to implement simplest one.

This implementation don't have to be correct even though it works better than version without Attention.

Setup

# Create and activate virtual environment.
python3 -m venv venv
# Install packages
pip install -r requirements.txt
# Run program
python main.py

Tensorboard

To run tensorboard use this command:

tensorboard --logdir runs

Lint

To lint code use this command:

black .

Troubleshooting

• (Ubuntu) During installation of tensorboard I encountered an error that required from me to install python3-dev package.