Skip to content

Commit

Permalink
Update link to image in Fabric PPO example (#17360)
Browse files Browse the repository at this point in the history
  • Loading branch information
awaelchli authored Apr 13, 2023
1 parent f14ee9e commit 17548d5
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/fabric/reinforcement_learning/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ In this example we have gone even further leveraging the flexibility offered by
The architecture is depicted in the following figure:

<p align="center">
<img src="./imgs/fabric_decoupled.png">
<img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/examples/fabric/reinforcement-learning/ppo_fabric_decoupled.png">
</p>

where, differently from the previous example, we have completely decoupled the environment from the agents: the *rank-0* process will be regarded as the *Player*, which runs `M+1` independent copies of the environment (*Env-0*, ..., *Env-M*); the *rank-1*, ..., *rank-N* are the *Trainers*, which contain the agent to be optimized. Player and Trainer share data through [collectives](https://lightning.ai/docs/fabric/stable/api/generated/lightning.fabric.plugins.collectives.TorchCollective.html#lightning.fabric.plugins.collectives.TorchCollective) and thanks to Fabric's flexibility we can run Player and Trainers on different devices.
Expand Down

0 comments on commit 17548d5

Please sign in to comment.