Skip to content

Commit

Permalink
Clarify note about dtensor
Browse files Browse the repository at this point in the history
  • Loading branch information
mattdangerw committed May 16, 2022
1 parent 618f577 commit fb263a9
Showing 1 changed file with 7 additions and 4 deletions.
11 changes: 7 additions & 4 deletions ROADMAP.md
Original file line number Diff line number Diff line change
Expand Up @@ -106,10 +106,13 @@ example demonstrating the component in an end-to-end architecture.

By the end of 2022, we should have a actively growing collection of examples
models, with a standardized set of training scripts, that match expected
performance as reported in publications. On the scalability front, we should
be running our training scripts on multi-worker GPU and TPU settings, using
[DTensor](https://www.tensorflow.org/guide/dtensor_overview) for data parallel
training.
performance as reported in publications.

On the scalability front, we should have at least one example demonstrating both
data parallel and model parallel training, in a multi-worker GPU and TPU
setting, leveraging
[DTensor](https://www.tensorflow.org/guide/dtensor_overview) for distributed
support.

### Tools for data preprocessing and postprocessing for end-to-end workflows

Expand Down

0 comments on commit fb263a9

Please sign in to comment.