Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core feature] Support horovod in mpi task #3567

Closed
2 tasks done
ByronHsu opened this issue Apr 3, 2023 · 0 comments
Closed
2 tasks done

[Core feature] Support horovod in mpi task #3567

ByronHsu opened this issue Apr 3, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@ByronHsu
Copy link
Contributor

ByronHsu commented Apr 3, 2023 •
edited
Loading

Motivation: Why do you think this is important?

Horovod is a special kind of tasks in mpi, it uses horovodrun to launch distributed training and ssh to communicate between launchers and workers.

  1. Horovod is not implemented in flytekit mpi task.
  2. Flyteplugins also need change to adjust to horovod.

Goal: What should the final outcome look like, ideally?

Able to run horovod on flyte

Describe alternatives you've considered

N/A

Propose: Link/Inline OR Additional context

No response

Are you sure this issue hasn't been raised already?

  • Yes

Have you read the Code of Conduct?

  • Yes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@eapolinario @ByronHsu @pingsutw