-
Notifications
You must be signed in to change notification settings - Fork 6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Data] Ensure all tests use shared cluster in test_csv
#48352
Conversation
Signed-off-by: Balaji Veeramani <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks for the fix!
# test_write_datasink_ray_remote_args test, which uses a cluster_utils cluster, will | ||
# fail with a double-init. | ||
def test_csv_read_no_header(shutdown_only, tmp_path): | ||
def test_csv_read_no_header(ray_start_regular_shared, tmp_path): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
any ideas why it was not using the shared cluster before? i also looked at the test code but couldn't find any particular reason...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Because there was a test (written three years ago) that depended on Ray getting shutdown. But that test isn't in this module anymore, and it calls ray.shutdown
in the test itself anyway so there's no reason not to use shared clusters at this point
…#48352) See ray-project#48228 (comment). Signed-off-by: Balaji Veeramani <[email protected]>
…#48352) See ray-project#48228 (comment). Signed-off-by: Balaji Veeramani <[email protected]>
…#48352) See ray-project#48228 (comment). Signed-off-by: Balaji Veeramani <[email protected]> Signed-off-by: mohitjain2504 <[email protected]>
Why are these changes needed?
See #48228 (comment).
Related issue number
Checks
git commit -s
) in this PR.scripts/format.sh
to lint the changes in this PR.method in Tune, I've added it in
doc/source/tune/api/
under thecorresponding
.rst
file.