-
Notifications
You must be signed in to change notification settings - Fork 245
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] test_from_json_mixed_types_list_struct failed #10351
Comments
Row comparison failure details
|
The output shows that an input of
But an almost identical input of
I have been unable to reproduce this so far with Spark 3.3.0, even using the same datagen seed. However, a manual test does show differences between CPU and GPU, but does not match the results from the failed CI run exactly.
GPU output
CPU Output
|
Note that this failure was from a distributed cluster setup, so the nature of the failure may have something to do with how the input data is partitioned across tasks. That particular distribution is probably not replicated in the default local run environment. |
Also, my manual test is using |
So if some partitions contain mixed types and some don't ... I will try and repro that in an integration test. I will create a PR to xfail this test while I investigate. |
Depends on rapidsai/cudf#14830 |
The test code from the comment in #10351 (comment) now works, but the test itself still fails because it needs support for LISTs not just STRUCTs. is the issue we want/need fixed for this to start passing. |
Details
The text was updated successfully, but these errors were encountered: