Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Unit test FAILED against : SPARK-24957: average with decimal followed by aggregation returning wrong result #10327

Closed
NvTimLiu opened this issue Jan 30, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@NvTimLiu
Copy link
Collaborator

NvTimLiu commented Jan 30, 2024

Describe the bug

Unit test FAILED: SPARK-24957: average with decimal followed by aggregation returning wrong result, details:

 SPARK-24957: average with decimal followed by aggregation returning wrong result *** FAILED ***
 org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 3.0 failed 1 times, most recent age 3.0 (TID 3) (nightly-work1-jenkins-rapids-scala213-nightly-pre-release-vqjl3 executor driver): pe conversion is not allowed from Table{columns=[ColumnVector{rows=1, type=STRING, nullCount=Optional.empty, ebf0)}, ColumnVector{rows=1, type=INT64, nullCount=Optional.empty, offHeap=(ID: 777021 7fb66003cbd0)}, T64, nullCount=Optional.empty, offHeap=(ID: 777022 7fb66003d3a0)}, ColumnVector{rows=1, type=INT64, fHeap=(ID: 777023 7fb66003d690)}, ColumnVector{rows=1, type=INT64, nullCount=Optional.empty, offHeap=(ID: 777024 {rows=1, type=INT64, nullCount=Optional.empty, offHeap=(ID: 777025 7fb66003dd80)}], cudfTable=140421271470672, rows=1} ongType, GpuUnsignedLongType, GpuUnsignedLongType, LongType, LongType] columns 0 to 6
	at com.nvidia.spark.rapids.GpuColumnVector.from(GpuColumnVector.java:674)
	at com.nvidia.spark.rapids.GpuColumnVector.from(GpuColumnVector.java:555)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$performGroupByAggregation$4(GpuAggregateExec.scala:394)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$performGroupByAggregation$2(GpuAggregateExec.scala:393)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$performGroupByAggregation$1(GpuAggregateExec.scala:378)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.performGroupByAggregation(GpuAggregateExec.scala:377)
	at com.nvidia.spark.rapids.AggHelper.aggregate(GpuAggregateExec.scala:292)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$aggregateWithoutCombine$4(GpuAggregateExec.scala:311)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$aggregateWithoutCombine$3(GpuAggregateExec.scala:309)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$aggregateWithoutCombine$2(GpuAggregateExec.scala:308)
	at apidsRetryIterator$AutoCloseableAttemptSpliterator.next(RmmRapidsRetryIterator.scala:477)
	at com.nvidia.spark.rapids.RmmRapidsRetryIterator$RmmRapidsRetryIterator.next(RmmRapidsRetryIterator.scala:613)
	at apidsRetryIterator$RmmRapidsRetryAutoCloseableIterator.next(RmmRapidsRetryIterator.scala:517)
	at scala.collection.Iterator$$anon$10.next(Iterator.scala:61
	at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
	at com.nvidia.spark.rapids.GpuMergeAggregateIterator.aggregateInputBatches(GpuAggregateExec.scala:795)
	at com.nvidia.spark.rapids.GpuMergeAggregateIterator.$anonfun$next$2(GpuAggregateExec.scala:752)
	at scala.Option.getOrElse(Option.scala:201)
	at com.nvidia.spark.rapids.GpuMergeAggregateIterator.next(GpuAggregateExec.scala:749)
	at com.nvidia.spark.rapids.GpuMergeAggregateIterator.next(GpuAggregateExec.scala:711)
	at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
@NvTimLiu NvTimLiu added bug Something isn't working ? - Needs Triage Need team to review and classify labels Jan 30, 2024
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Jan 30, 2024
@mattahrens
Copy link
Collaborator

Fixed by #10331

@jlowe jlowe closed this as completed Jan 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants