Skip to content

Commit

Permalink
Addressed all comments
Browse files Browse the repository at this point in the history
  • Loading branch information
c21 committed Oct 28, 2021
1 parent 8c7c617 commit d85d4ba
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@
* tree pre-ordering. This is used for aggregate push down in ORC.
*
* For nested data types (array, map and struct), the sub-field statistics are stored recursively
* inside parent column's `children` field. Here is an example of `OrcColumnStatistics`:
* inside parent column's children field. Here is an example of {@link OrcColumnStatistics}:
*
* Data schema:
* c1: int
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@
import java.util.Queue;

/**
* `OrcFooterReader` is a util class which encapsulates the helper
* {@link OrcFooterReader} is a util class which encapsulates the helper
* methods of reading ORC file footer.
*/
public class OrcFooterReader {
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -402,7 +402,7 @@ object OrcUtils extends Logging {
var columnsStatistics: OrcColumnStatistics = null
try {
columnsStatistics = OrcFooterReader.readStatistics(reader)
} catch { case e: RuntimeException =>
} catch { case e: Exception =>
throw new SparkException(
s"Cannot read columns statistics in file: $filePath. Please consider disabling " +
s"ORC aggregate push down by setting 'spark.sql.orc.aggregatePushdown' to false.", e)
Expand Down

0 comments on commit d85d4ba

Please sign in to comment.