[Bug]: Iceberg integration test warning log spam

[Abacn]

What happened?

https://github.com/apache/beam/actions/workflows/IO_Iceberg_Integration_Tests.yml

there are lots of warning logs:

025-01-27T10:28:15.6939911Z     Jan 27, 2025 10:28:15 AM org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector verifyUnmodifiedThrowingCheckedExceptions
2025-01-27T10:28:15.6948028Z     WARNING: Coder of type class org.apache.beam.sdk.schemas.SchemaCoder has a #structuralValue method which does not return true when the encoding of the elements is equal.
Element FileWriteResult{tableIdentifierString=test_db_testStreamToDynamicDestinationsAndKeepFields.test_table_4_e, serializableDataFile=SerializableDataFile{path=gs://managed-iceberg-integration-tests/HiveCatalogIT/390697b2-b28d-4553-87b1-da546d84fb88/test_db_testStreamToDynamicDestinationsAndKeepFields.db/test_table_4_e/data/4ecc656e-c85d-4939-b3e5-5066234c398b_2ac1dfa6-cb8e-461e-a657-6031a62b9575_1.parquet, fileFormat=PARQUET, recordCount=2, fileSizeInBytes=2705, partitionPath=, partitionSpecId=0, keyMetadata=null,
splitOffsets=[4], columnSizes={1=60, 2=56, 4=49, 5=72, 7=49, 8=51, 9=79, 10=50}, valueCounts={1=2, 2=2, 4=2, 5=2, 7=2, 8=2, 9=2, 10=2}, nullValueCounts={1=0, 2=0, 4=0, 5=0, 7=0, 8=0, 9=0, 10=0}, nanValueCounts={8=0}, lowerBounds={1=[B@57bb32b4, 2=[B@5f645f56, 4=[B@6e2a132, 5=[B@4cc2022d, 7=[B@4262b793, 8=[B@3f81de66, 9=[B@2c791395, 10=[B@70f6bf5d}, upperBounds={1=[B@27ff50ff, 2=[B@163cc888, 4=[B@72bd8461, 5=[B@37f4c13c, 7=[B@6a510795, 8=[B@1a59fadf, 9=[B@4d9eb79, 10=[B@153537ff}}}
2025-01-27T10:28:15.6955780Z     Jan 27, 2025 10:28:15 AM org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector verifyUnmodifiedThrowingCheckedExceptions
2025-01-27T10:28:15.6962562Z     WARNING: Coder of type class org.apache.beam.sdk.schemas.SchemaCoder has a #structuralValue method which does not return true when the encoding of the elements is equal.
Element FileWriteResult{tableIdentifierString=test_db_testStreamToDynamicDestinationsAndKeepFields.test_table_0_a, serializableDataFile=SerializableDataFile{path=gs://managed-iceberg-integration-tests/HiveCatalogIT/390697b2-b28d-4553-87b1-da546d84fb88/test_db_testStreamToDynamicDestinationsAndKeepFields.db/test_table_0_a/data/4ecc656e-c85d-4939-b3e5-5066234c398b_148e0654-c6a2-4a3f-a640-bc5e331cafeb_1.parquet,
fileFormat=PARQUET, recordCount=20, fileSizeInBytes=3139, partitionPath=, partitionSpecId=0, keyMetadata=null, splitOffsets=[4], columnSizes={1=104, 2=104, 4=97, 5=124, 7=97, 8=128, 9=128, 10=100}, valueCounts={1=20, 2=20, 4=20, 5=20, 7=20, 8=20, 9=20, 10=20}, nullValueCounts={1=0, 2=0, 4=0, 5=0, 7=0, 8=0, 9=0, 10=0}, nanValueCounts={8=0}, lowerBounds={1=[B@4dbe0ba2, 2=[B@392a4276, 4=[B@61a5970e, 5=[B@646372cd, 7=[B@593d86f8, 8=[B@326f565b, 9=[B@7fbfbaff, 10=[B@355adf}, upperBounds={1=[B@350a1667, 2=[B@7d1f4313, 4=[B@7ff5760d, 5=[B@55bc388e, 7=[B@3060b570, 8=[B@37607fb4, 9=[B@63f1324b, 10=[B@57bd0ef3}}}

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Infrastructure
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[liferoad]

@ahmedabu98

[ahmedabu98]

Should be fixed by #33554

This doesn't solve the flaky issue though

[Abacn]

Should be fixed by #33554

This doesn't solve the flaky issue though

ah nice, missed it. It's already being actively addressed