Code

[Managed Iceberg] unbounded source#33504

Code

Open

ahmedabu98 wants to merge 18 commits intoapache:masterapache/beam:masterfrom ahmedabu98:iceberg_streaming_sourceahmedabu98/beam:iceberg_streaming_sourceCopy head branch name to clipboard

+2,053-327

Commits

Commits on Jan 6, 2025

• initial

  ahmedabu98

  committed
  bb87511

  Copy full SHA for bb87511

Commits on Jan 7, 2025

• let CombinedScanTask do splitting (based on Parquet row groups)

  ahmedabu98

  committed
  853de4d

  Copy full SHA for 853de4d

• perf improv

  ahmedabu98

  committed
  69fd988

  Copy full SHA for 69fd988

Commits on Jan 8, 2025

• create one read task descriptor per snapshot range

  ahmedabu98

  committed
  da2f33f

  Copy full SHA for da2f33f

Commits on Jan 22, 2025

• Merge branch 'master' of https://github.com/ahmedabu98/beam into iceberg_streaming_source

  ahmedabu98

  committed
  73c8992

  Copy full SHA for 73c8992

Commits on Jan 25, 2025

• some improvements

  ahmedabu98

  committed
  81ca709

  Copy full SHA for 81ca709

Commits on Jan 30, 2025

• use GiB for streaming, Redistribute for batch; update docs

  ahmedabu98

  committed
  e319d76

  Copy full SHA for e319d76

• Merge branch 'master' of https://github.com/ahmedabu98/beam into iceberg_streaming_source

  ahmedabu98

  committed
  c25cd75

  Copy full SHA for c25cd75

Commits on Feb 3, 2025

• use static value

  ahmedabu98

  committed
  af1ec85

  Copy full SHA for af1ec85

• add some test

  ahmedabu98

  committed
  f5d3268

  Copy full SHA for f5d3268

• Merge branch 'master' of https://github.com/ahmedabu98/beam into iceberg_streaming_source

  ahmedabu98

  committed
  df40239

  Copy full SHA for df40239

Commits on Feb 4, 2025

• Merge branch 'master' of https://github.com/ahmedabu98/beam into iceberg_streaming_source

  ahmedabu98

  committed
  43ab88f

  Copy full SHA for 43ab88f

Commits on Feb 7, 2025

• Merge branch 'master' of https://github.com/ahmedabu98/beam into iceberg_streaming_source

  ahmedabu98

  committed
  20db0ee

  Copy full SHA for 20db0ee

Commits on Feb 10, 2025

• add a java doc; don't use static block to create coder

  ahmedabu98

  committed
  622625f

  Copy full SHA for 622625f

• spotless

  ahmedabu98

  committed
  4c25d3f

  Copy full SHA for 4c25d3f

Commits on Feb 13, 2025

• add options: from/to timestamp, starting strategy, and streaming toggle

  ahmedabu98

  committed
  8666166

  Copy full SHA for 8666166

• trigger integration tests

  ahmedabu98

  committed
  297c309

  Copy full SHA for 297c309

• small test fix

  ahmedabu98

  committed
  5e3a2cc

  Copy full SHA for 5e3a2cc