Code

Sample Mode Alpha#11247

Code

Merged

QMalcolm merged 20 commits intomaindbt-labs/dbt-core:mainfrom qmalcolm--sample-mode-alphadbt-labs/dbt-core:qmalcolm--sample-mode-alphaCopy head branch name to clipboardFeb 4, 2025

+1,040-22

Commits

Commits on Jan 31, 2025

• Add --sample flag to run command

  QMalcolm

  committed
  1faa8b7

  Copy full SHA for 1faa8b7

• Remove no longer needed if statement around EventTimeFilter creation for microbatch models

  Show description for 2394402
  QMalcolm

  committed
  2394402

  Copy full SHA for 2394402

• Get sample mode working with --event-time-start/end

  Show description for 25fb1e5
  QMalcolm

  committed
  25fb1e5

  Copy full SHA for 25fb1e5

• Begin using --sample-window for sample mode instead of --event-time-start/end

  Show description for 6f68797
  QMalcolm

  committed
  6f68797

  Copy full SHA for 6f68797

• Move SampleWindow class to sample_window.py in event_time submodule

  Show description for 6bcb328
  QMalcolm

  committed
  6bcb328

  Copy full SHA for 6bcb328

• Create an offset_timestamp separate from MicrobatchBuilder

  Show description for d6f113f
  QMalcolm

  committed
  d6f113f

  Copy full SHA for d6f113f

• Add types-python-dateutil to dev requirements

  Show description for c547617
  QMalcolm

  committed
  c547617

  Copy full SHA for c547617

• Begin supporting microbatch models in sample mode

  QMalcolm

  committed
  cf5bfd6

  Copy full SHA for cf5bfd6

• Move parsing logic of SampleWindowType to SampleWindow

  QMalcolm

  committed
  a8cbec2

  Copy full SHA for a8cbec2

• Allow for specificaion of "specific" sample windows

  Show description for fb64b00
  QMalcolm

  committed
  fb64b00

  Copy full SHA for fb64b00

• Fix tests of BaseResolver.resolve_event_time_filter for sample mode changes

  QMalcolm

  committed
  10674f7

  Copy full SHA for 10674f7

• Add --no-sample as it's necessary for retry

  QMalcolm

  committed
  7e86080

  Copy full SHA for 7e86080

• Add guards to accessing of sample and sample_window

  Show description for 2942861
  QMalcolm

  committed
  2942861

  Copy full SHA for 2942861

• Gate sample mode functionality via env var DBT_EXPERIMENTAL_SAMPLE_MODE

  Show description for 1811754
  QMalcolm

  committed
  1811754

  Copy full SHA for 1811754

Commits on Feb 2, 2025

• Add sample mode tests for incremental models

  QMalcolm

  committed
  719b550

  Copy full SHA for 719b550

• Add changie doc for sample mode initial implementation

  QMalcolm

  committed
  01ae64f

  Copy full SHA for 01ae64f

Commits on Feb 3, 2025

• Fixup sample mode functional tests

  Show description for 5c51a6f
  QMalcolm

  committed
  5c51a6f

  Copy full SHA for 5c51a6f

• Ensure microbatch creates correct number of batches when sample mode env var isn't present

  Show description for 3c5539b
  QMalcolm

  committed
  3c5539b

  Copy full SHA for 3c5539b

• Correct comment in SampleWindow post serialization method

  QMalcolm

  committed
  6d001d7

  Copy full SHA for 6d001d7

• Hide CLI sample mode options

  Show description for 1ef8b3f
  QMalcolm

  committed
  1ef8b3f

  Copy full SHA for 1ef8b3f