move configs to models subfolder #6868
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
github-actions
bot
added
content
| @@ -3,14 +3,14 @@ title: "lookback" | |||
| id: "lookback" | |||
| sidebar_label: "lookback" | |||
| resource_types: [models] | |||
| description: "dbt uses `lookback` to detrmine how many 'batches' of `batch_size` to reprocesses when a microbatch incremental model is running incrementally." | |||
| description: "dbt uses `lookback` to determine how many 'batches' of `batch_size` to reprocess when a microbatch incremental model is running incrementally." | |||
| datatype: int | |||
| --- | |||
|
|
|||
| <VersionCallout version="1.9" /> | |||
There was a problem hiding this comment.
Doesn't need to be addressed with this PR but this renders as "Available from dbt v1.9 or with the dbt Cloud "Latest" release track" but the "Compatible" release track is v1.9, so wouldn't it be available there too? Maybe I'm overanalyzing, but it seems confusing
| <VersionCallout version="1.9" /> | |
| <VersionCallout version="1.9" /> |
| datatype: int | ||
| --- | ||
|
|
||
| <VersionCallout version="1.9" /> | ||
| ## Definition | ||
|
|
||
| Set the `lookback` to an integer greater than or equal to zero. The default value is `1`. You can configure `lookback` for a [model](/docs/build/models) in your `dbt_project.yml` file, property YAML file, or config block. | ||
| Set the `lookback` to an integer greater than or equal to zero. The default value is `1`. You can configure `lookback` for a [microbatch incremental model](/docs/build/incremental-microbatch) in your `dbt_project.yml` file, property YAML file, or config block. |
There was a problem hiding this comment.
Maybe nitpicking but this section doesn't actually define what "lookback" is.
There was a problem hiding this comment.
ah i didn't write this and i think it was merged in this pr that you worked with Quigley on but i'm happy to define it in this pr
There was a problem hiding this comment.
will add:
Configure a
lookbackwindow to reprocess additional batches during microbatch incremental model runs. It processes X batches up to the latest bookmark (the last successfully processed data point) to capture late-arriving records.
Set the
lookbackto an integer greater than or equal to zero. The default value is1. You can configurelookbackfor a microbatch incremental model n yourdbt_project.ymlfile, property YAML file, or config block.
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
define lookback
Co-authored-by: Matt Shaver <[email protected]>
|
Check your created Crawler Check your created index on your Algolia Application |
this pr movesbatch_size and begin and lookback under “For models” subfolder (alongside concurrent_batches). previously they were listed under “General configs”. also replced config block example label from 'sql file' to 'Config block'.
raised by Grace in internal slack
🚀 Deployment available! Here are the direct links to the updated files: