Releases: astronomer/astronomer-cosmos
Releases · astronomer/astronomer-cosmos
v1.2.0
Features
- Add support to model versioning available since dbt 1.6 by @binhnq94 in #516
- Add AWS Athena profile mapping by @benjamin-awd in #578
- Support customizing how dbt nodes are converted to Airflow by @tatiana in #503
- Make the arg
dbt_project_path
in theProjectConfig
optional by @MrBones757 in #581
Bug fixes
- Fix Cosmos custom selector to support filtering a single model by @jlaneve and @harels in #576
- Fix using
GoogleCloudServiceAccountDictProfileMapping
together withLoadMethod.DBT_LS
by @joppevos in #587 - Fix using the
full_refresh
argument in projects that contain tests by @EgorSemenov and @tatiana in #590 - Stop creating symbolic links for
dbt_packages
(solvesLocalExecutor
concurrency issue) by @tatiana in #600
Others
v1.2.0a1
v1.1.3
Bug fixes
- Only create task group and test task only if the model has a test by @raffifu in #543
- Fix parsing test nodes when using the custom load method (
LoadMethod.CUSTOM
) by @raffifu in #563 - Fix
DbtTestOperator
when test does not havetest_metadata
by @javihernovoa and @tatiana in #565 - Support dbt 1.6 and
apache-airflow-providers-cncf-kubernetes
7.3.0 by @tatiana in #564
v1.1.2
Bug fixes
- Fix using
ExecutionMode.KUBERNETES
by @pgoslatara and @tatiana in #554 - Add support to
apache-airflow-providers-cncf-kubernetes < 7.4.0
by @tatiana in #553 - Fix
on_warning_callback
behaviour onDbtTestLocalOperator
by @edgga, @marco9663 and @tatiana in #558 - Use
returncode
instead ofstderr
to determine dbt graph loading errors by @cliff-lau-cloverhealth in #547 - Improve error message in
config.py
by @meyobagero in #532 - Fix
DbtTestOperator
when test does not havetest_metadata
by @tatiana in #558 - Fix
target-path
not specified issue indbt-project.yml
by @tatiana in #533
Others
v1.1.1
Bug fixes
- Remove redundant prefix of task names when
test_behavior = TestBehavior.AFTER_EACH
by @binhnq94 in #524 - Fix rendering vars in
DbtModel
when usingLoadMode.CUSTOM
by @dojinkimm in #502 - Fix attempt of emitting OpenLineage events if task execution fails by @tatiana in #526
- Fix Rust dependency for Windows users by @tatiana in #526
- Fix
DbtRunOperationLocalOperator
missing flags by @tatiana in #529 - Fix
DbtRunLocalOperator
to support the full refresh argument by @tatiana in #529
Others
- Docs: Comparison of concepts in dbt and Airflow by @tatiana in #523.
- Update PyPI project links by @tatiana in #528
- pre-commit updates
v1.1.1a1
Full Changelog: astronomer-cosmos-v1.1.1...astronomer-cosmos-v1.1.1a1
v1.1.0
Features
- Support dbt global flags (via dbt_cmd_global_flags in operator_args) by @tatiana in #469
- Support parsing DAGs when there are no connections by @jlaneve in #489
Enhancements
- Hide sensitive field when using BigQuery keyfile_dict profile mapping by @jbandoro in #471
- Consistent Airflow Dataset URIs, inlets and outlets with
Openlineage package <https://pypi.org/project/openlineage-integration-common/>
_ by @tatiana in #485.Read more <https://astronomer.github.io/astronomer-cosmos/configuration/lineage.html>
_. - Refactor
LoadMethod.DBT_LS
to run from a temporary directory with symbolic links by @tatiana in #488 - Run
dbt deps
when usingLoadMethod.DBT_LS
by @DanMawdsleyBA in #481 - Update Cosmos log color to purple by @harels in #494
- Change operators to log
dbt
commands output as opposed to recording to XCom by @tatiana in #513
Bug fixes
- Fix bug on select node add exclude selector subset ids logic by @jensenity in #463
- Refactor dbt ls to run from a temporary directory, to avoid Read-only file system errors during DAG parsing, by @tatiana in #414
- Fix profile_config arg in DbtKubernetesBaseOperator by @david-mag in #505
- Fix SnowflakePrivateKeyPemProfileMapping private_key reference by @nacpacheco in #501
- Fix incorrect temporary directory creation in VirtualenvOperator init by @tatiana in #500
- Fix log propagation issue by @tatiana in #498
- Fix PostgresUserPasswordProfileMapping to retrieve port from connection by @jlneve in #511
Others
- Docs: Fix RenderConfig load argument by @jbandoro in #466
- Enable CI integration tests from external forks by @tatiana in #458
- Improve CI tests runtime by @tatiana in #457
- Change CI to run coverage after tests pass by @tatiana in #461
- Fix forks code revision in code coverage by @tatiana in #472
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #467
- Drop support to Python 3.7 in the CI test matrix by @harels in #490
- Add Airflow 2.7 to the CI test matrix by @tatiana in #487
- Add MyPy type checks to CI since we exceeded pre-commit disk quota usage by @tatiana in #510
v1.1.0a2
v1.1.0a1
Feature (pending documentation!)
Enhancements
Bug fixes
- Fix bug on select node add exclude selector subset ids logic by @jensenity in #463
- Refactor dbt ls to run from a temporary directory to avoid Read-only file system errors during DAG parsing, by @tatiana in #414
Others
- Docs: Fix RenderConfig load argument by @jbandoro in #466
- Enable CI integration tests from external forks by @tatiana in #458
- Improve CI tests runtime by @tatiana in #457
- Change CI to run coverage after tests pass by @tatiana in #461
- Fix forks code revision in code coverage by @tatiana in #472
- [pre-commit.ci] pre-commit auto-update by @pre-commit-ci in #467
v1.4.0a3
Features
- Add dbt docs natively in Airflow via plugin by @dwreeves in #737
- Add support for
InvocationMode.DBT_RUNNER
for local execution mode by @jbandoro in #850 - Support partial parsing to render DAGs faster when using
ExecutionMode.LOCAL
,ExecutionMode.VIRTUALENV
andLoadMode.DBT_LS
by @dwreeves in #800 - Improve performance by 22-35% or more by caching partial parse artefact by @tatiana in #904
- Add Azure Container Instance as Execution Mode by @danielvdende in #771
- Add dbt build operators by @dylanharper-qz in #795
- Add dbt profile config variables to mapped profile by @ykuc in #794
- Add more template fields to
DbtBaseOperator
by @dwreeves in #786 - Add
pip_install_options
argument to operators by @octiva in #808
Bug fixes
- Make
PostgresUserPasswordProfileMapping
schema argument optional by @FouziaTariq in #683 - Fix
folder_dir
not showing on logs forDbtDocsS3LocalOperator
by @PrimOox in #856 - Improve
dbt ls
parsing resilience to missing tags/config by @tatiana in #859 - Fix
operator_args
modified in place in Airflow converter by @jbandoro in #835 - Fix Docker and Kubernetes operators execute method resolution by @jbandoro in #849
- Fix
TrinoBaseProfileMapping
required parameter for non method authentication by @AlexandrKhabarov in #921 - Fix global flags for lists by @ms32035 in #863
- Fix
GoogleCloudServiceAccountDictProfileMapping
when getting values from the Airflow connectionextra__
keys by @glebkrapivin in #923 - Fix using the dag as a keyword argument as
specific_args_keys
in DbtTaskGroup by @tboutaour in #916 - Fix ACI integration (
DbtAzureContainerInstanceBaseOperator
) by @danielvdende in #872 - Fix setting dbt project dir to the tmp dir by @dwreeves in #873
- Fix dbt docs operator to not use
graph.gpickle
file when--no-write-json
is passed by @dwreeves in #883 - Make Pydantic a required dependency by @pankajkoti in #939
Docs
- Fix docs homepage link by @jlaneve in #860
- Fix docs
ExecutionConfig.dbt_project_path
by @jbandoro in #847 - Fix typo in MWAA getting started guide by @jlaneve in #846
- Fix typo related to exporting docs to GCS by @tboutaour in #922
- Improve partial parsing docs by @tatiana in #898
- Improve docs for datasets for airflow >= 2.4 by @SiddiqueAhmad in #879
- Improve test behaviour docs to highlight
warning
feature in thevirtualenv
mode by @mc51 in #910 - Fix docs typo by @SiddiqueAhmad in #917
Others
- Add performance integration tests by @jlaneve in #827
- Enable
append_env
inoperator_args
by default by @tatiana in #899 - Expose the
dbt
graph in theDbtToAirflowConverter
class by @tommyjxl in #886 - Improve dbt docs plugin rendering padding by @dwreeves in #876
- Add
connect_retries
to databricks profile to fix expensive integration failures by @jbandoro in #826 - Add import sorting (isort) to Cosmos by @jbandoro in #866
- Add Python 3.11 to CI/tests by @tatiana and @jbandoro in #821, #824 and #825
- Fix failing
test_created_pod
forapache-airflow-providers-cncf-kubernetes
after v8.0.0 update by @jbandoro in #854 - Extend
DatabricksTokenProfileMapping
test to include session properties by @tatiana in #858 - Fix broken integration test uncovered from Pytest 8.0 update by @jbandoro in #845
- Replace deprecated
DummyOperator
byEmptyOperator
if Airflow >=2.4.0 by @tatiana in #900 - Add Apache Airflow 2.9 to the test matrix by @tatiana in #940
- Improve DEBUG logs when creating Datasets
- Pre-commit hook updates in #820, #834, #843 and #852, #890, #896, #901, #905, #908, #919, #931, #941