Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Log elapsed_time for sql file upload/download (#1536)
Add logs to records the upload and download time for the SQL files on the remote storage **Upload logs** ``` [2025-02-12, 14:40:48 UTC] {logging_mixin.py:190} INFO - 14:40:48 Completed successfully [2025-02-12, 14:40:48 UTC] {logging_mixin.py:190} INFO - 14:40:48 [2025-02-12, 14:40:48 UTC] {logging_mixin.py:190} INFO - 14:40:48 Done. PASS=5 WARN=0 ERROR=0 SKIP=0 TOTAL=5 [2025-02-12, 14:40:50 UTC] {local.py:196} WARNING - Artifact schema version: https://schemas.getdbt.com/dbt/manifest/v12.json is above dbt-ol supported version 7. This might cause errors. [2025-02-12, 14:40:50 UTC] {connection.py:277} WARNING - Connection schemes (type: google_cloud_platform) shall not contain '_' according to RFC3986. [2025-02-12, 14:40:50 UTC] {base.py:84} INFO - Retrieving connection 'gcp_gs_conn' [2025-02-12, 14:41:03 UTC] {local.py:339} INFO - SQL file upload completed in 12.52 seconds. ``` **Download logs:** ``` [2025-02-12, 14:41:25 UTC] {connection.py:277} WARNING - Connection schemes (type: google_cloud_platform) shall not contain '_' according to RFC3986. [2025-02-12, 14:41:25 UTC] {base.py:84} INFO - Retrieving connection 'gcp_gs_conn' [2025-02-12, 14:41:27 UTC] {bigquery.py:126} INFO - SQL file download completed in 2.43 seconds. [2025-02-12, 14:41:27 UTC] {baseoperator.py:416} WARNING - DbtRunAirflowAsyncOperator.execute cannot be called outside TaskInstance! [2025-02-12, 14:41:27 UTC] {connection.py:277} WARNING - Connection schemes (type: google_cloud_platform) shall not contain '_' according to RFC3986. [2025-02-12, 14:41:27 UTC] {base.py:84} INFO - Retrieving connection 'gcp_gs_conn' ``` closes: #1522
- Loading branch information