Skip to content

Add option to skip manifest uploads#560

Open
alina-atomskaya wants to merge 1 commit into
brooklyn-data:mainfrom
alina-atomskaya:feat/upload-manifest-flag-main
Open

Add option to skip manifest uploads#560
alina-atomskaya wants to merge 1 commit into
brooklyn-data:mainfrom
alina-atomskaya:feat/upload-manifest-flag-main

Conversation

@alina-atomskaya

Copy link
Copy Markdown

Update type - breaking / non-breaking

  • Minor bug fix
  • Documentation improvements
  • Quality of Life improvements
  • New features (non-breaking change)
  • New features (breaking change)
  • Other (non-breaking change)
  • Other (breaking change)
  • Release preparation

What does this solve?

Adds a new dbt_artifacts_upload_manifest var to optionally skip manifest dataset uploads on routine runs.

By default, the var is true, so the current behavior is preserved.

When set to false, dbt_artifacts skips uploading manifest datasets:

  • models
  • sources
  • tests
  • seeds
  • snapshots
  • exposures

invocations and execution datasets are still uploaded.

This is useful for scheduled/routine runs where project metadata does not change every time, but execution results still need to be recorded.

Outstanding questions

No outstanding questions.

Local integration tests were not run because Docker is not available on my machine.

What databases have you tested with?

  • Snowflake
  • Google BigQuery
  • Databricks
  • Postgres
  • Trino
  • SQL Server

Testing

  • git diff --check passed
  • ./scripts/ci/setup.sh passed
  • ./scripts/ci/test.sh trino passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant