Skip to content

Consolidate copied lib code to single artifact, use dataset optionally, aws changes

Spencer Sutton requested to merge aws-integration into master

We need to not be copying lib code across dags but instead referencing them from a single artifact from the python sdk location.

This MR contains those changes.

Additionally, this has a change that will optionally use dataset service if a dataset_id is passed into the dag.

Merge request reports