Skip to content

standardize azure related dag implementation

saketh somaraju requested to merge az/sa-test-publish into master

Type of change

  • Bug Fix
  • Feature

Does this introduce a change in the core logic?

  • [No]

Does this introduce a change in the cloud provider implementation, if so which cloud?

  • AWS
  • Azure
  • GCP
  • IBM

Current Configuration.

  • No Azure publish job
  • GIT SHA is appended to csv parser dag name, which in turn creates a new dag for each commit
  • Dag task image naming convention is not uniform with other repositories.
  • Docker image is hardcoded in dag zip artifact.

Updates description?

  • Add Azure publish job to publish dag task image to msosdu ACR.
  • GIT SHA appending is removed from to csv parser dag name.
  • Update dag task image naming convention to make sure it is uniform with other dag repositories.
  • Variabilize docker image in azure dag zip artifact, such that image tag is taken from airflow variables.

Related to osdu/platform/ci-cd-pipelines!1044 (merged)

Edited by saketh somaraju

Merge request reports