cherry-pick-97fc9e14 to release/0.16

Type of change

• Bug Fix
• Feature

Does this introduce a change in the cloud provider implementation, if so which cloud?

• AWS
• Azure
• GCP
• IBM

Updates description?

• Fixed zgy convertation dag render process
• Upgraded zgy pipeline
• Upgraded with MCR (Microsoft Container Registry) [Azure compliant]
• Integrated common azure dag pipeline
• Added e2e testing

Origianl MR: !105 (merged)