saketh somaraju (2f07ae3f) at 06 Feb 07:59
update refs
saketh somaraju (51ac6266) at 06 Feb 07:44
Thanks @shivani_karipe for merging this request
shivani karipe (29a74d83) at 04 Jan 04:59
The airflow base image version has been updated from 2.2.4 to 2.4.3, resulting in a reduction in the number of vulnerabilities
less no of vulnerabilities were observed after this upgrade compared to 2.2.4 image
2.2.4 image had a total of 563 vulnerabilities ( link : https://community.opengroup.org/osdu/platform/deployment-and-operations/base-containers-azure/airflow-docker-image/-/jobs/2389174#L3223 )
the 2.4.3 image now exhibits fewer vulnerabilities, totaling 341 ( link: https://community.opengroup.org/osdu/platform/deployment-and-operations/base-containers-azure/airflow-docker-image/-/jobs/2411838#L2364)
This change has been tested with following DAG runs.
shivani karipe (51ac6266) at 04 Jan 04:59
Merge branch 'az/sk-upgrade-airflow' into 'main'
... and 1 more commit
The airflow base image version has been updated from 2.2.4 to 2.4.3, resulting in a reduction in the number of vulnerabilities
less no of vulnerabilities were observed after this upgrade compared to 2.2.4 image
2.2.4 image had a total of 563 vulnerabilities ( link : https://community.opengroup.org/osdu/platform/deployment-and-operations/base-containers-azure/airflow-docker-image/-/jobs/2389174#L3223 )
the 2.4.3 image now exhibits fewer vulnerabilities, totaling 341 ( link: https://community.opengroup.org/osdu/platform/deployment-and-operations/base-containers-azure/airflow-docker-image/-/jobs/2411838#L2364)
This change has been tested with following DAG runs.
David Diederich (6bad0ea5) at 12 Dec 05:48
OSDU Data Platform v0.25.0
David Diederich (15c6e8be) at 10 Dec 21:50
Create Release Branch for version 0.25
saketh somaraju (b54f64fc) at 07 Dec 12:29
Merge branch 'az/sk-vulnerability-scanning' into 'main'
Hi @Srinivasan_Narayanan , yes the pipeline will still fail for container_scanning job because there are still some vulnerabilities left in the upgraded image. These are coming from apache base image itslef. however as mentioned in the MR, 2.2.4 has 563 vulnerabilities where as with current MR targeted version, 2.4.3 image, has 342 vulnerabilities.
Hi @shivani_karipe Pipeline is failing while container scanning. Plz look into. Thx
The airflow base image version has been updated from 2.2.4 to 2.4.3, resulting in a reduction in the number of vulnerabilities
less no of vulnerabilities were observed after this upgrade compared to 2.2.4 image
2.2.4 image had a total of 563 vulnerabilities ( link : https://community.opengroup.org/osdu/platform/deployment-and-operations/base-containers-azure/airflow-docker-image/-/jobs/2389174#L3223 )
the 2.4.3 image now exhibits fewer vulnerabilities, totaling 341 ( link: https://community.opengroup.org/osdu/platform/deployment-and-operations/base-containers-azure/airflow-docker-image/-/jobs/2411838#L2364)
This change has been tested with following DAG runs.
shivani karipe (29a74d83) at 29 Nov 14:11
deleted unused packages
shivani karipe (6bed68cd) at 29 Nov 11:12
test with apache/airflow:slim-2.4.3-python3.8
shivani karipe (4aa2bd7c) at 29 Nov 11:11
test with apache/airflow:2.4.3-python3.8
shivani karipe (703efac2) at 29 Nov 11:06
test with apache/airflow:2.4.3-python3.10
shivani karipe (712d17a0) at 29 Nov 11:05
test with apache/airflow:2.4.3-python3.9
shivani karipe (9a137f0e) at 29 Nov 10:56
test
shivani karipe (f709bd9a) at 29 Nov 10:54
upgrading airflow to 2.4.3