Full Upgrade of First Party Library Dependencies for Release 0.20 (!482) · Merge requests · OSDU Software / OSDU Data Platform / System / Search

David Diederich requested to merge dependency-upgrade-2 into master Apr 11, 2023

This generated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release. The intent is to try to fully upgrade all dependent libraries to see if the latest code will work. It is expected that these will often fail, since the upgrades were previously rejected for failing pipelines and have not been directly addressed yet. This upgrade should only be merged in the CI pipeline reports success.

If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library. But significant upgrade efforts should not occur on this MR, as part of the release tagging process. Instead, significant work should be scheduled for a subsequent milestone.

This MR may co-exist with a separate, smaller upgrade MR. If both pass, this one should be used instead.

Dependency Information Before the Upgrade

Branch: master
SHA:    f702c5b2dbdc62ccc66d1b8177510493c56fb7df
Maven:  0.21.0-SNAPSHOT

Maven Dependencies	Root	testing/integration-tests/
core-lib-azure	0.20.0-rc5	0.13.0-rc6
core-lib-gcp	0.19.0-rc3
os-core-lib-aws	0.21.0-rc1	0.21.0-rc1
obm	0.18.0
oqm	0.18.0
os-core-common	0.20.0-rc1, 0.19.0	0.19.0
os-core-lib-ibm	0.16.0-rc1	0.15.2
osm	0.18.0
(3rd Party) org.apache.logging.log4j.log4j-api	2.17.1	2.11.1, 2.13.3
(3rd Party) org.apache.logging.log4j.log4j-core	2.17.1	2.13.3
(3rd Party) org.apache.logging.log4j.log4j-jul	2.17.1	2.13.3
(3rd Party) org.apache.logging.log4j.log4j-slf4j-impl	2.17.1	2.13.3
(3rd Party) org.apache.logging.log4j.log4j-to-slf4j	2.17.1	2.11.2
(3rd Party) org.yaml.snakeyaml	1.33	1.26

Critical: Found Vulnerable Snake YAML dependency (<2.0)
├─ _Root_
│  ├─ org.projectlombok.lombok == 1.18.8
│  │  └─ org.opengroup.osdu.os-core-common == 0.20.0-rc1
│  │     └─ org.springframework.boot.spring-boot-starter-web == 2.6.6
│  │        └─ org.springframework.boot.spring-boot-starter == 2.7.7
│  │           └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-core == 0.21.0-SNAPSHOT
│  │  └─ org.springframework.boot.spring-boot-starter-security == 2.7.7
│  │     └─ org.springframework.boot.spring-boot-starter == 2.7.7
│  │        └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-byoc == 0.21.0-SNAPSHOT
│  │  └─ pl.allegro.tech.embedded-elasticsearch == 2.10.0
│  │     └─ com.fasterxml.jackson.dataformat.jackson-dataformat-yaml == 2.14.1
│  │        └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-gc == 0.21.0-SNAPSHOT
│  │  └─ org.elasticsearch.elasticsearch == 7.8.1
│  │     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│  │        └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-aws == 0.21.0-SNAPSHOT
│  │  └─ org.springframework.boot.spring-boot-starter-security == 2.7.7
│  │     └─ org.springframework.boot.spring-boot-starter == 2.7.7
│  │        └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-azure == 0.21.0-SNAPSHOT
│  │  └─ org.opengroup.osdu.core-lib-azure == 0.20.0-rc5
│  │     └─ org.redisson.redisson == 3.15.3
│  │        └─ org.yaml.snakeyaml == 1.33
│  └─ org.opengroup.osdu.search-ibm == 0.21.0-SNAPSHOT
│     └─ org.yaml.snakeyaml == 1.33
└─ testing/integration-tests/
├─ org.opengroup.osdu.search.search-test-core == 0.21.0-SNAPSHOT
│  └─ org.elasticsearch.elasticsearch == 7.8.1
│     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│        └─ org.yaml.snakeyaml == 1.26
├─ org.opengroup.osdu.search.search-test-aws == 0.21.0-SNAPSHOT
│  └─ org.elasticsearch.elasticsearch == 7.8.1
│     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│        └─ org.yaml.snakeyaml == 1.26
├─ org.opengroup.osdu.search.search-test-azure == 0.21.0-SNAPSHOT
│  └─ org.elasticsearch.elasticsearch == 7.8.1
│     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│        └─ org.yaml.snakeyaml == 1.26
├─ org.opengroup.osdu.search.search-test-gc == 0.21.0-SNAPSHOT
│  └─ org.elasticsearch.elasticsearch == 7.8.1
│     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│        └─ org.yaml.snakeyaml == 1.26
├─ org.opengroup.osdu.search.search-test-ibm == 0.21.0-SNAPSHOT
│  └─ org.elasticsearch.elasticsearch == 7.8.1
│     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│        └─ org.yaml.snakeyaml == 1.26
└─ org.opengroup.osdu.search.search-test-anthos == 0.21.0-SNAPSHOT
└─ org.elasticsearch.elasticsearch == 7.8.1
└─ org.elasticsearch.elasticsearch-x-content == 7.8.1
└─ org.yaml.snakeyaml == 1.26

Dependency Information After the Upgrade

Branch: dependency-upgrade-2
SHA:    f0dded7025b346166af1015cd2cd7bebc050f8a4
Maven:  0.21.0-SNAPSHOT

Maven Dependencies	Root	testing/integration-tests/
core-lib-azure	0.20.0	0.20.0
core-lib-gc	0.20.0
os-core-lib-aws	0.21.0-rc2	0.21.0-rc2
obm	0.20.0
oqm	0.20.0
os-core-common	0.20.1	0.20.1
os-core-lib-ibm	0.20.0	0.20.0
osm	0.20.0
(3rd Party) org.apache.logging.log4j.log4j-api	2.17.1	2.11.1, 2.13.3
(3rd Party) org.apache.logging.log4j.log4j-core	2.17.1	2.13.3
(3rd Party) org.apache.logging.log4j.log4j-to-slf4j	2.17.1	2.11.2
(3rd Party) org.yaml.snakeyaml	1.33	1.26, 1.27, 2.0

Critical: Found Vulnerable Snake YAML dependency (<2.0)
├─ _Root_
│  ├─ org.projectlombok.lombok == 1.18.8
│  │  └─ org.opengroup.osdu.os-core-common == 0.20.1
│  │     └─ org.springframework.boot.spring-boot-starter-web == 2.6.6
│  │        └─ org.springframework.boot.spring-boot-starter == 2.7.7
│  │           └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-core == 0.21.0-SNAPSHOT
│  │  └─ org.springframework.boot.spring-boot-starter-security == 2.7.7
│  │     └─ org.springframework.boot.spring-boot-starter == 2.7.7
│  │        └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-byoc == 0.21.0-SNAPSHOT
│  │  └─ pl.allegro.tech.embedded-elasticsearch == 2.10.0
│  │     └─ com.fasterxml.jackson.dataformat.jackson-dataformat-yaml == 2.14.1
│  │        └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-gc == 0.21.0-SNAPSHOT
│  │  └─ org.elasticsearch.elasticsearch == 7.8.1
│  │     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│  │        └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-aws == 0.21.0-SNAPSHOT
│  │  └─ org.springframework.boot.spring-boot-starter-security == 2.7.7
│  │     └─ org.springframework.boot.spring-boot-starter == 2.7.7
│  │        └─ org.yaml.snakeyaml == 1.33
│  ├─ org.opengroup.osdu.search-azure == 0.21.0-SNAPSHOT
│  │  └─ org.opengroup.osdu.core-lib-azure == 0.20.0
│  │     └─ org.redisson.redisson == 3.15.3
│  │        └─ org.yaml.snakeyaml == 1.33
│  └─ org.opengroup.osdu.search-ibm == 0.21.0-SNAPSHOT
│     └─ org.yaml.snakeyaml == 1.33
└─ testing/integration-tests/
├─ org.opengroup.osdu.search.search-test-core == 0.21.0-SNAPSHOT
│  └─ org.elasticsearch.elasticsearch == 7.8.1
│     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│        └─ org.yaml.snakeyaml == 1.26
├─ org.opengroup.osdu.search.search-test-aws == 0.21.0-SNAPSHOT
│  └─ org.elasticsearch.elasticsearch == 7.8.1
│     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│        └─ org.yaml.snakeyaml == 1.26
├─ org.opengroup.osdu.search.search-test-azure == 0.21.0-SNAPSHOT
│  └─ org.opengroup.osdu.core-lib-azure == 0.20.0
│     └─ org.redisson.redisson == 3.15.3
│        └─ org.yaml.snakeyaml == 1.27
├─ org.opengroup.osdu.search.search-test-gc == 0.21.0-SNAPSHOT
│  └─ org.elasticsearch.elasticsearch == 7.8.1
│     └─ org.elasticsearch.elasticsearch-x-content == 7.8.1
│        └─ org.yaml.snakeyaml == 1.26
└─ org.opengroup.osdu.search.search-test-anthos == 0.21.0-SNAPSHOT
└─ org.elasticsearch.elasticsearch == 7.8.1
└─ org.elasticsearch.elasticsearch-x-content == 7.8.1
└─ org.yaml.snakeyaml == 1.26

Admin message

Full Upgrade of First Party Library Dependencies for Release 0.20

Dependency Information Before the Upgrade

Dependency Information After the Upgrade

Merge request reports