Elastic 7

ElasticSearch 7.8.1 for indexer service

added GC label

mentioned in issue home#67 (closed)

added AWS Azure IBM labels

@osdu/platform/roles/core-contributors to review Elastic 7 migration changes

added Common Code label

added 1 commit

• a98572ae - Update pom.xml

Compare with previous version

resolved all threads

@Stanislav_Riabokon please take a look at integration tests

added 142 commits

• a98572ae...b34ffdce - 141 commits from branch master
• 07086a80 - Merge remote-tracking branch 'origin/master' into elastic_7

Compare with previous version

@Stanislav_Riabokon, @rostislav.dublin please merge with latest changes in master

locked this merge request

unlocked this merge request

added 12 commits

• 07086a80...24f5206c - 11 commits from branch master
• 4322e8a5 - Merge remote-tracking branch 'origin/master' into elastic_7

Compare with previous version

@Stanislav_Riabokon

1. Are there any corresponding/similar changes in core-common and search related to elastic 7? Is there any common issue tracking all elastic 7 dependent changes in all module/changes at one place.
2. Are these changes backward compatible to 6.8.1 or 6.8.3 by any chance?

1. Only Search has similar changes for elastic 7. If you are interested, you can take a look at search-service!70 (merged)
2. Elastic 7.8.1 has another Java API in comparison with 6.8.1 or 6.8.3. There are some findings:

Record with location should be:

"data": {
        "Field": "OSDU OFFICE - 3",
        "Location": "29.749655,-95.473476",

OR

 "Location": {
        "lat":18.5204,
        "lon":73.8567
      }

OR "location" : [-71.34, 41.12]

https://www.elastic.co/guide/en/elasticsearch/reference/1.7/mapping-geo-point-type.html

A new schema for indexes:

{
"dynamic":false,
		"properties": {
			"id": {
				"type": "keyword"
			},
			"kind": {
				"type": "keyword"
			},
			"namespace": {
				"type": "keyword"
			},
			"type": {
				"type": "keyword"
			},
			"version": {
				"type": "keyword"
			},
			"x-acl": {
				"type": "keyword"
			},
			"acl": {
				"properties": {
					"owners": {
						"type": "keyword"
					},
					"viewers": {
						"type": "keyword"
					}
				}
			},
			"legal": {
				"properties": {
					"legaltags": {
						"type": "keyword"
					},
					"otherRelevantDataCountries": {
						"type": "keyword"
					},
					"status": {
						"type": "keyword"
					}
				}
			},
			"data": {
				"properties": {
					"Field": {
						"type": "text"
					},
					"Location": {
						"type": "geo_point"
					},
					"LocationGeoShape": {
					    "type": "geo_shape"
					},
					"Basin": {
						"type": "text"
					},
					"County": {
						"type": "text"
					},
					"State": {
						"type": "text"
					},
					"Country": {
						"type": "text"
					},
					"WellStatus": {
						"type": "text"
					},
					"OriginalOperator": {
						"type": "text"
					},
					"WellName": {
						"type": "text"
					},
					"WellType": {
						"type": "text"
					},
					"EmptyAttribute": {
						"type": "text"
					},
					"Rank": {
						"type": "integer"
					},
					"Score": {
						"type": "integer"
					},
					"Established": {
						"type": "date"
					}
				}
			}
		}
}

For information: https://www.elastic.co/guide/en/elasticsearch/reference/current/removal-of-types.html

added 10 commits

• 4322e8a5...af0d36ee - 8 commits from branch master
• d6cba616 - Merge branch 'elastic_7' of...
• 08bdcaeb - upgrade test version to 0.0.3 and elastic version in test poms

Compare with previous version

added M4 label

added 1 deleted label

removed 1 deleted label

added no-detached-pipeline label