add support for feature-collection indexing
Data Definition team has harmonized the geo-shape payload on bulk-records. Any records that has geo-shape, must be GeoJson and must conform to the schema mentioned here. All shapes must be put in FeatureCollection.
Earlier implementation of indexer service was missing this key shape hence geo-shape indexing and search workflows was broken.
This MR adds support for FeatureCollection indexing. It also adds official opendes:wks:master-data--Wellbore:1.0.0
as integration test to validate index and search workflow.
This MR also fixes few schema parsing errors which we discovered while enabling opendes:wks:master-data--Wellbore:1.0.0
indexing.
Merge request reports
Activity
added Common Code M5 labels
added M4 label
@manishk @Vibhuti.Sharma @ankitsharma @amaverma Can you please take a look at this
added 40 commits
- c70f5559 - 601086: updates devops
- 579c88b5 - 601086: adds ImportFromOSDU
- bb132d9f - Merged PR 17: 601086: setup pipeline
- 41a33008 - Merge branch 'master' of...
- bf8c26dc - Fix typo in IndexerService.md
- be07f9b2 - Merge branch 'typo-fix' of...
- 2ead08be - Merged PR 141: Pullback from gitlab
- f942d31c - Add weu env
- 6f1bd7e1 - Merged PR 173: Add weu env
- b5b358e8 - increase replicateCount to 20
- e8877a49 - update hpa to use replicaCount from helm-config
- b6796623 - Merged PR 254: Increase instance count to 20
- fc69351e - Merge branch 'master' of...
- 04504aec - Merge branch 'master' of...
- e1ed5538 - Add CVN env
- 2a82eae8 - Merged PR 308: Pullback
- bedfa29d - Changed CVX<=>CVN env. order
- 265a8f5e - Merged PR 454: Added CVN env
- dd4f2e7a - Merged PR 545: Updated pipeline.yml
- 712d2887 - Merge remote-tracking branch 'upstream/master' into US132_pullback_latest
- 1bf47d59 - use indexer-test-core jar from cache
- f58a306e - Merged PR 699: Pull back
- 0c204f3a - Merge conflict in devops/azure/chart/templates/hpa.yaml
- 7ddcd682 - Merged PR 865: Pull Back
- c985d3b6 - Merge branch 'master' of...
- 8b417d5e - Merged PR 906: Pullback index tag changes from Gitlab
- c5521afc - fix integration tests by modifying index
- 240c2b31 - minor change
- 35c2fbf8 - Merged PR 909: use new kind for tagging integration test
- 92e87ca7 - add readiness check delays for better logging
- a01024cb - Merged PR 976: add readiness check delays for better logging
- c16cc46f - suppress property mismatch warnings
- f8c6a2e1 - add comment
- bcf6f97e - Merged PR 988: suppress property mismatch warnings
- 327bc272 - add support for featurecollection
- 0739c6ff - use version in schema for AbstractFeatureCollection
- a9a58c28 - add integration test of r3 schema
- 9bbd1322 - fix typo
- 2e017374 - Merge remote-tracking branch 'indexer-ado/geojson-schema' into feature-collection
- f9f4af35 - schema updates
Toggle commit listadded 17 commits
-
b8cb612b...acc92cfb - 16 commits from branch
master
- 2621aed8 - merge from master
-
b8cb612b...acc92cfb - 16 commits from branch
requested review from @ankitsharma
added 1 commit
- d39a5916 - update test core version to support geoshape query
added 8 commits
-
d39a5916...98c2a941 - 6 commits from branch
master
- 2958fa24 - Merge branch 'master' into feature-collection
- 116a94c5 - Merge branch 'master' into feature-collection
-
d39a5916...98c2a941 - 6 commits from branch
@wsmatth @Dmitriy_Rudko Can you please review?
@nthakur Can you please provide context for this MR? I would go ahead and review this according to that.
- Resolved by Neelesh Thakur
@ethiraj @nthakur I am seeing this a lot in our logs when we fail these tests. Any ideas?
AppException(error=AppError(code=409, reason=Wrong definition format:opendes:wks:core_dl_geopoint, message=Wrong definition format:opendes:wks:core_dl_geopoint, errors=null, debuggingInfo=null, originalException=null), originalException=null) at org.opengroup.osdu.indexer.schema.converter.PropertiesProcessor.getDefinitionIdentity(PropertiesProcessor.java:112) at org.opengroup.osdu.indexer.schema.converter.PropertiesProcessor.processRef(PropertiesProcessor.java:82) at org.opengroup.osdu.indexer.schema.converter.PropertiesProcessor.processPropertyEntry(PropertiesProcessor.java:183) at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267)
added 4 commits
-
aaec3900...551d7a2d - 2 commits from branch
master
- 74b2cb32 - use official schema id for geoJson integration test and revert kind version update
- 68e0d0e9 - Merge branch 'master' into feature-collection
-
aaec3900...551d7a2d - 2 commits from branch
added 1 commit
- 17318719 - update integration test schema version for r3 data as Azure env have some conflicts
removed M5 label
mentioned in commit 47e8a38c
mentioned in merge request !138 (merged)
mentioned in merge request !127 (closed)
mentioned in merge request !69 (closed)
added MRNew Feature label
changed milestone to %M5 - Release 0.8