Indexing issue with GeoJSON structure in Spatial block
eds_ingest dag use a search service to get records from the source system(OSDU/NON OSDU) and ingest them into a target OSDU system using osdu_ingest.
Search service provides the flattened "SpatialLocation.Wgs84Coordinates" and it gets ingested using osdu_ingest, but there is an indexing issue.
Troubleshooting reveals that Spatial data is not indexed since GeoJSON syntax is incorrect.
"geo-json shape parsing error: must be a valid FeatureCollection attribute: SpatialLocation.Wgs84Coordinates",
Looks like string fields are displayed even though it is flattened, but not array-like Wgs84Coordinates??. There may be a problem with indexing in handling array-like structure?
There are other flattened fields displayed in the search query,
Storage shows the Wgs84Coordinates
CC: @debasisc @AshishSaxenaAccenture @chad
Sample Seismic Trace data