Establish common understanding for usage of Datasets
Today we have several dataset types available in the platform: https://community.opengroup.org/osdu/data/data-definitions/-/tree/master/E-R/dataset
For each of these we also have: data.SchemaFormatTypeID → SchemaFormatType
This seems to duplicate certain information about the file object, also it seems unclear if we need specialised objects for new file types such as: DLIS, LAS2, LAS3 and so on..
For now we have ingested these as file-generics and added SchemaFormatType to indicate format.
If we add dataset types for DLIS, LAS and so on.. We essentially end up overlapping with the purpose of the well-log WPC as both of these will represent similar information and ultimately be confusing towards any end-user exploring the platform.
Could we settle with only file-generic with the purpose of indexing files in blob/s3/.. storage?