Documentation - Dataset service for FileCollection Generic (showcase handling of multiple files in the collection)
Checked documentation here. https://community.opengroup.org/osdu/platform/system/dataset/-/tree/master
I also did one pass using AWS-provided Postman collection. See results here - https://community.opengroup.org/osdu/platform/pre-shipping/-/blob/main/R3-M22/Test_plan_Results_M22/Core%20Services/M22-AWS-Dataset-FileCollection-steps-and-data-Debasis.zip
What if someone is starting from an existing Dataset record FileCollection.Generic which has 4 files)? Is it mandatory that the record should capture proper information in 4 elements of array for FileSourceInfos? Where is the style of suffixing (File/File2/File3) documented for upload or for retrieval? Is it mandatory that files are uploaded in sub-folders such as "file1", "file2" and so on?
Upload example - PUT 'https://psosdu-shared-file-20231221225646693800000006.s3.amazonaws.com/osdu/E9WkOPfJf4HtOMbGqaGQqh0ycgfXGHZK/file1'
Download example - 'https://psosdu-shared-file-20231221225646693800000006.s3.amazonaws.com/osdu/E9WkOPfJf4HtOMbGqaGQqh0ycgfXGHZK/file1'
See synthetic example of a Dataset record. https://community.opengroup.org/osdu/data/data-definitions/-/blob/master/Examples/dataset/FileCollection.Generic.1.0.0.json
"FileSourceInfos": [
{
"FileSource": "s3://default_bucket/opendes/data/vds-dataset/vds-file-1",
"Name": "vds-file-1",
"FileSize": "439452464",
"Checksum": "d41d8cd98f00b204e9800998ecf8427e",
"ChecksumAlgorithm": "MD5"
},
{
"FileSource": "s3://default_bucket/opendes/data/vds-dataset/vds-file-2",
"Name": "vds-file-2",
"FileSize": "433645463",
"Checksum": "204e9800998ecf8427ed41d8cd98f00b",
"ChecksumAlgorithm": "MD5"
}
],
cc @ydzeng , @nisha.thakran , @todaiks , @chad , @AshishSaxenaAccenture , @Srinivasan_Narayanan , @Yauhen_Shaliou , @anujgupta, @priyankabhongade