CSV Ingestion Steps using Dataset service
CSV Ingestion – We will be using the schema “osdu:wks:reference-data--ContractorType:1.0.0” and inserting reference data.
Prepare your CSV file. E.g. see below for example on contractor type schema
|Positioning-A1||Establishes location of surface equipment-A1||Position-A1|
We will get a dataset storage instruction from dataset service by sending a POST request.
In this request, we will get the SignedUrl to upload the file. SignedURL is used for uploading the csv file.
Now we will use the SignedURL to upload the CSV file we created in earlier step by sending a PUT request.
In the next step, we will create a dataset registry record pointing to the uploaded file by sending a PUT request. Please note the TargetKind property. This contains the metadata about the file such as the FileSource and name of CSV.
Final step is trigger the CSV ingestion workflow by sending a POST request.