Ingestion Workflow merge requestshttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests2020-06-25T20:34:58Zhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/1workflow serivce - azure implementation.2020-06-25T20:34:58ZPingjiang Wangworkflow serivce - azure implementation.Azure implementation of the workflow service.Azure implementation of the workflow service.M1 - Release 0.1Dania Kodeih (Microsoft)Daniel SchollDania Kodeih (Microsoft)https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/3Ibm impl merge temp2020-07-17T16:12:01ZAnuj GuptaIbm impl merge tempAnuj GuptaAnuj Guptahttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/4Ibm impl2020-07-17T17:32:40ZAnuj GuptaIbm implAnuj GuptaAnuj Guptahttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/11Update fossa config2020-08-20T18:58:48ZDavid Diederichd.diederich@opengroup.orgUpdate fossa configCloses #42
This updates the fossa config to account for modules that weren't initially configured. More importantly, it updates the NOTICE file to match the new libraries being used by that module.Closes #42
This updates the fossa config to account for modules that weren't initially configured. More importantly, it updates the NOTICE file to match the new libraries being used by that module.M1 - Release 0.1David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/16IBM Impl and integration tests2020-09-15T09:45:02ZAnuj GuptaIBM Impl and integration testsIBM Implementation and Integration Test for Workflow
FYI @shrikgar raising another MR and will close the earlier one.IBM Implementation and Integration Test for Workflow
FYI @shrikgar raising another MR and will close the earlier one.M1 - Release 0.1Alan BrazAlan Brazhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/21AWS Implementation of Ingestion Workflow2020-10-05T19:31:00ZMatt WiseAWS Implementation of Ingestion WorkflowM1 - Release 0.1Spencer Suttonsuttonsp@amazon.comMatt WiseSpencer Suttonsuttonsp@amazon.comhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/23Enable CI/CD for AWS2020-10-09T21:03:05ZMatt WiseEnable CI/CD for AWSM1 - Release 0.1Matt WiseMatt Wisehttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/28New APIs: GET Workflow by Id and GET Workflow Run by Id2020-11-03T10:03:30ZMayank Saggar [Microsoft]New APIs: GET Workflow by Id and GET Workflow Run by IdThe MR implements GET workflow by Id and GET workflow Run by Id. The implementation includes a controller to support the api, a service layer and a repository layer for interacting with database. Also have written a few UTs for the same....The MR implements GET workflow by Id and GET workflow Run by Id. The implementation includes a controller to support the api, a service layer and a repository layer for interacting with database. Also have written a few UTs for the same.
This MR doesn't implement a breaking change.
The code coverage for the changes is at 100%. ITs for the same are still to be implemented.Kishore BattulaKishore Battulahttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/31[WIP] Get signed URL2020-11-18T16:15:22ZAalekh Jain[WIP] Get signed URLhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/41login to Docker Hub to prevent rate limiting issues2020-11-20T21:53:54ZRucha Deshpandelogin to Docker Hub to prevent rate limiting issuesM1 - Release 0.1Rucha DeshpandeRucha Deshpandehttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/39Implement custom operators api2020-11-24T12:32:37ZVineeth Guna [Microsoft]Implement custom operators apiImplemented all the api's mentioned in the [swagger file](/uploads/4d9bf7606074409eaef6112dac33b408/openapi__1_.yaml) for custom operatorsImplemented all the api's mentioned in the [swagger file](/uploads/4d9bf7606074409eaef6112dac33b408/openapi__1_.yaml) for custom operatorsVineeth Guna [Microsoft]Vineeth Guna [Microsoft]https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/48Added Failsafe Preintegration Phase to the Earlier ITs.2020-11-27T06:45:44ZMayank Saggar [Microsoft]Added Failsafe Preintegration Phase to the Earlier ITs.Added Failsafe plugin to Azure test Pom, Added new classes to run PreIntegration setup. Made changes to use the testData.json output from the PreIntegration setupAdded Failsafe plugin to Azure test Pom, Added new classes to run PreIntegration setup. Made changes to use the testData.json output from the PreIntegration setupMayank Saggar [Microsoft]Mayank Saggar [Microsoft]https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/42Integration tests for Create Workflow and Trigger workflow integrated with th...2020-12-03T08:37:30ZMayank Saggar [Microsoft]Integration tests for Create Workflow and Trigger workflow integrated with the test frameworkIntegration tests for Create workflow and Trigger workflow. Added a few example dags for testing.
In the current Tests I have implemented
- A success scenario
- A failure/bad request scenario
- A scenario without necessary authorization...Integration tests for Create workflow and Trigger workflow. Added a few example dags for testing.
In the current Tests I have implemented
- A success scenario
- A failure/bad request scenario
- A scenario without necessary authorization
- A scenario with different/invalid partition id
No changes have been made to the Environment variables and the requirement
For next steps
Implementing a pre-Integration and a Post-Integration phase
No Breaking changes have been introduced.Kishore BattulaMayank Saggar [Microsoft]Kishore Battulahttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/49Add integration tests for custom operator apis2020-12-04T08:05:23ZVineeth Guna [Microsoft]Add integration tests for custom operator apishttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/50Integration Tests for Get Workflow By Id and Get WorkflowRun by Id2020-12-04T10:15:28ZMayank Saggar [Microsoft]Integration Tests for Get Workflow By Id and Get WorkflowRun by IdIntegration tests for Get workflow by Id and Get workflowRun by Id. In the current Tests I have implemented
* A success scenario
* A failure/bad request scenario
* A scenario without necessary authorization
* A scenario with different/i...Integration tests for Get workflow by Id and Get workflowRun by Id. In the current Tests I have implemented
* A success scenario
* A failure/bad request scenario
* A scenario without necessary authorization
* A scenario with different/invalid partition id
No changes have been made to the Environment variables and the requirement remains same.
No Breaking changes have been introduced.Mayank Saggar [Microsoft]Mayank Saggar [Microsoft]https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/51Switching from string-replace method for endpoint to using string-format method2020-12-04T10:17:33ZMayank Saggar [Microsoft]Switching from string-replace method for endpoint to using string-format methodMayank Saggar [Microsoft]Mayank Saggar [Microsoft]https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/52Trigger workflow ITs correction2020-12-04T10:51:36ZMayank Saggar [Microsoft]Trigger workflow ITs correctionhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/53Fixed unit tests in CustomOperatorMetadataRepositoryTest which are failing du...2020-12-16T09:17:04ZVineeth Guna [Microsoft]Fixed unit tests in CustomOperatorMetadataRepositoryTest which are failing due to change in logichttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/55Fixed the response body to include conflictId if there is a conflict in creat...2020-12-17T06:17:50ZVineeth Guna [Microsoft]Fixed the response body to include conflictId if there is a conflict in creating a workflowhttps://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/56Fixed the response for trigger workflow to send right status code and message2020-12-17T08:18:14ZVineeth Guna [Microsoft]Fixed the response for trigger workflow to send right status code and message