DAGs should be updated to adhere to new workflow service APIs

Currently the DAGs for manifest ingestion work against the old workflow service APIs. These APIs are deleted in the latest MR on workflow service.

Below are changes needed in ingestion DAGs

• Input reading inside manifest process operator. The whole manifest content is available in conf section of airflow payload. Now it will be part of conf.executionContext
• Update status operator. The update status operator must be updated to use new API on workflow service

Details:

1. DAG currently is triggered with the following request object:

{
  "run_id": "2db251ff-bb77-4518-adae-820e8b559bec",
  "execution_date": "2021-02-08T01:10:43",
  "conf": {
    "workflow_id": "ada0d71c-847e-4724-a5a6-851d74d681e2",
    "run_id": "2db251ff-bb77-4518-adae-820e8b559bec",
    "authToken": "Bearer <token>",
    "execution_context": {
      "key1": "value1"
    },
    "correlation_id": "e1d062dd-2472-4d78-9d4c-43e48b78db0a"
  }
} 

2. Workflow API was updated. Please see the latest OpenAPI spec for Workflow service here: https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/blob/master/docs/api/openapi.workflow.yaml