Fetch-and-Ingest Non-WKS Master data AWS->Azure
Also check #94 (closed)
- Create the non-WKS schema in AWS using Schema service
- Populate non-WKS data in EDS/AWS Dev environment using Ingestion workflow
- Ingestion Workflow has been demonstrated by @debasisc to @rajesh747 and @sourav.kuila.
- Non-WKS schema is registered in Azure (use Schema service)
- Fetch and ingest workflow can be executed from the fetch and ingest DAG
- Verify ingested data is correct using Search and/or Storage