Ingest data using Custom Workflow
User should have an ability to configure a custom Ingestion workflow. Business scenarios can include:
- Cleaning data before Ingestion
- Transformation step before Ingestion
- Data checks
Ingestion framework should have an ability to
- Ability to register a custom workflow (create, edit, delete)
- Ability to execute this workflow
- Ability to register re-usable components