Updated EDS ingest code with logging and exception
Please find the description as below:
- Removed secretmanager_client (Cloud Specific Secret Manager) This will be replaced by Secret Service.
- Fetching Connected Source Data Job and Connected Source Registry Entry from eds_ingest for making criteria dict.
- Added new properties in criteria dict i.e lastSuccessfulRunDateUTC and dataProviderName.
- Implemented incremental fetch logic in _fetch_client.
- Added print statement for fetched records for clarity.
- Implemented AuthCode Generation for 2 flow types.
- Implemented Exceptional Handling to hand Runtime errors.
- Created a new Constant.py file to read Constants and Secrets(workaround).