|
|
|
**22 September 2020**
|
|
|
|
- Another commit done to Gitlab
|
|
|
|
- Single step CSV Ingestor DAG is now working in Airflow
|
|
|
|
- Manual registration (placed in dag directory)
|
|
|
|
- Manual execution (via Airflow UI)
|
|
|
|
- Authentication is supported (same as in Core Services)
|
|
|
|
|
|
|
|
Next steps:
|
|
|
|
- Finish Horizon 1 development (eta: 28 September)
|
|
|
|
- Integration tests
|
|
|
|
- Check for code vulnerabilities
|
|
|
|
- Once all above is done, Pull Request to merge to master
|
|
|
|
|
|
|
|
**15 September 2020**
|
|
|
|
- Initial commit to [separate branch](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/tree/osdu-r3-code/os-csv-parser/provider/csv-parser-azure) for CSV Ingestor DAG
|
|
|
|
- Plan to commit every Monday going forward
|
| ... | ... | |
