Adopting new Dag Repo Structure for supporting Packaged Dags
This issue is inline with this approved [ADR]
Following MR [Link] is introducing changes in DAG repo structure to support Packaged Dags
This is the new proposed structure for csv parser
├── airflowdags
├── osdu_csv_parser
| ├── __init__.py
| └── xyz.py
|
|___csv_ingestion_all_steps.py
As of now only Azure has made changes in their pipeline to honor this new structure, other CSPs should make changes in their pipelines to support this one
Once all CSP pipelines are moved to new structure, the existing folders airflowdags/dags
and airflowdags/plugins
folder will be cleaned up