Seek information pertaining to workflow, DAG, DAG Operator, and runtime environments from all CSPs and data workflow teams.
Request made of CSP and data workflow development teams (CSV, EDS, Energistics/WITSML, Manifest):
Per today’s daily dev standup discussion, I’m requesting information regarding the environment information for your workflow service, Airflow implementation, DAGs, and DAG Operators. Please fill out this table and send it back to me. I will aggregate and share with the group. We will use this as a baseline to address the next steps in unifying workflow environments to ensure the DAGs you and your teams are writing will run across all four CSP platforms. This effort will also drive discussions for standardization.
Given some teams are on holiday through Monday of next week, please target getting this to me by next Wednesday, Jan 20th. I will remind you in the daily dev standups. If you have follow-up questions, please let me know.
For the CSV, EDS, and Energistics/WITSML teams, please disregard the questions on Airflow as I know you depend on the CSP implementation for that answer. Please address the DAG Operator and container questions where possible.