Skip to content
GitLab
Menu
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in / Register
Toggle navigation
Menu
Open sidebar
Open Subsurface Data Universe Software
Platform
Data Flow
Data Ingestion
csv-parser
csv-parser
Commits
233b29e9
Commit
233b29e9
authored
Sep 28, 2021
by
harshit aggarwal
Browse files
minor fix
parent
3801b3d1
Pipeline
#68178
failed with stages
in 44 seconds
Changes
1
Pipelines
4
Show whitespace changes
Inline
Side-by-side
airflowdags/csv_ingestion_all_steps.py
View file @
233b29e9
...
...
@@ -50,8 +50,6 @@ env_vars = {| ENV_VARS or {} |}
if
data_service_to_use
:
env_vars
[
"data_service_to_use"
]
=
data_service_to_use
env_vars
[
"docker_image"
]
=
DOCKER_IMAGE
operator_kwargs
=
{
|
K8S_POD_OPERATOR_KWARGS
or
{}
|
}
with
DAG
(
DAG_NAME
,
default_args
=
default_args
)
as
dag
:
...
...
@@ -66,7 +64,7 @@ with DAG(DAG_NAME, default_args=default_args) as dag:
env_vars
=
env_vars
,
arguments
=
[
dumps
(
params
)],
is_delete_operator_pod
=
True
,
image
=
env_vars
[
"docker_image"
]
,
image
=
DOCKER_IMAGE
,
**
operator_kwargs
)
update_status_finished
=
UpdateStatusOperator
(
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment