diff --git a/README.md b/README.md index 1b144a8943d26871069ce0dca229724c9bb63f6c..12c4e2afcb79262f432f52082f1c03521d449b2e 100644 --- a/README.md +++ b/README.md @@ -14,6 +14,9 @@ * [Testing](#testing) * * [Running Unit Tests](#running-unit-tests) * * [Running E2E Tests](#running-e2e-tests) +* [Logging](#logging) +* * [Logging Configuration](#logging-configuration) +* * [Remote Logger](#remote-logger) * [DAGs Description](#dags-description) * * [Opaque Ingestion DAG](#opaque-ingestion-dag) * * [Manifest Ingestion DAG](#manifest-ingestion-dag) @@ -102,6 +105,16 @@ chmod +x tests/unit_tests.sh && tests/./unit_tests.sh ~~~ +## Logging +### Logging Configuration +As Airflow initializes the logging configuration at startup, it implies that all logger configuration settings will be kept in `airflow.cfg` file within your project or will be specified as environment variables according to the [Airflow specification](https://airflow.apache.org/docs/apache-airflow/1.10.14/howto/set-config.html). + +Look Airflow logging properties in the [documentaton](https://airflow.apache.org/docs/apache-airflow/1.10.14/howto/write-logs.html) +### Remote Logger +For GCP Composer `google_cloud_default` connection is used by default to store all logs into GCS bucket. +Look Airflow [documentaton](https://airflow.apache.org/docs/apache-airflow/1.10.14/howto/write-logs.html) documentation for AWS, Azure. + + ## DAGs Description ### Opaque Ingestion DAG