From c1a095b35c3cb76cd3190c94fb7cda9e8bf0c86f Mon Sep 17 00:00:00 2001 From: Siarhei Khaletski <siarhei_khaletski1@epam.com> Date: Mon, 21 Dec 2020 14:45:16 +0300 Subject: [PATCH] GONRG-1402: Added Logger Section for README.md file --- README.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/README.md b/README.md index 1b144a8..12c4e2a 100644 --- a/README.md +++ b/README.md @@ -14,6 +14,9 @@ * [Testing](#testing) * * [Running Unit Tests](#running-unit-tests) * * [Running E2E Tests](#running-e2e-tests) +* [Logging](#logging) +* * [Logging Configuration](#logging-configuration) +* * [Remote Logger](#remote-logger) * [DAGs Description](#dags-description) * * [Opaque Ingestion DAG](#opaque-ingestion-dag) * * [Manifest Ingestion DAG](#manifest-ingestion-dag) @@ -102,6 +105,16 @@ chmod +x tests/unit_tests.sh && tests/./unit_tests.sh ~~~ +## Logging +### Logging Configuration +As Airflow initializes the logging configuration at startup, it implies that all logger configuration settings will be kept in `airflow.cfg` file within your project or will be specified as environment variables according to the [Airflow specification](https://airflow.apache.org/docs/apache-airflow/1.10.14/howto/set-config.html). + +Look Airflow logging properties in the [documentaton](https://airflow.apache.org/docs/apache-airflow/1.10.14/howto/write-logs.html) +### Remote Logger +For GCP Composer `google_cloud_default` connection is used by default to store all logs into GCS bucket. +Look Airflow [documentaton](https://airflow.apache.org/docs/apache-airflow/1.10.14/howto/write-logs.html) documentation for AWS, Azure. + + ## DAGs Description ### Opaque Ingestion DAG -- GitLab