Skip to content

GONRG-938 Refactored logging from BigQuery to GCS

Oleksii Tsyganov (EPAM) requested to merge Refactor-logging-from-bigquery-to-gcs into master

Refactored Step 5 "5_bq_sink_dataset" according to base requirements mentioned by Dmitriy Rudko in the task GONRG-938.

Base requirements are following:

  • Default retention period for logs should be 30 days
  • Retention period for Audit Logs should be 1 year
  • All platform Audit Logs should be stored on a separate GCS bucket

Proper filter to capture Platform Audit Logs is following:

jsonPayload.auditLog.action:*

Tests were provided in 3 projects: OSDU-CICD-EPAM, OSDU-CICD-Community, osdu-community-production.

Merge request reports