Loading of 50,000 records using Osdu_ingest DAG fails for GCP Platform [GONRG-3584]
When trying to load test manifest ingestion (Osdu_ingest DAG) with 50,000 organization records, the process is failing with the Response code 500. First attempt DEBUG:root:Response: 500 DEBUG:root:json = {"timestamp": 1633097264234, "status": 500, "error": "Internal Server Error", "message": "Java heap space", "path": "/api/workflow/v1/workflow/Osdu_ingest/workflowRun"}
The second attempt after @aliaksandr_ramanovich added more memory _639_50000", "Source": "Source_TEST_BULK_2021-09-22_639_50000"}}]}}}, "headers": {"data-partition-id": "odesprod", "Accept": "application/json", "Authorization": "Bearer ya29.a0ARrdaM_7bjuhcD4aNLPF2jbK_MsQL1ncG7k_kwSR00_AxgkOPVdXhgOJH_iLzxMSj3mLDooFbusYwCM-avGyTphGmN1-BITJ6xzTwQzar88AFIdcYBYdSjbQ8ECne-IVen3aJdRKVW3YJaisEsBwXRdrL276"}, "verify": false} DEBUG:root:Response: 500 DEBUG:root:text =
This time it did not give any details in the text field of the response.