RI Manifest Ingestion Payload More Than 10 MB Fails
I did perform manifest ingestion with bulk and batch manifest ingestion with huge size payload, the Airflow process failed with the following log:
*** No logs found on s3 for ti=<TaskInstance: Osdu_ingest.process_manifest_task_2 07a62538-1c1e-4200-9d63-f880bde99362 [failed]> *** Could not read served logs: [Errno -2] Name or service not known
The list of runID wiht huge payload (more than 10 MB):
- 07a62538-1c1e-4200-9d63-f880bde99362 (batch 8000 records IDs payload)
- a1a8100b-d061-45e4-941d-9b85711d44ec (bulk 16000 records IDs payload)
I have performed a smaller payload (less than 10mb json) and they were successful
Do slack me in person or via Preship channel I can share the json payload in person (I cant attach the json payload here due to limit of 10mb attachment)