Limit not set for Search API query
We are not setting the limit in the search query while searching for external references and hence it defaults to 10 (i.e. maximum 10 records will be returned from search api) Therefore the integrity check is failing if total records are greater than 10
Code Reference - https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-ingestion-lib/-/blob/master/osdu_ingestion/libs/search_record_ids.py#L113
If we see currently there is no limit set