[Parsers] Pluggable logic of duplicated files detection - HASH calculation
According to OSDU Reference Architecture, duplicated files / data should not be saved in OSDU. HASH code should be calculated for each ingested file / WPC and this value should be stored in the schema. It seems that it makes sense to implement this logic on the parser side: each parser developer will calculate HASH code for the ingested WPC.