Feature Change - Support auto delete of files on file-staging-area
Why is this change needed?
The file-staging-area Blob Container is used by File Service for Generating Signed URLs for Upload operations. Once the file is uploaded, the client uses File Service's metadata API which will internally copy the blob contents from the file-staging-area to file-persistent-area and update the blob's metadata to Storage Service.
This results in lot of temporary files left over in the Staging area. Removing the files periodically will better the COGS.
Proposal
Use life-cycle management policies to recycle old files. The number of days after which the data should be deleted must be configurable. The Auto delete of Files should also be an Opt-In feature.
Acceptance Criteria
-
Design Feature to ensure can be implemented with a non breaking change. -
Update Storage Module -
Ensure all Module Unit Tests Pass -
Ensure all Template Unit Tests and Integration Tests Pass. Make sure the change will be applicable only to File-Staging-Area. -
Update all required documentation
Edited by Nidhi Jain