[M8 Retro] Link platform validation test in QA env as part of milestone release process
Currently the platform validation in QA env is not part of our release process. We should enforce this to achieve certain success rate (say 90% or 95%) before CSP teams deploy the tagged milestone baseline into pre shipping, and pre shipping test executing the tests.
In my mind, pre shipping test is basically per release cycle, but QA test should be at least per sprint (2 weeks), so that we can identify issues early to avoid late surprises.
This was discussed briefly in the retro meeting, but we need to dive into details to define specific actions. The owner of this is Vaibav, and firstly we need to discuss with CSPs to understand how the tests are run today, how often is deployments updates, how are the failures tracked, etc.