ADR: E2E preshipment team A workflow bot
Status
-
Draft -
Proposed -
Trialing -
Under Review -
Approved -
Retired
Context & Scope
Following the Preshipment validation dashboard :
There are multiple manual steps to achieve in order to test each workflow. This seems to be error prone and time consuming.
This ADR focuses on the following steps :
- Authenticate to any CSP
- File uploading whenever required
- Trigger DAG
- Validate the workflow
- Generate a report
- Clean up
That work could be also be extended with the following :
- Bulk loading
Another ADR has been approved for maintaining Postman collections to be integrated for testing on DAGs and services endpoints end to end executions.
There might be some overlapping with the .
Proposition
Implement a script/framework so we can test each use case independently from any computer but also a Gitlab pipeline (e2e tests).
- Pros :
Get a clear report of the process so we can more easily provide feedbacks.
Have a common place with configuration templates to fill in for CSPs (another script could also help on that part).
Add other workflows using the existing framework.
Test using multiple source files.
Match the framework version with the releases so pipelines could be run in multiple test environments at the same time (as long as environments are available).
Easy onboarding for new developers.
- Cons :
Maintenance of the configuration parameters (CSPs) should follow releases cadence.
Needs developers
Decision
Rationale
Consequences
- Direct consequence on the Preshipment team A.