Transformer - Testing Support - Add Partial Record Loading capability for shorter testing durations
For the automated JUnit tests, we require a configurable limiter on the getAllRecords function. The goal is to artificially limit the number of records plugged into lengthy workflows so they can be tested 100% without taking hours to complete. This is useful for advanced datatypes which require a great deal of processing.
This is an important task, as the more complex workflows that are added without automated testing support, the lower our test coverage numbers become.
Acceptance criteria:
- getAllRecords function extended with optional parameter for imposing a hard-limit on the max number of features that can be ingested in total.
- Updated function leveraged in all applicable test scenarios.