Augmenter performance enhancement
Compare changes
This MR is to address performance issue for index augmenter Poor performance for index augmenter
In this MR, we also include the following enhancements:
With all the changes, we re-tested the re-index with augmenter enabled. The performance with augmenter enabled is about 4 times worse than the performance with augmenter disabled.
Here is the test result for re-index of WellLog from two random runs. The indexer created 6 batches for 291 records and they were run in parallel:
41 records in 28,887 ms
50 records in 30,006 ms
50 records in 33,261 ms
50 records in 33,540 ms
50 records in 35,794 ms
50 records in 35,581 ms
41 records in 7,885 ms
50 records in 8,018 ms
50 records in 9,024 ms
50 records in 9,207 ms
50 records in 9,034 ms
50 records in 9,358 ms