--Task-- name: Detect_Regression enabled: True class_name: DetectRegression source_name: controller source_namespace: >default< target_name: controller target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [16/Sep/2023 14:26:09] Detect_Regression pre : N/A ________________________________________________________________________________ [16/Sep/2023 14:26:09] - INFO: Timeout for this Task has changed to 16h (57600 seconds) [16/Sep/2023 14:26:09] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset ________________________________________________________________________________ [16/Sep/2023 14:26:09] Detect_Regression step1 : Run detect regression script ________________________________________________________________________________ [16/Sep/2023 14:26:09] - INFO: Baselines for this run are: baseline resp (read from property 'baseline-resp' in test configuration file): [ { "Description": "Not Applicable" } ] Running Z-test ... Regression detection failed because of this exception Traceback (most recent call last): File "/mnt/disks/data/xslou/lodestar-fork/pyrock/lib/utils/ztest_detection.py", line 43, in ztest_detection regressed, regressions = check_regression(result, baseline) File "/mnt/disks/data/xslou/lodestar-fork/pyrock/lib/utils/ztest_detection.py", line 92, in check_regression if step['name'] in baseline[scenario_index]: IndexError: list index out of range Setting result to FAIL ________________________________________________________________________________ [16/Sep/2023 14:26:09] Detect_Regression post : Post method ________________________________________________________________________________ Task has been successfully stopped