--Task-- name: Detect_Regression enabled: True class_name: DetectRegression source_name: controller source_namespace: >default< target_name: controller target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [18/May/2023 22:12:54] Detect_Regression pre : N/A ________________________________________________________________________________ [18/May/2023 22:12:54] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [18/May/2023 22:12:54] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset ________________________________________________________________________________ [18/May/2023 22:12:54] Detect_Regression step1 : Run detect regression script ________________________________________________________________________________ [18/May/2023 22:12:54] - INFO: Baselines for this run are: baseline rps (read from property 'baseline-rps' in test configuration file): [2733, 2453] Regression detection failed because of this exception Traceback (most recent call last): File "/mnt/disks/data/xslou/lodestar-fork/pyrock/lib/utils/detect_regression.py", line 32, in detect_regression regressed, regressions = check_regression(result, {'rps': baseline_rps, File "/mnt/disks/data/xslou/lodestar-fork/pyrock/lib/utils/detect_regression.py", line 81, in check_regression raise ValueError(f'Number of baseline throughput entries {len(baseline["rps"])} ' ValueError: Number of baseline throughput entries 2 doesn't match with test results 8 Setting result to FAIL ________________________________________________________________________________ [18/May/2023 22:12:57] Detect_Regression post : Post method ________________________________________________________________________________ Task has been successfully stopped