--Task--
              name: Detect_Regression
           enabled: True
        class_name: DetectRegression
       source_name: controller
  source_namespace: >default<
       target_name: controller
  target_namespace: >default<
             start: 0
              stop: None
           timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow
              loop: False
          interval: None
      dependencies: []
          wait_for: []
    preceding_task: None
           options: {}
        group_name: None
       Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock

________________________________________________________________________________

[2024-02-29 23:38:14] Detect_Regression pre : N/A
________________________________________________________________________________

[2024-02-29 23:38:14] - INFO: Timeout for this Task has changed to 4h 40m (16800 seconds)
[2024-02-29 23:38:14] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset
________________________________________________________________________________

[2024-02-29 23:38:14] Detect_Regression step1 : Run detect regression script
________________________________________________________________________________

[2024-02-29 23:38:14] - INFO: Baselines for this run are:
	baseline resp (read from property 'baseline-resp' in test configuration file): [
    {
        "Description": "April 2023 from debug-other-tests job with 1400 users per sec",
        "ReadManagedUser": {
            "meanResponseTime": 22,
            "numberOfRequests": 928912,
            "standardDeviation": 20
        },
        "queryBySn": {
            "meanResponseTime": 21,
            "numberOfRequests": 929248,
            "standardDeviation": 68
        },
        "queryFull": {
            "meanResponseTime": 21,
            "numberOfRequests": 926453,
            "standardDeviation": 20
        },
        "queryPartial": {
            "meanResponseTime": 39,
            "numberOfRequests": 930407,
            "standardDeviation": 29
        },
        "queryStartsWith": {
            "meanResponseTime": 25,
            "numberOfRequests": 928694,
            "standardDeviation": 21
        },
        "scenario": "MixedQuery"
    },
    {
        "Description": "April 2023 from debug-other-tests job with 300 users per sec",
        "UpdateManagedUser": {
            "meanResponseTime": 87,
            "numberOfRequests": 238197,
            "standardDeviation": 18
        },
        "scenario": "update"
    },
    {
        "Description": "April 2023 from debug-other-tests job with 350 users per sec",
        "Patch Managed User": {
            "meanResponseTime": 89,
            "numberOfRequests": 291419,
            "standardDeviation": 35
        },
        "scenario": "patch"
    },
    {
        "CreateManagedUser": {
            "meanResponseTime": 76,
            "numberOfRequests": 202918,
            "standardDeviation": 12
        },
        "Description": "April 2023 from debug-other-tests job with 250 users per sec",
        "scenario": "create"
    },
    {
        "Description": "April 2023 from debug-other-tests job with 250 users per sec",
        "Patch Managed User": {
            "meanResponseTime": 50,
            "numberOfRequests": 191401,
            "standardDeviation": 22
        },
        "scenario": "delete"
    }
]

Running Z-test ...
Regression detection failed because of this exception
Traceback (most recent call last):
  File "/mnt/disks/data/xslou/lodestar-fork/pyrock/lib/utils/ztest_detection.py", line 43, in ztest_detection
    regressed, regressions = check_regression(result, baseline)
  File "/mnt/disks/data/xslou/lodestar-fork/pyrock/lib/utils/ztest_detection.py", line 92, in check_regression
    if step['name'] in baseline[scenario_index]:
IndexError: list index out of range
Setting result to FAIL
________________________________________________________________________________

[2024-02-29 23:38:14] Detect_Regression post : Post method
________________________________________________________________________________

Task has been successfully stopped