--Task--
              name: Detect_Regression
           enabled: True
        class_name: DetectRegression
       source_name: controller
  source_namespace: >default<
       target_name: controller
  target_namespace: >default<
             start: 0
              stop: None
           timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow
              loop: False
          interval: None
      dependencies: []
          wait_for: []
    preceding_task: None
           options: {}
        group_name: None
       Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock

________________________________________________________________________________

[2024-03-06 07:48:18] Detect_Regression pre : N/A
________________________________________________________________________________

[2024-03-06 07:48:18] - INFO: Timeout for this Task has changed to 4h (14400 seconds)
[2024-03-06 07:48:18] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset
________________________________________________________________________________

[2024-03-06 07:48:18] Detect_Regression step1 : Run detect regression script
________________________________________________________________________________

[2024-03-06 07:48:18] - INFO: Baselines for this run are:
	baseline resp (read from property 'baseline-resp' in test configuration file): [
    {
        "scenario": "MixedQuery",
        "Description": "April 2023 from debug-other-tests job with 1400 users per sec",
        "queryFull": {
            "meanResponseTime": 21,
            "standardDeviation": 20,
            "numberOfRequests": 926453
        },
        "queryPartial": {
            "meanResponseTime": 39,
            "standardDeviation": 29,
            "numberOfRequests": 930407
        },
        "queryStartsWith": {
            "meanResponseTime": 25,
            "standardDeviation": 21,
            "numberOfRequests": 928694
        },
        "queryBySn": {
            "meanResponseTime": 21,
            "standardDeviation": 68,
            "numberOfRequests": 929248
        },
        "ReadManagedUser": {
            "meanResponseTime": 22,
            "standardDeviation": 20,
            "numberOfRequests": 928912
        }
    },
    {
        "scenario": "update",
        "Description": "April 2023 from debug-other-tests job with 300 users per sec",
        "UpdateManagedUser": {
            "meanResponseTime": 87,
            "standardDeviation": 18,
            "numberOfRequests": 238197
        }
    },
    {
        "scenario": "patch",
        "Description": "April 2023 from debug-other-tests job with 350 users per sec",
        "Patch Managed User": {
            "meanResponseTime": 89,
            "standardDeviation": 35,
            "numberOfRequests": 291419
        }
    },
    {
        "scenario": "create",
        "Description": "April 2023 from debug-other-tests job with 250 users per sec",
        "CreateManagedUser": {
            "meanResponseTime": 76,
            "standardDeviation": 12,
            "numberOfRequests": 202918
        }
    },
    {
        "scenario": "delete",
        "Description": "April 2023 from debug-other-tests job with 250 users per sec",
        "Patch Managed User": {
            "meanResponseTime": 50,
            "standardDeviation": 22,
            "numberOfRequests": 191401
        }
    }
]

Running Z-test ...
No regression found
________________________________________________________________________________

[2024-03-06 07:48:18] Detect_Regression post : Post method
________________________________________________________________________________

Setting result to PASS
Task has been successfully stopped