--Task--
name: Reporting-mixedquery-300
enabled: True
class_name: GatlingResultTask
source_name: overseer-0
source_namespace: >default<
target_name: overseer-0
target_namespace: >default<
start: 0
stop: None
timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow
loop: False
interval: None
dependencies: []
wait_for: ['Reporting-mixedquery-10', 'Reporting-mixedquery-50', 'Reporting-mixedquery-100', 'Reporting-mixedquery-150', 'Reporting-mixedquery-200', 'Reporting-mixedquery-250']
preceding_task: None
options: {'task_name': 'mixedquery-300'}
group_name: None
Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock
________________________________________________________________________________
[2024-03-11 04:58:29] Reporting-mixedquery-300 pre : N/A
________________________________________________________________________________
source (overseer-0) is a component
[2024-03-11 04:58:29] - INFO: Timeout for this Task has changed to 1h 10m (4200 seconds)
[2024-03-11 04:58:29] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset
Pod stdout file : /results/orders/Reporting-mixedquery-300/stdout.txt
Pod stderr file : /results/orders/Reporting-mixedquery-300/stderr.txt
Pod log : /results/orders/Reporting-mixedquery-300
________________________________________________________________________________
[2024-03-11 04:58:29] Reporting-mixedquery-300 step1 : Write order for overseer to generate the report
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/order.json
{
"name": "Reporting-mixedquery-300",
"command": "/lodestar/clients/gatling-report-only-for-pyrock.sh mixedquery-300 --extra-run-jvm-options \"-Xmx4G\"",
"out-dir": "/results/orders/Reporting-mixedquery-300"
}
________________________________________________________________________________
[2024-03-11 04:58:30] Reporting-mixedquery-300 step2 : Make sure overseer is ready to accept order (not already busy)
________________________________________________________________________________
[loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING"
[loop_until]: (max_time=120, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
WAITING
--- stderr ---
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 7 100 7 0 0 23 0 --:--:-- --:--:-- --:--:-- 23
________________________________________________________________________________
[2024-03-11 04:58:30] Reporting-mixedquery-300 step3 : Send order to overseer
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/order.json overseer-0-67d9575494-4zhsb:/results/orders/order.json
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
Order has been successfully forwarded to overseer
________________________________________________________________________________
[2024-03-11 04:58:32] Reporting-mixedquery-300 step4 : Wait order is done
________________________________________________________________________________
Workaround for PERF-1966. Sleeping for 5 seconds.
[loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING"
[loop_until]: (max_time=4200, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 15s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 21s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
WAITING
--- stderr ---
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33
________________________________________________________________________________
[2024-03-11 04:58:58] Reporting-mixedquery-300 step5 : Wait until gatling report is generated on overseer
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
Checking pod: overseer-0-67d9575494-4zhsb for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-67d9575494-4zhsb --stdin -- bash -c 'if [ -f "/results/gatling/mixedquery-300.tar.gz" ]; then echo "/results/gatling/mixedquery-300.tar.gz file found"; exit 0; else echo "/results/gatling/mixedquery-300.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/mixedquery-300.tar.gz file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/gatling/mixedquery-300.tar.gz file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-67d9575494-4zhsb --stdin -- du -k /results/gatling/mixedquery-300.tar.gz
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
440 /results/gatling/mixedquery-300.tar.gz
--- stderr ---
- Download file (size 440k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
source : /results/gatling/mixedquery-300.tar.gz @ overseer-0-67d9575494-4zhsb
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/shared/mixedquery-300.tar.gz
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-67d9575494-4zhsb:/results/gatling/mixedquery-300.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/shared/mixedquery-300.tar.gz
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
________________________________________________________________________________
[2024-03-11 04:59:02] Reporting-mixedquery-300 step6 : Unzip the result
________________________________________________________________________________
[run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/shared/mixedquery-300.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/07_scenario/07_mixedquery-300/gatling
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
--- stderr ---
________________________________________________________________________________
[2024-03-11 04:59:02] Reporting-mixedquery-300 step7 : Print rc order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
Checking pod: overseer-0-67d9575494-4zhsb for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-67d9575494-4zhsb --stdin -- bash -c 'if [ -f "/results/orders/Reporting-mixedquery-300/rc.txt" ]; then echo "/results/orders/Reporting-mixedquery-300/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-mixedquery-300/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-mixedquery-300/rc.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-mixedquery-300/rc.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-67d9575494-4zhsb --stdin -- du -k /results/orders/Reporting-mixedquery-300/rc.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
4 /results/orders/Reporting-mixedquery-300/rc.txt
--- stderr ---
- Download file (size 4k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
source : /results/orders/Reporting-mixedquery-300/rc.txt @ overseer-0-67d9575494-4zhsb
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/rc.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-67d9575494-4zhsb:/results/orders/Reporting-mixedquery-300/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/rc.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/rc.txt is small (1 lines), printing all lines:
----- output -----
CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15])
________________________________________________________________________________
[2024-03-11 04:59:06] Reporting-mixedquery-300 step8 : Check rc log
________________________________________________________________________________
PASS: no error found in rc log
________________________________________________________________________________
[2024-03-11 04:59:06] Reporting-mixedquery-300 step9 : Print stdout order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
Checking pod: overseer-0-67d9575494-4zhsb for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-67d9575494-4zhsb --stdin -- bash -c 'if [ -f "/results/orders/Reporting-mixedquery-300/stdout.txt" ]; then echo "/results/orders/Reporting-mixedquery-300/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-mixedquery-300/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-mixedquery-300/stdout.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-mixedquery-300/stdout.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-67d9575494-4zhsb --stdin -- du -k /results/orders/Reporting-mixedquery-300/stdout.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
4 /results/orders/Reporting-mixedquery-300/stdout.txt
--- stderr ---
- Download file (size 4k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
source : /results/orders/Reporting-mixedquery-300/stdout.txt @ overseer-0-67d9575494-4zhsb
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/stdout.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-67d9575494-4zhsb:/results/orders/Reporting-mixedquery-300/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/stdout.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/stdout.txt is small (89 lines), printing all lines:
----- output -----
[cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/mixedquery-300/loadtest-20240311043024911 --extra-run-jvm-options -Xmx4G
GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling
Generating Gatling reports locally
Parsing log file(s)...
Parsing log file(s) done
Generating reports...
================================================================================
---- Global Information --------------------------------------------------------
> request count 353391 (OK=82873 KO=270518)
> min response time 6 (OK=17 KO=6 )
> max response time 60084 (OK=60000 KO=60084 )
> mean response time 14974 (OK=14409 KO=15147 )
> std deviation 23942 (OK=18468 KO=25381 )
> response time 50th percentile 10 (OK=4573 KO=8 )
> response time 75th percentile 23757 (OK=20019 KO=29739 )
> response time 95th percentile 60000 (OK=57626 KO=60000 )
> response time 99th percentile 60000 (OK=59657 KO=60000 )
> mean requests/sec 287.076 (OK=67.322 KO=219.755)
---- Response Time Distribution ------------------------------------------------
> t < 800 ms 2569 ( 1%)
> 800 ms <= t < 1200 ms 1038 ( 0%)
> t >= 1200 ms 79266 ( 22%)
> failed 270518 ( 77%)
---- Errors --------------------------------------------------------------------
> status.find.in(200,401), but actually found 503 196488 (72.63%)
> Request timeout to openam-ema-perf-iga.forgeblocks.com/34.144. 61269 (22.65%)
215.155:443 after 60000 ms
> status.find.in(200,401), but actually found 502 12756 ( 4.72%)
> j.i.IOException: Premature close 5 ( 0.00%)
================================================================================
Reports generated in 0s.
Please open the following file: file:///results/gatling/mixedquery-300/loadtest-20240311043024911/index.html
----------------------
[11/Mar/2024 04:58:56] Create tar file /results/gatling/mixedquery-300.tar.gz
----------------------
SIMULATION_PATH=/results/gatling/mixedquery-300/loadtest-20240311043024911
RESULT_FOLDER=mixedquery-300
RESULT_PATH=/results/gatling/mixedquery-300
PWD=/results/gatling/mixedquery-300/loadtest-20240311043024911
[cmd] tar -czvf /results/gatling/mixedquery-300.tar.gz --exclude=simulation.log *
group_retrievevariabl-5a49b.html
group_storevariables-5102b.html
index.html
js/
js/global_stats.json
js/highcharts-more.js
js/highstock.js
js/stats.json
js/jquery-3.5.1.min.js
js/assertions.xml
js/gatling.js
js/menu.js
js/bootstrap.min.js
js/ellipsis.js
js/all_sessions.js
js/stats.js
js/theme.js
js/assertions.json
js/unpack.js
req_querybysn-65c9b.html
req_queryfull-e5d3d.html
req_querypartial-f2acd.html
req_querystartswith-1e9cd.html
req_readmanageduser-f3f1e.html
req_restlogininitia-e2b9b.html
req_restloginuserna-d98ea.html
req_skip-2fa-3cbda.html
req_user-accesstoke-0d48d.html
req_user-authorize--dd8b8.html
style/
style/sortable.png
style/stat-l-temps.png
style/arrow_right_black.png
style/stat-l-roue.png
style/logo.svg
style/stat-fleche-bas.png
style/arrow_down_black.png
style/favicon.ico
style/logo-enterprise.svg
style/arrow_down.png
style/sorted-up.png
style/bootstrap.min.css
style/sorted-down.png
style/style.css
style/arrow_right.png
style/little_arrow_right.png
________________________________________________________________________________
[2024-03-11 04:59:10] Reporting-mixedquery-300 step10 : Check stdout log
________________________________________________________________________________
PASS: no error found in stdout log
________________________________________________________________________________
[2024-03-11 04:59:10] Reporting-mixedquery-300 step11 : Print stderr order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
Checking pod: overseer-0-67d9575494-4zhsb for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-67d9575494-4zhsb --stdin -- bash -c 'if [ -f "/results/orders/Reporting-mixedquery-300/stderr.txt" ]; then echo "/results/orders/Reporting-mixedquery-300/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-mixedquery-300/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-mixedquery-300/stderr.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-mixedquery-300/stderr.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-67d9575494-4zhsb --stdin -- du -k /results/orders/Reporting-mixedquery-300/stderr.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
0 /results/orders/Reporting-mixedquery-300/stderr.txt
--- stderr ---
- Download file (size 0k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
source : /results/orders/Reporting-mixedquery-300/stderr.txt @ overseer-0-67d9575494-4zhsb
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/stderr.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-67d9575494-4zhsb
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-67d9575494-4zhsb:/results/orders/Reporting-mixedquery-300/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/stderr.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/08_Verification/15_Reporting-mixedquery-300/stderr.txt is small (0 lines), printing all lines:
----- output -----
________________________________________________________________________________
[2024-03-11 04:59:14] Reporting-mixedquery-300 step12 : Check stderr log
________________________________________________________________________________
PASS: no error found in stderr log
________________________________________________________________________________
[2024-03-11 04:59:14] Reporting-mixedquery-300 step13 : Analyze graphs for spikes
________________________________________________________________________________
Analyze Gatling graphs for spikes
checking parameters
open overall stats JSON file
checking simulation request restLoginInitiate
checking simulation request restLoginUsernamePasswordCallback
checking simulation request Skip 2FA
checking simulation request User Authorize PKCE stage
checking simulation request User AccessToken PKCE stage
checking simulation request queryFull
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/07_scenario/07_mixedquery-300/gatling/req_queryfull-e5d3d.html - cannot check for spikes
checking simulation request queryBySn
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/07_scenario/07_mixedquery-300/gatling/req_querybysn-65c9b.html - cannot check for spikes
checking simulation request ReadManagedUser
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/07_scenario/07_mixedquery-300/gatling/req_readmanageduser-f3f1e.html - cannot check for spikes
checking simulation request queryPartial
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/07_scenario/07_mixedquery-300/gatling/req_querypartial-f2acd.html - cannot check for spikes
checking simulation request queryStartsWith
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/07_scenario/07_mixedquery-300/gatling/req_querystartswith-1e9cd.html - cannot check for spikes
no spikes found
________________________________________________________________________________
[2024-03-11 04:59:14] Reporting-mixedquery-300 step14 : Collect Gatling simulation data
________________________________________________________________________________
collected stats :
{
"global": {
"name": "All Requests",
"numberOfRequests": {
"total": 353391,
"ok": 82873,
"ko": 270518
},
"minResponseTime": {
"total": 6,
"ok": 17,
"ko": 6
},
"maxResponseTime": {
"total": 60084,
"ok": 60000,
"ko": 60084
},
"meanResponseTime": {
"total": 14974,
"ok": 14409,
"ko": 15147
},
"standardDeviation": {
"total": 23942,
"ok": 18468,
"ko": 25381
},
"percentiles1": {
"total": 10,
"ok": 4573,
"ko": 8
},
"percentiles2": {
"total": 23757,
"ok": 20019,
"ko": 29739
},
"percentiles3": {
"total": 60000,
"ok": 57626,
"ko": 60000
},
"percentiles4": {
"total": 60000,
"ok": 59657,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 2569,
"percentage": 1
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 1038,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 79266,
"percentage": 22
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 270518,
"percentage": 77
},
"meanNumberOfRequestsPerSecond": {
"total": 287.07636068237207,
"ok": 67.3216896831844,
"ko": 219.75467099918765
}
},
"details": [
{
"name": "restLoginInitiate",
"numberOfRequests": {
"total": 1,
"ok": 1,
"ko": 0
},
"minResponseTime": {
"total": 875,
"ok": 875,
"ko": 0
},
"maxResponseTime": {
"total": 875,
"ok": 875,
"ko": 0
},
"meanResponseTime": {
"total": 875,
"ok": 875,
"ko": 0
},
"standardDeviation": {
"total": 0,
"ok": 0,
"ko": 0
},
"percentiles1": {
"total": 875,
"ok": 875,
"ko": 0
},
"percentiles2": {
"total": 875,
"ok": 875,
"ko": 0
},
"percentiles3": {
"total": 875,
"ok": 875,
"ko": 0
},
"percentiles4": {
"total": 875,
"ok": 875,
"ko": 0
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 0,
"percentage": 0
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 1,
"percentage": 100
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 0,
"percentage": 0
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 0,
"percentage": 0
},
"meanNumberOfRequestsPerSecond": {
"total": 0.0008123476848090983,
"ok": 0.0008123476848090983,
"ko": 0
},
"spikes": []
},
{
"name": "restLoginUsernamePasswordCallback",
"numberOfRequests": {
"total": 1,
"ok": 1,
"ko": 0
},
"minResponseTime": {
"total": 223,
"ok": 223,
"ko": 0
},
"maxResponseTime": {
"total": 223,
"ok": 223,
"ko": 0
},
"meanResponseTime": {
"total": 223,
"ok": 223,
"ko": 0
},
"standardDeviation": {
"total": 0,
"ok": 0,
"ko": 0
},
"percentiles1": {
"total": 223,
"ok": 223,
"ko": 0
},
"percentiles2": {
"total": 223,
"ok": 223,
"ko": 0
},
"percentiles3": {
"total": 223,
"ok": 223,
"ko": 0
},
"percentiles4": {
"total": 223,
"ok": 223,
"ko": 0
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 1,
"percentage": 100
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 0,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 0,
"percentage": 0
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 0,
"percentage": 0
},
"meanNumberOfRequestsPerSecond": {
"total": 0.0008123476848090983,
"ok": 0.0008123476848090983,
"ko": 0
},
"spikes": []
},
{
"name": "Skip 2FA",
"numberOfRequests": {
"total": 1,
"ok": 1,
"ko": 0
},
"minResponseTime": {
"total": 54,
"ok": 54,
"ko": 0
},
"maxResponseTime": {
"total": 54,
"ok": 54,
"ko": 0
},
"meanResponseTime": {
"total": 54,
"ok": 54,
"ko": 0
},
"standardDeviation": {
"total": 0,
"ok": 0,
"ko": 0
},
"percentiles1": {
"total": 54,
"ok": 54,
"ko": 0
},
"percentiles2": {
"total": 54,
"ok": 54,
"ko": 0
},
"percentiles3": {
"total": 54,
"ok": 54,
"ko": 0
},
"percentiles4": {
"total": 54,
"ok": 54,
"ko": 0
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 1,
"percentage": 100
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 0,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 0,
"percentage": 0
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 0,
"percentage": 0
},
"meanNumberOfRequestsPerSecond": {
"total": 0.0008123476848090983,
"ok": 0.0008123476848090983,
"ko": 0
},
"spikes": []
},
{
"name": "User Authorize PKCE stage",
"numberOfRequests": {
"total": 1,
"ok": 1,
"ko": 0
},
"minResponseTime": {
"total": 50,
"ok": 50,
"ko": 0
},
"maxResponseTime": {
"total": 50,
"ok": 50,
"ko": 0
},
"meanResponseTime": {
"total": 50,
"ok": 50,
"ko": 0
},
"standardDeviation": {
"total": 0,
"ok": 0,
"ko": 0
},
"percentiles1": {
"total": 50,
"ok": 50,
"ko": 0
},
"percentiles2": {
"total": 50,
"ok": 50,
"ko": 0
},
"percentiles3": {
"total": 50,
"ok": 50,
"ko": 0
},
"percentiles4": {
"total": 50,
"ok": 50,
"ko": 0
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 1,
"percentage": 100
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 0,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 0,
"percentage": 0
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 0,
"percentage": 0
},
"meanNumberOfRequestsPerSecond": {
"total": 0.0008123476848090983,
"ok": 0.0008123476848090983,
"ko": 0
},
"spikes": []
},
{
"name": "User AccessToken PKCE stage",
"numberOfRequests": {
"total": 1,
"ok": 1,
"ko": 0
},
"minResponseTime": {
"total": 80,
"ok": 80,
"ko": 0
},
"maxResponseTime": {
"total": 80,
"ok": 80,
"ko": 0
},
"meanResponseTime": {
"total": 80,
"ok": 80,
"ko": 0
},
"standardDeviation": {
"total": 0,
"ok": 0,
"ko": 0
},
"percentiles1": {
"total": 80,
"ok": 80,
"ko": 0
},
"percentiles2": {
"total": 80,
"ok": 80,
"ko": 0
},
"percentiles3": {
"total": 80,
"ok": 80,
"ko": 0
},
"percentiles4": {
"total": 80,
"ok": 80,
"ko": 0
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 1,
"percentage": 100
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 0,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 0,
"percentage": 0
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 0,
"percentage": 0
},
"meanNumberOfRequestsPerSecond": {
"total": 0.0008123476848090983,
"ok": 0.0008123476848090983,
"ko": 0
},
"spikes": []
},
{
"name": "queryFull",
"numberOfRequests": {
"total": 70761,
"ok": 16762,
"ko": 53999
},
"minResponseTime": {
"total": 6,
"ok": 17,
"ko": 6
},
"maxResponseTime": {
"total": 60068,
"ok": 59991,
"ko": 60068
},
"meanResponseTime": {
"total": 15020,
"ok": 14514,
"ko": 15177
},
"standardDeviation": {
"total": 23981,
"ok": 18616,
"ko": 25415
},
"percentiles1": {
"total": 10,
"ok": 4518,
"ko": 8
},
"percentiles2": {
"total": 24352,
"ok": 20703,
"ko": 29992
},
"percentiles3": {
"total": 60000,
"ok": 57579,
"ko": 60000
},
"percentiles4": {
"total": 60000,
"ok": 59647,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 580,
"percentage": 1
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 231,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 15951,
"percentage": 23
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 53999,
"percentage": 76
},
"meanNumberOfRequestsPerSecond": {
"total": 57.482534524776604,
"ok": 13.616571892770105,
"ko": 43.8659626320065
},
"spikes": []
},
{
"name": "queryBySn",
"numberOfRequests": {
"total": 70742,
"ok": 16427,
"ko": 54315
},
"minResponseTime": {
"total": 6,
"ok": 17,
"ko": 6
},
"maxResponseTime": {
"total": 60080,
"ok": 60000,
"ko": 60080
},
"meanResponseTime": {
"total": 14883,
"ok": 14185,
"ko": 15094
},
"standardDeviation": {
"total": 23898,
"ok": 18355,
"ko": 25332
},
"percentiles1": {
"total": 9,
"ok": 4512,
"ko": 8
},
"percentiles2": {
"total": 23046,
"ok": 18846,
"ko": 31199
},
"percentiles3": {
"total": 60000,
"ok": 57655,
"ko": 60000
},
"percentiles4": {
"total": 60000,
"ok": 59662,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 520,
"percentage": 1
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 211,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 15696,
"percentage": 22
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 54315,
"percentage": 77
},
"meanNumberOfRequestsPerSecond": {
"total": 57.46709991876523,
"ok": 13.344435418359058,
"ko": 44.122664500406174
},
"spikes": []
},
{
"name": "ReadManagedUser",
"numberOfRequests": {
"total": 70500,
"ok": 16551,
"ko": 53949
},
"minResponseTime": {
"total": 6,
"ok": 18,
"ko": 6
},
"maxResponseTime": {
"total": 60084,
"ok": 60000,
"ko": 60084
},
"meanResponseTime": {
"total": 14974,
"ok": 14334,
"ko": 15170
},
"standardDeviation": {
"total": 23961,
"ok": 18491,
"ko": 25401
},
"percentiles1": {
"total": 10,
"ok": 4519,
"ko": 8
},
"percentiles2": {
"total": 23634,
"ok": 19809,
"ko": 33448
},
"percentiles3": {
"total": 60000,
"ok": 57718,
"ko": 60000
},
"percentiles4": {
"total": 60000,
"ok": 59629,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 511,
"percentage": 1
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 240,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 15800,
"percentage": 22
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 53949,
"percentage": 77
},
"meanNumberOfRequestsPerSecond": {
"total": 57.27051177904143,
"ok": 13.445166531275387,
"ko": 43.825345247766045
},
"spikes": []
},
{
"name": "queryPartial",
"numberOfRequests": {
"total": 70465,
"ok": 16448,
"ko": 54017
},
"minResponseTime": {
"total": 6,
"ok": 159,
"ko": 6
},
"maxResponseTime": {
"total": 60059,
"ok": 59999,
"ko": 60059
},
"meanResponseTime": {
"total": 15019,
"ok": 14504,
"ko": 15176
},
"standardDeviation": {
"total": 23928,
"ok": 18296,
"ko": 25395
},
"percentiles1": {
"total": 10,
"ok": 4720,
"ko": 8
},
"percentiles2": {
"total": 24056,
"ok": 20013,
"ko": 33301
},
"percentiles3": {
"total": 60000,
"ok": 57521,
"ko": 60000
},
"percentiles4": {
"total": 60000,
"ok": 59687,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 419,
"percentage": 1
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 177,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 15852,
"percentage": 22
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 54017,
"percentage": 77
},
"meanNumberOfRequestsPerSecond": {
"total": 57.24207961007311,
"ok": 13.36149471974005,
"ko": 43.88058489033306
},
"spikes": []
},
{
"name": "queryStartsWith",
"numberOfRequests": {
"total": 70918,
"ok": 16680,
"ko": 54238
},
"minResponseTime": {
"total": 6,
"ok": 39,
"ko": 6
},
"maxResponseTime": {
"total": 60073,
"ok": 59999,
"ko": 60073
},
"meanResponseTime": {
"total": 14974,
"ok": 14508,
"ko": 15117
},
"standardDeviation": {
"total": 23940,
"ok": 18574,
"ko": 25361
},
"percentiles1": {
"total": 10,
"ok": 4560,
"ko": 8
},
"percentiles2": {
"total": 23659,
"ok": 20493,
"ko": 28690
},
"percentiles3": {
"total": 60000,
"ok": 57669,
"ko": 60000
},
"percentiles4": {
"total": 60000,
"ok": 59631,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 535,
"percentage": 1
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 178,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 15967,
"percentage": 23
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 54238,
"percentage": 76
},
"meanNumberOfRequestsPerSecond": {
"total": 57.61007311129163,
"ok": 13.549959382615759,
"ko": 44.06011372867587
},
"spikes": []
}
]
}
{
"concurrency": null,
"generic_stats": {
"avg_num_of_requests_per_second": 287,
"avg_response_time": 14974,
"max_response_time": 60000,
"min_response_time": 17,
"num_requests": 353391,
"num_requests_pass": 82873,
"num_requests_percent_pass": 23.451
},
"options": "; duration:1200; testCase:idm.MixedQuery; testMode:open; throughput:300",
"stats": {
"details": [
{
"group1": {
"count": 0,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 0
},
"group2": {
"count": 1,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 100
},
"group3": {
"count": 0,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 0
},
"group4": {
"count": 0,
"htmlName": "failed",
"name": "failed",
"percentage": 0
},
"maxResponseTime": {
"ko": 0,
"ok": 875,
"total": 875
},
"meanNumberOfRequestsPerSecond": {
"ko": 0,
"ok": 0.0008123476848090983,
"total": 0.0008123476848090983
},
"meanResponseTime": {
"ko": 0,
"ok": 875,
"total": 875
},
"minResponseTime": {
"ko": 0,
"ok": 875,
"total": 875
},
"name": "restLoginInitiate",
"numberOfRequests": {
"ko": 0,
"ok": 1,
"total": 1
},
"percentiles1": {
"ko": 0,
"ok": 875,
"total": 875
},
"percentiles2": {
"ko": 0,
"ok": 875,
"total": 875
},
"percentiles3": {
"ko": 0,
"ok": 875,
"total": 875
},
"percentiles4": {
"ko": 0,
"ok": 875,
"total": 875
},
"spikes": [],
"standardDeviation": {
"ko": 0,
"ok": 0,
"total": 0
}
},
{
"group1": {
"count": 1,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 100
},
"group2": {
"count": 0,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 0,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 0
},
"group4": {
"count": 0,
"htmlName": "failed",
"name": "failed",
"percentage": 0
},
"maxResponseTime": {
"ko": 0,
"ok": 223,
"total": 223
},
"meanNumberOfRequestsPerSecond": {
"ko": 0,
"ok": 0.0008123476848090983,
"total": 0.0008123476848090983
},
"meanResponseTime": {
"ko": 0,
"ok": 223,
"total": 223
},
"minResponseTime": {
"ko": 0,
"ok": 223,
"total": 223
},
"name": "restLoginUsernamePasswordCallback",
"numberOfRequests": {
"ko": 0,
"ok": 1,
"total": 1
},
"percentiles1": {
"ko": 0,
"ok": 223,
"total": 223
},
"percentiles2": {
"ko": 0,
"ok": 223,
"total": 223
},
"percentiles3": {
"ko": 0,
"ok": 223,
"total": 223
},
"percentiles4": {
"ko": 0,
"ok": 223,
"total": 223
},
"spikes": [],
"standardDeviation": {
"ko": 0,
"ok": 0,
"total": 0
}
},
{
"group1": {
"count": 1,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 100
},
"group2": {
"count": 0,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 0,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 0
},
"group4": {
"count": 0,
"htmlName": "failed",
"name": "failed",
"percentage": 0
},
"maxResponseTime": {
"ko": 0,
"ok": 54,
"total": 54
},
"meanNumberOfRequestsPerSecond": {
"ko": 0,
"ok": 0.0008123476848090983,
"total": 0.0008123476848090983
},
"meanResponseTime": {
"ko": 0,
"ok": 54,
"total": 54
},
"minResponseTime": {
"ko": 0,
"ok": 54,
"total": 54
},
"name": "Skip 2FA",
"numberOfRequests": {
"ko": 0,
"ok": 1,
"total": 1
},
"percentiles1": {
"ko": 0,
"ok": 54,
"total": 54
},
"percentiles2": {
"ko": 0,
"ok": 54,
"total": 54
},
"percentiles3": {
"ko": 0,
"ok": 54,
"total": 54
},
"percentiles4": {
"ko": 0,
"ok": 54,
"total": 54
},
"spikes": [],
"standardDeviation": {
"ko": 0,
"ok": 0,
"total": 0
}
},
{
"group1": {
"count": 1,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 100
},
"group2": {
"count": 0,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 0,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 0
},
"group4": {
"count": 0,
"htmlName": "failed",
"name": "failed",
"percentage": 0
},
"maxResponseTime": {
"ko": 0,
"ok": 50,
"total": 50
},
"meanNumberOfRequestsPerSecond": {
"ko": 0,
"ok": 0.0008123476848090983,
"total": 0.0008123476848090983
},
"meanResponseTime": {
"ko": 0,
"ok": 50,
"total": 50
},
"minResponseTime": {
"ko": 0,
"ok": 50,
"total": 50
},
"name": "User Authorize PKCE stage",
"numberOfRequests": {
"ko": 0,
"ok": 1,
"total": 1
},
"percentiles1": {
"ko": 0,
"ok": 50,
"total": 50
},
"percentiles2": {
"ko": 0,
"ok": 50,
"total": 50
},
"percentiles3": {
"ko": 0,
"ok": 50,
"total": 50
},
"percentiles4": {
"ko": 0,
"ok": 50,
"total": 50
},
"spikes": [],
"standardDeviation": {
"ko": 0,
"ok": 0,
"total": 0
}
},
{
"group1": {
"count": 1,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 100
},
"group2": {
"count": 0,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 0,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 0
},
"group4": {
"count": 0,
"htmlName": "failed",
"name": "failed",
"percentage": 0
},
"maxResponseTime": {
"ko": 0,
"ok": 80,
"total": 80
},
"meanNumberOfRequestsPerSecond": {
"ko": 0,
"ok": 0.0008123476848090983,
"total": 0.0008123476848090983
},
"meanResponseTime": {
"ko": 0,
"ok": 80,
"total": 80
},
"minResponseTime": {
"ko": 0,
"ok": 80,
"total": 80
},
"name": "User AccessToken PKCE stage",
"numberOfRequests": {
"ko": 0,
"ok": 1,
"total": 1
},
"percentiles1": {
"ko": 0,
"ok": 80,
"total": 80
},
"percentiles2": {
"ko": 0,
"ok": 80,
"total": 80
},
"percentiles3": {
"ko": 0,
"ok": 80,
"total": 80
},
"percentiles4": {
"ko": 0,
"ok": 80,
"total": 80
},
"spikes": [],
"standardDeviation": {
"ko": 0,
"ok": 0,
"total": 0
}
},
{
"group1": {
"count": 580,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 1
},
"group2": {
"count": 231,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 15951,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 23
},
"group4": {
"count": 53999,
"htmlName": "failed",
"name": "failed",
"percentage": 76
},
"maxResponseTime": {
"ko": 60068,
"ok": 59991,
"total": 60068
},
"meanNumberOfRequestsPerSecond": {
"ko": 43.8659626320065,
"ok": 13.616571892770105,
"total": 57.482534524776604
},
"meanResponseTime": {
"ko": 15177,
"ok": 14514,
"total": 15020
},
"minResponseTime": {
"ko": 6,
"ok": 17,
"total": 6
},
"name": "queryFull",
"numberOfRequests": {
"ko": 53999,
"ok": 16762,
"total": 70761
},
"percentiles1": {
"ko": 8,
"ok": 4518,
"total": 10
},
"percentiles2": {
"ko": 29992,
"ok": 20703,
"total": 24352
},
"percentiles3": {
"ko": 60000,
"ok": 57579,
"total": 60000
},
"percentiles4": {
"ko": 60000,
"ok": 59647,
"total": 60000
},
"spikes": [],
"standardDeviation": {
"ko": 25415,
"ok": 18616,
"total": 23981
}
},
{
"group1": {
"count": 520,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 1
},
"group2": {
"count": 211,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 15696,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 22
},
"group4": {
"count": 54315,
"htmlName": "failed",
"name": "failed",
"percentage": 77
},
"maxResponseTime": {
"ko": 60080,
"ok": 60000,
"total": 60080
},
"meanNumberOfRequestsPerSecond": {
"ko": 44.122664500406174,
"ok": 13.344435418359058,
"total": 57.46709991876523
},
"meanResponseTime": {
"ko": 15094,
"ok": 14185,
"total": 14883
},
"minResponseTime": {
"ko": 6,
"ok": 17,
"total": 6
},
"name": "queryBySn",
"numberOfRequests": {
"ko": 54315,
"ok": 16427,
"total": 70742
},
"percentiles1": {
"ko": 8,
"ok": 4512,
"total": 9
},
"percentiles2": {
"ko": 31199,
"ok": 18846,
"total": 23046
},
"percentiles3": {
"ko": 60000,
"ok": 57655,
"total": 60000
},
"percentiles4": {
"ko": 60000,
"ok": 59662,
"total": 60000
},
"spikes": [],
"standardDeviation": {
"ko": 25332,
"ok": 18355,
"total": 23898
}
},
{
"group1": {
"count": 511,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 1
},
"group2": {
"count": 240,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 15800,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 22
},
"group4": {
"count": 53949,
"htmlName": "failed",
"name": "failed",
"percentage": 77
},
"maxResponseTime": {
"ko": 60084,
"ok": 60000,
"total": 60084
},
"meanNumberOfRequestsPerSecond": {
"ko": 43.825345247766045,
"ok": 13.445166531275387,
"total": 57.27051177904143
},
"meanResponseTime": {
"ko": 15170,
"ok": 14334,
"total": 14974
},
"minResponseTime": {
"ko": 6,
"ok": 18,
"total": 6
},
"name": "ReadManagedUser",
"numberOfRequests": {
"ko": 53949,
"ok": 16551,
"total": 70500
},
"percentiles1": {
"ko": 8,
"ok": 4519,
"total": 10
},
"percentiles2": {
"ko": 33448,
"ok": 19809,
"total": 23634
},
"percentiles3": {
"ko": 60000,
"ok": 57718,
"total": 60000
},
"percentiles4": {
"ko": 60000,
"ok": 59629,
"total": 60000
},
"spikes": [],
"standardDeviation": {
"ko": 25401,
"ok": 18491,
"total": 23961
}
},
{
"group1": {
"count": 419,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 1
},
"group2": {
"count": 177,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 15852,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 22
},
"group4": {
"count": 54017,
"htmlName": "failed",
"name": "failed",
"percentage": 77
},
"maxResponseTime": {
"ko": 60059,
"ok": 59999,
"total": 60059
},
"meanNumberOfRequestsPerSecond": {
"ko": 43.88058489033306,
"ok": 13.36149471974005,
"total": 57.24207961007311
},
"meanResponseTime": {
"ko": 15176,
"ok": 14504,
"total": 15019
},
"minResponseTime": {
"ko": 6,
"ok": 159,
"total": 6
},
"name": "queryPartial",
"numberOfRequests": {
"ko": 54017,
"ok": 16448,
"total": 70465
},
"percentiles1": {
"ko": 8,
"ok": 4720,
"total": 10
},
"percentiles2": {
"ko": 33301,
"ok": 20013,
"total": 24056
},
"percentiles3": {
"ko": 60000,
"ok": 57521,
"total": 60000
},
"percentiles4": {
"ko": 60000,
"ok": 59687,
"total": 60000
},
"spikes": [],
"standardDeviation": {
"ko": 25395,
"ok": 18296,
"total": 23928
}
},
{
"group1": {
"count": 535,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 1
},
"group2": {
"count": 178,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 15967,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 23
},
"group4": {
"count": 54238,
"htmlName": "failed",
"name": "failed",
"percentage": 76
},
"maxResponseTime": {
"ko": 60073,
"ok": 59999,
"total": 60073
},
"meanNumberOfRequestsPerSecond": {
"ko": 44.06011372867587,
"ok": 13.549959382615759,
"total": 57.61007311129163
},
"meanResponseTime": {
"ko": 15117,
"ok": 14508,
"total": 14974
},
"minResponseTime": {
"ko": 6,
"ok": 39,
"total": 6
},
"name": "queryStartsWith",
"numberOfRequests": {
"ko": 54238,
"ok": 16680,
"total": 70918
},
"percentiles1": {
"ko": 8,
"ok": 4560,
"total": 10
},
"percentiles2": {
"ko": 28690,
"ok": 20493,
"total": 23659
},
"percentiles3": {
"ko": 60000,
"ok": 57669,
"total": 60000
},
"percentiles4": {
"ko": 60000,
"ok": 59631,
"total": 60000
},
"spikes": [],
"standardDeviation": {
"ko": 25361,
"ok": 18574,
"total": 23940
}
}
],
"global": {
"group1": {
"count": 2569,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 1
},
"group2": {
"count": 1038,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 79266,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 22
},
"group4": {
"count": 270518,
"htmlName": "failed",
"name": "failed",
"percentage": 77
},
"maxResponseTime": {
"ko": 60084,
"ok": 60000,
"total": 60084
},
"meanNumberOfRequestsPerSecond": {
"ko": 219.75467099918765,
"ok": 67.3216896831844,
"total": 287.07636068237207
},
"meanResponseTime": {
"ko": 15147,
"ok": 14409,
"total": 14974
},
"minResponseTime": {
"ko": 6,
"ok": 17,
"total": 6
},
"name": "All Requests",
"numberOfRequests": {
"ko": 270518,
"ok": 82873,
"total": 353391
},
"percentiles1": {
"ko": 8,
"ok": 4573,
"total": 10
},
"percentiles2": {
"ko": 29739,
"ok": 20019,
"total": 23757
},
"percentiles3": {
"ko": 60000,
"ok": 57626,
"total": 60000
},
"percentiles4": {
"ko": 60000,
"ok": 59657,
"total": 60000
},
"standardDeviation": {
"ko": 25381,
"ok": 18468,
"total": 23942
}
}
},
"target_hostname": "openam-ema-perf-iga.forgeblocks.com",
"tool_name": "gatling"
}
________________________________________________________________________________
[2024-03-11 04:59:14] Reporting-mixedquery-300 step15 : Update run description in the Gatling HTML report
________________________________________________________________________________
________________________________________________________________________________
[2024-03-11 04:59:14] Reporting-mixedquery-300 step16 : Remove gatling task's stdout file
________________________________________________________________________________
Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/07_scenario/07_mixedquery-300/stdout.txt
Compressing Gatling stdout.txt file..
________________________________________________________________________________
[2024-03-11 04:59:42] Reporting-mixedquery-300 post : Check output
________________________________________________________________________________
Setting result to PASS
Task has been successfully stopped