--Task--
name: Reporting-login-tree-350
enabled: True
class_name: GatlingResultTask
source_name: overseer-0
source_namespace: >default<
target_name: overseer-0
target_namespace: >default<
start: 0
stop: None
timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow
loop: False
interval: None
dependencies: []
wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150', 'Reporting-login-tree-200', 'Reporting-login-tree-250', 'Reporting-login-tree-300']
options: {'task_name': 'login-tree-350'}
group_name: None
Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock
________________________________________________________________________________
[2024-02-15 16:30:51] Reporting-login-tree-350 pre : N/A
________________________________________________________________________________
source (overseer-0) is a component
[2024-02-15 16:30:51] - INFO: Timeout for this Task has changed to 4h (14400 seconds)
[2024-02-15 16:30:51] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset
Pod stdout file : /results/orders/Reporting-login-tree-350/stdout.txt
Pod stderr file : /results/orders/Reporting-login-tree-350/stderr.txt
Pod log : /results/orders/Reporting-login-tree-350
________________________________________________________________________________
[2024-02-15 16:30:51] Reporting-login-tree-350 step1 : Write order for overseer to generate the report
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/order.json
{
"name": "Reporting-login-tree-350",
"command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-350 --extra-run-jvm-options \"-Xmx4G\"",
"out-dir": "/results/orders/Reporting-login-tree-350"
}
________________________________________________________________________________
[2024-02-15 16:30:52] Reporting-login-tree-350 step2 : Make sure overseer is ready to accept order (not already busy)
________________________________________________________________________________
[loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING"
[loop_until]: (max_time=120, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
WAITING
--- stderr ---
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 7 100 7 0 0 24 0 --:--:-- --:--:-- --:--:-- 24
________________________________________________________________________________
[2024-02-15 16:30:52] Reporting-login-tree-350 step3 : Send order to overseer
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/order.json overseer-0-6c7ffb9c57-bwwsc:/results/orders/order.json
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
Order has been successfully forwarded to overseer
________________________________________________________________________________
[2024-02-15 16:30:54] Reporting-login-tree-350 step4 : Wait order is done
________________________________________________________________________________
Workaround for PERF-1966. Sleeping for 5 seconds.
[loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING"
[loop_until]: (max_time=14400, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 15s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 21s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
WAITING
--- stderr ---
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 7 100 7 0 0 32 0 --:--:-- --:--:-- --:--:-- 32
________________________________________________________________________________
[2024-02-15 16:31:20] Reporting-login-tree-350 step5 : Wait until gatling report is generated on overseer
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-350.tar.gz" ]; then echo "/results/gatling/login-tree-350.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-350.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-350.tar.gz file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/gatling/login-tree-350.tar.gz file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/gatling/login-tree-350.tar.gz
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
352 /results/gatling/login-tree-350.tar.gz
--- stderr ---
- Download file (size 352k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
source : /results/gatling/login-tree-350.tar.gz @ overseer-0-6c7ffb9c57-bwwsc
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/gatling/login-tree-350.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
________________________________________________________________________________
[2024-02-15 16:31:24] Reporting-login-tree-350 step6 : Unzip the result
________________________________________________________________________________
[run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
--- stderr ---
________________________________________________________________________________
[2024-02-15 16:31:24] Reporting-login-tree-350 step7 : Print rc order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-350/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/rc.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-login-tree-350/rc.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-350/rc.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
4 /results/orders/Reporting-login-tree-350/rc.txt
--- stderr ---
- Download file (size 4k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
source : /results/orders/Reporting-login-tree-350/rc.txt @ overseer-0-6c7ffb9c57-bwwsc
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-350/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt is small (1 lines), printing all lines:
----- output -----
CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15])
________________________________________________________________________________
[2024-02-15 16:31:28] Reporting-login-tree-350 step8 : Check rc log
________________________________________________________________________________
PASS: no error found in rc log
________________________________________________________________________________
[2024-02-15 16:31:28] Reporting-login-tree-350 step9 : Print stdout order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-350/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/stdout.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-login-tree-350/stdout.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-350/stdout.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
4 /results/orders/Reporting-login-tree-350/stdout.txt
--- stderr ---
- Download file (size 4k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
source : /results/orders/Reporting-login-tree-350/stdout.txt @ overseer-0-6c7ffb9c57-bwwsc
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-350/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt is small (86 lines), printing all lines:
----- output -----
[cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-350/loadtest-20240215152216494 --extra-run-jvm-options -Xmx4G
GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling
Generating Gatling reports locally
Parsing log file(s)...
Parsing log file(s) done
Generating reports...
================================================================================
---- Global Information --------------------------------------------------------
> request count 2250390 (OK=1758261 KO=492129)
> min response time 35 (OK=41 KO=35 )
> max response time 60001 (OK=58152 KO=60001 )
> mean response time 10142 (OK=10396 KO=9235 )
> std deviation 8760 (OK=9173 KO=7016 )
> response time 50th percentile 9040 (OK=8868 KO=9040 )
> response time 75th percentile 14028 (OK=14949 KO=9065 )
> response time 95th percentile 27652 (OK=28253 KO=24783 )
> response time 99th percentile 38510 (OK=39256 KO=34142 )
> mean requests/sec 617.052 (OK=482.112 KO=134.941)
---- Response Time Distribution ------------------------------------------------
> t < 800 ms 307835 ( 14%)
> 800 ms <= t < 1200 ms 26745 ( 1%)
> t >= 1200 ms 1423681 ( 63%)
> failed 492129 ( 22%)
---- Errors --------------------------------------------------------------------
> status.find.is(200), but actually found 502 434961 (52.02%)
> restLoginUsernamePasswordCallback: Failed to build request: No 343952 (41.14%)
attribute named 'callbacks' is defined
> status.find.is(200), but actually found 503 54505 ( 6.52%)
> status.find.is(200), but actually found 500 1691 ( 0.20%)
> status.find.is(200), but actually found 401 925 ( 0.11%)
> Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 36 ( 0.00%)
5.190.24.146:443 after 60000 ms
> j.i.IOException: Premature close 8 ( 0.00%)
> status.find.is(200), but actually found 400 2 ( 0.00%)
> j.n.c.ClosedChannelException 1 ( 0.00%)
================================================================================
Reports generated in 0s.
Please open the following file: file:///results/gatling/login-tree-350/loadtest-20240215152216494/index.html
----------------------
[15/Feb/2024 16:31:15] Create tar file /results/gatling/login-tree-350.tar.gz
----------------------
SIMULATION_PATH=/results/gatling/login-tree-350/loadtest-20240215152216494
RESULT_FOLDER=login-tree-350
RESULT_PATH=/results/gatling/login-tree-350
PWD=/results/gatling/login-tree-350/loadtest-20240215152216494
[cmd] tar -czvf /results/gatling/login-tree-350.tar.gz --exclude=simulation.log *
index.html
js/
js/all_sessions.js
js/bootstrap.min.js
js/gatling.js
js/stats.json
js/jquery-3.5.1.min.js
js/theme.js
js/highstock.js
js/assertions.xml
js/menu.js
js/ellipsis.js
js/highcharts-more.js
js/stats.js
js/global_stats.json
js/unpack.js
js/assertions.json
req_restlogininitia-e2b9b.html
req_restloginprogre-9fc93.html
req_restloginuserna-d98ea.html
style/
style/logo.svg
style/arrow_right.png
style/stat-l-temps.png
style/stat-l-roue.png
style/favicon.ico
style/style.css
style/sorted-down.png
style/logo-enterprise.svg
style/stat-fleche-bas.png
style/bootstrap.min.css
style/arrow_right_black.png
style/arrow_down_black.png
style/sorted-up.png
style/sortable.png
style/arrow_down.png
style/little_arrow_right.png
________________________________________________________________________________
[2024-02-15 16:31:32] Reporting-login-tree-350 step10 : Check stdout log
________________________________________________________________________________
PASS: no error found in stdout log
________________________________________________________________________________
[2024-02-15 16:31:32] Reporting-login-tree-350 step11 : Print stderr order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-350/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/stderr.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-login-tree-350/stderr.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-350/stderr.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
0 /results/orders/Reporting-login-tree-350/stderr.txt
--- stderr ---
- Download file (size 0k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
source : /results/orders/Reporting-login-tree-350/stderr.txt @ overseer-0-6c7ffb9c57-bwwsc
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-6c7ffb9c57-bwwsc
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-350/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt is small (0 lines), printing all lines:
----- output -----
________________________________________________________________________________
[2024-02-15 16:31:36] Reporting-login-tree-350 step12 : Check stderr log
________________________________________________________________________________
PASS: no error found in stderr log
________________________________________________________________________________
[2024-02-15 16:31:36] Reporting-login-tree-350 step13 : Analyze graphs for spikes
________________________________________________________________________________
Analyze Gatling graphs for spikes
checking parameters
open overall stats JSON file
checking simulation request restLoginInitiate
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes
checking simulation request restLoginUsernamePasswordCallback
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restloginuserna-d98ea.html - cannot check for spikes
checking simulation request restloginProgressiveProfileCallback
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restloginprogre-9fc93.html - cannot check for spikes
no spikes found
________________________________________________________________________________
[2024-02-15 16:31:36] Reporting-login-tree-350 step14 : Collect gatling simulation data
________________________________________________________________________________
collected stats :
{
"global": {
"name": "All Requests",
"numberOfRequests": {
"total": 2250390,
"ok": 1758261,
"ko": 492129
},
"minResponseTime": {
"total": 35,
"ok": 41,
"ko": 35
},
"maxResponseTime": {
"total": 60001,
"ok": 58152,
"ko": 60001
},
"meanResponseTime": {
"total": 10142,
"ok": 10396,
"ko": 9235
},
"standardDeviation": {
"total": 8760,
"ok": 9173,
"ko": 7016
},
"percentiles1": {
"total": 9040,
"ok": 8868,
"ko": 9040
},
"percentiles2": {
"total": 14028,
"ok": 14949,
"ko": 9065
},
"percentiles3": {
"total": 27652,
"ok": 28253,
"ko": 24783
},
"percentiles4": {
"total": 38510,
"ok": 39256,
"ko": 34142
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 307835,
"percentage": 14
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 26745,
"percentage": 1
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 1423681,
"percentage": 63
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 492129,
"percentage": 22
},
"meanNumberOfRequestsPerSecond": {
"total": 617.0523718124485,
"ok": 482.11159857417056,
"ko": 134.94077323827804
}
},
"details": [
{
"name": "restLoginInitiate",
"numberOfRequests": {
"total": 1264639,
"ok": 920687,
"ko": 343952
},
"minResponseTime": {
"total": 38,
"ok": 41,
"ko": 38
},
"maxResponseTime": {
"total": 60001,
"ok": 58152,
"ko": 60001
},
"meanResponseTime": {
"total": 8066,
"ok": 7942,
"ko": 8397
},
"standardDeviation": {
"total": 7392,
"ok": 8050,
"ko": 5222
},
"percentiles1": {
"total": 7652,
"ok": 6032,
"ko": 9040
},
"percentiles2": {
"total": 10314,
"ok": 12026,
"ko": 9041
},
"percentiles3": {
"total": 22926,
"ok": 23765,
"ko": 16285
},
"percentiles4": {
"total": 32234,
"ok": 33405,
"ko": 28919
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 208041,
"percentage": 16
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 21615,
"percentage": 2
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 691031,
"percentage": 55
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 343952,
"percentage": 27
},
"meanNumberOfRequestsPerSecond": {
"total": 346.76144776528656,
"ok": 252.45050726624623,
"ko": 94.31094049904031
},
"spikes": []
},
{
"name": "restLoginUsernamePasswordCallback",
"numberOfRequests": {
"total": 920687,
"ok": 782309,
"ko": 138378
},
"minResponseTime": {
"total": 35,
"ok": 101,
"ko": 35
},
"maxResponseTime": {
"total": 60001,
"ok": 56280,
"ko": 60001
},
"meanResponseTime": {
"total": 12830,
"ok": 13121,
"ko": 11180
},
"standardDeviation": {
"total": 9646,
"ok": 9595,
"ko": 9764
},
"percentiles1": {
"total": 11442,
"ok": 11907,
"ko": 8613
},
"percentiles2": {
"total": 17161,
"ok": 17322,
"ko": 16000
},
"percentiles3": {
"total": 31594,
"ok": 31703,
"ko": 31208
},
"percentiles4": {
"total": 43699,
"ok": 43601,
"ko": 44015
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 92746,
"percentage": 10
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 4823,
"percentage": 1
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 684740,
"percentage": 74
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 138378,
"percentage": 15
},
"meanNumberOfRequestsPerSecond": {
"total": 252.45050726624623,
"ok": 214.5075404442007,
"ko": 37.94296682204552
},
"spikes": []
},
{
"name": "restloginProgressiveProfileCallback",
"numberOfRequests": {
"total": 65064,
"ok": 55265,
"ko": 9799
},
"minResponseTime": {
"total": 36,
"ok": 133,
"ko": 36
},
"maxResponseTime": {
"total": 60000,
"ok": 52805,
"ko": 60000
},
"meanResponseTime": {
"total": 12473,
"ok": 12699,
"ko": 11204
},
"standardDeviation": {
"total": 9180,
"ok": 9139,
"ko": 9307
},
"percentiles1": {
"total": 11437,
"ok": 11693,
"ko": 9212
},
"percentiles2": {
"total": 16403,
"ok": 16451,
"ko": 16041
},
"percentiles3": {
"total": 30420,
"ok": 30517,
"ko": 29929
},
"percentiles4": {
"total": 41399,
"ok": 41448,
"ko": 39727
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 7048,
"percentage": 11
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 307,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 47910,
"percentage": 74
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 9799,
"percentage": 15
},
"meanNumberOfRequestsPerSecond": {
"total": 17.84041678091582,
"ok": 15.15355086372361,
"ko": 2.686865917192213
},
"spikes": []
}
]
}
{
"concurrency": null,
"generic_stats": {
"avg_num_of_requests_per_second": 617,
"avg_response_time": 10142,
"max_response_time": 58152,
"min_response_time": 41,
"num_requests": 2250390,
"num_requests_pass": 1758261,
"num_requests_percent_pass": 78.131
},
"options": "; testCase:idc.login; testMode:open; throughput:350; rampup-duration:30; duration:3600",
"stats": {
"details": [
{
"group1": {
"count": 208041,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 16
},
"group2": {
"count": 21615,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 2
},
"group3": {
"count": 691031,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 55
},
"group4": {
"count": 343952,
"htmlName": "failed",
"name": "failed",
"percentage": 27
},
"maxResponseTime": {
"ko": 60001,
"ok": 58152,
"total": 60001
},
"meanNumberOfRequestsPerSecond": {
"ko": 94.31094049904031,
"ok": 252.45050726624623,
"total": 346.76144776528656
},
"meanResponseTime": {
"ko": 8397,
"ok": 7942,
"total": 8066
},
"minResponseTime": {
"ko": 38,
"ok": 41,
"total": 38
},
"name": "restLoginInitiate",
"numberOfRequests": {
"ko": 343952,
"ok": 920687,
"total": 1264639
},
"percentiles1": {
"ko": 9040,
"ok": 6032,
"total": 7652
},
"percentiles2": {
"ko": 9041,
"ok": 12026,
"total": 10314
},
"percentiles3": {
"ko": 16285,
"ok": 23765,
"total": 22926
},
"percentiles4": {
"ko": 28919,
"ok": 33405,
"total": 32234
},
"spikes": [],
"standardDeviation": {
"ko": 5222,
"ok": 8050,
"total": 7392
}
},
{
"group1": {
"count": 92746,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 10
},
"group2": {
"count": 4823,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 1
},
"group3": {
"count": 684740,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 74
},
"group4": {
"count": 138378,
"htmlName": "failed",
"name": "failed",
"percentage": 15
},
"maxResponseTime": {
"ko": 60001,
"ok": 56280,
"total": 60001
},
"meanNumberOfRequestsPerSecond": {
"ko": 37.94296682204552,
"ok": 214.5075404442007,
"total": 252.45050726624623
},
"meanResponseTime": {
"ko": 11180,
"ok": 13121,
"total": 12830
},
"minResponseTime": {
"ko": 35,
"ok": 101,
"total": 35
},
"name": "restLoginUsernamePasswordCallback",
"numberOfRequests": {
"ko": 138378,
"ok": 782309,
"total": 920687
},
"percentiles1": {
"ko": 8613,
"ok": 11907,
"total": 11442
},
"percentiles2": {
"ko": 16000,
"ok": 17322,
"total": 17161
},
"percentiles3": {
"ko": 31208,
"ok": 31703,
"total": 31594
},
"percentiles4": {
"ko": 44015,
"ok": 43601,
"total": 43699
},
"spikes": [],
"standardDeviation": {
"ko": 9764,
"ok": 9595,
"total": 9646
}
},
{
"group1": {
"count": 7048,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 11
},
"group2": {
"count": 307,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 47910,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 74
},
"group4": {
"count": 9799,
"htmlName": "failed",
"name": "failed",
"percentage": 15
},
"maxResponseTime": {
"ko": 60000,
"ok": 52805,
"total": 60000
},
"meanNumberOfRequestsPerSecond": {
"ko": 2.686865917192213,
"ok": 15.15355086372361,
"total": 17.84041678091582
},
"meanResponseTime": {
"ko": 11204,
"ok": 12699,
"total": 12473
},
"minResponseTime": {
"ko": 36,
"ok": 133,
"total": 36
},
"name": "restloginProgressiveProfileCallback",
"numberOfRequests": {
"ko": 9799,
"ok": 55265,
"total": 65064
},
"percentiles1": {
"ko": 9212,
"ok": 11693,
"total": 11437
},
"percentiles2": {
"ko": 16041,
"ok": 16451,
"total": 16403
},
"percentiles3": {
"ko": 29929,
"ok": 30517,
"total": 30420
},
"percentiles4": {
"ko": 39727,
"ok": 41448,
"total": 41399
},
"spikes": [],
"standardDeviation": {
"ko": 9307,
"ok": 9139,
"total": 9180
}
}
],
"global": {
"group1": {
"count": 307835,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 14
},
"group2": {
"count": 26745,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 1
},
"group3": {
"count": 1423681,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 63
},
"group4": {
"count": 492129,
"htmlName": "failed",
"name": "failed",
"percentage": 22
},
"maxResponseTime": {
"ko": 60001,
"ok": 58152,
"total": 60001
},
"meanNumberOfRequestsPerSecond": {
"ko": 134.94077323827804,
"ok": 482.11159857417056,
"total": 617.0523718124485
},
"meanResponseTime": {
"ko": 9235,
"ok": 10396,
"total": 10142
},
"minResponseTime": {
"ko": 35,
"ok": 41,
"total": 35
},
"name": "All Requests",
"numberOfRequests": {
"ko": 492129,
"ok": 1758261,
"total": 2250390
},
"percentiles1": {
"ko": 9040,
"ok": 8868,
"total": 9040
},
"percentiles2": {
"ko": 9065,
"ok": 14949,
"total": 14028
},
"percentiles3": {
"ko": 24783,
"ok": 28253,
"total": 27652
},
"percentiles4": {
"ko": 34142,
"ok": 39256,
"total": 38510
},
"standardDeviation": {
"ko": 7016,
"ok": 9173,
"total": 8760
}
}
},
"target_hostname": "openam-ema-perf-benchmark.forgeblocks.com",
"tool_name": "gatling"
}
________________________________________________________________________________
[2024-02-15 16:31:36] Reporting-login-tree-350 step15 : Remove gatling task's stdout file
________________________________________________________________________________
Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/stdout.txt
Compressing Gatling stdout.txt file..
________________________________________________________________________________
[2024-02-15 16:32:01] Reporting-login-tree-350 post : Check output
________________________________________________________________________________
Setting result to PASS
Task has been successfully stopped