--Task--
name: Reporting-login-tree-200
enabled: True
class_name: GatlingResultTask
source_name: overseer-0
source_namespace: >default<
target_name: overseer-0
target_namespace: >default<
start: 0
stop: None
timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow
loop: False
interval: None
dependencies: []
wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150']
options: {'task_name': 'login-tree-200'}
group_name: None
Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock
________________________________________________________________________________
[2024-02-13 14:53:42] Reporting-login-tree-200 pre : N/A
________________________________________________________________________________
source (overseer-0) is a component
[2024-02-13 14:53:42] - INFO: Timeout for this Task has changed to 4h (14400 seconds)
[2024-02-13 14:53:42] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset
Pod stdout file : /results/orders/Reporting-login-tree-200/stdout.txt
Pod stderr file : /results/orders/Reporting-login-tree-200/stderr.txt
Pod log : /results/orders/Reporting-login-tree-200
________________________________________________________________________________
[2024-02-13 14:53:42] Reporting-login-tree-200 step1 : Write order for overseer to generate the report
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/order.json
{
"name": "Reporting-login-tree-200",
"command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-200 --extra-run-jvm-options \"-Xmx4G\"",
"out-dir": "/results/orders/Reporting-login-tree-200"
}
________________________________________________________________________________
[2024-02-13 14:53:42] Reporting-login-tree-200 step2 : Make sure overseer is ready to accept order (not already busy)
________________________________________________________________________________
[loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING"
[loop_until]: (max_time=120, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
WAITING
--- stderr ---
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33
________________________________________________________________________________
[2024-02-13 14:53:43] Reporting-login-tree-200 step3 : Send order to overseer
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/order.json overseer-0-58754774cf-xhms5:/results/orders/order.json
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
Order has been successfully forwarded to overseer
________________________________________________________________________________
[2024-02-13 14:53:44] Reporting-login-tree-200 step4 : Wait order is done
________________________________________________________________________________
Workaround for PERF-1966. Sleeping for 5 seconds.
[loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING"
[loop_until]: (max_time=14400, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry
[loop_until]: Function succeeded after 10s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
WAITING
--- stderr ---
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 34
________________________________________________________________________________
[2024-02-13 14:54:00] Reporting-login-tree-200 step5 : Wait until gatling report is generated on overseer
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-200.tar.gz" ]; then echo "/results/gatling/login-tree-200.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-200.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-200.tar.gz file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/gatling/login-tree-200.tar.gz file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/gatling/login-tree-200.tar.gz
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
360 /results/gatling/login-tree-200.tar.gz
--- stderr ---
- Download file (size 360k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
source : /results/gatling/login-tree-200.tar.gz @ overseer-0-58754774cf-xhms5
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-200.tar.gz
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/gatling/login-tree-200.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-200.tar.gz
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
________________________________________________________________________________
[2024-02-13 14:54:04] Reporting-login-tree-200 step6 : Unzip the result
________________________________________________________________________________
[run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-200.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/gatling
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
--- stderr ---
________________________________________________________________________________
[2024-02-13 14:54:04] Reporting-login-tree-200 step7 : Print rc order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-200/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-200/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-200/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-200/rc.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-login-tree-200/rc.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-200/rc.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
4 /results/orders/Reporting-login-tree-200/rc.txt
--- stderr ---
- Download file (size 4k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
source : /results/orders/Reporting-login-tree-200/rc.txt @ overseer-0-58754774cf-xhms5
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/rc.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-200/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/rc.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/rc.txt is small (1 lines), printing all lines:
----- output -----
CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15])
________________________________________________________________________________
[2024-02-13 14:54:08] Reporting-login-tree-200 step8 : Check rc log
________________________________________________________________________________
PASS: no error found in rc log
________________________________________________________________________________
[2024-02-13 14:54:08] Reporting-login-tree-200 step9 : Print stdout order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-200/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-200/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-200/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-200/stdout.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-login-tree-200/stdout.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-200/stdout.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
4 /results/orders/Reporting-login-tree-200/stdout.txt
--- stderr ---
- Download file (size 4k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
source : /results/orders/Reporting-login-tree-200/stdout.txt @ overseer-0-58754774cf-xhms5
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stdout.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-200/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stdout.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stdout.txt is small (84 lines), printing all lines:
----- output -----
[cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-200/loadtest-20240213103225243 --extra-run-jvm-options -Xmx4G
GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling
Generating Gatling reports locally
Parsing log file(s)...
Parsing log file(s) done
Generating reports...
================================================================================
---- Global Information --------------------------------------------------------
> request count 1447633 (OK=1200376 KO=247257)
> min response time 33 (OK=39 KO=33 )
> max response time 81196 (OK=81196 KO=60087 )
> mean response time 14261 (OK=15824 KO=6670 )
> std deviation 13657 (OK=13314 KO=12725 )
> response time 50th percentile 9615 (OK=11847 KO=3042 )
> response time 75th percentile 22487 (OK=24757 KO=7885 )
> response time 95th percentile 41681 (OK=41793 KO=27999 )
> response time 99th percentile 55892 (OK=51893 KO=60000 )
> mean requests/sec 397.483 (OK=329.593 KO=67.89 )
---- Response Time Distribution ------------------------------------------------
> t < 800 ms 103363 ( 7%)
> 800 ms <= t < 1200 ms 16181 ( 1%)
> t >= 1200 ms 1080832 ( 75%)
> failed 247257 ( 17%)
---- Errors --------------------------------------------------------------------
> restLoginUsernamePasswordCallback: Failed to build request: No 135204 (35.35%)
attribute named 'callbacks' is defined
> status.find.is(200), but actually found 503 133904 (35.01%)
> status.find.is(200), but actually found 502 87390 (22.85%)
> Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 10397 ( 2.72%)
4.102.200.114:443 after 60000 ms
> status.find.is(200), but actually found 500 9675 ( 2.53%)
> status.find.is(200), but actually found 401 5890 ( 1.54%)
> j.i.IOException: Premature close 1 ( 0.00%)
================================================================================
Reports generated in 0s.
Please open the following file: file:///results/gatling/login-tree-200/loadtest-20240213103225243/index.html
----------------------
[13/Feb/2024 14:53:59] Create tar file /results/gatling/login-tree-200.tar.gz
----------------------
SIMULATION_PATH=/results/gatling/login-tree-200/loadtest-20240213103225243
RESULT_FOLDER=login-tree-200
RESULT_PATH=/results/gatling/login-tree-200
PWD=/results/gatling/login-tree-200/loadtest-20240213103225243
[cmd] tar -czvf /results/gatling/login-tree-200.tar.gz --exclude=simulation.log *
index.html
js/
js/assertions.json
js/stats.js
js/all_sessions.js
js/highstock.js
js/theme.js
js/menu.js
js/highcharts-more.js
js/assertions.xml
js/gatling.js
js/ellipsis.js
js/jquery-3.5.1.min.js
js/stats.json
js/global_stats.json
js/bootstrap.min.js
js/unpack.js
req_restlogininitia-e2b9b.html
req_restloginprogre-9fc93.html
req_restloginuserna-d98ea.html
style/
style/stat-fleche-bas.png
style/bootstrap.min.css
style/arrow_right_black.png
style/sorted-up.png
style/style.css
style/arrow_down.png
style/stat-l-roue.png
style/sortable.png
style/logo.svg
style/sorted-down.png
style/arrow_right.png
style/logo-enterprise.svg
style/arrow_down_black.png
style/stat-l-temps.png
style/favicon.ico
style/little_arrow_right.png
________________________________________________________________________________
[2024-02-13 14:54:12] Reporting-login-tree-200 step10 : Check stdout log
________________________________________________________________________________
PASS: no error found in stdout log
________________________________________________________________________________
[2024-02-13 14:54:12] Reporting-login-tree-200 step11 : Print stderr order
________________________________________________________________________________
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-200/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-200/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-200/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-200/stderr.txt file found"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
/results/orders/Reporting-login-tree-200/stderr.txt file found
--- stderr ---
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-200/stderr.txt
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
0 /results/orders/Reporting-login-tree-200/stderr.txt
--- stderr ---
- Download file (size 0k)
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
source : /results/orders/Reporting-login-tree-200/stderr.txt @ overseer-0-58754774cf-xhms5
destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stderr.txt
[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-58754774cf-xhms5
--- stderr ---
[loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-200/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stderr.txt
[loop_until]: (max_time=-1, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---
[print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stderr.txt is small (0 lines), printing all lines:
----- output -----
________________________________________________________________________________
[2024-02-13 14:54:16] Reporting-login-tree-200 step12 : Check stderr log
________________________________________________________________________________
PASS: no error found in stderr log
________________________________________________________________________________
[2024-02-13 14:54:16] Reporting-login-tree-200 step13 : Analyze graphs for spikes
________________________________________________________________________________
Analyze Gatling graphs for spikes
checking parameters
open overall stats JSON file
checking simulation request restLoginInitiate
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes
checking simulation request restLoginUsernamePasswordCallback
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/gatling/req_restloginuserna-d98ea.html - cannot check for spikes
checking simulation request restloginProgressiveProfileCallback
[warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/gatling/req_restloginprogre-9fc93.html - cannot check for spikes
no spikes found
________________________________________________________________________________
[2024-02-13 14:54:16] Reporting-login-tree-200 step14 : Collect gatling simulation data
________________________________________________________________________________
collected stats :
{
"global": {
"name": "All Requests",
"numberOfRequests": {
"total": 1447633,
"ok": 1200376,
"ko": 247257
},
"minResponseTime": {
"total": 33,
"ok": 39,
"ko": 33
},
"maxResponseTime": {
"total": 81196,
"ok": 81196,
"ko": 60087
},
"meanResponseTime": {
"total": 14261,
"ok": 15824,
"ko": 6670
},
"standardDeviation": {
"total": 13657,
"ok": 13314,
"ko": 12725
},
"percentiles1": {
"total": 9615,
"ok": 11847,
"ko": 3042
},
"percentiles2": {
"total": 22487,
"ok": 24757,
"ko": 7885
},
"percentiles3": {
"total": 41681,
"ok": 41793,
"ko": 27999
},
"percentiles4": {
"total": 55892,
"ok": 51893,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 103363,
"percentage": 7
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 16181,
"percentage": 1
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 1080832,
"percentage": 75
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 247257,
"percentage": 17
},
"meanNumberOfRequestsPerSecond": {
"total": 397.4829763866008,
"ok": 329.5925315760571,
"ko": 67.89044481054366
}
},
"details": [
{
"name": "restLoginInitiate",
"numberOfRequests": {
"total": 723586,
"ok": 588382,
"ko": 135204
},
"minResponseTime": {
"total": 36,
"ok": 39,
"ko": 36
},
"maxResponseTime": {
"total": 60026,
"ok": 59999,
"ko": 60026
},
"meanResponseTime": {
"total": 10799,
"ok": 12258,
"ko": 4447
},
"standardDeviation": {
"total": 11957,
"ok": 12017,
"ko": 9331
},
"percentiles1": {
"total": 6241,
"ok": 7863,
"ko": 1534
},
"percentiles2": {
"total": 16873,
"ok": 20352,
"ko": 6047
},
"percentiles3": {
"total": 34756,
"ok": 35345,
"ko": 12150
},
"percentiles4": {
"total": 49382,
"ok": 48693,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 85949,
"percentage": 12
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 11088,
"percentage": 2
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 491345,
"percentage": 68
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 135204,
"percentage": 19
},
"meanNumberOfRequestsPerSecond": {
"total": 198.6781987918726,
"ok": 161.55464030752333,
"ko": 37.12355848434926
},
"spikes": []
},
{
"name": "restLoginUsernamePasswordCallback",
"numberOfRequests": {
"total": 588382,
"ok": 498515,
"ko": 89867
},
"minResponseTime": {
"total": 33,
"ok": 109,
"ko": 33
},
"maxResponseTime": {
"total": 60087,
"ok": 59994,
"ko": 60087
},
"meanResponseTime": {
"total": 17513,
"ok": 19014,
"ko": 9183
},
"standardDeviation": {
"total": 14361,
"ok": 13643,
"ko": 15360
},
"percentiles1": {
"total": 12954,
"ok": 15026,
"ko": 4049
},
"percentiles2": {
"total": 26756,
"ok": 28556,
"ko": 9813
},
"percentiles3": {
"total": 46367,
"ok": 45549,
"ko": 60000
},
"percentiles4": {
"total": 60000,
"ok": 53577,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 15459,
"percentage": 3
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 4681,
"percentage": 1
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 478375,
"percentage": 81
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 89867,
"percentage": 15
},
"meanNumberOfRequestsPerSecond": {
"total": 161.55464030752333,
"ok": 136.87946183415707,
"ko": 24.675178473366284
},
"spikes": []
},
{
"name": "restloginProgressiveProfileCallback",
"numberOfRequests": {
"total": 135665,
"ok": 113479,
"ko": 22186
},
"minResponseTime": {
"total": 33,
"ok": 155,
"ko": 33
},
"maxResponseTime": {
"total": 81196,
"ok": 81196,
"ko": 60068
},
"meanResponseTime": {
"total": 18620,
"ok": 20296,
"ko": 10044
},
"standardDeviation": {
"total": 14299,
"ok": 13347,
"ko": 15851
},
"percentiles1": {
"total": 13807,
"ok": 16935,
"ko": 5039
},
"percentiles2": {
"total": 27591,
"ok": 29886,
"ko": 10029
},
"percentiles3": {
"total": 47586,
"ok": 46577,
"ko": 60000
},
"percentiles4": {
"total": 60000,
"ok": 53007,
"ko": 60000
},
"group1": {
"name": "t < 800 ms",
"htmlName": "t < 800 ms",
"count": 1955,
"percentage": 1
},
"group2": {
"name": "800 ms <= t < 1200 ms",
"htmlName": "t >= 800 ms
t < 1200 ms",
"count": 412,
"percentage": 0
},
"group3": {
"name": "t >= 1200 ms",
"htmlName": "t >= 1200 ms",
"count": 111112,
"percentage": 82
},
"group4": {
"name": "failed",
"htmlName": "failed",
"count": 22186,
"percentage": 16
},
"meanNumberOfRequestsPerSecond": {
"total": 37.25013728720483,
"ok": 31.158429434376718,
"ko": 6.091707852828116
},
"spikes": []
}
]
}
{
"concurrency": null,
"generic_stats": {
"avg_num_of_requests_per_second": 397,
"avg_response_time": 14261,
"max_response_time": 81196,
"min_response_time": 39,
"num_requests": 1447633,
"num_requests_pass": 1200376,
"num_requests_percent_pass": 82.92
},
"options": "; testCase:idc.login; testMode:open; throughput:200; rampup-duration:30; duration:3600",
"stats": {
"details": [
{
"group1": {
"count": 85949,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 12
},
"group2": {
"count": 11088,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 2
},
"group3": {
"count": 491345,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 68
},
"group4": {
"count": 135204,
"htmlName": "failed",
"name": "failed",
"percentage": 19
},
"maxResponseTime": {
"ko": 60026,
"ok": 59999,
"total": 60026
},
"meanNumberOfRequestsPerSecond": {
"ko": 37.12355848434926,
"ok": 161.55464030752333,
"total": 198.6781987918726
},
"meanResponseTime": {
"ko": 4447,
"ok": 12258,
"total": 10799
},
"minResponseTime": {
"ko": 36,
"ok": 39,
"total": 36
},
"name": "restLoginInitiate",
"numberOfRequests": {
"ko": 135204,
"ok": 588382,
"total": 723586
},
"percentiles1": {
"ko": 1534,
"ok": 7863,
"total": 6241
},
"percentiles2": {
"ko": 6047,
"ok": 20352,
"total": 16873
},
"percentiles3": {
"ko": 12150,
"ok": 35345,
"total": 34756
},
"percentiles4": {
"ko": 60000,
"ok": 48693,
"total": 49382
},
"spikes": [],
"standardDeviation": {
"ko": 9331,
"ok": 12017,
"total": 11957
}
},
{
"group1": {
"count": 15459,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 3
},
"group2": {
"count": 4681,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 1
},
"group3": {
"count": 478375,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 81
},
"group4": {
"count": 89867,
"htmlName": "failed",
"name": "failed",
"percentage": 15
},
"maxResponseTime": {
"ko": 60087,
"ok": 59994,
"total": 60087
},
"meanNumberOfRequestsPerSecond": {
"ko": 24.675178473366284,
"ok": 136.87946183415707,
"total": 161.55464030752333
},
"meanResponseTime": {
"ko": 9183,
"ok": 19014,
"total": 17513
},
"minResponseTime": {
"ko": 33,
"ok": 109,
"total": 33
},
"name": "restLoginUsernamePasswordCallback",
"numberOfRequests": {
"ko": 89867,
"ok": 498515,
"total": 588382
},
"percentiles1": {
"ko": 4049,
"ok": 15026,
"total": 12954
},
"percentiles2": {
"ko": 9813,
"ok": 28556,
"total": 26756
},
"percentiles3": {
"ko": 60000,
"ok": 45549,
"total": 46367
},
"percentiles4": {
"ko": 60000,
"ok": 53577,
"total": 60000
},
"spikes": [],
"standardDeviation": {
"ko": 15360,
"ok": 13643,
"total": 14361
}
},
{
"group1": {
"count": 1955,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 1
},
"group2": {
"count": 412,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 0
},
"group3": {
"count": 111112,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 82
},
"group4": {
"count": 22186,
"htmlName": "failed",
"name": "failed",
"percentage": 16
},
"maxResponseTime": {
"ko": 60068,
"ok": 81196,
"total": 81196
},
"meanNumberOfRequestsPerSecond": {
"ko": 6.091707852828116,
"ok": 31.158429434376718,
"total": 37.25013728720483
},
"meanResponseTime": {
"ko": 10044,
"ok": 20296,
"total": 18620
},
"minResponseTime": {
"ko": 33,
"ok": 155,
"total": 33
},
"name": "restloginProgressiveProfileCallback",
"numberOfRequests": {
"ko": 22186,
"ok": 113479,
"total": 135665
},
"percentiles1": {
"ko": 5039,
"ok": 16935,
"total": 13807
},
"percentiles2": {
"ko": 10029,
"ok": 29886,
"total": 27591
},
"percentiles3": {
"ko": 60000,
"ok": 46577,
"total": 47586
},
"percentiles4": {
"ko": 60000,
"ok": 53007,
"total": 60000
},
"spikes": [],
"standardDeviation": {
"ko": 15851,
"ok": 13347,
"total": 14299
}
}
],
"global": {
"group1": {
"count": 103363,
"htmlName": "t < 800 ms",
"name": "t < 800 ms",
"percentage": 7
},
"group2": {
"count": 16181,
"htmlName": "t >= 800 ms
t < 1200 ms",
"name": "800 ms <= t < 1200 ms",
"percentage": 1
},
"group3": {
"count": 1080832,
"htmlName": "t >= 1200 ms",
"name": "t >= 1200 ms",
"percentage": 75
},
"group4": {
"count": 247257,
"htmlName": "failed",
"name": "failed",
"percentage": 17
},
"maxResponseTime": {
"ko": 60087,
"ok": 81196,
"total": 81196
},
"meanNumberOfRequestsPerSecond": {
"ko": 67.89044481054366,
"ok": 329.5925315760571,
"total": 397.4829763866008
},
"meanResponseTime": {
"ko": 6670,
"ok": 15824,
"total": 14261
},
"minResponseTime": {
"ko": 33,
"ok": 39,
"total": 33
},
"name": "All Requests",
"numberOfRequests": {
"ko": 247257,
"ok": 1200376,
"total": 1447633
},
"percentiles1": {
"ko": 3042,
"ok": 11847,
"total": 9615
},
"percentiles2": {
"ko": 7885,
"ok": 24757,
"total": 22487
},
"percentiles3": {
"ko": 27999,
"ok": 41793,
"total": 41681
},
"percentiles4": {
"ko": 60000,
"ok": 51893,
"total": 55892
},
"standardDeviation": {
"ko": 12725,
"ok": 13314,
"total": 13657
}
}
},
"target_hostname": "openam-ema-perf-benchmark.forgeblocks.com",
"tool_name": "gatling"
}
________________________________________________________________________________
[2024-02-13 14:54:16] Reporting-login-tree-200 step15 : Remove gatling task's stdout file
________________________________________________________________________________
Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/stdout.txt
Compressing Gatling stdout.txt file..
________________________________________________________________________________
[2024-02-13 14:54:35] Reporting-login-tree-200 post : Check output
________________________________________________________________________________
Setting result to PASS
Task has been successfully stopped