--Task-- name: Reporting-login-tree-150 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100'] options: {'task_name': 'login-tree-150'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-02-13 14:53:07] Reporting-login-tree-150 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [2024-02-13 14:53:07] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [2024-02-13 14:53:07] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-150/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-150/stderr.txt Pod log : /results/orders/Reporting-login-tree-150 ________________________________________________________________________________ [2024-02-13 14:53:07] Reporting-login-tree-150 step1 : Write order for overseer to generate the report ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/order.json { "name": "Reporting-login-tree-150", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-150 --extra-run-jvm-options \"-Xmx4G\"", "out-dir": "/results/orders/Reporting-login-tree-150" } ________________________________________________________________________________ [2024-02-13 14:53:07] Reporting-login-tree-150 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2024-02-13 14:53:07] Reporting-login-tree-150 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/order.json overseer-0-58754774cf-xhms5:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-02-13 14:53:09] Reporting-login-tree-150 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=14400, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2024-02-13 14:53:25] Reporting-login-tree-150 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-150.tar.gz" ]; then echo "/results/gatling/login-tree-150.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-150.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-150.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/login-tree-150.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/gatling/login-tree-150.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 360 /results/gatling/login-tree-150.tar.gz --- stderr --- - Download file (size 360k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- source : /results/gatling/login-tree-150.tar.gz @ overseer-0-58754774cf-xhms5 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-150.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/gatling/login-tree-150.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-150.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-02-13 14:53:29] Reporting-login-tree-150 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-150.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/04_login-tree-150/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [2024-02-13 14:53:29] Reporting-login-tree-150 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-150/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-150/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-150/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-150/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-150/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-150/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-150/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- source : /results/orders/Reporting-login-tree-150/rc.txt @ overseer-0-58754774cf-xhms5 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-150/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-02-13 14:53:33] Reporting-login-tree-150 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [2024-02-13 14:53:33] Reporting-login-tree-150 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-150/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-150/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-150/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-150/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-150/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-150/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-150/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- source : /results/orders/Reporting-login-tree-150/stdout.txt @ overseer-0-58754774cf-xhms5 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-150/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/stdout.txt is small (84 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-150/loadtest-20240213092943563 --extra-run-jvm-options -Xmx4G GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Generating Gatling reports locally Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 1218251 (OK=1202465 KO=15786 ) > min response time 34 (OK=39 KO=34 ) > max response time 60002 (OK=59998 KO=60002 ) > mean response time 11811 (OK=11805 KO=12249 ) > std deviation 11293 (OK=11289 KO=11575 ) > response time 50th percentile 9032 (OK=9009 KO=9620 ) > response time 75th percentile 20225 (OK=20281 KO=14972 ) > response time 95th percentile 32133 (OK=32142 KO=30913 ) > response time 99th percentile 44294 (OK=44031 KO=60000 ) > mean requests/sec 335.329 (OK=330.984 KO=4.345 ) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 278383 ( 23%) > 800 ms <= t < 1200 ms 30030 ( 2%) > t >= 1200 ms 894052 ( 73%) > failed 15786 ( 1%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 502 11066 (51.21%) > restLoginUsernamePasswordCallback: Failed to build request: No 5822 (26.94%) attribute named 'callbacks' is defined > status.find.is(200), but actually found 500 1938 ( 8.97%) > status.find.is(200), but actually found 401 1857 ( 8.59%) > Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 564 ( 2.61%) 4.102.200.114:443 after 60000 ms > status.find.is(200), but actually found 503 360 ( 1.67%) > j.i.IOException: Premature close 1 ( 0.00%) ================================================================================ Reports generated in 0s. Please open the following file: file:///results/gatling/login-tree-150/loadtest-20240213092943563/index.html ---------------------- [13/Feb/2024 14:53:22] Create tar file /results/gatling/login-tree-150.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/login-tree-150/loadtest-20240213092943563 RESULT_FOLDER=login-tree-150 RESULT_PATH=/results/gatling/login-tree-150 PWD=/results/gatling/login-tree-150/loadtest-20240213092943563 [cmd] tar -czvf /results/gatling/login-tree-150.tar.gz --exclude=simulation.log * index.html js/ js/assertions.json js/stats.js js/all_sessions.js js/highstock.js js/theme.js js/menu.js js/highcharts-more.js js/assertions.xml js/gatling.js js/ellipsis.js js/jquery-3.5.1.min.js js/stats.json js/global_stats.json js/bootstrap.min.js js/unpack.js req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/stat-fleche-bas.png style/bootstrap.min.css style/arrow_right_black.png style/sorted-up.png style/style.css style/arrow_down.png style/stat-l-roue.png style/sortable.png style/logo.svg style/sorted-down.png style/arrow_right.png style/logo-enterprise.svg style/arrow_down_black.png style/stat-l-temps.png style/favicon.ico style/little_arrow_right.png ________________________________________________________________________________ [2024-02-13 14:53:37] Reporting-login-tree-150 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2024-02-13 14:53:37] Reporting-login-tree-150 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-150/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-150/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-150/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-150/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-150/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-150/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting-login-tree-150/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- source : /results/orders/Reporting-login-tree-150/stderr.txt @ overseer-0-58754774cf-xhms5 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-150/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/12_Reporting-login-tree-150/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-02-13 14:53:40] Reporting-login-tree-150 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2024-02-13 14:53:40] Reporting-login-tree-150 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/04_login-tree-150/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/04_login-tree-150/gatling/req_restloginuserna-d98ea.html - cannot check for spikes checking simulation request restloginProgressiveProfileCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/04_login-tree-150/gatling/req_restloginprogre-9fc93.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2024-02-13 14:53:40] Reporting-login-tree-150 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 1218251, "ok": 1202465, "ko": 15786 }, "minResponseTime": { "total": 34, "ok": 39, "ko": 34 }, "maxResponseTime": { "total": 60002, "ok": 59998, "ko": 60002 }, "meanResponseTime": { "total": 11811, "ok": 11805, "ko": 12249 }, "standardDeviation": { "total": 11293, "ok": 11289, "ko": 11575 }, "percentiles1": { "total": 9032, "ok": 9009, "ko": 9620 }, "percentiles2": { "total": 20225, "ok": 20281, "ko": 14972 }, "percentiles3": { "total": 32133, "ok": 32142, "ko": 30913 }, "percentiles4": { "total": 44294, "ok": 44031, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 278383, "percentage": 23 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 30030, "percentage": 2 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 894052, "percentage": 73 }, "group4": { "name": "failed", "htmlName": "failed", "count": 15786, "percentage": 1 }, "meanNumberOfRequestsPerSecond": { "total": 335.3292045141756, "ok": 330.98403523259014, "ko": 4.345169281585466 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 542698, "ok": 536876, "ko": 5822 }, "minResponseTime": { "total": 37, "ok": 39, "ko": 37 }, "maxResponseTime": { "total": 60001, "ok": 44133, "ko": 60001 }, "meanResponseTime": { "total": 5790, "ok": 5766, "ko": 7944 }, "standardDeviation": { "total": 7399, "ok": 7390, "ko": 7876 }, "percentiles1": { "total": 2982, "ok": 2897, "ko": 6837 }, "percentiles2": { "total": 9377, "ok": 9358, "ko": 10184 }, "percentiles3": { "total": 20505, "ok": 20602, "ko": 15024 }, "percentiles4": { "total": 32775, "ok": 32736, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 220503, "percentage": 41 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 9937, "percentage": 2 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 306436, "percentage": 56 }, "group4": { "name": "failed", "htmlName": "failed", "count": 5822, "percentage": 1 }, "meanNumberOfRequestsPerSecond": { "total": 149.38012661712082, "ok": 147.77759427470411, "ko": 1.6025323424167355 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 536876, "ok": 529389, "ko": 7487 }, "minResponseTime": { "total": 34, "ok": 107, "ko": 34 }, "maxResponseTime": { "total": 60002, "ok": 59998, "ko": 60002 }, "meanResponseTime": { "total": 16092, "ok": 16114, "ko": 14504 }, "standardDeviation": { "total": 11698, "ok": 11681, "ko": 12752 }, "percentiles1": { "total": 16863, "ok": 16980, "ko": 11188 }, "percentiles2": { "total": 23858, "ok": 23892, "ko": 17089 }, "percentiles3": { "total": 35359, "ok": 35363, "ko": 34316 }, "percentiles4": { "total": 47919, "ok": 47772, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 50889, "percentage": 9 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 17416, "percentage": 3 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 461084, "percentage": 86 }, "group4": { "name": "failed", "htmlName": "failed", "count": 7487, "percentage": 1 }, "meanNumberOfRequestsPerSecond": { "total": 147.77759427470411, "ok": 145.71676300578034, "ko": 2.0608312689237547 }, "spikes": [] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 138677, "ok": 136200, "ko": 2477 }, "minResponseTime": { "total": 36, "ok": 153, "ko": 36 }, "maxResponseTime": { "total": 60001, "ok": 59997, "ko": 60001 }, "meanResponseTime": { "total": 18803, "ok": 18862, "ko": 15553 }, "standardDeviation": { "total": 10702, "ok": 10666, "ko": 12111 }, "percentiles1": { "total": 19633, "ok": 19719, "ko": 13989 }, "percentiles2": { "total": 24881, "ok": 24934, "ko": 18660 }, "percentiles3": { "total": 36166, "ok": 36190, "ko": 31764 }, "percentiles4": { "total": 48385, "ok": 48196, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 6991, "percentage": 5 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 2677, "percentage": 2 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 126532, "percentage": 91 }, "group4": { "name": "failed", "htmlName": "failed", "count": 2477, "percentage": 2 }, "meanNumberOfRequestsPerSecond": { "total": 38.17148362235067, "ok": 37.4896779521057, "ko": 0.6818056702449766 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 335, "avg_response_time": 11811, "max_response_time": 59998, "min_response_time": 39, "num_requests": 1218251, "num_requests_pass": 1202465, "num_requests_percent_pass": 98.704 }, "options": "; testCase:idc.login; testMode:open; throughput:150; rampup-duration:30; duration:3600", "stats": { "details": [ { "group1": { "count": 220503, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 41 }, "group2": { "count": 9937, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 2 }, "group3": { "count": 306436, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 56 }, "group4": { "count": 5822, "htmlName": "failed", "name": "failed", "percentage": 1 }, "maxResponseTime": { "ko": 60001, "ok": 44133, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 1.6025323424167355, "ok": 147.77759427470411, "total": 149.38012661712082 }, "meanResponseTime": { "ko": 7944, "ok": 5766, "total": 5790 }, "minResponseTime": { "ko": 37, "ok": 39, "total": 37 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 5822, "ok": 536876, "total": 542698 }, "percentiles1": { "ko": 6837, "ok": 2897, "total": 2982 }, "percentiles2": { "ko": 10184, "ok": 9358, "total": 9377 }, "percentiles3": { "ko": 15024, "ok": 20602, "total": 20505 }, "percentiles4": { "ko": 60000, "ok": 32736, "total": 32775 }, "spikes": [], "standardDeviation": { "ko": 7876, "ok": 7390, "total": 7399 } }, { "group1": { "count": 50889, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 9 }, "group2": { "count": 17416, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 3 }, "group3": { "count": 461084, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 86 }, "group4": { "count": 7487, "htmlName": "failed", "name": "failed", "percentage": 1 }, "maxResponseTime": { "ko": 60002, "ok": 59998, "total": 60002 }, "meanNumberOfRequestsPerSecond": { "ko": 2.0608312689237547, "ok": 145.71676300578034, "total": 147.77759427470411 }, "meanResponseTime": { "ko": 14504, "ok": 16114, "total": 16092 }, "minResponseTime": { "ko": 34, "ok": 107, "total": 34 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 7487, "ok": 529389, "total": 536876 }, "percentiles1": { "ko": 11188, "ok": 16980, "total": 16863 }, "percentiles2": { "ko": 17089, "ok": 23892, "total": 23858 }, "percentiles3": { "ko": 34316, "ok": 35363, "total": 35359 }, "percentiles4": { "ko": 60000, "ok": 47772, "total": 47919 }, "spikes": [], "standardDeviation": { "ko": 12752, "ok": 11681, "total": 11698 } }, { "group1": { "count": 6991, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 5 }, "group2": { "count": 2677, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 2 }, "group3": { "count": 126532, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 91 }, "group4": { "count": 2477, "htmlName": "failed", "name": "failed", "percentage": 2 }, "maxResponseTime": { "ko": 60001, "ok": 59997, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 0.6818056702449766, "ok": 37.4896779521057, "total": 38.17148362235067 }, "meanResponseTime": { "ko": 15553, "ok": 18862, "total": 18803 }, "minResponseTime": { "ko": 36, "ok": 153, "total": 36 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 2477, "ok": 136200, "total": 138677 }, "percentiles1": { "ko": 13989, "ok": 19719, "total": 19633 }, "percentiles2": { "ko": 18660, "ok": 24934, "total": 24881 }, "percentiles3": { "ko": 31764, "ok": 36190, "total": 36166 }, "percentiles4": { "ko": 60000, "ok": 48196, "total": 48385 }, "spikes": [], "standardDeviation": { "ko": 12111, "ok": 10666, "total": 10702 } } ], "global": { "group1": { "count": 278383, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 23 }, "group2": { "count": 30030, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 2 }, "group3": { "count": 894052, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 73 }, "group4": { "count": 15786, "htmlName": "failed", "name": "failed", "percentage": 1 }, "maxResponseTime": { "ko": 60002, "ok": 59998, "total": 60002 }, "meanNumberOfRequestsPerSecond": { "ko": 4.345169281585466, "ok": 330.98403523259014, "total": 335.3292045141756 }, "meanResponseTime": { "ko": 12249, "ok": 11805, "total": 11811 }, "minResponseTime": { "ko": 34, "ok": 39, "total": 34 }, "name": "All Requests", "numberOfRequests": { "ko": 15786, "ok": 1202465, "total": 1218251 }, "percentiles1": { "ko": 9620, "ok": 9009, "total": 9032 }, "percentiles2": { "ko": 14972, "ok": 20281, "total": 20225 }, "percentiles3": { "ko": 30913, "ok": 32142, "total": 32133 }, "percentiles4": { "ko": 60000, "ok": 44031, "total": 44294 }, "standardDeviation": { "ko": 11575, "ok": 11289, "total": 11293 } } }, "target_hostname": "openam-ema-perf-benchmark.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2024-02-13 14:53:40] Reporting-login-tree-150 step15 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/04_login-tree-150/stdout.txt Compressing Gatling stdout.txt file.. ________________________________________________________________________________ [2024-02-13 14:53:42] Reporting-login-tree-150 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped