--Task-- name: Reporting-login-tree-350 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150', 'Reporting-login-tree-200', 'Reporting-login-tree-250', 'Reporting-login-tree-300'] options: {'task_name': 'login-tree-350'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-02-24 07:07:41] Reporting-login-tree-350 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [2024-02-24 07:07:41] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [2024-02-24 07:07:41] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-350/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-350/stderr.txt Pod log : /results/orders/Reporting-login-tree-350 ________________________________________________________________________________ [2024-02-24 07:07:41] Reporting-login-tree-350 step1 : Write order for overseer to generate the report ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/order.json { "name": "Reporting-login-tree-350", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-350 --extra-run-jvm-options \"-Xmx4G\"", "out-dir": "/results/orders/Reporting-login-tree-350" } ________________________________________________________________________________ [2024-02-24 07:07:41] Reporting-login-tree-350 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 23 0 --:--:-- --:--:-- --:--:-- 23 ________________________________________________________________________________ [2024-02-24 07:07:42] Reporting-login-tree-350 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/order.json overseer-0-7cd5776d75-rlmrk:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-02-24 07:07:43] Reporting-login-tree-350 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=14400, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 15s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 31 0 --:--:-- --:--:-- --:--:-- 31 ________________________________________________________________________________ [2024-02-24 07:08:04] Reporting-login-tree-350 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- Checking pod: overseer-0-7cd5776d75-rlmrk for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cd5776d75-rlmrk --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-350.tar.gz" ]; then echo "/results/gatling/login-tree-350.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-350.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-350.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/login-tree-350.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cd5776d75-rlmrk --stdin -- du -k /results/gatling/login-tree-350.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 340 /results/gatling/login-tree-350.tar.gz --- stderr --- - Download file (size 340k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- source : /results/gatling/login-tree-350.tar.gz @ overseer-0-7cd5776d75-rlmrk destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7cd5776d75-rlmrk:/results/gatling/login-tree-350.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-02-24 07:08:09] Reporting-login-tree-350 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [2024-02-24 07:08:09] Reporting-login-tree-350 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- Checking pod: overseer-0-7cd5776d75-rlmrk for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cd5776d75-rlmrk --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-350/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-350/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cd5776d75-rlmrk --stdin -- du -k /results/orders/Reporting-login-tree-350/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-350/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- source : /results/orders/Reporting-login-tree-350/rc.txt @ overseer-0-7cd5776d75-rlmrk destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7cd5776d75-rlmrk:/results/orders/Reporting-login-tree-350/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-02-24 07:08:13] Reporting-login-tree-350 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [2024-02-24 07:08:13] Reporting-login-tree-350 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- Checking pod: overseer-0-7cd5776d75-rlmrk for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cd5776d75-rlmrk --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-350/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-350/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cd5776d75-rlmrk --stdin -- du -k /results/orders/Reporting-login-tree-350/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-350/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- source : /results/orders/Reporting-login-tree-350/stdout.txt @ overseer-0-7cd5776d75-rlmrk destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7cd5776d75-rlmrk:/results/orders/Reporting-login-tree-350/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt is small (85 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-350/loadtest-20240224055950630 --extra-run-jvm-options -Xmx4G GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Generating Gatling reports locally Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 2433994 (OK=2256035 KO=177959) > min response time 33 (OK=38 KO=33 ) > max response time 60001 (OK=59875 KO=60001 ) > mean response time 11683 (OK=12188 KO=5286 ) > std deviation 8996 (OK=8982 KO=6320 ) > response time 50th percentile 10497 (OK=11018 KO=4036 ) > response time 75th percentile 16780 (OK=17299 KO=8042 ) > response time 95th percentile 28748 (OK=29158 KO=17394 ) > response time 99th percentile 37517 (OK=37763 KO=26234 ) > mean requests/sec 660.156 (OK=611.889 KO=48.267) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 234171 ( 10%) > 800 ms <= t < 1200 ms 20140 ( 1%) > t >= 1200 ms 2001724 ( 82%) > failed 177959 ( 7%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 502 104211 (38.19%) > restLoginUsernamePasswordCallback: Failed to build request: No 94950 (34.79%) attribute named 'callbacks' is defined > status.find.is(200), but actually found 503 71260 (26.11%) > status.find.is(200), but actually found 500 2111 ( 0.77%) > Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 269 ( 0.10%) 5.190.24.146:443 after 60000 ms > status.find.is(200), but actually found 401 104 ( 0.04%) > i.n.h.s.SslHandshakeTimeoutException: handshake timed out afte 4 ( 0.00%) r 10000ms ================================================================================ Reports generated in 0s. Please open the following file: file:///results/gatling/login-tree-350/loadtest-20240224055950630/index.html ---------------------- [24/Feb/2024 07:08:04] Create tar file /results/gatling/login-tree-350.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/login-tree-350/loadtest-20240224055950630 RESULT_FOLDER=login-tree-350 RESULT_PATH=/results/gatling/login-tree-350 PWD=/results/gatling/login-tree-350/loadtest-20240224055950630 [cmd] tar -czvf /results/gatling/login-tree-350.tar.gz --exclude=simulation.log * index.html js/ js/jquery-3.5.1.min.js js/menu.js js/assertions.json js/highcharts-more.js js/unpack.js js/stats.json js/bootstrap.min.js js/gatling.js js/all_sessions.js js/global_stats.json js/highstock.js js/ellipsis.js js/theme.js js/stats.js js/assertions.xml req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/stat-l-temps.png style/arrow_right_black.png style/style.css style/sortable.png style/logo-enterprise.svg style/favicon.ico style/bootstrap.min.css style/arrow_down.png style/stat-l-roue.png style/stat-fleche-bas.png style/little_arrow_right.png style/sorted-up.png style/arrow_down_black.png style/sorted-down.png style/logo.svg style/arrow_right.png ________________________________________________________________________________ [2024-02-24 07:08:17] Reporting-login-tree-350 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2024-02-24 07:08:17] Reporting-login-tree-350 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- Checking pod: overseer-0-7cd5776d75-rlmrk for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cd5776d75-rlmrk --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-350/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-350/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cd5776d75-rlmrk --stdin -- du -k /results/orders/Reporting-login-tree-350/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting-login-tree-350/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- source : /results/orders/Reporting-login-tree-350/stderr.txt @ overseer-0-7cd5776d75-rlmrk destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cd5776d75-rlmrk --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7cd5776d75-rlmrk:/results/orders/Reporting-login-tree-350/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-02-24 07:08:21] Reporting-login-tree-350 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2024-02-24 07:08:21] Reporting-login-tree-350 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restloginuserna-d98ea.html - cannot check for spikes checking simulation request restloginProgressiveProfileCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restloginprogre-9fc93.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2024-02-24 07:08:21] Reporting-login-tree-350 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 2433994, "ok": 2256035, "ko": 177959 }, "minResponseTime": { "total": 33, "ok": 38, "ko": 33 }, "maxResponseTime": { "total": 60001, "ok": 59875, "ko": 60001 }, "meanResponseTime": { "total": 11683, "ok": 12188, "ko": 5286 }, "standardDeviation": { "total": 8996, "ok": 8982, "ko": 6320 }, "percentiles1": { "total": 10497, "ok": 11018, "ko": 4036 }, "percentiles2": { "total": 16780, "ok": 17299, "ko": 8042 }, "percentiles3": { "total": 28748, "ok": 29158, "ko": 17394 }, "percentiles4": { "total": 37517, "ok": 37763, "ko": 26234 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 234171, "percentage": 10 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 20140, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 2001724, "percentage": 82 }, "group4": { "name": "failed", "htmlName": "failed", "count": 177959, "percentage": 7 }, "meanNumberOfRequestsPerSecond": { "total": 660.15568212639, "ok": 611.8890697043666, "ko": 48.26661242202333 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 1264423, "ok": 1169473, "ko": 94950 }, "minResponseTime": { "total": 36, "ok": 38, "ko": 36 }, "maxResponseTime": { "total": 60001, "ok": 55989, "ko": 60001 }, "meanResponseTime": { "total": 8488, "ok": 8821, "ko": 4385 }, "standardDeviation": { "total": 7623, "ok": 7692, "ko": 5183 }, "percentiles1": { "total": 7191, "ok": 7569, "ko": 3693 }, "percentiles2": { "total": 12476, "ok": 12840, "ko": 8040 }, "percentiles3": { "total": 23714, "ok": 24089, "ko": 12157 }, "percentiles4": { "total": 31713, "ok": 32141, "ko": 20994 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 203832, "percentage": 16 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 14255, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 951386, "percentage": 75 }, "group4": { "name": "failed", "htmlName": "failed", "count": 94950, "percentage": 8 }, "meanNumberOfRequestsPerSecond": { "total": 342.9408733387578, "ok": 317.1882289123949, "ko": 25.752644426362895 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 1169473, "ok": 1086472, "ko": 83001 }, "minResponseTime": { "total": 33, "ok": 98, "ko": 33 }, "maxResponseTime": { "total": 60001, "ok": 59875, "ko": 60001 }, "meanResponseTime": { "total": 15138, "ok": 15811, "ko": 6316 }, "standardDeviation": { "total": 9090, "ok": 8860, "ko": 7273 }, "percentiles1": { "total": 14105, "ok": 14744, "ko": 4037 }, "percentiles2": { "total": 20396, "ok": 20795, "ko": 9570 }, "percentiles3": { "total": 32341, "ok": 32751, "ko": 21858 }, "percentiles4": { "total": 40352, "ok": 40828, "ko": 28549 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 30337, "percentage": 3 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 5885, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 1050250, "percentage": 90 }, "group4": { "name": "failed", "htmlName": "failed", "count": 83001, "percentage": 7 }, "meanNumberOfRequestsPerSecond": { "total": 317.1882289123949, "ok": 294.6764307024681, "ko": 22.51179820992677 }, "spikes": [] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 98, "ok": 90, "ko": 8 }, "minResponseTime": { "total": 35, "ok": 205, "ko": 35 }, "maxResponseTime": { "total": 41709, "ok": 41709, "ko": 16027 }, "meanResponseTime": { "total": 14191, "ok": 15050, "ko": 4536 }, "standardDeviation": { "total": 8755, "ok": 8473, "ko": 5452 }, "percentiles1": { "total": 12479, "ok": 13801, "ko": 2041 }, "percentiles2": { "total": 17281, "ok": 19781, "ko": 8037 }, "percentiles3": { "total": 31139, "ok": 31159, "ko": 13230 }, "percentiles4": { "total": 39926, "ok": 40073, "ko": 15468 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 2, "percentage": 2 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 88, "percentage": 90 }, "group4": { "name": "failed", "htmlName": "failed", "count": 8, "percentage": 8 }, "meanNumberOfRequestsPerSecond": { "total": 0.026579875237320316, "ok": 0.024410089503661515, "ko": 0.0021697857336588013 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 660, "avg_response_time": 11683, "max_response_time": 59875, "min_response_time": 38, "num_requests": 2433994, "num_requests_pass": 2256035, "num_requests_percent_pass": 92.689 }, "options": "; testCase:idc.login; testMode:open; throughput:350; rampup-duration:30; duration:3600", "stats": { "details": [ { "group1": { "count": 203832, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 16 }, "group2": { "count": 14255, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 951386, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 75 }, "group4": { "count": 94950, "htmlName": "failed", "name": "failed", "percentage": 8 }, "maxResponseTime": { "ko": 60001, "ok": 55989, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 25.752644426362895, "ok": 317.1882289123949, "total": 342.9408733387578 }, "meanResponseTime": { "ko": 4385, "ok": 8821, "total": 8488 }, "minResponseTime": { "ko": 36, "ok": 38, "total": 36 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 94950, "ok": 1169473, "total": 1264423 }, "percentiles1": { "ko": 3693, "ok": 7569, "total": 7191 }, "percentiles2": { "ko": 8040, "ok": 12840, "total": 12476 }, "percentiles3": { "ko": 12157, "ok": 24089, "total": 23714 }, "percentiles4": { "ko": 20994, "ok": 32141, "total": 31713 }, "spikes": [], "standardDeviation": { "ko": 5183, "ok": 7692, "total": 7623 } }, { "group1": { "count": 30337, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 3 }, "group2": { "count": 5885, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 1050250, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 90 }, "group4": { "count": 83001, "htmlName": "failed", "name": "failed", "percentage": 7 }, "maxResponseTime": { "ko": 60001, "ok": 59875, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 22.51179820992677, "ok": 294.6764307024681, "total": 317.1882289123949 }, "meanResponseTime": { "ko": 6316, "ok": 15811, "total": 15138 }, "minResponseTime": { "ko": 33, "ok": 98, "total": 33 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 83001, "ok": 1086472, "total": 1169473 }, "percentiles1": { "ko": 4037, "ok": 14744, "total": 14105 }, "percentiles2": { "ko": 9570, "ok": 20795, "total": 20396 }, "percentiles3": { "ko": 21858, "ok": 32751, "total": 32341 }, "percentiles4": { "ko": 28549, "ok": 40828, "total": 40352 }, "spikes": [], "standardDeviation": { "ko": 7273, "ok": 8860, "total": 9090 } }, { "group1": { "count": 2, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 2 }, "group2": { "count": 0, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 88, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 90 }, "group4": { "count": 8, "htmlName": "failed", "name": "failed", "percentage": 8 }, "maxResponseTime": { "ko": 16027, "ok": 41709, "total": 41709 }, "meanNumberOfRequestsPerSecond": { "ko": 0.0021697857336588013, "ok": 0.024410089503661515, "total": 0.026579875237320316 }, "meanResponseTime": { "ko": 4536, "ok": 15050, "total": 14191 }, "minResponseTime": { "ko": 35, "ok": 205, "total": 35 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 8, "ok": 90, "total": 98 }, "percentiles1": { "ko": 2041, "ok": 13801, "total": 12479 }, "percentiles2": { "ko": 8037, "ok": 19781, "total": 17281 }, "percentiles3": { "ko": 13230, "ok": 31159, "total": 31139 }, "percentiles4": { "ko": 15468, "ok": 40073, "total": 39926 }, "spikes": [], "standardDeviation": { "ko": 5452, "ok": 8473, "total": 8755 } } ], "global": { "group1": { "count": 234171, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 10 }, "group2": { "count": 20140, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 2001724, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 82 }, "group4": { "count": 177959, "htmlName": "failed", "name": "failed", "percentage": 7 }, "maxResponseTime": { "ko": 60001, "ok": 59875, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 48.26661242202333, "ok": 611.8890697043666, "total": 660.15568212639 }, "meanResponseTime": { "ko": 5286, "ok": 12188, "total": 11683 }, "minResponseTime": { "ko": 33, "ok": 38, "total": 33 }, "name": "All Requests", "numberOfRequests": { "ko": 177959, "ok": 2256035, "total": 2433994 }, "percentiles1": { "ko": 4036, "ok": 11018, "total": 10497 }, "percentiles2": { "ko": 8042, "ok": 17299, "total": 16780 }, "percentiles3": { "ko": 17394, "ok": 29158, "total": 28748 }, "percentiles4": { "ko": 26234, "ok": 37763, "total": 37517 }, "standardDeviation": { "ko": 6320, "ok": 8982, "total": 8996 } } }, "target_hostname": "openam-ema-perf-benchmark.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2024-02-24 07:08:21] Reporting-login-tree-350 step15 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/stdout.txt Compressing Gatling stdout.txt file.. ________________________________________________________________________________ [2024-02-24 07:08:37] Reporting-login-tree-350 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped