--Task-- name: Reporting-login-tree-250 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150', 'Reporting-login-tree-200'] options: {'task_name': 'login-tree-250'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-01-26 01:42:56] Reporting-login-tree-250 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [2024-01-26 01:42:56] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [2024-01-26 01:42:56] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-250/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-250/stderr.txt Pod log : /results/orders/Reporting-login-tree-250 ________________________________________________________________________________ [2024-01-26 01:42:56] Reporting-login-tree-250 step1 : Write order for overseer to generate the report ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/order.json { "name": "Reporting-login-tree-250", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-250 --extra-run-jvm-options \"-Xmx4G\"", "out-dir": "/results/orders/Reporting-login-tree-250" } ________________________________________________________________________________ [2024-01-26 01:42:57] Reporting-login-tree-250 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 26 0 --:--:-- --:--:-- --:--:-- 26 ________________________________________________________________________________ [2024-01-26 01:42:57] Reporting-login-tree-250 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/order.json overseer-0-7cfd994c8b-ffn5c:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-01-26 01:42:59] Reporting-login-tree-250 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=14400, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 15s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 21s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 26s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 26 0 --:--:-- --:--:-- --:--:-- 26 ________________________________________________________________________________ [2024-01-26 01:43:30] Reporting-login-tree-250 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- Checking pod: overseer-0-7cfd994c8b-ffn5c for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cfd994c8b-ffn5c --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-250.tar.gz" ]; then echo "/results/gatling/login-tree-250.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-250.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-250.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/login-tree-250.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cfd994c8b-ffn5c --stdin -- du -k /results/gatling/login-tree-250.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 276 /results/gatling/login-tree-250.tar.gz --- stderr --- - Download file (size 276k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- source : /results/gatling/login-tree-250.tar.gz @ overseer-0-7cfd994c8b-ffn5c destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-250.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7cfd994c8b-ffn5c:/results/gatling/login-tree-250.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-250.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-01-26 01:43:34] Reporting-login-tree-250 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-250.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/06_login-tree-250/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [2024-01-26 01:43:35] Reporting-login-tree-250 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- Checking pod: overseer-0-7cfd994c8b-ffn5c for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cfd994c8b-ffn5c --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-250/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-250/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-250/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-250/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-250/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cfd994c8b-ffn5c --stdin -- du -k /results/orders/Reporting-login-tree-250/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-250/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- source : /results/orders/Reporting-login-tree-250/rc.txt @ overseer-0-7cfd994c8b-ffn5c destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7cfd994c8b-ffn5c:/results/orders/Reporting-login-tree-250/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-01-26 01:43:39] Reporting-login-tree-250 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [2024-01-26 01:43:39] Reporting-login-tree-250 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- Checking pod: overseer-0-7cfd994c8b-ffn5c for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cfd994c8b-ffn5c --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-250/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-250/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-250/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-250/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-250/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cfd994c8b-ffn5c --stdin -- du -k /results/orders/Reporting-login-tree-250/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-250/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- source : /results/orders/Reporting-login-tree-250/stdout.txt @ overseer-0-7cfd994c8b-ffn5c destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7cfd994c8b-ffn5c:/results/orders/Reporting-login-tree-250/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stdout.txt is small (77 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-250/loadtest-20240125223205144 --extra-run-jvm-options -Xmx4G GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Generating Gatling reports locally Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 1821593 (OK=1816093 KO=5500 ) > min response time 37 (OK=39 KO=37 ) > max response time 2123 (OK=2123 KO=236 ) > mean response time 94 (OK=94 KO=45 ) > std deviation 55 (OK=55 KO=11 ) > response time 50th percentile 107 (OK=112 KO=44 ) > response time 75th percentile 140 (OK=140 KO=48 ) > response time 95th percentile 161 (OK=161 KO=53 ) > response time 99th percentile 200 (OK=200 KO=63 ) > mean requests/sec 501.678 (OK=500.163 KO=1.515 ) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 1815910 (100%) > 800 ms <= t < 1200 ms 180 ( 0%) > t >= 1200 ms 3 ( 0%) > failed 5500 ( 0%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 401 2750 (50.00%) > jsonPath($.tokenId).find.exists, found nothing 2750 (50.00%) ================================================================================ Reports generated in 0s. Please open the following file: file:///results/gatling/login-tree-250/loadtest-20240125223205144/index.html ---------------------- [26/Jan/2024 01:43:27] Create tar file /results/gatling/login-tree-250.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/login-tree-250/loadtest-20240125223205144 RESULT_FOLDER=login-tree-250 RESULT_PATH=/results/gatling/login-tree-250 PWD=/results/gatling/login-tree-250/loadtest-20240125223205144 [cmd] tar -czvf /results/gatling/login-tree-250.tar.gz --exclude=simulation.log * index.html js/ js/highcharts-more.js js/all_sessions.js js/jquery-3.5.1.min.js js/assertions.xml js/global_stats.json js/menu.js js/gatling.js js/assertions.json js/ellipsis.js js/unpack.js js/stats.js js/stats.json js/highstock.js js/bootstrap.min.js js/theme.js req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/bootstrap.min.css style/stat-fleche-bas.png style/arrow_right_black.png style/arrow_right.png style/stat-l-temps.png style/sorted-up.png style/logo.svg style/sortable.png style/sorted-down.png style/little_arrow_right.png style/logo-enterprise.svg style/stat-l-roue.png style/style.css style/favicon.ico style/arrow_down.png style/arrow_down_black.png ________________________________________________________________________________ [2024-01-26 01:43:43] Reporting-login-tree-250 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2024-01-26 01:43:43] Reporting-login-tree-250 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- Checking pod: overseer-0-7cfd994c8b-ffn5c for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cfd994c8b-ffn5c --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-250/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-250/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-250/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-250/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-250/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7cfd994c8b-ffn5c --stdin -- du -k /results/orders/Reporting-login-tree-250/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting-login-tree-250/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- source : /results/orders/Reporting-login-tree-250/stderr.txt @ overseer-0-7cfd994c8b-ffn5c destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cfd994c8b-ffn5c --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7cfd994c8b-ffn5c:/results/orders/Reporting-login-tree-250/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-01-26 01:43:47] Reporting-login-tree-250 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2024-01-26 01:43:47] Reporting-login-tree-250 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/06_login-tree-250/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback checking simulation request restloginProgressiveProfileCallback no spikes found ________________________________________________________________________________ [2024-01-26 01:43:47] Reporting-login-tree-250 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 1821593, "ok": 1816093, "ko": 5500 }, "minResponseTime": { "total": 37, "ok": 39, "ko": 37 }, "maxResponseTime": { "total": 2123, "ok": 2123, "ko": 236 }, "meanResponseTime": { "total": 94, "ok": 94, "ko": 45 }, "standardDeviation": { "total": 55, "ok": 55, "ko": 11 }, "percentiles1": { "total": 107, "ok": 112, "ko": 44 }, "percentiles2": { "total": 140, "ok": 140, "ko": 48 }, "percentiles3": { "total": 161, "ok": 161, "ko": 53 }, "percentiles4": { "total": 200, "ok": 200, "ko": 63 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 1815910, "percentage": 100 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 180, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 3, "percentage": 0 }, "group4": { "name": "failed", "htmlName": "failed", "count": 5500, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 501.6780501239328, "ok": 500.16331589093915, "ko": 1.5147342329936657 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 905970, "ok": 905970, "ko": 0 }, "minResponseTime": { "total": 39, "ok": 39, "ko": 0 }, "maxResponseTime": { "total": 2123, "ok": 2123, "ko": 0 }, "meanResponseTime": { "total": 44, "ok": 44, "ko": 0 }, "standardDeviation": { "total": 5, "ok": 5, "ko": 0 }, "percentiles1": { "total": 44, "ok": 44, "ko": 0 }, "percentiles2": { "total": 45, "ok": 45, "ko": 0 }, "percentiles3": { "total": 47, "ok": 47, "ko": 0 }, "percentiles4": { "total": 53, "ok": 53, "ko": 0 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 905966, "percentage": 100 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 2, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 2, "percentage": 0 }, "group4": { "name": "failed", "htmlName": "failed", "count": 0, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 249.50977692095842, "ok": 249.50977692095842, "ko": 0 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 905970, "ok": 903220, "ko": 2750 }, "minResponseTime": { "total": 43, "ok": 102, "ko": 43 }, "maxResponseTime": { "total": 1224, "ok": 1224, "ko": 236 }, "meanResponseTime": { "total": 144, "ok": 144, "ko": 50 }, "standardDeviation": { "total": 33, "ok": 33, "ko": 13 }, "percentiles1": { "total": 140, "ok": 140, "ko": 48 }, "percentiles2": { "total": 148, "ok": 148, "ko": 50 }, "percentiles3": { "total": 171, "ok": 171, "ko": 56 }, "percentiles4": { "total": 276, "ok": 276, "ko": 78 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 903043, "percentage": 100 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 176, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 1, "percentage": 0 }, "group4": { "name": "failed", "htmlName": "failed", "count": 2750, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 249.50977692095842, "ok": 248.7524098044616, "ko": 0.7573671164968329 }, "spikes": [] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 9653, "ok": 6903, "ko": 2750 }, "minResponseTime": { "total": 37, "ok": 144, "ko": 37 }, "maxResponseTime": { "total": 1138, "ok": 1138, "ko": 203 }, "meanResponseTime": { "total": 150, "ok": 193, "ko": 41 }, "standardDeviation": { "total": 75, "ok": 34, "ko": 4 }, "percentiles1": { "total": 181, "ok": 190, "ko": 40 }, "percentiles2": { "total": 196, "ok": 201, "ko": 41 }, "percentiles3": { "total": 220, "ok": 225, "ko": 44 }, "percentiles4": { "total": 258, "ok": 276, "ko": 49 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 6901, "percentage": 71 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 2, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "htmlName": "failed", "count": 2750, "percentage": 28 }, "meanNumberOfRequestsPerSecond": { "total": 2.6584962820159737, "ok": 1.9011291655191407, "ko": 0.7573671164968329 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 502, "avg_response_time": 94, "max_response_time": 2123, "min_response_time": 39, "num_requests": 1821593, "num_requests_pass": 1816093, "num_requests_percent_pass": 99.698 }, "options": "; testCase:idc.login; testMode:open; throughput:250; rampup-duration:30; duration:3600", "stats": { "details": [ { "group1": { "count": 905966, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 2, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 2, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0 }, "group4": { "count": 0, "htmlName": "failed", "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 0, "ok": 2123, "total": 2123 }, "meanNumberOfRequestsPerSecond": { "ko": 0, "ok": 249.50977692095842, "total": 249.50977692095842 }, "meanResponseTime": { "ko": 0, "ok": 44, "total": 44 }, "minResponseTime": { "ko": 0, "ok": 39, "total": 39 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 0, "ok": 905970, "total": 905970 }, "percentiles1": { "ko": 0, "ok": 44, "total": 44 }, "percentiles2": { "ko": 0, "ok": 45, "total": 45 }, "percentiles3": { "ko": 0, "ok": 47, "total": 47 }, "percentiles4": { "ko": 0, "ok": 53, "total": 53 }, "spikes": [], "standardDeviation": { "ko": 0, "ok": 5, "total": 5 } }, { "group1": { "count": 903043, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 176, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 1, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0 }, "group4": { "count": 2750, "htmlName": "failed", "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 236, "ok": 1224, "total": 1224 }, "meanNumberOfRequestsPerSecond": { "ko": 0.7573671164968329, "ok": 248.7524098044616, "total": 249.50977692095842 }, "meanResponseTime": { "ko": 50, "ok": 144, "total": 144 }, "minResponseTime": { "ko": 43, "ok": 102, "total": 43 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 2750, "ok": 903220, "total": 905970 }, "percentiles1": { "ko": 48, "ok": 140, "total": 140 }, "percentiles2": { "ko": 50, "ok": 148, "total": 148 }, "percentiles3": { "ko": 56, "ok": 171, "total": 171 }, "percentiles4": { "ko": 78, "ok": 276, "total": 276 }, "spikes": [], "standardDeviation": { "ko": 13, "ok": 33, "total": 33 } }, { "group1": { "count": 6901, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 71 }, "group2": { "count": 2, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0 }, "group4": { "count": 2750, "htmlName": "failed", "name": "failed", "percentage": 28 }, "maxResponseTime": { "ko": 203, "ok": 1138, "total": 1138 }, "meanNumberOfRequestsPerSecond": { "ko": 0.7573671164968329, "ok": 1.9011291655191407, "total": 2.6584962820159737 }, "meanResponseTime": { "ko": 41, "ok": 193, "total": 150 }, "minResponseTime": { "ko": 37, "ok": 144, "total": 37 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 2750, "ok": 6903, "total": 9653 }, "percentiles1": { "ko": 40, "ok": 190, "total": 181 }, "percentiles2": { "ko": 41, "ok": 201, "total": 196 }, "percentiles3": { "ko": 44, "ok": 225, "total": 220 }, "percentiles4": { "ko": 49, "ok": 276, "total": 258 }, "spikes": [], "standardDeviation": { "ko": 4, "ok": 34, "total": 75 } } ], "global": { "group1": { "count": 1815910, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 180, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 3, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 0 }, "group4": { "count": 5500, "htmlName": "failed", "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 236, "ok": 2123, "total": 2123 }, "meanNumberOfRequestsPerSecond": { "ko": 1.5147342329936657, "ok": 500.16331589093915, "total": 501.6780501239328 }, "meanResponseTime": { "ko": 45, "ok": 94, "total": 94 }, "minResponseTime": { "ko": 37, "ok": 39, "total": 37 }, "name": "All Requests", "numberOfRequests": { "ko": 5500, "ok": 1816093, "total": 1821593 }, "percentiles1": { "ko": 44, "ok": 112, "total": 107 }, "percentiles2": { "ko": 48, "ok": 140, "total": 140 }, "percentiles3": { "ko": 53, "ok": 161, "total": 161 }, "percentiles4": { "ko": 63, "ok": 200, "total": 200 }, "standardDeviation": { "ko": 11, "ok": 55, "total": 55 } } }, "target_hostname": "openam-ema-perf-benchmark.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2024-01-26 01:43:47] Reporting-login-tree-250 step15 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/06_login-tree-250/stdout.txt Compressing Gatling stdout.txt file.. ________________________________________________________________________________ [2024-01-26 01:43:47] Reporting-login-tree-250 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped