--Task-- name: Reporting-login-tree-450 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150', 'Reporting-login-tree-200', 'Reporting-login-tree-250', 'Reporting-login-tree-300', 'Reporting-login-tree-350', 'Reporting-login-tree-400'] options: {'task_name': 'login-tree-450'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-02-25 06:34:05] Reporting-login-tree-450 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [2024-02-25 06:34:05] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [2024-02-25 06:34:05] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-450/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-450/stderr.txt Pod log : /results/orders/Reporting-login-tree-450 ________________________________________________________________________________ [2024-02-25 06:34:05] Reporting-login-tree-450 step1 : Write order for overseer to generate the report ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/order.json { "name": "Reporting-login-tree-450", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-450 --extra-run-jvm-options \"-Xmx4G\"", "out-dir": "/results/orders/Reporting-login-tree-450" } ________________________________________________________________________________ [2024-02-25 06:34:05] Reporting-login-tree-450 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 27 0 --:--:-- --:--:-- --:--:-- 27 ________________________________________________________________________________ [2024-02-25 06:34:05] Reporting-login-tree-450 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/order.json overseer-0-86b9999bcb-xv8f9:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-02-25 06:34:07] Reporting-login-tree-450 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=14400, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 16s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 21s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 26s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 25 0 --:--:-- --:--:-- --:--:-- 25 ________________________________________________________________________________ [2024-02-25 06:34:39] Reporting-login-tree-450 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- Checking pod: overseer-0-86b9999bcb-xv8f9 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-86b9999bcb-xv8f9 --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-450.tar.gz" ]; then echo "/results/gatling/login-tree-450.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-450.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-450.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/login-tree-450.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-86b9999bcb-xv8f9 --stdin -- du -k /results/gatling/login-tree-450.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 284 /results/gatling/login-tree-450.tar.gz --- stderr --- - Download file (size 284k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- source : /results/gatling/login-tree-450.tar.gz @ overseer-0-86b9999bcb-xv8f9 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-450.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-86b9999bcb-xv8f9:/results/gatling/login-tree-450.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-450.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-02-25 06:34:43] Reporting-login-tree-450 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-450.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/10_login-tree-450/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [2024-02-25 06:34:43] Reporting-login-tree-450 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- Checking pod: overseer-0-86b9999bcb-xv8f9 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-86b9999bcb-xv8f9 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-450/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-450/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-450/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-450/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-450/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-86b9999bcb-xv8f9 --stdin -- du -k /results/orders/Reporting-login-tree-450/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-450/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- source : /results/orders/Reporting-login-tree-450/rc.txt @ overseer-0-86b9999bcb-xv8f9 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-86b9999bcb-xv8f9:/results/orders/Reporting-login-tree-450/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-02-25 06:34:47] Reporting-login-tree-450 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [2024-02-25 06:34:47] Reporting-login-tree-450 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- Checking pod: overseer-0-86b9999bcb-xv8f9 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-86b9999bcb-xv8f9 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-450/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-450/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-450/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-450/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-450/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-86b9999bcb-xv8f9 --stdin -- du -k /results/orders/Reporting-login-tree-450/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-450/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- source : /results/orders/Reporting-login-tree-450/stdout.txt @ overseer-0-86b9999bcb-xv8f9 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-86b9999bcb-xv8f9:/results/orders/Reporting-login-tree-450/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/stdout.txt is small (82 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-450/loadtest-20240225052053943 --extra-run-jvm-options -Xmx4G GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Generating Gatling reports locally Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 2111793 (OK=851420 KO=1260373) > min response time 33 (OK=39 KO=33 ) > max response time 60044 (OK=41843 KO=60044 ) > mean response time 9082 (OK=9134 KO=9046 ) > std deviation 4432 (OK=6031 KO=2888 ) > response time 50th percentile 9038 (OK=8633 KO=9038 ) > response time 75th percentile 9041 (OK=13189 KO=9039 ) > response time 95th percentile 17144 (OK=19154 KO=12708 ) > response time 99th percentile 23582 (OK=26026 KO=19625 ) > mean requests/sec 580.163 (OK=233.907 KO=346.256) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 78123 ( 4%) > 800 ms <= t < 1200 ms 7676 ( 0%) > t >= 1200 ms 765621 ( 36%) > failed 1260373 ( 60%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 502 1243230 (51.73%) > restLoginUsernamePasswordCallback: Failed to build request: No 1142809 (47.55%) attribute named 'callbacks' is defined > status.find.is(200), but actually found 503 17141 ( 0.71%) > Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 1 ( 0.00%) 5.190.24.146:443 after 60000 ms > status.find.is(200), but actually found 401 1 ( 0.00%) ================================================================================ Reports generated in 0s. Please open the following file: file:///results/gatling/login-tree-450/loadtest-20240225052053943/index.html ---------------------- [25/Feb/2024 06:34:38] Create tar file /results/gatling/login-tree-450.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/login-tree-450/loadtest-20240225052053943 RESULT_FOLDER=login-tree-450 RESULT_PATH=/results/gatling/login-tree-450 PWD=/results/gatling/login-tree-450/loadtest-20240225052053943 [cmd] tar -czvf /results/gatling/login-tree-450.tar.gz --exclude=simulation.log * index.html js/ js/ellipsis.js js/unpack.js js/global_stats.json js/highstock.js js/gatling.js js/bootstrap.min.js js/theme.js js/menu.js js/all_sessions.js js/highcharts-more.js js/stats.js js/jquery-3.5.1.min.js js/assertions.json js/stats.json js/assertions.xml req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/stat-l-temps.png style/stat-l-roue.png style/favicon.ico style/sorted-up.png style/little_arrow_right.png style/logo-enterprise.svg style/sorted-down.png style/sortable.png style/stat-fleche-bas.png style/arrow_right_black.png style/logo.svg style/arrow_down_black.png style/style.css style/bootstrap.min.css style/arrow_right.png style/arrow_down.png ________________________________________________________________________________ [2024-02-25 06:34:51] Reporting-login-tree-450 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2024-02-25 06:34:51] Reporting-login-tree-450 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- Checking pod: overseer-0-86b9999bcb-xv8f9 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-86b9999bcb-xv8f9 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-450/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-450/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-450/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-450/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-450/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-86b9999bcb-xv8f9 --stdin -- du -k /results/orders/Reporting-login-tree-450/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting-login-tree-450/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- source : /results/orders/Reporting-login-tree-450/stderr.txt @ overseer-0-86b9999bcb-xv8f9 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-86b9999bcb-xv8f9 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-86b9999bcb-xv8f9:/results/orders/Reporting-login-tree-450/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/18_Reporting-login-tree-450/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-02-25 06:34:55] Reporting-login-tree-450 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2024-02-25 06:34:55] Reporting-login-tree-450 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/10_login-tree-450/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/10_login-tree-450/gatling/req_restloginuserna-d98ea.html - cannot check for spikes checking simulation request restloginProgressiveProfileCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/10_login-tree-450/gatling/req_restloginprogre-9fc93.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2024-02-25 06:34:55] Reporting-login-tree-450 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 2111793, "ok": 851420, "ko": 1260373 }, "minResponseTime": { "total": 33, "ok": 39, "ko": 33 }, "maxResponseTime": { "total": 60044, "ok": 41843, "ko": 60044 }, "meanResponseTime": { "total": 9082, "ok": 9134, "ko": 9046 }, "standardDeviation": { "total": 4432, "ok": 6031, "ko": 2888 }, "percentiles1": { "total": 9038, "ok": 8633, "ko": 9038 }, "percentiles2": { "total": 9041, "ok": 13189, "ko": 9039 }, "percentiles3": { "total": 17144, "ok": 19154, "ko": 12708 }, "percentiles4": { "total": 23582, "ok": 26026, "ko": 19625 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 78123, "percentage": 4 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 7676, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 765621, "percentage": 36 }, "group4": { "name": "failed", "htmlName": "failed", "count": 1260373, "percentage": 60 }, "meanNumberOfRequestsPerSecond": { "total": 580.1629120879121, "ok": 233.9065934065934, "ko": 346.2563186813187 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 1625033, "ok": 482224, "ko": 1142809 }, "minResponseTime": { "total": 36, "ok": 39, "ko": 36 }, "maxResponseTime": { "total": 42953, "ok": 41843, "ko": 42953 }, "meanResponseTime": { "total": 8167, "ok": 6341, "ko": 8937 }, "standardDeviation": { "total": 3338, "ok": 4957, "ko": 1865 }, "percentiles1": { "total": 9038, "ok": 5909, "ko": 9038 }, "percentiles2": { "total": 9039, "ok": 8945, "ko": 9039 }, "percentiles3": { "total": 11590, "ok": 14791, "ko": 9042 }, "percentiles4": { "total": 17888, "ok": 23336, "ko": 14967 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 68781, "percentage": 4 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 6095, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 407348, "percentage": 25 }, "group4": { "name": "failed", "htmlName": "failed", "count": 1142809, "percentage": 70 }, "meanNumberOfRequestsPerSecond": { "total": 446.43763736263736, "ok": 132.47912087912087, "ko": 313.95851648351646 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 482224, "ok": 365826, "ko": 116398 }, "minResponseTime": { "total": 33, "ok": 102, "ko": 33 }, "maxResponseTime": { "total": 60044, "ok": 40202, "ko": 60044 }, "meanResponseTime": { "total": 12139, "ok": 12783, "ko": 10116 }, "standardDeviation": { "total": 5994, "ok": 5321, "ko": 7380 }, "percentiles1": { "total": 12375, "ok": 12925, "ko": 9107 }, "percentiles2": { "total": 15703, "ok": 15858, "ko": 15205 }, "percentiles3": { "total": 21309, "ok": 21190, "ko": 22231 }, "percentiles4": { "total": 29290, "ok": 27360, "ko": 34907 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 9275, "percentage": 2 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 1567, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 354984, "percentage": 74 }, "group4": { "name": "failed", "htmlName": "failed", "count": 116398, "percentage": 24 }, "meanNumberOfRequestsPerSecond": { "total": 132.47912087912087, "ok": 100.50164835164836, "ko": 31.97747252747253 }, "spikes": [] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 4536, "ok": 3370, "ko": 1166 }, "minResponseTime": { "total": 34, "ok": 142, "ko": 34 }, "maxResponseTime": { "total": 37938, "ok": 37938, "ko": 37011 }, "meanResponseTime": { "total": 11776, "ok": 12662, "ko": 9215 }, "standardDeviation": { "total": 5852, "ok": 5196, "ko": 6809 }, "percentiles1": { "total": 12173, "ok": 12852, "ko": 8056 }, "percentiles2": { "total": 15262, "ok": 15609, "ko": 13675 }, "percentiles3": { "total": 20762, "ok": 20797, "ko": 20677 }, "percentiles4": { "total": 28708, "ok": 26980, "ko": 31872 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 67, "percentage": 1 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 14, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 3289, "percentage": 73 }, "group4": { "name": "failed", "htmlName": "failed", "count": 1166, "percentage": 26 }, "meanNumberOfRequestsPerSecond": { "total": 1.2461538461538462, "ok": 0.9258241758241759, "ko": 0.32032967032967036 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 580, "avg_response_time": 9082, "max_response_time": 41843, "min_response_time": 39, "num_requests": 2111793, "num_requests_pass": 851420, "num_requests_percent_pass": 40.317 }, "options": "; testCase:idc.login; testMode:open; throughput:450; rampup-duration:30; duration:3600", "stats": { "details": [ { "group1": { "count": 68781, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 4 }, "group2": { "count": 6095, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 407348, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 25 }, "group4": { "count": 1142809, "htmlName": "failed", "name": "failed", "percentage": 70 }, "maxResponseTime": { "ko": 42953, "ok": 41843, "total": 42953 }, "meanNumberOfRequestsPerSecond": { "ko": 313.95851648351646, "ok": 132.47912087912087, "total": 446.43763736263736 }, "meanResponseTime": { "ko": 8937, "ok": 6341, "total": 8167 }, "minResponseTime": { "ko": 36, "ok": 39, "total": 36 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 1142809, "ok": 482224, "total": 1625033 }, "percentiles1": { "ko": 9038, "ok": 5909, "total": 9038 }, "percentiles2": { "ko": 9039, "ok": 8945, "total": 9039 }, "percentiles3": { "ko": 9042, "ok": 14791, "total": 11590 }, "percentiles4": { "ko": 14967, "ok": 23336, "total": 17888 }, "spikes": [], "standardDeviation": { "ko": 1865, "ok": 4957, "total": 3338 } }, { "group1": { "count": 9275, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 2 }, "group2": { "count": 1567, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 354984, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 74 }, "group4": { "count": 116398, "htmlName": "failed", "name": "failed", "percentage": 24 }, "maxResponseTime": { "ko": 60044, "ok": 40202, "total": 60044 }, "meanNumberOfRequestsPerSecond": { "ko": 31.97747252747253, "ok": 100.50164835164836, "total": 132.47912087912087 }, "meanResponseTime": { "ko": 10116, "ok": 12783, "total": 12139 }, "minResponseTime": { "ko": 33, "ok": 102, "total": 33 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 116398, "ok": 365826, "total": 482224 }, "percentiles1": { "ko": 9107, "ok": 12925, "total": 12375 }, "percentiles2": { "ko": 15205, "ok": 15858, "total": 15703 }, "percentiles3": { "ko": 22231, "ok": 21190, "total": 21309 }, "percentiles4": { "ko": 34907, "ok": 27360, "total": 29290 }, "spikes": [], "standardDeviation": { "ko": 7380, "ok": 5321, "total": 5994 } }, { "group1": { "count": 67, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 1 }, "group2": { "count": 14, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 3289, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 73 }, "group4": { "count": 1166, "htmlName": "failed", "name": "failed", "percentage": 26 }, "maxResponseTime": { "ko": 37011, "ok": 37938, "total": 37938 }, "meanNumberOfRequestsPerSecond": { "ko": 0.32032967032967036, "ok": 0.9258241758241759, "total": 1.2461538461538462 }, "meanResponseTime": { "ko": 9215, "ok": 12662, "total": 11776 }, "minResponseTime": { "ko": 34, "ok": 142, "total": 34 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 1166, "ok": 3370, "total": 4536 }, "percentiles1": { "ko": 8056, "ok": 12852, "total": 12173 }, "percentiles2": { "ko": 13675, "ok": 15609, "total": 15262 }, "percentiles3": { "ko": 20677, "ok": 20797, "total": 20762 }, "percentiles4": { "ko": 31872, "ok": 26980, "total": 28708 }, "spikes": [], "standardDeviation": { "ko": 6809, "ok": 5196, "total": 5852 } } ], "global": { "group1": { "count": 78123, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 4 }, "group2": { "count": 7676, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 765621, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 36 }, "group4": { "count": 1260373, "htmlName": "failed", "name": "failed", "percentage": 60 }, "maxResponseTime": { "ko": 60044, "ok": 41843, "total": 60044 }, "meanNumberOfRequestsPerSecond": { "ko": 346.2563186813187, "ok": 233.9065934065934, "total": 580.1629120879121 }, "meanResponseTime": { "ko": 9046, "ok": 9134, "total": 9082 }, "minResponseTime": { "ko": 33, "ok": 39, "total": 33 }, "name": "All Requests", "numberOfRequests": { "ko": 1260373, "ok": 851420, "total": 2111793 }, "percentiles1": { "ko": 9038, "ok": 8633, "total": 9038 }, "percentiles2": { "ko": 9039, "ok": 13189, "total": 9041 }, "percentiles3": { "ko": 12708, "ok": 19154, "total": 17144 }, "percentiles4": { "ko": 19625, "ok": 26026, "total": 23582 }, "standardDeviation": { "ko": 2888, "ok": 6031, "total": 4432 } } }, "target_hostname": "openam-ema-perf-benchmark.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2024-02-25 06:34:55] Reporting-login-tree-450 step15 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/10_login-tree-450/stdout.txt Compressing Gatling stdout.txt file.. ________________________________________________________________________________ [2024-02-25 06:35:57] Reporting-login-tree-450 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped