--Task-- name: Reporting-login-tree-250 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150', 'Reporting-login-tree-200'] options: {'task_name': 'login-tree-250'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-02-13 14:54:35] Reporting-login-tree-250 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [2024-02-13 14:54:35] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [2024-02-13 14:54:35] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-250/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-250/stderr.txt Pod log : /results/orders/Reporting-login-tree-250 ________________________________________________________________________________ [2024-02-13 14:54:35] Reporting-login-tree-250 step1 : Write order for overseer to generate the report ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/order.json { "name": "Reporting-login-tree-250", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-250 --extra-run-jvm-options \"-Xmx4G\"", "out-dir": "/results/orders/Reporting-login-tree-250" } ________________________________________________________________________________ [2024-02-13 14:54:35] Reporting-login-tree-250 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 25 0 --:--:-- --:--:-- --:--:-- 25 ________________________________________________________________________________ [2024-02-13 14:54:36] Reporting-login-tree-250 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/order.json overseer-0-58754774cf-xhms5:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-02-13 14:54:37] Reporting-login-tree-250 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=14400, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 15s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2024-02-13 14:54:58] Reporting-login-tree-250 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-250.tar.gz" ]; then echo "/results/gatling/login-tree-250.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-250.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-250.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/login-tree-250.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/gatling/login-tree-250.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 344 /results/gatling/login-tree-250.tar.gz --- stderr --- - Download file (size 344k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- source : /results/gatling/login-tree-250.tar.gz @ overseer-0-58754774cf-xhms5 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-250.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/gatling/login-tree-250.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-250.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-02-13 14:55:02] Reporting-login-tree-250 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-250.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/06_login-tree-250/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [2024-02-13 14:55:02] Reporting-login-tree-250 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-250/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-250/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-250/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-250/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-250/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-250/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-250/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- source : /results/orders/Reporting-login-tree-250/rc.txt @ overseer-0-58754774cf-xhms5 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-250/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-02-13 14:55:06] Reporting-login-tree-250 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [2024-02-13 14:55:06] Reporting-login-tree-250 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-250/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-250/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-250/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-250/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-250/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-250/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-250/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- source : /results/orders/Reporting-login-tree-250/stdout.txt @ overseer-0-58754774cf-xhms5 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-250/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stdout.txt is small (84 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-250/loadtest-20240213113559908 --extra-run-jvm-options -Xmx4G GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Generating Gatling reports locally Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 1555486 (OK=1019008 KO=536478) > min response time 32 (OK=38 KO=32 ) > max response time 63000 (OK=63000 KO=60036 ) > mean response time 14256 (OK=17826 KO=7475 ) > std deviation 14631 (OK=13691 KO=13945 ) > response time 50th percentile 9448 (OK=14218 KO=2981 ) > response time 75th percentile 21191 (OK=26170 KO=8111 ) > response time 95th percentile 45808 (OK=45411 KO=54131 ) > response time 99th percentile 60000 (OK=55139 KO=60000 ) > mean requests/sec 425.229 (OK=278.57 KO=146.659) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 54404 ( 3%) > 800 ms <= t < 1200 ms 10978 ( 1%) > t >= 1200 ms 953626 ( 61%) > failed 536478 ( 34%) ---- Errors -------------------------------------------------------------------- > restLoginUsernamePasswordCallback: Failed to build request: No 348015 (39.35%) attribute named 'callbacks' is defined > status.find.is(200), but actually found 503 305523 (34.54%) > status.find.is(200), but actually found 502 185738 (21.00%) > Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 25099 ( 2.84%) 4.102.200.114:443 after 60000 ms > status.find.is(200), but actually found 500 12729 ( 1.44%) > status.find.is(200), but actually found 401 7385 ( 0.83%) > j.i.IOException: Premature close 4 ( 0.00%) ================================================================================ Reports generated in 0s. Please open the following file: file:///results/gatling/login-tree-250/loadtest-20240213113559908/index.html ---------------------- [13/Feb/2024 14:54:55] Create tar file /results/gatling/login-tree-250.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/login-tree-250/loadtest-20240213113559908 RESULT_FOLDER=login-tree-250 RESULT_PATH=/results/gatling/login-tree-250 PWD=/results/gatling/login-tree-250/loadtest-20240213113559908 [cmd] tar -czvf /results/gatling/login-tree-250.tar.gz --exclude=simulation.log * index.html js/ js/assertions.json js/stats.js js/all_sessions.js js/highstock.js js/theme.js js/menu.js js/highcharts-more.js js/assertions.xml js/gatling.js js/ellipsis.js js/jquery-3.5.1.min.js js/stats.json js/global_stats.json js/bootstrap.min.js js/unpack.js req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/stat-fleche-bas.png style/bootstrap.min.css style/arrow_right_black.png style/sorted-up.png style/style.css style/arrow_down.png style/stat-l-roue.png style/sortable.png style/logo.svg style/sorted-down.png style/arrow_right.png style/logo-enterprise.svg style/arrow_down_black.png style/stat-l-temps.png style/favicon.ico style/little_arrow_right.png ________________________________________________________________________________ [2024-02-13 14:55:10] Reporting-login-tree-250 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2024-02-13 14:55:10] Reporting-login-tree-250 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- Checking pod: overseer-0-58754774cf-xhms5 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-250/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-250/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-250/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-250/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-250/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-58754774cf-xhms5 --stdin -- du -k /results/orders/Reporting-login-tree-250/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting-login-tree-250/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- source : /results/orders/Reporting-login-tree-250/stderr.txt @ overseer-0-58754774cf-xhms5 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-58754774cf-xhms5 --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-58754774cf-xhms5:/results/orders/Reporting-login-tree-250/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/14_Reporting-login-tree-250/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-02-13 14:55:14] Reporting-login-tree-250 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2024-02-13 14:55:14] Reporting-login-tree-250 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/06_login-tree-250/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/06_login-tree-250/gatling/req_restloginuserna-d98ea.html - cannot check for spikes checking simulation request restloginProgressiveProfileCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/06_login-tree-250/gatling/req_restloginprogre-9fc93.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2024-02-13 14:55:14] Reporting-login-tree-250 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 1555486, "ok": 1019008, "ko": 536478 }, "minResponseTime": { "total": 32, "ok": 38, "ko": 32 }, "maxResponseTime": { "total": 63000, "ok": 63000, "ko": 60036 }, "meanResponseTime": { "total": 14256, "ok": 17826, "ko": 7475 }, "standardDeviation": { "total": 14631, "ok": 13691, "ko": 13945 }, "percentiles1": { "total": 9448, "ok": 14218, "ko": 2981 }, "percentiles2": { "total": 21191, "ok": 26170, "ko": 8111 }, "percentiles3": { "total": 45808, "ok": 45411, "ko": 54131 }, "percentiles4": { "total": 60000, "ok": 55139, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 54404, "percentage": 3 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 10978, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 953626, "percentage": 61 }, "group4": { "name": "failed", "htmlName": "failed", "count": 536478, "percentage": 34 }, "meanNumberOfRequestsPerSecond": { "total": 425.2285401858939, "ok": 278.5697102241662, "ko": 146.65882996172772 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 902320, "ok": 554305, "ko": 348015 }, "minResponseTime": { "total": 35, "ok": 38, "ko": 35 }, "maxResponseTime": { "total": 60021, "ok": 59993, "ko": 60021 }, "meanResponseTime": { "total": 11202, "ok": 14979, "ko": 5188 }, "standardDeviation": { "total": 12746, "ok": 12774, "ko": 10121 }, "percentiles1": { "total": 7396, "ok": 11280, "ko": 46 }, "percentiles2": { "total": 16246, "ok": 22667, "ko": 8040 }, "percentiles3": { "total": 36933, "ok": 39217, "ko": 18714 }, "percentiles4": { "total": 56814, "ok": 51965, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 49256, "percentage": 5 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 8945, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 496104, "percentage": 55 }, "group4": { "name": "failed", "htmlName": "failed", "count": 348015, "percentage": 39 }, "meanNumberOfRequestsPerSecond": { "total": 246.67031164570804, "ok": 151.53225806451613, "ko": 95.13805358119191 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 554305, "ok": 394133, "ko": 160172 }, "minResponseTime": { "total": 32, "ok": 109, "ko": 32 }, "maxResponseTime": { "total": 60034, "ok": 60000, "ko": 60034 }, "meanResponseTime": { "total": 18703, "ok": 21209, "ko": 12537 }, "standardDeviation": { "total": 16247, "ok": 14124, "ko": 19213 }, "percentiles1": { "total": 13672, "ok": 17553, "ko": 4077 }, "percentiles2": { "total": 27910, "ok": 30882, "ko": 12039 }, "percentiles3": { "total": 52837, "ok": 48697, "ko": 60000 }, "percentiles4": { "total": 60000, "ok": 57217, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 4739, "percentage": 1 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 1964, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 387430, "percentage": 70 }, "group4": { "name": "failed", "htmlName": "failed", "count": 160172, "percentage": 29 }, "meanNumberOfRequestsPerSecond": { "total": 151.53225806451613, "ok": 107.7454893384363, "ko": 43.78676872607983 }, "spikes": [] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 98861, "ok": 70570, "ko": 28291 }, "minResponseTime": { "total": 32, "ok": 157, "ko": 32 }, "maxResponseTime": { "total": 63000, "ok": 63000, "ko": 60036 }, "meanResponseTime": { "total": 17190, "ok": 21292, "ko": 6959 }, "standardDeviation": { "total": 14161, "ok": 13076, "ko": 11298 }, "percentiles1": { "total": 13501, "ok": 17450, "ko": 4036 }, "percentiles2": { "total": 24352, "ok": 29253, "ko": 8624 }, "percentiles3": { "total": 46098, "ok": 47409, "ko": 26144 }, "percentiles4": { "total": 59246, "ok": 56838, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 409, "percentage": 0 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 69, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 70092, "percentage": 71 }, "group4": { "name": "failed", "htmlName": "failed", "count": 28291, "percentage": 29 }, "meanNumberOfRequestsPerSecond": { "total": 27.025970475669766, "ok": 19.29196282121378, "ko": 7.734007654455987 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 425, "avg_response_time": 14256, "max_response_time": 63000, "min_response_time": 38, "num_requests": 1555486, "num_requests_pass": 1019008, "num_requests_percent_pass": 65.511 }, "options": "; testCase:idc.login; testMode:open; throughput:250; rampup-duration:30; duration:3600", "stats": { "details": [ { "group1": { "count": 49256, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 5 }, "group2": { "count": 8945, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 496104, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 55 }, "group4": { "count": 348015, "htmlName": "failed", "name": "failed", "percentage": 39 }, "maxResponseTime": { "ko": 60021, "ok": 59993, "total": 60021 }, "meanNumberOfRequestsPerSecond": { "ko": 95.13805358119191, "ok": 151.53225806451613, "total": 246.67031164570804 }, "meanResponseTime": { "ko": 5188, "ok": 14979, "total": 11202 }, "minResponseTime": { "ko": 35, "ok": 38, "total": 35 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 348015, "ok": 554305, "total": 902320 }, "percentiles1": { "ko": 46, "ok": 11280, "total": 7396 }, "percentiles2": { "ko": 8040, "ok": 22667, "total": 16246 }, "percentiles3": { "ko": 18714, "ok": 39217, "total": 36933 }, "percentiles4": { "ko": 60000, "ok": 51965, "total": 56814 }, "spikes": [], "standardDeviation": { "ko": 10121, "ok": 12774, "total": 12746 } }, { "group1": { "count": 4739, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 1 }, "group2": { "count": 1964, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 387430, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 70 }, "group4": { "count": 160172, "htmlName": "failed", "name": "failed", "percentage": 29 }, "maxResponseTime": { "ko": 60034, "ok": 60000, "total": 60034 }, "meanNumberOfRequestsPerSecond": { "ko": 43.78676872607983, "ok": 107.7454893384363, "total": 151.53225806451613 }, "meanResponseTime": { "ko": 12537, "ok": 21209, "total": 18703 }, "minResponseTime": { "ko": 32, "ok": 109, "total": 32 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 160172, "ok": 394133, "total": 554305 }, "percentiles1": { "ko": 4077, "ok": 17553, "total": 13672 }, "percentiles2": { "ko": 12039, "ok": 30882, "total": 27910 }, "percentiles3": { "ko": 60000, "ok": 48697, "total": 52837 }, "percentiles4": { "ko": 60000, "ok": 57217, "total": 60000 }, "spikes": [], "standardDeviation": { "ko": 19213, "ok": 14124, "total": 16247 } }, { "group1": { "count": 409, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 0 }, "group2": { "count": 69, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 70092, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 71 }, "group4": { "count": 28291, "htmlName": "failed", "name": "failed", "percentage": 29 }, "maxResponseTime": { "ko": 60036, "ok": 63000, "total": 63000 }, "meanNumberOfRequestsPerSecond": { "ko": 7.734007654455987, "ok": 19.29196282121378, "total": 27.025970475669766 }, "meanResponseTime": { "ko": 6959, "ok": 21292, "total": 17190 }, "minResponseTime": { "ko": 32, "ok": 157, "total": 32 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 28291, "ok": 70570, "total": 98861 }, "percentiles1": { "ko": 4036, "ok": 17450, "total": 13501 }, "percentiles2": { "ko": 8624, "ok": 29253, "total": 24352 }, "percentiles3": { "ko": 26144, "ok": 47409, "total": 46098 }, "percentiles4": { "ko": 60000, "ok": 56838, "total": 59246 }, "spikes": [], "standardDeviation": { "ko": 11298, "ok": 13076, "total": 14161 } } ], "global": { "group1": { "count": 54404, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 3 }, "group2": { "count": 10978, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 953626, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 61 }, "group4": { "count": 536478, "htmlName": "failed", "name": "failed", "percentage": 34 }, "maxResponseTime": { "ko": 60036, "ok": 63000, "total": 63000 }, "meanNumberOfRequestsPerSecond": { "ko": 146.65882996172772, "ok": 278.5697102241662, "total": 425.2285401858939 }, "meanResponseTime": { "ko": 7475, "ok": 17826, "total": 14256 }, "minResponseTime": { "ko": 32, "ok": 38, "total": 32 }, "name": "All Requests", "numberOfRequests": { "ko": 536478, "ok": 1019008, "total": 1555486 }, "percentiles1": { "ko": 2981, "ok": 14218, "total": 9448 }, "percentiles2": { "ko": 8111, "ok": 26170, "total": 21191 }, "percentiles3": { "ko": 54131, "ok": 45411, "total": 45808 }, "percentiles4": { "ko": 60000, "ok": 55139, "total": 60000 }, "standardDeviation": { "ko": 13945, "ok": 13691, "total": 14631 } } }, "target_hostname": "openam-ema-perf-benchmark.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2024-02-13 14:55:14] Reporting-login-tree-250 step15 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/06_login-tree-250/stdout.txt Compressing Gatling stdout.txt file.. ________________________________________________________________________________ [2024-02-13 14:55:47] Reporting-login-tree-250 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped