--Task-- name: Reporting-login-tree-200 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150'] options: {'task_name': 'login-tree-200'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-02-15 16:28:24] Reporting-login-tree-200 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [2024-02-15 16:28:24] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [2024-02-15 16:28:24] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-200/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-200/stderr.txt Pod log : /results/orders/Reporting-login-tree-200 ________________________________________________________________________________ [2024-02-15 16:28:24] Reporting-login-tree-200 step1 : Write order for overseer to generate the report ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/order.json { "name": "Reporting-login-tree-200", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-200 --extra-run-jvm-options \"-Xmx4G\"", "out-dir": "/results/orders/Reporting-login-tree-200" } ________________________________________________________________________________ [2024-02-15 16:28:24] Reporting-login-tree-200 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 27 0 --:--:-- --:--:-- --:--:-- 27 ________________________________________________________________________________ [2024-02-15 16:28:24] Reporting-login-tree-200 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/order.json overseer-0-6c7ffb9c57-bwwsc:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-02-15 16:28:26] Reporting-login-tree-200 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=14400, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 15s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 21s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2024-02-15 16:28:52] Reporting-login-tree-200 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-200.tar.gz" ]; then echo "/results/gatling/login-tree-200.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-200.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-200.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/login-tree-200.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/gatling/login-tree-200.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 284 /results/gatling/login-tree-200.tar.gz --- stderr --- - Download file (size 284k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- source : /results/gatling/login-tree-200.tar.gz @ overseer-0-6c7ffb9c57-bwwsc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-200.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/gatling/login-tree-200.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-200.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-02-15 16:28:56] Reporting-login-tree-200 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-200.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [2024-02-15 16:28:57] Reporting-login-tree-200 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-200/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-200/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-200/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-200/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-200/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-200/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-200/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- source : /results/orders/Reporting-login-tree-200/rc.txt @ overseer-0-6c7ffb9c57-bwwsc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-200/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-02-15 16:29:00] Reporting-login-tree-200 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [2024-02-15 16:29:00] Reporting-login-tree-200 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-200/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-200/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-200/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-200/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-200/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-200/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-200/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- source : /results/orders/Reporting-login-tree-200/stdout.txt @ overseer-0-6c7ffb9c57-bwwsc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-200/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stdout.txt is small (82 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-200/loadtest-20240215121336587 --extra-run-jvm-options -Xmx4G GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Generating Gatling reports locally Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 1600295 (OK=1590237 KO=10058 ) > min response time 33 (OK=38 KO=33 ) > max response time 60001 (OK=23161 KO=60001 ) > mean response time 231 (OK=214 KO=2917 ) > std deviation 1184 (OK=1044 KO=6585 ) > response time 50th percentile 113 (OK=113 KO=39 ) > response time 75th percentile 137 (OK=137 KO=41 ) > response time 95th percentile 207 (OK=205 KO=12800 ) > response time 99th percentile 6605 (OK=5410 KO=22996 ) > mean requests/sec 440.731 (OK=437.961 KO=2.77 ) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 1565121 ( 98%) > 800 ms <= t < 1200 ms 1561 ( 0%) > t >= 1200 ms 23555 ( 1%) > failed 10058 ( 1%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 503 7806 (48.54%) > restLoginUsernamePasswordCallback: Failed to build request: No 6023 (37.45%) attribute named 'callbacks' is defined > status.find.is(200), but actually found 401 2178 (13.54%) > Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 53 ( 0.33%) 5.190.24.146:443 after 60000 ms > status.find.is(200), but actually found 502 21 ( 0.13%) ================================================================================ Reports generated in 0s. Please open the following file: file:///results/gatling/login-tree-200/loadtest-20240215121336587/index.html ---------------------- [15/Feb/2024 16:28:49] Create tar file /results/gatling/login-tree-200.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/login-tree-200/loadtest-20240215121336587 RESULT_FOLDER=login-tree-200 RESULT_PATH=/results/gatling/login-tree-200 PWD=/results/gatling/login-tree-200/loadtest-20240215121336587 [cmd] tar -czvf /results/gatling/login-tree-200.tar.gz --exclude=simulation.log * index.html js/ js/all_sessions.js js/bootstrap.min.js js/gatling.js js/stats.json js/jquery-3.5.1.min.js js/theme.js js/highstock.js js/assertions.xml js/menu.js js/ellipsis.js js/highcharts-more.js js/stats.js js/global_stats.json js/unpack.js js/assertions.json req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/logo.svg style/arrow_right.png style/stat-l-temps.png style/stat-l-roue.png style/favicon.ico style/style.css style/sorted-down.png style/logo-enterprise.svg style/stat-fleche-bas.png style/bootstrap.min.css style/arrow_right_black.png style/arrow_down_black.png style/sorted-up.png style/sortable.png style/arrow_down.png style/little_arrow_right.png ________________________________________________________________________________ [2024-02-15 16:29:04] Reporting-login-tree-200 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2024-02-15 16:29:04] Reporting-login-tree-200 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-200/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-200/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-200/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-200/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-200/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-200/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting-login-tree-200/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- source : /results/orders/Reporting-login-tree-200/stderr.txt @ overseer-0-6c7ffb9c57-bwwsc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-200/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/13_Reporting-login-tree-200/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-02-15 16:29:08] Reporting-login-tree-200 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2024-02-15 16:29:08] Reporting-login-tree-200 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/gatling/req_restloginuserna-d98ea.html - cannot check for spikes checking simulation request restloginProgressiveProfileCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/gatling/req_restloginprogre-9fc93.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2024-02-15 16:29:08] Reporting-login-tree-200 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 1600295, "ok": 1590237, "ko": 10058 }, "minResponseTime": { "total": 33, "ok": 38, "ko": 33 }, "maxResponseTime": { "total": 60001, "ok": 23161, "ko": 60001 }, "meanResponseTime": { "total": 231, "ok": 214, "ko": 2917 }, "standardDeviation": { "total": 1184, "ok": 1044, "ko": 6585 }, "percentiles1": { "total": 113, "ok": 113, "ko": 39 }, "percentiles2": { "total": 137, "ok": 137, "ko": 41 }, "percentiles3": { "total": 207, "ok": 205, "ko": 12800 }, "percentiles4": { "total": 6605, "ok": 5410, "ko": 22996 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 1565121, "percentage": 98 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 1561, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 23555, "percentage": 1 }, "group4": { "name": "failed", "htmlName": "failed", "count": 10058, "percentage": 1 }, "meanNumberOfRequestsPerSecond": { "total": 440.73120352519965, "ok": 437.96116772239054, "ko": 2.7700358028091436 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 723548, "ok": 717525, "ko": 6023 }, "minResponseTime": { "total": 36, "ok": 38, "ko": 36 }, "maxResponseTime": { "total": 60001, "ok": 21573, "ko": 60001 }, "meanResponseTime": { "total": 151, "ok": 151, "ko": 238 }, "standardDeviation": { "total": 983, "ok": 935, "ko": 3450 }, "percentiles1": { "total": 42, "ok": 42, "ko": 38 }, "percentiles2": { "total": 43, "ok": 43, "ko": 39 }, "percentiles3": { "total": 47, "ok": 47, "ko": 41 }, "percentiles4": { "total": 4915, "ok": 4945, "ko": 45 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 705780, "percentage": 98 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 64, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 11681, "percentage": 2 }, "group4": { "name": "failed", "htmlName": "failed", "count": 6023, "percentage": 1 }, "meanNumberOfRequestsPerSecond": { "total": 199.26962269347288, "ok": 197.61085100523272, "ko": 1.6587716882401542 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 717525, "ok": 713815, "ko": 3710 }, "minResponseTime": { "total": 33, "ok": 95, "ko": 33 }, "maxResponseTime": { "total": 60001, "ok": 23161, "ko": 60001 }, "meanResponseTime": { "total": 301, "ok": 265, "ko": 7301 }, "standardDeviation": { "total": 1386, "ok": 1170, "ko": 7685 }, "percentiles1": { "total": 126, "ok": 126, "ko": 10072 }, "percentiles2": { "total": 143, "ok": 143, "ko": 11839 }, "percentiles3": { "total": 220, "ok": 213, "ko": 15675 }, "percentiles4": { "total": 9228, "ok": 6403, "ko": 24684 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 702800, "percentage": 98 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 1176, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 9839, "percentage": 1 }, "group4": { "name": "failed", "htmlName": "failed", "count": 3710, "percentage": 1 }, "meanNumberOfRequestsPerSecond": { "total": 197.61085100523272, "ok": 196.58909391352245, "ko": 1.0217570917102727 }, "spikes": [] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 159222, "ok": 158897, "ko": 325 }, "minResponseTime": { "total": 33, "ok": 129, "ko": 33 }, "maxResponseTime": { "total": 60001, "ok": 15392, "ko": 60001 }, "meanResponseTime": { "total": 281, "ok": 276, "ko": 2530 }, "standardDeviation": { "total": 986, "ok": 878, "ko": 9738 }, "percentiles1": { "total": 173, "ok": 173, "ko": 35 }, "percentiles2": { "total": 195, "ok": 195, "ko": 37 }, "percentiles3": { "total": 275, "ok": 275, "ko": 12703 }, "percentiles4": { "total": 4123, "ok": 3996, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 156541, "percentage": 98 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 321, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 2035, "percentage": 1 }, "group4": { "name": "failed", "htmlName": "failed", "count": 325, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 43.85072982649408, "ok": 43.76122280363536, "ko": 0.0895070228587166 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 441, "avg_response_time": 231, "max_response_time": 23161, "min_response_time": 38, "num_requests": 1600295, "num_requests_pass": 1590237, "num_requests_percent_pass": 99.371 }, "options": "; testCase:idc.login; testMode:open; throughput:200; rampup-duration:30; duration:3600", "stats": { "details": [ { "group1": { "count": 705780, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 98 }, "group2": { "count": 64, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 11681, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 2 }, "group4": { "count": 6023, "htmlName": "failed", "name": "failed", "percentage": 1 }, "maxResponseTime": { "ko": 60001, "ok": 21573, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 1.6587716882401542, "ok": 197.61085100523272, "total": 199.26962269347288 }, "meanResponseTime": { "ko": 238, "ok": 151, "total": 151 }, "minResponseTime": { "ko": 36, "ok": 38, "total": 36 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 6023, "ok": 717525, "total": 723548 }, "percentiles1": { "ko": 38, "ok": 42, "total": 42 }, "percentiles2": { "ko": 39, "ok": 43, "total": 43 }, "percentiles3": { "ko": 41, "ok": 47, "total": 47 }, "percentiles4": { "ko": 45, "ok": 4945, "total": 4915 }, "spikes": [], "standardDeviation": { "ko": 3450, "ok": 935, "total": 983 } }, { "group1": { "count": 702800, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 98 }, "group2": { "count": 1176, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 9839, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 1 }, "group4": { "count": 3710, "htmlName": "failed", "name": "failed", "percentage": 1 }, "maxResponseTime": { "ko": 60001, "ok": 23161, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 1.0217570917102727, "ok": 196.58909391352245, "total": 197.61085100523272 }, "meanResponseTime": { "ko": 7301, "ok": 265, "total": 301 }, "minResponseTime": { "ko": 33, "ok": 95, "total": 33 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 3710, "ok": 713815, "total": 717525 }, "percentiles1": { "ko": 10072, "ok": 126, "total": 126 }, "percentiles2": { "ko": 11839, "ok": 143, "total": 143 }, "percentiles3": { "ko": 15675, "ok": 213, "total": 220 }, "percentiles4": { "ko": 24684, "ok": 6403, "total": 9228 }, "spikes": [], "standardDeviation": { "ko": 7685, "ok": 1170, "total": 1386 } }, { "group1": { "count": 156541, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 98 }, "group2": { "count": 321, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 2035, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 1 }, "group4": { "count": 325, "htmlName": "failed", "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 60001, "ok": 15392, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 0.0895070228587166, "ok": 43.76122280363536, "total": 43.85072982649408 }, "meanResponseTime": { "ko": 2530, "ok": 276, "total": 281 }, "minResponseTime": { "ko": 33, "ok": 129, "total": 33 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 325, "ok": 158897, "total": 159222 }, "percentiles1": { "ko": 35, "ok": 173, "total": 173 }, "percentiles2": { "ko": 37, "ok": 195, "total": 195 }, "percentiles3": { "ko": 12703, "ok": 275, "total": 275 }, "percentiles4": { "ko": 60000, "ok": 3996, "total": 4123 }, "spikes": [], "standardDeviation": { "ko": 9738, "ok": 878, "total": 986 } } ], "global": { "group1": { "count": 1565121, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 98 }, "group2": { "count": 1561, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 23555, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 1 }, "group4": { "count": 10058, "htmlName": "failed", "name": "failed", "percentage": 1 }, "maxResponseTime": { "ko": 60001, "ok": 23161, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 2.7700358028091436, "ok": 437.96116772239054, "total": 440.73120352519965 }, "meanResponseTime": { "ko": 2917, "ok": 214, "total": 231 }, "minResponseTime": { "ko": 33, "ok": 38, "total": 33 }, "name": "All Requests", "numberOfRequests": { "ko": 10058, "ok": 1590237, "total": 1600295 }, "percentiles1": { "ko": 39, "ok": 113, "total": 113 }, "percentiles2": { "ko": 41, "ok": 137, "total": 137 }, "percentiles3": { "ko": 12800, "ok": 205, "total": 207 }, "percentiles4": { "ko": 22996, "ok": 5410, "total": 6605 }, "standardDeviation": { "ko": 6585, "ok": 1044, "total": 1184 } } }, "target_hostname": "openam-ema-perf-benchmark.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2024-02-15 16:29:08] Reporting-login-tree-200 step15 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/05_login-tree-200/stdout.txt Compressing Gatling stdout.txt file.. ________________________________________________________________________________ [2024-02-15 16:29:09] Reporting-login-tree-200 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped