--Task-- name: Reporting-login-tree-350 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150', 'Reporting-login-tree-200', 'Reporting-login-tree-250', 'Reporting-login-tree-300'] options: {'task_name': 'login-tree-350'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-01-25 08:33:28] Reporting-login-tree-350 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [2024-01-25 08:33:28] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [2024-01-25 08:33:28] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-350/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-350/stderr.txt Pod log : /results/orders/Reporting-login-tree-350 ________________________________________________________________________________ [2024-01-25 08:33:28] Reporting-login-tree-350 step1 : Write order for overseer to generate the report ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/order.json { "name": "Reporting-login-tree-350", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-350 --extra-run-jvm-options \"-Xmx4G\"", "out-dir": "/results/orders/Reporting-login-tree-350" } ________________________________________________________________________________ [2024-01-25 08:33:29] Reporting-login-tree-350 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 24 0 --:--:-- --:--:-- --:--:-- 24 ________________________________________________________________________________ [2024-01-25 08:33:29] Reporting-login-tree-350 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/order.json overseer-0-d46ffd65f-r5drf:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-01-25 08:33:30] Reporting-login-tree-350 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=14400, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 15s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2024-01-25 08:33:51] Reporting-login-tree-350 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- Checking pod: overseer-0-d46ffd65f-r5drf for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-d46ffd65f-r5drf --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-350.tar.gz" ]; then echo "/results/gatling/login-tree-350.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-350.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-350.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/login-tree-350.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-d46ffd65f-r5drf --stdin -- du -k /results/gatling/login-tree-350.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 380 /results/gatling/login-tree-350.tar.gz --- stderr --- - Download file (size 380k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- source : /results/gatling/login-tree-350.tar.gz @ overseer-0-d46ffd65f-r5drf destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-d46ffd65f-r5drf:/results/gatling/login-tree-350.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-01-25 08:33:55] Reporting-login-tree-350 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-350.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [2024-01-25 08:33:56] Reporting-login-tree-350 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- Checking pod: overseer-0-d46ffd65f-r5drf for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-d46ffd65f-r5drf --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-350/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-350/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-d46ffd65f-r5drf --stdin -- du -k /results/orders/Reporting-login-tree-350/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-350/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- source : /results/orders/Reporting-login-tree-350/rc.txt @ overseer-0-d46ffd65f-r5drf destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-d46ffd65f-r5drf:/results/orders/Reporting-login-tree-350/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-01-25 08:33:59] Reporting-login-tree-350 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [2024-01-25 08:33:59] Reporting-login-tree-350 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- Checking pod: overseer-0-d46ffd65f-r5drf for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-d46ffd65f-r5drf --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-350/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-350/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-d46ffd65f-r5drf --stdin -- du -k /results/orders/Reporting-login-tree-350/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-350/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- source : /results/orders/Reporting-login-tree-350/stdout.txt @ overseer-0-d46ffd65f-r5drf destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-d46ffd65f-r5drf:/results/orders/Reporting-login-tree-350/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stdout.txt is small (87 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-350/loadtest-20240125072540781 --extra-run-jvm-options -Xmx4G GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Generating Gatling reports locally Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 2586986 (OK=2464353 KO=122633) > min response time 34 (OK=40 KO=34 ) > max response time 60001 (OK=58377 KO=60001 ) > mean response time 9383 (OK=9534 KO=6346 ) > std deviation 7504 (OK=7471 KO=7523 ) > response time 50th percentile 8646 (OK=8832 KO=4038 ) > response time 75th percentile 13613 (OK=13734 KO=10134 ) > response time 95th percentile 23297 (OK=23298 KO=22423 ) > response time 99th percentile 32078 (OK=32218 KO=30765 ) > mean requests/sec 709.346 (OK=675.721 KO=33.626) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 336883 ( 13%) > 800 ms <= t < 1200 ms 37123 ( 1%) > t >= 1200 ms 2090347 ( 81%) > failed 122633 ( 5%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 502 55987 (27.12%) > restLoginUsernamePasswordCallback: Failed to build request: No 41898 (20.30%) attribute named 'callbacks' is defined > restloginProgressiveProfileCallback: Failed to build request: 41898 (20.30%) No attribute named 'callbacks' is defined > status.find.is(200), but actually found 503 37791 (18.31%) > status.find.is(200), but actually found 400 16532 ( 8.01%) > status.find.is(200), but actually found 401 5069 ( 2.46%) > jsonPath($.tokenId).find.exists, found nothing 4633 ( 2.24%) > status.find.is(200), but actually found 500 2599 ( 1.26%) > Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 22 ( 0.01%) 4.49.170.241:443 after 60000 ms ================================================================================ Reports generated in 0s. Please open the following file: file:///results/gatling/login-tree-350/loadtest-20240125072540781/index.html ---------------------- [25/Jan/2024 08:33:51] Create tar file /results/gatling/login-tree-350.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/login-tree-350/loadtest-20240125072540781 RESULT_FOLDER=login-tree-350 RESULT_PATH=/results/gatling/login-tree-350 PWD=/results/gatling/login-tree-350/loadtest-20240125072540781 [cmd] tar -czvf /results/gatling/login-tree-350.tar.gz --exclude=simulation.log * index.html js/ js/highcharts-more.js js/highstock.js js/stats.js js/global_stats.json js/assertions.json js/jquery-3.5.1.min.js js/bootstrap.min.js js/theme.js js/ellipsis.js js/stats.json js/menu.js js/gatling.js js/unpack.js js/assertions.xml js/all_sessions.js req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/arrow_down.png style/bootstrap.min.css style/logo-enterprise.svg style/sorted-up.png style/logo.svg style/sorted-down.png style/arrow_right_black.png style/stat-l-temps.png style/arrow_down_black.png style/sortable.png style/arrow_right.png style/little_arrow_right.png style/style.css style/stat-fleche-bas.png style/favicon.ico style/stat-l-roue.png ________________________________________________________________________________ [2024-01-25 08:34:03] Reporting-login-tree-350 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2024-01-25 08:34:03] Reporting-login-tree-350 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- Checking pod: overseer-0-d46ffd65f-r5drf for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-d46ffd65f-r5drf --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-350/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-350/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-350/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-350/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-350/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-d46ffd65f-r5drf --stdin -- du -k /results/orders/Reporting-login-tree-350/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting-login-tree-350/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- source : /results/orders/Reporting-login-tree-350/stderr.txt @ overseer-0-d46ffd65f-r5drf destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-d46ffd65f-r5drf --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-d46ffd65f-r5drf:/results/orders/Reporting-login-tree-350/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/16_Reporting-login-tree-350/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-01-25 08:34:07] Reporting-login-tree-350 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2024-01-25 08:34:07] Reporting-login-tree-350 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restloginuserna-d98ea.html - cannot check for spikes checking simulation request restloginProgressiveProfileCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/gatling/req_restloginprogre-9fc93.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2024-01-25 08:34:07] Reporting-login-tree-350 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 2586986, "ok": 2464353, "ko": 122633 }, "minResponseTime": { "total": 34, "ok": 40, "ko": 34 }, "maxResponseTime": { "total": 60001, "ok": 58377, "ko": 60001 }, "meanResponseTime": { "total": 9383, "ok": 9534, "ko": 6346 }, "standardDeviation": { "total": 7504, "ok": 7471, "ko": 7523 }, "percentiles1": { "total": 8646, "ok": 8832, "ko": 4038 }, "percentiles2": { "total": 13613, "ok": 13734, "ko": 10134 }, "percentiles3": { "total": 23297, "ok": 23298, "ko": 22423 }, "percentiles4": { "total": 32078, "ok": 32218, "ko": 30765 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 336883, "percentage": 13 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 37123, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 2090347, "percentage": 81 }, "group4": { "name": "failed", "htmlName": "failed", "count": 122633, "percentage": 5 }, "meanNumberOfRequestsPerSecond": { "total": 709.3463120372909, "ok": 675.7205922676172, "ko": 33.6257197696737 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 1265891, "ok": 1223993, "ko": 41898 }, "minResponseTime": { "total": 37, "ok": 40, "ko": 37 }, "maxResponseTime": { "total": 60001, "ok": 58377, "ko": 60001 }, "meanResponseTime": { "total": 6271, "ok": 6285, "ko": 5843 }, "standardDeviation": { "total": 6164, "ok": 6149, "ko": 6595 }, "percentiles1": { "total": 4924, "ok": 4966, "ko": 4041 }, "percentiles2": { "total": 9630, "ok": 9635, "ko": 9296 }, "percentiles3": { "total": 18073, "ok": 18068, "ko": 18020 }, "percentiles4": { "total": 27095, "ok": 27068, "ko": 27382 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 274296, "percentage": 22 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 25330, "percentage": 2 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 924367, "percentage": 73 }, "group4": { "name": "failed", "htmlName": "failed", "count": 41898, "percentage": 3 }, "meanNumberOfRequestsPerSecond": { "total": 347.1047436248972, "ok": 335.6163970386619, "ko": 11.488346586235261 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 1223993, "ok": 1184624, "ko": 39369 }, "minResponseTime": { "total": 34, "ok": 96, "ko": 34 }, "maxResponseTime": { "total": 60001, "ok": 55785, "ko": 60001 }, "meanResponseTime": { "total": 12620, "ok": 12743, "ko": 8914 }, "standardDeviation": { "total": 7358, "ok": 7281, "ko": 8591 }, "percentiles1": { "total": 11956, "ok": 12028, "ko": 7401 }, "percentiles2": { "total": 16608, "ok": 16654, "ko": 13951 }, "percentiles3": { "total": 26024, "ok": 25931, "ko": 27209 }, "percentiles4": { "total": 34035, "ok": 34126, "ko": 31041 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 59869, "percentage": 5 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 11289, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 1113466, "percentage": 91 }, "group4": { "name": "failed", "htmlName": "failed", "count": 39369, "percentage": 3 }, "meanNumberOfRequestsPerSecond": { "total": 335.6163970386619, "ok": 324.8214971209213, "ko": 10.794899917740608 }, "spikes": [] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 97102, "ok": 55736, "ko": 41366 }, "minResponseTime": { "total": 34, "ok": 129, "ko": 34 }, "maxResponseTime": { "total": 52761, "ok": 52761, "ko": 38009 }, "meanResponseTime": { "total": 9153, "ok": 12673, "ko": 4410 }, "standardDeviation": { "total": 7991, "ok": 7077, "ko": 6572 }, "percentiles1": { "total": 8232, "ok": 11931, "ko": 1627 }, "percentiles2": { "total": 13780, "ok": 16510, "ko": 6879 }, "percentiles3": { "total": 24192, "ok": 25431, "ko": 17779 }, "percentiles4": { "total": 32562, "ok": 32817, "ko": 32096 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 2718, "percentage": 3 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 504, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 52514, "percentage": 54 }, "group4": { "name": "failed", "htmlName": "failed", "count": 41366, "percentage": 43 }, "meanNumberOfRequestsPerSecond": { "total": 26.625171373731835, "ok": 15.282698108034001, "ko": 11.342473265697834 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 709, "avg_response_time": 9383, "max_response_time": 58377, "min_response_time": 40, "num_requests": 2586986, "num_requests_pass": 2464353, "num_requests_percent_pass": 95.26 }, "options": "; testCase:idc.login; testMode:open; throughput:350; rampup-duration:30; duration:3600", "stats": { "details": [ { "group1": { "count": 274296, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 22 }, "group2": { "count": 25330, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 2 }, "group3": { "count": 924367, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 73 }, "group4": { "count": 41898, "htmlName": "failed", "name": "failed", "percentage": 3 }, "maxResponseTime": { "ko": 60001, "ok": 58377, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 11.488346586235261, "ok": 335.6163970386619, "total": 347.1047436248972 }, "meanResponseTime": { "ko": 5843, "ok": 6285, "total": 6271 }, "minResponseTime": { "ko": 37, "ok": 40, "total": 37 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 41898, "ok": 1223993, "total": 1265891 }, "percentiles1": { "ko": 4041, "ok": 4966, "total": 4924 }, "percentiles2": { "ko": 9296, "ok": 9635, "total": 9630 }, "percentiles3": { "ko": 18020, "ok": 18068, "total": 18073 }, "percentiles4": { "ko": 27382, "ok": 27068, "total": 27095 }, "spikes": [], "standardDeviation": { "ko": 6595, "ok": 6149, "total": 6164 } }, { "group1": { "count": 59869, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 5 }, "group2": { "count": 11289, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 1113466, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 91 }, "group4": { "count": 39369, "htmlName": "failed", "name": "failed", "percentage": 3 }, "maxResponseTime": { "ko": 60001, "ok": 55785, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 10.794899917740608, "ok": 324.8214971209213, "total": 335.6163970386619 }, "meanResponseTime": { "ko": 8914, "ok": 12743, "total": 12620 }, "minResponseTime": { "ko": 34, "ok": 96, "total": 34 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 39369, "ok": 1184624, "total": 1223993 }, "percentiles1": { "ko": 7401, "ok": 12028, "total": 11956 }, "percentiles2": { "ko": 13951, "ok": 16654, "total": 16608 }, "percentiles3": { "ko": 27209, "ok": 25931, "total": 26024 }, "percentiles4": { "ko": 31041, "ok": 34126, "total": 34035 }, "spikes": [], "standardDeviation": { "ko": 8591, "ok": 7281, "total": 7358 } }, { "group1": { "count": 2718, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 3 }, "group2": { "count": 504, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 52514, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 54 }, "group4": { "count": 41366, "htmlName": "failed", "name": "failed", "percentage": 43 }, "maxResponseTime": { "ko": 38009, "ok": 52761, "total": 52761 }, "meanNumberOfRequestsPerSecond": { "ko": 11.342473265697834, "ok": 15.282698108034001, "total": 26.625171373731835 }, "meanResponseTime": { "ko": 4410, "ok": 12673, "total": 9153 }, "minResponseTime": { "ko": 34, "ok": 129, "total": 34 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 41366, "ok": 55736, "total": 97102 }, "percentiles1": { "ko": 1627, "ok": 11931, "total": 8232 }, "percentiles2": { "ko": 6879, "ok": 16510, "total": 13780 }, "percentiles3": { "ko": 17779, "ok": 25431, "total": 24192 }, "percentiles4": { "ko": 32096, "ok": 32817, "total": 32562 }, "spikes": [], "standardDeviation": { "ko": 6572, "ok": 7077, "total": 7991 } } ], "global": { "group1": { "count": 336883, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 13 }, "group2": { "count": 37123, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 2090347, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 81 }, "group4": { "count": 122633, "htmlName": "failed", "name": "failed", "percentage": 5 }, "maxResponseTime": { "ko": 60001, "ok": 58377, "total": 60001 }, "meanNumberOfRequestsPerSecond": { "ko": 33.6257197696737, "ok": 675.7205922676172, "total": 709.3463120372909 }, "meanResponseTime": { "ko": 6346, "ok": 9534, "total": 9383 }, "minResponseTime": { "ko": 34, "ok": 40, "total": 34 }, "name": "All Requests", "numberOfRequests": { "ko": 122633, "ok": 2464353, "total": 2586986 }, "percentiles1": { "ko": 4038, "ok": 8832, "total": 8646 }, "percentiles2": { "ko": 10134, "ok": 13734, "total": 13613 }, "percentiles3": { "ko": 22423, "ok": 23298, "total": 23297 }, "percentiles4": { "ko": 30765, "ok": 32218, "total": 32078 }, "standardDeviation": { "ko": 7523, "ok": 7471, "total": 7504 } } }, "target_hostname": "openam-ema-perf-benchmark.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2024-01-25 08:34:07] Reporting-login-tree-350 step15 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/08_login-tree-350/stdout.txt Compressing Gatling stdout.txt file.. ________________________________________________________________________________ [2024-01-25 08:34:17] Reporting-login-tree-350 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped