--Task-- name: Reporting-login-tree-300 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['Reporting-login-tree-10', 'Reporting-login-tree-50', 'Reporting-login-tree-100', 'Reporting-login-tree-150', 'Reporting-login-tree-200', 'Reporting-login-tree-250'] options: {'task_name': 'login-tree-300'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-02-15 16:29:57] Reporting-login-tree-300 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [2024-02-15 16:29:57] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [2024-02-15 16:29:57] - INFO: timeout was set to GatlingResultTask default (half of global_duration or 3600 seconds (whatever is higher)), because it was unset Pod stdout file : /results/orders/Reporting-login-tree-300/stdout.txt Pod stderr file : /results/orders/Reporting-login-tree-300/stderr.txt Pod log : /results/orders/Reporting-login-tree-300 ________________________________________________________________________________ [2024-02-15 16:29:57] Reporting-login-tree-300 step1 : Write order for overseer to generate the report ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/order.json { "name": "Reporting-login-tree-300", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh login-tree-300 --extra-run-jvm-options \"-Xmx4G\"", "out-dir": "/results/orders/Reporting-login-tree-300" } ________________________________________________________________________________ [2024-02-15 16:29:57] Reporting-login-tree-300 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 26 0 --:--:-- --:--:-- --:--:-- 26 ________________________________________________________________________________ [2024-02-15 16:29:57] Reporting-login-tree-300 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/order.json overseer-0-6c7ffb9c57-bwwsc:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-02-15 16:29:59] Reporting-login-tree-300 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=14400, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 15s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 26 0 --:--:-- --:--:-- --:--:-- 26 ________________________________________________________________________________ [2024-02-15 16:30:20] Reporting-login-tree-300 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/gatling/login-tree-300.tar.gz" ]; then echo "/results/gatling/login-tree-300.tar.gz file found"; exit 0; else echo "/results/gatling/login-tree-300.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/login-tree-300.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/login-tree-300.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/gatling/login-tree-300.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 364 /results/gatling/login-tree-300.tar.gz --- stderr --- - Download file (size 364k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- source : /results/gatling/login-tree-300.tar.gz @ overseer-0-6c7ffb9c57-bwwsc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-300.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/gatling/login-tree-300.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-300.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-02-15 16:30:24] Reporting-login-tree-300 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/shared/login-tree-300.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/07_login-tree-300/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [2024-02-15 16:30:25] Reporting-login-tree-300 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-300/rc.txt" ]; then echo "/results/orders/Reporting-login-tree-300/rc.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-300/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-300/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-300/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-300/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-300/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- source : /results/orders/Reporting-login-tree-300/rc.txt @ overseer-0-6c7ffb9c57-bwwsc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-300/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-02-15 16:30:28] Reporting-login-tree-300 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [2024-02-15 16:30:28] Reporting-login-tree-300 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-300/stdout.txt" ]; then echo "/results/orders/Reporting-login-tree-300/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-300/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-300/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-300/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-300/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting-login-tree-300/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- source : /results/orders/Reporting-login-tree-300/stdout.txt @ overseer-0-6c7ffb9c57-bwwsc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-300/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/stdout.txt is small (84 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh --reports-only /results/gatling/login-tree-300/loadtest-20240215141859716 --extra-run-jvm-options -Xmx4G GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Generating Gatling reports locally Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 2149687 (OK=1933155 KO=216532) > min response time 34 (OK=40 KO=34 ) > max response time 76646 (OK=76646 KO=60024 ) > mean response time 11828 (OK=12208 KO=8428 ) > std deviation 10088 (OK=9845 KO=11500 ) > response time 50th percentile 10038 (OK=10634 KO=6107 ) > response time 75th percentile 16925 (OK=17455 KO=10556 ) > response time 95th percentile 30653 (OK=30864 KO=26501 ) > response time 99th percentile 45489 (OK=43666 KO=60000 ) > mean requests/sec 591.548 (OK=531.963 KO=59.585) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 206234 ( 10%) > 800 ms <= t < 1200 ms 29740 ( 1%) > t >= 1200 ms 1697181 ( 79%) > failed 216532 ( 10%) ---- Errors -------------------------------------------------------------------- > restLoginUsernamePasswordCallback: Failed to build request: No 128995 (37.33%) attribute named 'callbacks' is defined > status.find.is(200), but actually found 502 112983 (32.70%) > status.find.is(200), but actually found 503 85917 (24.87%) > status.find.is(200), but actually found 401 6027 ( 1.74%) > Request timeout to openam-ema-perf-benchmark.forgeblocks.com/3 6010 ( 1.74%) 5.190.24.146:443 after 60000 ms > status.find.is(200), but actually found 500 5592 ( 1.62%) > j.i.IOException: Premature close 3 ( 0.00%) ================================================================================ Reports generated in 0s. Please open the following file: file:///results/gatling/login-tree-300/loadtest-20240215141859716/index.html ---------------------- [15/Feb/2024 16:30:18] Create tar file /results/gatling/login-tree-300.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/login-tree-300/loadtest-20240215141859716 RESULT_FOLDER=login-tree-300 RESULT_PATH=/results/gatling/login-tree-300 PWD=/results/gatling/login-tree-300/loadtest-20240215141859716 [cmd] tar -czvf /results/gatling/login-tree-300.tar.gz --exclude=simulation.log * index.html js/ js/all_sessions.js js/bootstrap.min.js js/gatling.js js/stats.json js/jquery-3.5.1.min.js js/theme.js js/highstock.js js/assertions.xml js/menu.js js/ellipsis.js js/highcharts-more.js js/stats.js js/global_stats.json js/unpack.js js/assertions.json req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/logo.svg style/arrow_right.png style/stat-l-temps.png style/stat-l-roue.png style/favicon.ico style/style.css style/sorted-down.png style/logo-enterprise.svg style/stat-fleche-bas.png style/bootstrap.min.css style/arrow_right_black.png style/arrow_down_black.png style/sorted-up.png style/sortable.png style/arrow_down.png style/little_arrow_right.png ________________________________________________________________________________ [2024-02-15 16:30:32] Reporting-login-tree-300 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [2024-02-15 16:30:32] Reporting-login-tree-300 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- Checking pod: overseer-0-6c7ffb9c57-bwwsc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- bash -c 'if [ -f "/results/orders/Reporting-login-tree-300/stderr.txt" ]; then echo "/results/orders/Reporting-login-tree-300/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting-login-tree-300/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting-login-tree-300/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting-login-tree-300/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6c7ffb9c57-bwwsc --stdin -- du -k /results/orders/Reporting-login-tree-300/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting-login-tree-300/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- source : /results/orders/Reporting-login-tree-300/stderr.txt @ overseer-0-6c7ffb9c57-bwwsc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-6c7ffb9c57-bwwsc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6c7ffb9c57-bwwsc:/results/orders/Reporting-login-tree-300/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/08_Verification/15_Reporting-login-tree-300/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-02-15 16:30:36] Reporting-login-tree-300 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [2024-02-15 16:30:36] Reporting-login-tree-300 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/07_login-tree-300/gatling/req_restlogininitia-e2b9b.html - cannot check for spikes checking simulation request restLoginUsernamePasswordCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/07_login-tree-300/gatling/req_restloginuserna-d98ea.html - cannot check for spikes checking simulation request restloginProgressiveProfileCallback [warn] responseTimePercentiles was not found in /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/07_login-tree-300/gatling/req_restloginprogre-9fc93.html - cannot check for spikes no spikes found ________________________________________________________________________________ [2024-02-15 16:30:36] Reporting-login-tree-300 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "All Requests", "numberOfRequests": { "total": 2149687, "ok": 1933155, "ko": 216532 }, "minResponseTime": { "total": 34, "ok": 40, "ko": 34 }, "maxResponseTime": { "total": 76646, "ok": 76646, "ko": 60024 }, "meanResponseTime": { "total": 11828, "ok": 12208, "ko": 8428 }, "standardDeviation": { "total": 10088, "ok": 9845, "ko": 11500 }, "percentiles1": { "total": 10038, "ok": 10634, "ko": 6107 }, "percentiles2": { "total": 16925, "ok": 17455, "ko": 10556 }, "percentiles3": { "total": 30653, "ok": 30864, "ko": 26501 }, "percentiles4": { "total": 45489, "ok": 43666, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 206234, "percentage": 10 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 29740, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 1697181, "percentage": 79 }, "group4": { "name": "failed", "htmlName": "failed", "count": 216532, "percentage": 10 }, "meanNumberOfRequestsPerSecond": { "total": 591.5484314804623, "ok": 531.963401210787, "ko": 59.585030269675286 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 1083153, "ok": 954158, "ko": 128995 }, "minResponseTime": { "total": 38, "ok": 40, "ko": 38 }, "maxResponseTime": { "total": 60002, "ok": 59787, "ko": 60002 }, "meanResponseTime": { "total": 8420, "ok": 8680, "ko": 6498 }, "standardDeviation": { "total": 8645, "ok": 8694, "ko": 8018 }, "percentiles1": { "total": 6275, "ok": 6436, "ko": 4954 }, "percentiles2": { "total": 12433, "ok": 13052, "ko": 9041 }, "percentiles3": { "total": 24996, "ok": 25530, "ko": 17608 }, "percentiles4": { "total": 40354, "ok": 40226, "ko": 57923 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 187227, "percentage": 17 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 22809, "percentage": 2 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 744122, "percentage": 69 }, "group4": { "name": "failed", "htmlName": "failed", "count": 128995, "percentage": 12 }, "meanNumberOfRequestsPerSecond": { "total": 298.06081452944414, "ok": 262.5641166758393, "ko": 35.49669785360484 }, "spikes": [] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 954158, "ok": 876286, "ko": 77872 }, "minResponseTime": { "total": 34, "ok": 101, "ko": 34 }, "maxResponseTime": { "total": 76646, "ok": 76646, "ko": 60010 }, "meanResponseTime": { "total": 15390, "ok": 15731, "ko": 11556 }, "standardDeviation": { "total": 10369, "ok": 9761, "ko": 15143 }, "percentiles1": { "total": 13226, "ok": 13587, "ko": 7111 }, "percentiles2": { "total": 20597, "ok": 20872, "ko": 14989 }, "percentiles3": { "total": 34431, "ok": 34184, "ko": 60000 }, "percentiles4": { "total": 50970, "ok": 45832, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 17532, "percentage": 2 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 6400, "percentage": 1 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 852354, "percentage": 89 }, "group4": { "name": "failed", "htmlName": "failed", "count": 77872, "percentage": 8 }, "meanNumberOfRequestsPerSecond": { "total": 262.5641166758393, "ok": 241.13538800220144, "ko": 21.428728673637863 }, "spikes": [] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 112376, "ok": 102711, "ko": 9665 }, "minResponseTime": { "total": 34, "ok": 137, "ko": 34 }, "maxResponseTime": { "total": 60024, "ok": 59813, "ko": 60024 }, "meanResponseTime": { "total": 14427, "ok": 14940, "ko": 8977 }, "standardDeviation": { "total": 9333, "ok": 8952, "ko": 11345 }, "percentiles1": { "total": 12744, "ok": 13102, "ko": 6146 }, "percentiles2": { "total": 18540, "ok": 18985, "ko": 12040 }, "percentiles3": { "total": 31700, "ok": 31975, "ko": 26841 }, "percentiles4": { "total": 46730, "ok": 45629, "ko": 60000 }, "group1": { "name": "t < 800 ms", "htmlName": "t < 800 ms", "count": 1475, "percentage": 1 }, "group2": { "name": "800 ms <= t < 1200 ms", "htmlName": "t >= 800 ms
t < 1200 ms", "count": 531, "percentage": 0 }, "group3": { "name": "t >= 1200 ms", "htmlName": "t >= 1200 ms", "count": 100705, "percentage": 90 }, "group4": { "name": "failed", "htmlName": "failed", "count": 9665, "percentage": 9 }, "meanNumberOfRequestsPerSecond": { "total": 30.923500275178867, "ok": 28.263896532746283, "ko": 2.6596037424325814 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 592, "avg_response_time": 11828, "max_response_time": 76646, "min_response_time": 40, "num_requests": 2149687, "num_requests_pass": 1933155, "num_requests_percent_pass": 89.927 }, "options": "; testCase:idc.login; testMode:open; throughput:300; rampup-duration:30; duration:3600", "stats": { "details": [ { "group1": { "count": 187227, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 17 }, "group2": { "count": 22809, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 2 }, "group3": { "count": 744122, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 69 }, "group4": { "count": 128995, "htmlName": "failed", "name": "failed", "percentage": 12 }, "maxResponseTime": { "ko": 60002, "ok": 59787, "total": 60002 }, "meanNumberOfRequestsPerSecond": { "ko": 35.49669785360484, "ok": 262.5641166758393, "total": 298.06081452944414 }, "meanResponseTime": { "ko": 6498, "ok": 8680, "total": 8420 }, "minResponseTime": { "ko": 38, "ok": 40, "total": 38 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 128995, "ok": 954158, "total": 1083153 }, "percentiles1": { "ko": 4954, "ok": 6436, "total": 6275 }, "percentiles2": { "ko": 9041, "ok": 13052, "total": 12433 }, "percentiles3": { "ko": 17608, "ok": 25530, "total": 24996 }, "percentiles4": { "ko": 57923, "ok": 40226, "total": 40354 }, "spikes": [], "standardDeviation": { "ko": 8018, "ok": 8694, "total": 8645 } }, { "group1": { "count": 17532, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 2 }, "group2": { "count": 6400, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 852354, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 89 }, "group4": { "count": 77872, "htmlName": "failed", "name": "failed", "percentage": 8 }, "maxResponseTime": { "ko": 60010, "ok": 76646, "total": 76646 }, "meanNumberOfRequestsPerSecond": { "ko": 21.428728673637863, "ok": 241.13538800220144, "total": 262.5641166758393 }, "meanResponseTime": { "ko": 11556, "ok": 15731, "total": 15390 }, "minResponseTime": { "ko": 34, "ok": 101, "total": 34 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 77872, "ok": 876286, "total": 954158 }, "percentiles1": { "ko": 7111, "ok": 13587, "total": 13226 }, "percentiles2": { "ko": 14989, "ok": 20872, "total": 20597 }, "percentiles3": { "ko": 60000, "ok": 34184, "total": 34431 }, "percentiles4": { "ko": 60000, "ok": 45832, "total": 50970 }, "spikes": [], "standardDeviation": { "ko": 15143, "ok": 9761, "total": 10369 } }, { "group1": { "count": 1475, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 1 }, "group2": { "count": 531, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 0 }, "group3": { "count": 100705, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 90 }, "group4": { "count": 9665, "htmlName": "failed", "name": "failed", "percentage": 9 }, "maxResponseTime": { "ko": 60024, "ok": 59813, "total": 60024 }, "meanNumberOfRequestsPerSecond": { "ko": 2.6596037424325814, "ok": 28.263896532746283, "total": 30.923500275178867 }, "meanResponseTime": { "ko": 8977, "ok": 14940, "total": 14427 }, "minResponseTime": { "ko": 34, "ok": 137, "total": 34 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 9665, "ok": 102711, "total": 112376 }, "percentiles1": { "ko": 6146, "ok": 13102, "total": 12744 }, "percentiles2": { "ko": 12040, "ok": 18985, "total": 18540 }, "percentiles3": { "ko": 26841, "ok": 31975, "total": 31700 }, "percentiles4": { "ko": 60000, "ok": 45629, "total": 46730 }, "spikes": [], "standardDeviation": { "ko": 11345, "ok": 8952, "total": 9333 } } ], "global": { "group1": { "count": 206234, "htmlName": "t < 800 ms", "name": "t < 800 ms", "percentage": 10 }, "group2": { "count": 29740, "htmlName": "t >= 800 ms
t < 1200 ms", "name": "800 ms <= t < 1200 ms", "percentage": 1 }, "group3": { "count": 1697181, "htmlName": "t >= 1200 ms", "name": "t >= 1200 ms", "percentage": 79 }, "group4": { "count": 216532, "htmlName": "failed", "name": "failed", "percentage": 10 }, "maxResponseTime": { "ko": 60024, "ok": 76646, "total": 76646 }, "meanNumberOfRequestsPerSecond": { "ko": 59.585030269675286, "ok": 531.963401210787, "total": 591.5484314804623 }, "meanResponseTime": { "ko": 8428, "ok": 12208, "total": 11828 }, "minResponseTime": { "ko": 34, "ok": 40, "total": 34 }, "name": "All Requests", "numberOfRequests": { "ko": 216532, "ok": 1933155, "total": 2149687 }, "percentiles1": { "ko": 6107, "ok": 10634, "total": 10038 }, "percentiles2": { "ko": 10556, "ok": 17455, "total": 16925 }, "percentiles3": { "ko": 26501, "ok": 30864, "total": 30653 }, "percentiles4": { "ko": 60000, "ok": 43666, "total": 45489 }, "standardDeviation": { "ko": 11500, "ok": 9845, "total": 10088 } } }, "target_hostname": "openam-ema-perf-benchmark.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [2024-02-15 16:30:36] Reporting-login-tree-300 step15 : Remove gatling task's stdout file ________________________________________________________________________________ Cleanup of Gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_login_tree/07_scenario/07_login-tree-300/stdout.txt Compressing Gatling stdout.txt file.. ________________________________________________________________________________ [2024-02-15 16:30:51] Reporting-login-tree-300 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped