--Task-- name: Reporting_saml2-open-10 enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {'task_name': 'saml2-open-10'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [07/Aug/2022 18:37:38] Reporting_saml2-open-10 pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [07/Aug/2022 18:37:38] - INFO: Timeout for this Task has changed to 1h (3600 seconds) Pod stdout file : /results/orders/Reporting_saml2-open-10/stdout.txt Pod stderr file : /results/orders/Reporting_saml2-open-10/stderr.txt Pod log : /results/orders/Reporting_saml2-open-10 ________________________________________________________________________________ [07/Aug/2022 18:37:38] Reporting_saml2-open-10 step1 : Write order for overseer to generate the report ________________________________________________________________________________ Order file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/order.json { "name": "Reporting_saml2-open-10", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh saml2-open-10", "out-dir": "/results/orders/Reporting_saml2-open-10" } ________________________________________________________________________________ [07/Aug/2022 18:37:38] Reporting_saml2-open-10 step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 19 0 --:--:-- --:--:-- --:--:-- 19 ________________________________________________________________________________ [07/Aug/2022 18:37:38] Reporting_saml2-open-10 step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/order.json overseer-0-675d4fb6f9-rlvvn:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [07/Aug/2022 18:37:41] Reporting_saml2-open-10 step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=3600, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 16s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 29 0 --:--:-- --:--:-- --:--:-- 29 ________________________________________________________________________________ [07/Aug/2022 18:38:02] Reporting_saml2-open-10 step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- Checking pod: overseer-0-675d4fb6f9-rlvvn for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-675d4fb6f9-rlvvn -i -- bash -c 'if [ -f "/results/gatling/saml2-open-10.tar.gz" ]; then echo "/results/gatling/saml2-open-10.tar.gz file found"; exit 0; else echo "/results/gatling/saml2-open-10.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/saml2-open-10.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/saml2-open-10.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-675d4fb6f9-rlvvn -i -- du -k /results/gatling/saml2-open-10.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 380 /results/gatling/saml2-open-10.tar.gz --- stderr --- - Download file (size 380k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- source : /results/gatling/saml2-open-10.tar.gz @ overseer-0-675d4fb6f9-rlvvn destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/shared/saml2-open-10.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-675d4fb6f9-rlvvn:/results/gatling/saml2-open-10.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/shared/saml2-open-10.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [07/Aug/2022 18:38:06] Reporting_saml2-open-10 step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/shared/saml2-open-10.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/05_saml2/01_saml2-open-10/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [07/Aug/2022 18:38:06] Reporting_saml2-open-10 step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- Checking pod: overseer-0-675d4fb6f9-rlvvn for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-675d4fb6f9-rlvvn -i -- bash -c 'if [ -f "/results/orders/Reporting_saml2-open-10/rc.txt" ]; then echo "/results/orders/Reporting_saml2-open-10/rc.txt file found"; exit 0; else echo "/results/orders/Reporting_saml2-open-10/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting_saml2-open-10/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting_saml2-open-10/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-675d4fb6f9-rlvvn -i -- du -k /results/orders/Reporting_saml2-open-10/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting_saml2-open-10/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- source : /results/orders/Reporting_saml2-open-10/rc.txt @ overseer-0-675d4fb6f9-rlvvn destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-675d4fb6f9-rlvvn:/results/orders/Reporting_saml2-open-10/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [07/Aug/2022 18:38:10] Reporting_saml2-open-10 step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [07/Aug/2022 18:38:10] Reporting_saml2-open-10 step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- Checking pod: overseer-0-675d4fb6f9-rlvvn for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-675d4fb6f9-rlvvn -i -- bash -c 'if [ -f "/results/orders/Reporting_saml2-open-10/stdout.txt" ]; then echo "/results/orders/Reporting_saml2-open-10/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting_saml2-open-10/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting_saml2-open-10/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting_saml2-open-10/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-675d4fb6f9-rlvvn -i -- du -k /results/orders/Reporting_saml2-open-10/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting_saml2-open-10/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- source : /results/orders/Reporting_saml2-open-10/stdout.txt @ overseer-0-675d4fb6f9-rlvvn destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-675d4fb6f9-rlvvn:/results/orders/Reporting_saml2-open-10/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/stdout.txt is small (85 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh -ro /results/gatling/saml2-open-10/loadtest-20220807163646593 GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 356508 (OK=356508 KO=0 ) > min response time 0 (OK=0 KO=- ) > max response time 645 (OK=645 KO=- ) > mean response time 8 (OK=8 KO=- ) > std deviation 9 (OK=9 KO=- ) > response time 50th percentile 5 (OK=5 KO=- ) > response time 75th percentile 10 (OK=10 KO=- ) > response time 95th percentile 26 (OK=26 KO=- ) > response time 99th percentile 31 (OK=31 KO=- ) > mean requests/sec 99.251 (OK=99.251 KO=- ) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 356508 (100%) > 800 ms < t < 1200 ms 0 ( 0%) > t > 1200 ms 0 ( 0%) > failed 0 ( 0%) ================================================================================ Reports generated in 0s. Please open the following file: /results/gatling/saml2-open-10/loadtest-20220807163646593/index.html ---------------------- [07/Aug/2022 19:37:59] Create tar file /results/gatling/saml2-open-10.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/saml2-open-10/loadtest-20220807163646593 RESULT_FOLDER=saml2-open-10 RESULT_PATH=/results/gatling/saml2-open-10 PWD=/results/gatling/saml2-open-10/loadtest-20220807163646593 [cmd] tar -czvf /results/gatling/saml2-open-10.tar.gz --exclude=simulation.log * group_logout-0323d.html group_sso-start-bbb7c.html index.html js/ js/all_sessions.js js/global_stats.json js/theme.js js/stats.json js/moment.min.js js/unpack.js js/highstock.js js/jquery.min.js js/stats.js js/gatling.js js/menu.js js/assertions.json js/assertions.xml js/highcharts-more.js js/bootstrap.min.js req_get-saml2-conti-f8631.html req_logout---idp-si-027c3.html req_logout---idp-si-3f602.html req_logout---idp-si-4f656.html req_logout---idp-si-857c2.html req_post-saml-respo-f5a5b.html req_rest-login-77f36.html req_sso-start---tri-08623.html req_sso-start---tri-bd780.html req_submit-response-0145f.html style/ style/favicon.ico style/logo-gatling.jpg style/arrow_right_black.png style/little_arrow_right.png style/bootstrap.min.css style/arrow_right.png style/logo.svg style/style.css style/stat-fond.png style/stat-l-roue.png style/sorted-up.png style/sortable.png style/arrow_down_black.png style/arrow_down.png style/logo.png style/cible.png style/stat-fleche-bas.png style/stat-l-temps.png style/sorted-down.png ________________________________________________________________________________ [07/Aug/2022 18:38:14] Reporting_saml2-open-10 step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [07/Aug/2022 18:38:14] Reporting_saml2-open-10 step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- Checking pod: overseer-0-675d4fb6f9-rlvvn for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-675d4fb6f9-rlvvn -i -- bash -c 'if [ -f "/results/orders/Reporting_saml2-open-10/stderr.txt" ]; then echo "/results/orders/Reporting_saml2-open-10/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting_saml2-open-10/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting_saml2-open-10/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting_saml2-open-10/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-675d4fb6f9-rlvvn -i -- du -k /results/orders/Reporting_saml2-open-10/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting_saml2-open-10/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- source : /results/orders/Reporting_saml2-open-10/stderr.txt @ overseer-0-675d4fb6f9-rlvvn destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-675d4fb6f9-rlvvn --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-675d4fb6f9-rlvvn:/results/orders/Reporting_saml2-open-10/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/saml2/06_Verification/09_Reporting_saml2-open-10/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [07/Aug/2022 18:38:18] Reporting_saml2-open-10 step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [07/Aug/2022 18:38:18] Reporting_saml2-open-10 step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request SSO Start checking simulation request Logout checking simulation request REST Login checking simulation request GET SAML2 Continue Url checking simulation request POST SAML response checking simulation request Submit response to SP no spikes found ________________________________________________________________________________ [07/Aug/2022 18:38:18] Reporting_saml2-open-10 step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "Global Information", "numberOfRequests": { "total": 356508, "ok": 356508, "ko": 0 }, "minResponseTime": { "total": 0, "ok": 0, "ko": 0 }, "maxResponseTime": { "total": 645, "ok": 645, "ko": 0 }, "meanResponseTime": { "total": 8, "ok": 8, "ko": 0 }, "standardDeviation": { "total": 9, "ok": 9, "ko": 0 }, "percentiles1": { "total": 5, "ok": 5, "ko": 0 }, "percentiles2": { "total": 10, "ok": 10, "ko": 0 }, "percentiles3": { "total": 26, "ok": 26, "ko": 0 }, "percentiles4": { "total": 31, "ok": 31, "ko": 0 }, "group1": { "name": "t < 800 ms", "count": 356508, "percentage": 100 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "count": 0, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 99.25055679287306, "ok": 99.25055679287306, "ko": 0 } }, "details": [ { "name": "SSO Start", "numberOfRequests": { "total": 35651, "ok": 35651, "ko": 0 }, "minResponseTime": { "total": 8, "ok": 8, "ko": 0 }, "maxResponseTime": { "total": 622, "ok": 622, "ko": 0 }, "meanResponseTime": { "total": 12, "ok": 12, "ko": 0 }, "standardDeviation": { "total": 8, "ok": 8, "ko": 0 }, "percentiles1": { "total": 11, "ok": 11, "ko": 0 }, "percentiles2": { "total": 12, "ok": 12, "ko": 0 }, "percentiles3": { "total": 16, "ok": 16, "ko": 0 }, "percentiles4": { "total": 50, "ok": 50, "ko": 0 }, "group1": { "name": "t < 800 ms", "count": 35651, "percentage": 100 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "count": 0, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 9.925111358574611, "ok": 9.925111358574611, "ko": 0 }, "spikes": [] }, { "name": "Logout", "numberOfRequests": { "total": 35650, "ok": 35650, "ko": 0 }, "minResponseTime": { "total": 6, "ok": 6, "ko": 0 }, "maxResponseTime": { "total": 268, "ok": 268, "ko": 0 }, "meanResponseTime": { "total": 12, "ok": 12, "ko": 0 }, "standardDeviation": { "total": 4, "ok": 4, "ko": 0 }, "percentiles1": { "total": 11, "ok": 11, "ko": 0 }, "percentiles2": { "total": 13, "ok": 13, "ko": 0 }, "percentiles3": { "total": 15, "ok": 15, "ko": 0 }, "percentiles4": { "total": 22, "ok": 22, "ko": 0 }, "group1": { "name": "t < 800 ms", "count": 35650, "percentage": 100 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "count": 0, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 9.924832962138085, "ok": 9.924832962138085, "ko": 0 }, "spikes": [] }, { "name": "REST Login", "numberOfRequests": { "total": 35651, "ok": 35651, "ko": 0 }, "minResponseTime": { "total": 7, "ok": 7, "ko": 0 }, "maxResponseTime": { "total": 485, "ok": 485, "ko": 0 }, "meanResponseTime": { "total": 10, "ok": 10, "ko": 0 }, "standardDeviation": { "total": 3, "ok": 3, "ko": 0 }, "percentiles1": { "total": 10, "ok": 10, "ko": 0 }, "percentiles2": { "total": 12, "ok": 12, "ko": 0 }, "percentiles3": { "total": 14, "ok": 14, "ko": 0 }, "percentiles4": { "total": 17, "ok": 17, "ko": 0 }, "group1": { "name": "t < 800 ms", "count": 35651, "percentage": 100 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "count": 0, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 9.925111358574611, "ok": 9.925111358574611, "ko": 0 }, "spikes": [] }, { "name": "GET SAML2 Continue Url", "numberOfRequests": { "total": 35651, "ok": 35651, "ko": 0 }, "minResponseTime": { "total": 0, "ok": 0, "ko": 0 }, "maxResponseTime": { "total": 52, "ok": 52, "ko": 0 }, "meanResponseTime": { "total": 1, "ok": 1, "ko": 0 }, "standardDeviation": { "total": 1, "ok": 1, "ko": 0 }, "percentiles1": { "total": 1, "ok": 1, "ko": 0 }, "percentiles2": { "total": 1, "ok": 1, "ko": 0 }, "percentiles3": { "total": 1, "ok": 1, "ko": 0 }, "percentiles4": { "total": 2, "ok": 2, "ko": 0 }, "group1": { "name": "t < 800 ms", "count": 35651, "percentage": 100 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "count": 0, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 9.925111358574611, "ok": 9.925111358574611, "ko": 0 }, "spikes": [] }, { "name": "POST SAML response", "numberOfRequests": { "total": 35651, "ok": 35651, "ko": 0 }, "minResponseTime": { "total": 10, "ok": 10, "ko": 0 }, "maxResponseTime": { "total": 645, "ok": 645, "ko": 0 }, "meanResponseTime": { "total": 15, "ok": 15, "ko": 0 }, "standardDeviation": { "total": 7, "ok": 7, "ko": 0 }, "percentiles1": { "total": 14, "ok": 14, "ko": 0 }, "percentiles2": { "total": 16, "ok": 16, "ko": 0 }, "percentiles3": { "total": 18, "ok": 18, "ko": 0 }, "percentiles4": { "total": 48, "ok": 48, "ko": 0 }, "group1": { "name": "t < 800 ms", "count": 35651, "percentage": 100 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "count": 0, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 9.925111358574611, "ok": 9.925111358574611, "ko": 0 }, "spikes": [] }, { "name": "Submit response to SP", "numberOfRequests": { "total": 35651, "ok": 35651, "ko": 0 }, "minResponseTime": { "total": 21, "ok": 21, "ko": 0 }, "maxResponseTime": { "total": 587, "ok": 587, "ko": 0 }, "meanResponseTime": { "total": 26, "ok": 26, "ko": 0 }, "standardDeviation": { "total": 7, "ok": 7, "ko": 0 }, "percentiles1": { "total": 25, "ok": 25, "ko": 0 }, "percentiles2": { "total": 27, "ok": 27, "ko": 0 }, "percentiles3": { "total": 31, "ok": 31, "ko": 0 }, "percentiles4": { "total": 55, "ok": 55, "ko": 0 }, "group1": { "name": "t < 800 ms", "count": 35651, "percentage": 100 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "count": 0, "percentage": 0 }, "meanNumberOfRequestsPerSecond": { "total": 9.925111358574611, "ok": 9.925111358574611, "ko": 0 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 99, "avg_response_time": 8, "max_response_time": 645, "min_response_time": 0, "num_requests": 356508, "num_requests_pass": 356508, "num_requests_percent_pass": 100.0 }, "options": "; testMode:open; simulation:com.forgerock.gatling.Loadtest; testCase:am.Saml2; throughput:10; rampup-duration:30", "stats": { "details": [ { "group1": { "count": 35651, "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 0, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "name": "t > 1200 ms", "percentage": 0 }, "group4": { "count": 0, "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 0, "ok": 622, "total": 622 }, "meanNumberOfRequestsPerSecond": { "ko": 0, "ok": 9.925111358574611, "total": 9.925111358574611 }, "meanResponseTime": { "ko": 0, "ok": 12, "total": 12 }, "minResponseTime": { "ko": 0, "ok": 8, "total": 8 }, "name": "SSO Start", "numberOfRequests": { "ko": 0, "ok": 35651, "total": 35651 }, "percentiles1": { "ko": 0, "ok": 11, "total": 11 }, "percentiles2": { "ko": 0, "ok": 12, "total": 12 }, "percentiles3": { "ko": 0, "ok": 16, "total": 16 }, "percentiles4": { "ko": 0, "ok": 50, "total": 50 }, "spikes": [], "standardDeviation": { "ko": 0, "ok": 8, "total": 8 } }, { "group1": { "count": 35650, "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 0, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "name": "t > 1200 ms", "percentage": 0 }, "group4": { "count": 0, "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 0, "ok": 268, "total": 268 }, "meanNumberOfRequestsPerSecond": { "ko": 0, "ok": 9.924832962138085, "total": 9.924832962138085 }, "meanResponseTime": { "ko": 0, "ok": 12, "total": 12 }, "minResponseTime": { "ko": 0, "ok": 6, "total": 6 }, "name": "Logout", "numberOfRequests": { "ko": 0, "ok": 35650, "total": 35650 }, "percentiles1": { "ko": 0, "ok": 11, "total": 11 }, "percentiles2": { "ko": 0, "ok": 13, "total": 13 }, "percentiles3": { "ko": 0, "ok": 15, "total": 15 }, "percentiles4": { "ko": 0, "ok": 22, "total": 22 }, "spikes": [], "standardDeviation": { "ko": 0, "ok": 4, "total": 4 } }, { "group1": { "count": 35651, "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 0, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "name": "t > 1200 ms", "percentage": 0 }, "group4": { "count": 0, "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 0, "ok": 485, "total": 485 }, "meanNumberOfRequestsPerSecond": { "ko": 0, "ok": 9.925111358574611, "total": 9.925111358574611 }, "meanResponseTime": { "ko": 0, "ok": 10, "total": 10 }, "minResponseTime": { "ko": 0, "ok": 7, "total": 7 }, "name": "REST Login", "numberOfRequests": { "ko": 0, "ok": 35651, "total": 35651 }, "percentiles1": { "ko": 0, "ok": 10, "total": 10 }, "percentiles2": { "ko": 0, "ok": 12, "total": 12 }, "percentiles3": { "ko": 0, "ok": 14, "total": 14 }, "percentiles4": { "ko": 0, "ok": 17, "total": 17 }, "spikes": [], "standardDeviation": { "ko": 0, "ok": 3, "total": 3 } }, { "group1": { "count": 35651, "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 0, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "name": "t > 1200 ms", "percentage": 0 }, "group4": { "count": 0, "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 0, "ok": 52, "total": 52 }, "meanNumberOfRequestsPerSecond": { "ko": 0, "ok": 9.925111358574611, "total": 9.925111358574611 }, "meanResponseTime": { "ko": 0, "ok": 1, "total": 1 }, "minResponseTime": { "ko": 0, "ok": 0, "total": 0 }, "name": "GET SAML2 Continue Url", "numberOfRequests": { "ko": 0, "ok": 35651, "total": 35651 }, "percentiles1": { "ko": 0, "ok": 1, "total": 1 }, "percentiles2": { "ko": 0, "ok": 1, "total": 1 }, "percentiles3": { "ko": 0, "ok": 1, "total": 1 }, "percentiles4": { "ko": 0, "ok": 2, "total": 2 }, "spikes": [], "standardDeviation": { "ko": 0, "ok": 1, "total": 1 } }, { "group1": { "count": 35651, "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 0, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "name": "t > 1200 ms", "percentage": 0 }, "group4": { "count": 0, "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 0, "ok": 645, "total": 645 }, "meanNumberOfRequestsPerSecond": { "ko": 0, "ok": 9.925111358574611, "total": 9.925111358574611 }, "meanResponseTime": { "ko": 0, "ok": 15, "total": 15 }, "minResponseTime": { "ko": 0, "ok": 10, "total": 10 }, "name": "POST SAML response", "numberOfRequests": { "ko": 0, "ok": 35651, "total": 35651 }, "percentiles1": { "ko": 0, "ok": 14, "total": 14 }, "percentiles2": { "ko": 0, "ok": 16, "total": 16 }, "percentiles3": { "ko": 0, "ok": 18, "total": 18 }, "percentiles4": { "ko": 0, "ok": 48, "total": 48 }, "spikes": [], "standardDeviation": { "ko": 0, "ok": 7, "total": 7 } }, { "group1": { "count": 35651, "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 0, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "name": "t > 1200 ms", "percentage": 0 }, "group4": { "count": 0, "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 0, "ok": 587, "total": 587 }, "meanNumberOfRequestsPerSecond": { "ko": 0, "ok": 9.925111358574611, "total": 9.925111358574611 }, "meanResponseTime": { "ko": 0, "ok": 26, "total": 26 }, "minResponseTime": { "ko": 0, "ok": 21, "total": 21 }, "name": "Submit response to SP", "numberOfRequests": { "ko": 0, "ok": 35651, "total": 35651 }, "percentiles1": { "ko": 0, "ok": 25, "total": 25 }, "percentiles2": { "ko": 0, "ok": 27, "total": 27 }, "percentiles3": { "ko": 0, "ok": 31, "total": 31 }, "percentiles4": { "ko": 0, "ok": 55, "total": 55 }, "spikes": [], "standardDeviation": { "ko": 0, "ok": 7, "total": 7 } } ], "global": { "group1": { "count": 356508, "name": "t < 800 ms", "percentage": 100 }, "group2": { "count": 0, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "name": "t > 1200 ms", "percentage": 0 }, "group4": { "count": 0, "name": "failed", "percentage": 0 }, "maxResponseTime": { "ko": 0, "ok": 645, "total": 645 }, "meanNumberOfRequestsPerSecond": { "ko": 0, "ok": 99.25055679287306, "total": 99.25055679287306 }, "meanResponseTime": { "ko": 0, "ok": 8, "total": 8 }, "minResponseTime": { "ko": 0, "ok": 0, "total": 0 }, "name": "Global Information", "numberOfRequests": { "ko": 0, "ok": 356508, "total": 356508 }, "percentiles1": { "ko": 0, "ok": 5, "total": 5 }, "percentiles2": { "ko": 0, "ok": 10, "total": 10 }, "percentiles3": { "ko": 0, "ok": 26, "total": 26 }, "percentiles4": { "ko": 0, "ok": 31, "total": 31 }, "standardDeviation": { "ko": 0, "ok": 9, "total": 9 } } }, "target_hostname": "xlou.iam.xlou-cdm.engineeringpit.com", "tool_name": "gatling" } ________________________________________________________________________________ [07/Aug/2022 18:38:18] Reporting_saml2-open-10 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped