--Task-- name: Reporting_authn-users enabled: True class_name: GatlingResultTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {'task_name': 'authn-users'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [24/Sep/2022 11:37:57] Reporting_authn-users pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [24/Sep/2022 11:37:57] - INFO: Timeout for this Task has changed to 1h (3600 seconds) Pod stdout file : /results/orders/Reporting_authn-users/stdout.txt Pod stderr file : /results/orders/Reporting_authn-users/stderr.txt Pod log : /results/orders/Reporting_authn-users ________________________________________________________________________________ [24/Sep/2022 11:37:57] Reporting_authn-users step1 : Write order for overseer to generate the report ________________________________________________________________________________ Order file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/order.json { "name": "Reporting_authn-users", "command": "/lodestar/clients/gatling-report-only-for-pyrock.sh authn-users", "out-dir": "/results/orders/Reporting_authn-users" } ________________________________________________________________________________ [24/Sep/2022 11:37:57] Reporting_authn-users step2 : Make sure overseer is ready to accept order (not already busy) ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 21 0 --:--:-- --:--:-- --:--:-- 21 ________________________________________________________________________________ [24/Sep/2022 11:37:57] Reporting_authn-users step3 : Send order to overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/order.json overseer-0-c7fc5cc47-x4c97:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [24/Sep/2022 11:37:59] Reporting_authn-users step4 : Wait order is done ________________________________________________________________________________ Workaround for PERF-1966. Sleeping for 5 seconds. [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=3600, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 5s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 15s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 21s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 26s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 31s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 37s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 42s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 47s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 52s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 58s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 03s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 08s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 13s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 19s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 24s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 29s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 34s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 40s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 45s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 50s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 1m 55s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 01s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 06s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 11s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 16s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 22s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 27s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 32s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 38s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 43s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 48s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 53s (rc=0) - failed to find expected output: WAITING - retry [loop_until]: Function succeeded after 2m 59s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 30 0 --:--:-- --:--:-- --:--:-- 30 ________________________________________________________________________________ [24/Sep/2022 11:41:03] Reporting_authn-users step5 : Wait until gatling report is generated on overseer ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- Checking pod: overseer-0-c7fc5cc47-x4c97 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- bash -c 'if [ -f "/results/gatling/authn-users.tar.gz" ]; then echo "/results/gatling/authn-users.tar.gz file found"; exit 0; else echo "/results/gatling/authn-users.tar.gz file not found"; exit 1; fi' | grep "/results/gatling/authn-users.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/gatling/authn-users.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- du -k /results/gatling/authn-users.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 292 /results/gatling/authn-users.tar.gz --- stderr --- - Download file (size 292k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- source : /results/gatling/authn-users.tar.gz @ overseer-0-c7fc5cc47-x4c97 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/shared/authn-users.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-c7fc5cc47-x4c97:/results/gatling/authn-users.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/shared/authn-users.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [24/Sep/2022 11:41:07] Reporting_authn-users step6 : Unzip the result ________________________________________________________________________________ [run_command]: tar zxf /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/shared/authn-users.tar.gz -C /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users/gatling [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- --- stderr --- ________________________________________________________________________________ [24/Sep/2022 11:41:07] Reporting_authn-users step7 : Print rc order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- Checking pod: overseer-0-c7fc5cc47-x4c97 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- bash -c 'if [ -f "/results/orders/Reporting_authn-users/rc.txt" ]; then echo "/results/orders/Reporting_authn-users/rc.txt file found"; exit 0; else echo "/results/orders/Reporting_authn-users/rc.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting_authn-users/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting_authn-users/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- du -k /results/orders/Reporting_authn-users/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting_authn-users/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- source : /results/orders/Reporting_authn-users/rc.txt @ overseer-0-c7fc5cc47-x4c97 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-c7fc5cc47-x4c97:/results/orders/Reporting_authn-users/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [24/Sep/2022 11:41:11] Reporting_authn-users step8 : Check rc log ________________________________________________________________________________ PASS: no error found in rc log ________________________________________________________________________________ [24/Sep/2022 11:41:11] Reporting_authn-users step9 : Print stdout order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- Checking pod: overseer-0-c7fc5cc47-x4c97 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- bash -c 'if [ -f "/results/orders/Reporting_authn-users/stdout.txt" ]; then echo "/results/orders/Reporting_authn-users/stdout.txt file found"; exit 0; else echo "/results/orders/Reporting_authn-users/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting_authn-users/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting_authn-users/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- du -k /results/orders/Reporting_authn-users/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/Reporting_authn-users/stdout.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- source : /results/orders/Reporting_authn-users/stdout.txt @ overseer-0-c7fc5cc47-x4c97 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-c7fc5cc47-x4c97:/results/orders/Reporting_authn-users/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/stdout.txt is small (91 lines), printing all lines: ----- output ----- [cmd] /lodestar/clients/gatling/bin/gatling.sh -ro /results/gatling/authn-users/loadtest-20220924053712672 GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Parsing log file(s)... Parsing log file(s) done Generating reports... ================================================================================ ---- Global Information -------------------------------------------------------- > request count 12937864 (OK=12730847 KO=207017) > min response time 2 (OK=8 KO=2 ) > max response time 60016 (OK=59981 KO=60016 ) > mean response time 1284 (OK=1225 KO=4938 ) > std deviation 4786 (OK=4596 KO=10923 ) > response time 50th percentile 80 (OK=80 KO=8 ) > response time 75th percentile 120 (OK=119 KO=5925 ) > response time 95th percentile 10412 (OK=9962 KO=18397 ) > response time 99th percentile 24049 (OK=23859 KO=60000 ) > mean requests/sec 599.169 (OK=589.582 KO=9.587 ) ---- Response Time Distribution ------------------------------------------------ > t < 800 ms 11560554 ( 89%) > 800 ms < t < 1200 ms 102449 ( 1%) > t > 1200 ms 1067844 ( 8%) > failed 207017 ( 2%) ---- Errors -------------------------------------------------------------------- > status.find.is(200), but actually found 503 122478 (33.91%) > restloginProgressiveProfileCallback: Failed to build request: 77075 (21.34%) No attribute named 'callbacks' is defined > restLoginUsernamePasswordCallback: Failed to build request: No 77075 (21.34%) attribute named 'callbacks' is defined > status.find.is(200), but actually found 502 48755 (13.50%) > status.find.is(200), but actually found 400 21470 ( 5.94%) > i.g.h.c.i.RequestTimeoutException: Request timeout to openam-f 5933 ( 1.64%) r-pit-testing18.forgeblocks.com/34.111.142.226:443 after 60000... > status.find.is(200), but actually found 401 4491 ( 1.24%) > jsonPath($.tokenId).find.exists, found nothing 3873 ( 1.07%) > status.find.is(200), but actually found 500 10 ( 0.00%) > i.n.c.ConnectTimeoutException: connection timed out: openam-fr 7 ( 0.00%) -pit-testing18.forgeblocks.com/34.111.142.226:443 ================================================================================ Reports generated in 0s. Please open the following file: /results/gatling/authn-users/loadtest-20220924053712672/index.html ---------------------- [24/Sep/2022 12:41:00] Create tar file /results/gatling/authn-users.tar.gz ---------------------- SIMULATION_PATH=/results/gatling/authn-users/loadtest-20220924053712672 RESULT_FOLDER=authn-users RESULT_PATH=/results/gatling/authn-users PWD=/results/gatling/authn-users/loadtest-20220924053712672 [cmd] tar -czvf /results/gatling/authn-users.tar.gz --exclude=simulation.log * index.html js/ js/theme.js js/assertions.json js/bootstrap.min.js js/stats.json js/highstock.js js/moment.min.js js/highcharts-more.js js/assertions.xml js/menu.js js/global_stats.json js/jquery.min.js js/stats.js js/unpack.js js/gatling.js js/all_sessions.js req_restlogininitia-e2b9b.html req_restloginprogre-9fc93.html req_restloginuserna-d98ea.html style/ style/logo.png style/stat-fond.png style/arrow_right_black.png style/logo-gatling.jpg style/arrow_down_black.png style/arrow_down.png style/stat-l-roue.png style/stat-fleche-bas.png style/cible.png style/logo.svg style/arrow_right.png style/bootstrap.min.css style/stat-l-temps.png style/favicon.ico style/style.css style/little_arrow_right.png style/sortable.png style/sorted-down.png style/sorted-up.png ________________________________________________________________________________ [24/Sep/2022 11:41:14] Reporting_authn-users step10 : Check stdout log ________________________________________________________________________________ PASS: no error found in stdout log ________________________________________________________________________________ [24/Sep/2022 11:41:14] Reporting_authn-users step11 : Print stderr order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- Checking pod: overseer-0-c7fc5cc47-x4c97 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- bash -c 'if [ -f "/results/orders/Reporting_authn-users/stderr.txt" ]; then echo "/results/orders/Reporting_authn-users/stderr.txt file found"; exit 0; else echo "/results/orders/Reporting_authn-users/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/Reporting_authn-users/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/Reporting_authn-users/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- du -k /results/orders/Reporting_authn-users/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/Reporting_authn-users/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- source : /results/orders/Reporting_authn-users/stderr.txt @ overseer-0-c7fc5cc47-x4c97 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-c7fc5cc47-x4c97:/results/orders/Reporting_authn-users/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/06_Verification/04_Reporting_authn-users/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [24/Sep/2022 11:41:18] Reporting_authn-users step12 : Check stderr log ________________________________________________________________________________ PASS: no error found in stderr log ________________________________________________________________________________ [24/Sep/2022 11:41:18] Reporting_authn-users step13 : Analyze graphs for spikes ________________________________________________________________________________ Analyze Gatling graphs for spikes checking parameters open overall stats JSON file checking simulation request restLoginInitiate checking simulation request restLoginUsernamePasswordCallback checking simulation request restloginProgressiveProfileCallback 14 spikes found - see "spikes" sections in js/stats.json ________________________________________________________________________________ [24/Sep/2022 11:41:18] Reporting_authn-users step14 : Collect gatling simulation data ________________________________________________________________________________ collected stats : { "global": { "name": "Global Information", "numberOfRequests": { "total": 12937864, "ok": 12730847, "ko": 207017 }, "minResponseTime": { "total": 2, "ok": 8, "ko": 2 }, "maxResponseTime": { "total": 60016, "ok": 59981, "ko": 60016 }, "meanResponseTime": { "total": 1284, "ok": 1225, "ko": 4938 }, "standardDeviation": { "total": 4786, "ok": 4596, "ko": 10923 }, "percentiles1": { "total": 80, "ok": 80, "ko": 8 }, "percentiles2": { "total": 120, "ok": 119, "ko": 5925 }, "percentiles3": { "total": 10412, "ok": 9962, "ko": 18397 }, "percentiles4": { "total": 24049, "ok": 23859, "ko": 60000 }, "group1": { "name": "t < 800 ms", "count": 11560554, "percentage": 89 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 102449, "percentage": 1 }, "group3": { "name": "t > 1200 ms", "count": 1067844, "percentage": 8 }, "group4": { "name": "failed", "count": 207017, "percentage": 2 }, "meanNumberOfRequestsPerSecond": { "total": 599.1693604408836, "ok": 589.5821330986894, "ko": 9.587227342194229 } }, "details": [ { "name": "restLoginInitiate", "numberOfRequests": { "total": 6475045, "ok": 6397970, "ko": 77075 }, "minResponseTime": { "total": 6, "ok": 8, "ko": 6 }, "maxResponseTime": { "total": 60016, "ok": 59972, "ko": 60016 }, "meanResponseTime": { "total": 851, "ok": 808, "ko": 4383 }, "standardDeviation": { "total": 3682, "ok": 3534, "ko": 9467 }, "percentiles1": { "total": 12, "ok": 12, "ko": 8 }, "percentiles2": { "total": 14, "ok": 14, "ko": 6686 }, "percentiles3": { "total": 5498, "ok": 4883, "ko": 15087 }, "percentiles4": { "total": 19646, "ok": 19558, "ko": 60000 }, "group1": { "name": "t < 800 ms", "count": 5924735, "percentage": 92 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 20341, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 452894, "percentage": 7 }, "group4": { "name": "failed", "count": 77075, "percentage": 1 }, "meanNumberOfRequestsPerSecond": { "total": 299.8677812253971, "ok": 296.29833742416525, "ko": 3.5694438012318805 }, "spikes": [ { "datetime": "2022-09-24T08:17:34", "maxResponseTime": 12670 }, { "datetime": "2022-09-24T08:30:53", "maxResponseTime": 12135 }, { "datetime": "2022-09-24T08:31:14", "maxResponseTime": 17111 }, { "datetime": "2022-09-24T10:19:56", "maxResponseTime": 16163 } ] }, { "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "total": 6397848, "ok": 6332877, "ko": 64971 }, "minResponseTime": { "total": 2, "ok": 60, "ko": 2 }, "maxResponseTime": { "total": 60015, "ok": 59981, "ko": 60015 }, "meanResponseTime": { "total": 1709, "ok": 1645, "ko": 7948 }, "standardDeviation": { "total": 5649, "ok": 5430, "ko": 15113 }, "percentiles1": { "total": 101, "ok": 101, "ko": 5 }, "percentiles2": { "total": 176, "ok": 175, "ko": 10038 }, "percentiles3": { "total": 16059, "ok": 15833, "ko": 60000 }, "percentiles4": { "total": 26418, "ok": 26091, "ko": 60001 }, "group1": { "name": "t < 800 ms", "count": 5635819, "percentage": 88 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 82108, "percentage": 1 }, "group3": { "name": "t > 1200 ms", "count": 614950, "percentage": 10 }, "group4": { "name": "failed", "count": 64971, "percentage": 1 }, "meanNumberOfRequestsPerSecond": { "total": 296.2926874450053, "ok": 293.28379567452413, "ko": 3.0088917704811746 }, "spikes": [ { "datetime": "2022-09-24T06:16:16", "maxResponseTime": 12058 }, { "datetime": "2022-09-24T06:44:42", "maxResponseTime": 11762 }, { "datetime": "2022-09-24T07:41:34", "maxResponseTime": 11255 }, { "datetime": "2022-09-24T08:05:41", "maxResponseTime": 12469 }, { "datetime": "2022-09-24T08:17:34", "maxResponseTime": 23374 }, { "datetime": "2022-09-24T08:30:09", "maxResponseTime": 7945 }, { "datetime": "2022-09-24T08:30:31", "maxResponseTime": 24348 }, { "datetime": "2022-09-24T09:39:59", "maxResponseTime": 6395 }, { "datetime": "2022-09-24T10:19:34", "maxResponseTime": 22385 }, { "datetime": "2022-09-24T11:26:52", "maxResponseTime": 3425 } ] }, { "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "total": 64971, "ok": 0, "ko": 64971 }, "minResponseTime": { "total": 3, "ok": 0, "ko": 3 }, "maxResponseTime": { "total": 57000, "ok": 0, "ko": 57000 }, "meanResponseTime": { "total": 2587, "ok": 0, "ko": 2587 }, "standardDeviation": { "total": 5520, "ok": 0, "ko": 5520 }, "percentiles1": { "total": 5, "ok": 0, "ko": 5 }, "percentiles2": { "total": 3182, "ok": 0, "ko": 3182 }, "percentiles3": { "total": 14360, "ok": 0, "ko": 14360 }, "percentiles4": { "total": 24443, "ok": 0, "ko": 24443 }, "group1": { "name": "t < 800 ms", "count": 0, "percentage": 0 }, "group2": { "name": "800 ms < t < 1200 ms", "count": 0, "percentage": 0 }, "group3": { "name": "t > 1200 ms", "count": 0, "percentage": 0 }, "group4": { "name": "failed", "count": 64971, "percentage": 100 }, "meanNumberOfRequestsPerSecond": { "total": 3.0088917704811746, "ok": 0, "ko": 3.0088917704811746 }, "spikes": [] } ] } { "concurrency": null, "generic_stats": { "avg_num_of_requests_per_second": 599, "avg_response_time": 1284, "max_response_time": 59981, "min_response_time": 8, "num_requests": 12937864, "num_requests_pass": 12730847, "num_requests_percent_pass": 98.4 }, "options": "; simulation:com.forgerock.gatling.Loadtest; testCase:idc.login; testMode:open; throughput:300; rampup-duration:30", "stats": { "details": [ { "group1": { "count": 5924735, "name": "t < 800 ms", "percentage": 92 }, "group2": { "count": 20341, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 452894, "name": "t > 1200 ms", "percentage": 7 }, "group4": { "count": 77075, "name": "failed", "percentage": 1 }, "maxResponseTime": { "ko": 60016, "ok": 59972, "total": 60016 }, "meanNumberOfRequestsPerSecond": { "ko": 3.5694438012318805, "ok": 296.29833742416525, "total": 299.8677812253971 }, "meanResponseTime": { "ko": 4383, "ok": 808, "total": 851 }, "minResponseTime": { "ko": 6, "ok": 8, "total": 6 }, "name": "restLoginInitiate", "numberOfRequests": { "ko": 77075, "ok": 6397970, "total": 6475045 }, "percentiles1": { "ko": 8, "ok": 12, "total": 12 }, "percentiles2": { "ko": 6686, "ok": 14, "total": 14 }, "percentiles3": { "ko": 15087, "ok": 4883, "total": 5498 }, "percentiles4": { "ko": 60000, "ok": 19558, "total": 19646 }, "spikes": [ { "datetime": "2022-09-24T08:17:34", "maxResponseTime": 12670 }, { "datetime": "2022-09-24T08:30:53", "maxResponseTime": 12135 }, { "datetime": "2022-09-24T08:31:14", "maxResponseTime": 17111 }, { "datetime": "2022-09-24T10:19:56", "maxResponseTime": 16163 } ], "standardDeviation": { "ko": 9467, "ok": 3534, "total": 3682 } }, { "group1": { "count": 5635819, "name": "t < 800 ms", "percentage": 88 }, "group2": { "count": 82108, "name": "800 ms < t < 1200 ms", "percentage": 1 }, "group3": { "count": 614950, "name": "t > 1200 ms", "percentage": 10 }, "group4": { "count": 64971, "name": "failed", "percentage": 1 }, "maxResponseTime": { "ko": 60015, "ok": 59981, "total": 60015 }, "meanNumberOfRequestsPerSecond": { "ko": 3.0088917704811746, "ok": 293.28379567452413, "total": 296.2926874450053 }, "meanResponseTime": { "ko": 7948, "ok": 1645, "total": 1709 }, "minResponseTime": { "ko": 2, "ok": 60, "total": 2 }, "name": "restLoginUsernamePasswordCallback", "numberOfRequests": { "ko": 64971, "ok": 6332877, "total": 6397848 }, "percentiles1": { "ko": 5, "ok": 101, "total": 101 }, "percentiles2": { "ko": 10038, "ok": 175, "total": 176 }, "percentiles3": { "ko": 60000, "ok": 15833, "total": 16059 }, "percentiles4": { "ko": 60001, "ok": 26091, "total": 26418 }, "spikes": [ { "datetime": "2022-09-24T06:16:16", "maxResponseTime": 12058 }, { "datetime": "2022-09-24T06:44:42", "maxResponseTime": 11762 }, { "datetime": "2022-09-24T07:41:34", "maxResponseTime": 11255 }, { "datetime": "2022-09-24T08:05:41", "maxResponseTime": 12469 }, { "datetime": "2022-09-24T08:17:34", "maxResponseTime": 23374 }, { "datetime": "2022-09-24T08:30:09", "maxResponseTime": 7945 }, { "datetime": "2022-09-24T08:30:31", "maxResponseTime": 24348 }, { "datetime": "2022-09-24T09:39:59", "maxResponseTime": 6395 }, { "datetime": "2022-09-24T10:19:34", "maxResponseTime": 22385 }, { "datetime": "2022-09-24T11:26:52", "maxResponseTime": 3425 } ], "standardDeviation": { "ko": 15113, "ok": 5430, "total": 5649 } }, { "group1": { "count": 0, "name": "t < 800 ms", "percentage": 0 }, "group2": { "count": 0, "name": "800 ms < t < 1200 ms", "percentage": 0 }, "group3": { "count": 0, "name": "t > 1200 ms", "percentage": 0 }, "group4": { "count": 64971, "name": "failed", "percentage": 100 }, "maxResponseTime": { "ko": 57000, "ok": 0, "total": 57000 }, "meanNumberOfRequestsPerSecond": { "ko": 3.0088917704811746, "ok": 0, "total": 3.0088917704811746 }, "meanResponseTime": { "ko": 2587, "ok": 0, "total": 2587 }, "minResponseTime": { "ko": 3, "ok": 0, "total": 3 }, "name": "restloginProgressiveProfileCallback", "numberOfRequests": { "ko": 64971, "ok": 0, "total": 64971 }, "percentiles1": { "ko": 5, "ok": 0, "total": 5 }, "percentiles2": { "ko": 3182, "ok": 0, "total": 3182 }, "percentiles3": { "ko": 14360, "ok": 0, "total": 14360 }, "percentiles4": { "ko": 24443, "ok": 0, "total": 24443 }, "spikes": [], "standardDeviation": { "ko": 5520, "ok": 0, "total": 5520 } } ], "global": { "group1": { "count": 11560554, "name": "t < 800 ms", "percentage": 89 }, "group2": { "count": 102449, "name": "800 ms < t < 1200 ms", "percentage": 1 }, "group3": { "count": 1067844, "name": "t > 1200 ms", "percentage": 8 }, "group4": { "count": 207017, "name": "failed", "percentage": 2 }, "maxResponseTime": { "ko": 60016, "ok": 59981, "total": 60016 }, "meanNumberOfRequestsPerSecond": { "ko": 9.587227342194229, "ok": 589.5821330986894, "total": 599.1693604408836 }, "meanResponseTime": { "ko": 4938, "ok": 1225, "total": 1284 }, "minResponseTime": { "ko": 2, "ok": 8, "total": 2 }, "name": "Global Information", "numberOfRequests": { "ko": 207017, "ok": 12730847, "total": 12937864 }, "percentiles1": { "ko": 8, "ok": 80, "total": 80 }, "percentiles2": { "ko": 5925, "ok": 119, "total": 120 }, "percentiles3": { "ko": 18397, "ok": 9962, "total": 10412 }, "percentiles4": { "ko": 60000, "ok": 23859, "total": 24049 }, "standardDeviation": { "ko": 10923, "ok": 4596, "total": 4786 } } }, "target_hostname": "openam-fr-pit-testing18.forgeblocks.com", "tool_name": "gatling" } ________________________________________________________________________________ [24/Sep/2022 11:41:18] Reporting_authn-users step15 : Remove gatling task's stdout file ________________________________________________________________________________ Deleting gatling stdout file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/05_scenario/01_authn-users/stdout.txt Gatling stdout.txt has been deleted ________________________________________________________________________________ [24/Sep/2022 11:41:18] Reporting_authn-users post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped