--Task-- name: authn-users-4000 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: ['authn-users-3500'] preceding_task: authn-users-3500 options: {'testMode': 'open', 'testCase': 'am.AMAuthN', 'throughput': 4000, 'rampup-duration': 30, 'duration': 3600} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-04-10 04:45:22] authn-users-4000 pre : N/A ________________________________________________________________________________ [2024-04-10 04:45:22] - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) [2024-04-10 04:45:22] - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/authn-users-4000/stdout.txt Pod log : /results/orders/authn-users-4000 2024-04-10 04:45:22,233 INFO 2024-04-10 04:45:22,233 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 04:45:22,233 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 04:45:22,548 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 04:45:22,548 INFO [loop_until]: OK (rc = 0) 2024-04-10 04:45:22,548 DEBUG --- stdout --- 2024-04-10 04:45:22,549 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 04:45:22,549 DEBUG --- stderr --- 2024-04-10 04:45:22,549 DEBUG ________________________________________________________________________________ [2024-04-10 04:45:22] authn-users-4000 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-04-10 04:45:22,550 INFO 2024-04-10 04:45:22,550 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 04:45:22,550 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 04:45:22,915 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 04:45:22,915 INFO [loop_until]: OK (rc = 0) 2024-04-10 04:45:22,915 DEBUG --- stdout --- 2024-04-10 04:45:22,915 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 04:45:22,915 DEBUG --- stderr --- 2024-04-10 04:45:22,916 DEBUG /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling-open/ --run-description "am.AMAuthN@medium" --results-folder /results/gatling/authn-users-4000 --extra-run-jvm-options "-Xmx4G" --no-reports ________________________________________________________________________________ [2024-04-10 04:45:22] authn-users-4000 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-04-10 04:45:22,916 INFO 2024-04-10 04:45:22,916 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 04:45:22,917 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 04:45:23,285 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 04:45:23,286 INFO [loop_until]: OK (rc = 0) 2024-04-10 04:45:23,286 DEBUG --- stdout --- 2024-04-10 04:45:23,286 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 04:45:23,286 DEBUG --- stderr --- 2024-04-10 04:45:23,286 DEBUG Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/order.json { "name": "authn-users-4000", "command": " /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling-open/ --run-description \"am.AMAuthN@medium\" --results-folder /results/gatling/authn-users-4000 --extra-run-jvm-options \"-Xmx4G\" --no-reports", "out-dir": "/results/orders/authn-users-4000", "environment": { "JAVA_OPTS": "-Dam_host=xlou.iam.xlou-cdm.engineeringpit.com -DamadminPassword=**** -DamadminUsername=amadmin -Dduration=3600 -Dnum_users=1000000 -Drampup_duration=30 -DtestCase=am.AMAuthN -DtestMode=open -Dthroughput=4000 -Duser_password=T35tr0ck123" } } ________________________________________________________________________________ [2024-04-10 04:45:23] authn-users-4000 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-04-10 04:45:23,288 INFO 2024-04-10 04:45:23,288 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-04-10 04:45:23,288 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-04-10 04:45:23,610 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-10 04:45:23,610 INFO [loop_until]: OK (rc = 0) 2024-04-10 04:45:23,610 DEBUG --- stdout --- 2024-04-10 04:45:23,610 DEBUG WAITING 2024-04-10 04:45:23,610 DEBUG --- stderr --- 2024-04-10 04:45:23,610 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 25 0 --:--:-- --:--:-- --:--:-- 24 ________________________________________________________________________________ [2024-04-10 04:45:23] authn-users-4000 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-04-10 04:45:23,611 INFO 2024-04-10 04:45:23,611 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 04:45:23,611 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 04:45:23,936 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 04:45:23,936 INFO [loop_until]: OK (rc = 0) 2024-04-10 04:45:23,936 DEBUG --- stdout --- 2024-04-10 04:45:23,936 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 04:45:23,936 DEBUG --- stderr --- 2024-04-10 04:45:23,936 DEBUG 2024-04-10 04:45:23,937 INFO 2024-04-10 04:45:23,937 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/order.json overseer-0-6f8784665d-zq5hb:/results/orders/order.json 2024-04-10 04:45:23,937 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-10 04:45:25,310 INFO [loop_until]: OK (rc = 0) 2024-04-10 04:45:25,311 DEBUG --- stdout --- 2024-04-10 04:45:25,311 DEBUG 2024-04-10 04:45:25,311 DEBUG --- stderr --- 2024-04-10 04:45:25,311 DEBUG Order has been successfully forwarded to overseer [2024-04-10 04:45:25] - INFO: Check if Gatling simulation started successfully 2024-04-10 04:45:25,311 INFO 2024-04-10 04:45:25,311 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 04:45:25,311 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 04:45:25,628 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 04:45:25,628 INFO [loop_until]: OK (rc = 0) 2024-04-10 04:45:25,628 DEBUG --- stdout --- 2024-04-10 04:45:25,628 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 04:45:25,628 DEBUG --- stderr --- 2024-04-10 04:45:25,628 DEBUG 2024-04-10 04:45:25,629 INFO 2024-04-10 04:45:25,629 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb -- head -n 25 /results/orders/authn-users-4000/stdout.txt | grep "started..." 2024-04-10 04:45:25,629 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-04-10 04:45:26,388 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: started... - retry 2024-04-10 04:45:32,172 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: started... - retry 2024-04-10 04:45:37,940 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-04-10 04:45:37,940 INFO [loop_until]: OK (rc = 0) 2024-04-10 04:45:37,940 DEBUG --- stdout --- 2024-04-10 04:45:37,940 DEBUG GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling Gatling 3.10.5 is available! (you're using 3.9.5) Simulation com.forgerock.gatling.Loadtest started... ================================================================================ 2024-04-10 05:45:37 5s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=1663 KO=0 ) > userRestLogin (OK=1663 KO=0 ) ---- am.AMAuthN ---------------------------------------------------------------- [- ] 0% waiting: 14456943 / active: 9 / done: 1663 ================================================================================ 2024-04-10 04:45:37,940 DEBUG --- stderr --- 2024-04-10 04:45:37,940 DEBUG ________________________________________________________________________________ [2024-04-10 04:45:37] authn-users-4000 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m 01s, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 02s, retry Order is running since 14m 02s, retry Order is running since 16m 03s, retry Order is running since 18m 03s, retry Order is running since 20m 03s, retry Order is running since 22m 04s, retry Order is running since 24m 04s, retry Order is running since 26m 04s, retry Order is running since 28m 05s, retry Order is running since 30m 05s, retry Order is running since 32m 06s, retry Order is running since 34m 06s, retry Order is running since 36m 06s, retry Order is running since 38m 07s, retry Order is running since 40m 07s, retry Order is running since 42m 07s, retry Order is running since 44m 08s, retry Order is running since 46m 08s, retry Order is running since 48m 08s, retry Order is running since 50m 09s, retry Order is running since 52m 09s, retry Order is running since 54m 09s, retry Order is running since 56m 10s, retry Order is running since 58m 10s, retry Order is running since 1h, retry PASS : Order stopped by itself after 1h 02m and before timeout (1h 12m) ________________________________________________________________________________ [2024-04-10 05:47:49] authn-users-4000 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-04-10 05:47:49,353 INFO 2024-04-10 05:47:49,353 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:49,353 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:49,706 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:49,707 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:49,707 DEBUG --- stdout --- 2024-04-10 05:47:49,707 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:49,707 DEBUG --- stderr --- 2024-04-10 05:47:49,707 DEBUG 2024-04-10 05:47:49,707 INFO 2024-04-10 05:47:49,707 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb -- rm -f /results/orders/order.json 2024-04-10 05:47:49,707 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-10 05:47:50,513 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:50,513 DEBUG --- stdout --- 2024-04-10 05:47:50,513 DEBUG 2024-04-10 05:47:50,513 DEBUG --- stderr --- 2024-04-10 05:47:50,513 DEBUG Order ran during 1h 02m ________________________________________________________________________________ [2024-04-10 05:47:50] authn-users-4000 download_logs : Download individual order files ________________________________________________________________________________ [2024-04-10 05:47:50] - PASS: file already downloaded /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/order.json 2024-04-10 05:47:50,514 INFO 2024-04-10 05:47:50,514 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:50,514 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:50,835 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:50,835 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:50,835 DEBUG --- stdout --- 2024-04-10 05:47:50,836 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:50,836 DEBUG --- stderr --- 2024-04-10 05:47:50,836 DEBUG Checking pod: overseer-0-6f8784665d-zq5hb for file exists, if not wait. 2024-04-10 05:47:50,836 INFO 2024-04-10 05:47:50,836 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:50,836 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:51,169 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:51,169 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:51,169 DEBUG --- stdout --- 2024-04-10 05:47:51,170 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:51,170 DEBUG --- stderr --- 2024-04-10 05:47:51,170 DEBUG 2024-04-10 05:47:51,170 INFO 2024-04-10 05:47:51,170 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb --stdin -- bash -c 'if [ -f "/results/orders/authn-users-4000/rc.txt" ]; then echo "/results/orders/authn-users-4000/rc.txt file found"; exit 0; else echo "/results/orders/authn-users-4000/rc.txt file not found"; exit 1; fi' | grep "/results/orders/authn-users-4000/rc.txt file found" 2024-04-10 05:47:51,170 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-10 05:47:52,023 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-10 05:47:52,023 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:52,024 DEBUG --- stdout --- 2024-04-10 05:47:52,024 DEBUG /results/orders/authn-users-4000/rc.txt file found 2024-04-10 05:47:52,024 DEBUG --- stderr --- 2024-04-10 05:47:52,024 DEBUG 2024-04-10 05:47:52,025 INFO 2024-04-10 05:47:52,025 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:52,025 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:52,395 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:52,395 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:52,395 DEBUG --- stdout --- 2024-04-10 05:47:52,395 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:52,395 DEBUG --- stderr --- 2024-04-10 05:47:52,395 DEBUG 2024-04-10 05:47:52,396 INFO 2024-04-10 05:47:52,396 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb --stdin -- du -k /results/orders/authn-users-4000/rc.txt 2024-04-10 05:47:53,273 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-10 05:47:53,274 DEBUG --- stdout --- 2024-04-10 05:47:53,274 DEBUG 4 /results/orders/authn-users-4000/rc.txt 2024-04-10 05:47:53,274 DEBUG --- stderr --- 2024-04-10 05:47:53,274 DEBUG 2024-04-10 05:47:53,274 INFO - Download file (size 4k) 2024-04-10 05:47:53,274 INFO 2024-04-10 05:47:53,274 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:53,274 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:53,604 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:53,604 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:53,604 DEBUG --- stdout --- 2024-04-10 05:47:53,604 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:53,604 DEBUG --- stderr --- 2024-04-10 05:47:53,604 DEBUG source : /results/orders/authn-users-4000/rc.txt @ overseer-0-6f8784665d-zq5hb destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/rc.txt 2024-04-10 05:47:53,604 INFO 2024-04-10 05:47:53,604 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:53,604 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:53,926 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:53,926 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:53,926 DEBUG --- stdout --- 2024-04-10 05:47:53,926 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:53,926 DEBUG --- stderr --- 2024-04-10 05:47:53,926 DEBUG 2024-04-10 05:47:53,926 INFO 2024-04-10 05:47:53,927 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6f8784665d-zq5hb:/results/orders/authn-users-4000/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/rc.txt 2024-04-10 05:47:53,927 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-10 05:47:54,727 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:54,727 DEBUG --- stdout --- 2024-04-10 05:47:54,727 DEBUG tar: Removing leading `/' from member names 2024-04-10 05:47:54,727 DEBUG --- stderr --- 2024-04-10 05:47:54,727 DEBUG 2024-04-10 05:47:54,728 INFO 2024-04-10 05:47:54,728 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:54,728 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:55,069 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:55,070 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:55,070 DEBUG --- stdout --- 2024-04-10 05:47:55,070 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:55,070 DEBUG --- stderr --- 2024-04-10 05:47:55,070 DEBUG Checking pod: overseer-0-6f8784665d-zq5hb for file exists, if not wait. 2024-04-10 05:47:55,070 INFO 2024-04-10 05:47:55,070 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:55,070 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:55,400 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:55,401 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:55,401 DEBUG --- stdout --- 2024-04-10 05:47:55,401 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:55,401 DEBUG --- stderr --- 2024-04-10 05:47:55,401 DEBUG 2024-04-10 05:47:55,402 INFO 2024-04-10 05:47:55,402 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb --stdin -- bash -c 'if [ -f "/results/orders/authn-users-4000/stderr.txt" ]; then echo "/results/orders/authn-users-4000/stderr.txt file found"; exit 0; else echo "/results/orders/authn-users-4000/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/authn-users-4000/stderr.txt file found" 2024-04-10 05:47:55,402 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-10 05:47:56,261 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-10 05:47:56,262 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:56,262 DEBUG --- stdout --- 2024-04-10 05:47:56,262 DEBUG /results/orders/authn-users-4000/stderr.txt file found 2024-04-10 05:47:56,262 DEBUG --- stderr --- 2024-04-10 05:47:56,262 DEBUG 2024-04-10 05:47:56,262 INFO 2024-04-10 05:47:56,263 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:56,263 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:56,623 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:56,623 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:56,623 DEBUG --- stdout --- 2024-04-10 05:47:56,623 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:56,623 DEBUG --- stderr --- 2024-04-10 05:47:56,623 DEBUG 2024-04-10 05:47:56,623 INFO 2024-04-10 05:47:56,624 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb --stdin -- du -k /results/orders/authn-users-4000/stderr.txt 2024-04-10 05:47:57,540 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-10 05:47:57,540 DEBUG --- stdout --- 2024-04-10 05:47:57,541 DEBUG 0 /results/orders/authn-users-4000/stderr.txt 2024-04-10 05:47:57,541 DEBUG --- stderr --- 2024-04-10 05:47:57,541 DEBUG 2024-04-10 05:47:57,541 INFO - Download file (size 0k) 2024-04-10 05:47:57,541 INFO 2024-04-10 05:47:57,541 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:57,541 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:57,882 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:57,882 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:57,882 DEBUG --- stdout --- 2024-04-10 05:47:57,883 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:57,883 DEBUG --- stderr --- 2024-04-10 05:47:57,883 DEBUG source : /results/orders/authn-users-4000/stderr.txt @ overseer-0-6f8784665d-zq5hb destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/stderr.txt 2024-04-10 05:47:57,883 INFO 2024-04-10 05:47:57,883 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:57,883 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:58,249 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:58,249 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:58,249 DEBUG --- stdout --- 2024-04-10 05:47:58,249 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:58,249 DEBUG --- stderr --- 2024-04-10 05:47:58,249 DEBUG 2024-04-10 05:47:58,250 INFO 2024-04-10 05:47:58,250 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6f8784665d-zq5hb:/results/orders/authn-users-4000/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/stderr.txt 2024-04-10 05:47:58,250 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-10 05:47:59,135 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:59,136 DEBUG --- stdout --- 2024-04-10 05:47:59,136 DEBUG tar: Removing leading `/' from member names 2024-04-10 05:47:59,136 DEBUG --- stderr --- 2024-04-10 05:47:59,136 DEBUG 2024-04-10 05:47:59,136 INFO 2024-04-10 05:47:59,136 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:59,136 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:59,442 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:59,442 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:59,442 DEBUG --- stdout --- 2024-04-10 05:47:59,442 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:59,442 DEBUG --- stderr --- 2024-04-10 05:47:59,442 DEBUG Checking pod: overseer-0-6f8784665d-zq5hb for file exists, if not wait. 2024-04-10 05:47:59,443 INFO 2024-04-10 05:47:59,443 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:47:59,443 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:47:59,753 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:47:59,753 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:47:59,753 DEBUG --- stdout --- 2024-04-10 05:47:59,753 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:47:59,753 DEBUG --- stderr --- 2024-04-10 05:47:59,753 DEBUG 2024-04-10 05:47:59,754 INFO 2024-04-10 05:47:59,754 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb --stdin -- bash -c 'if [ -f "/results/orders/authn-users-4000/stdout.txt" ]; then echo "/results/orders/authn-users-4000/stdout.txt file found"; exit 0; else echo "/results/orders/authn-users-4000/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/authn-users-4000/stdout.txt file found" 2024-04-10 05:47:59,754 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-10 05:48:00,601 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-10 05:48:00,602 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:00,602 DEBUG --- stdout --- 2024-04-10 05:48:00,602 DEBUG /results/orders/authn-users-4000/stdout.txt file found 2024-04-10 05:48:00,602 DEBUG --- stderr --- 2024-04-10 05:48:00,602 DEBUG 2024-04-10 05:48:00,602 INFO 2024-04-10 05:48:00,602 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:48:00,602 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:48:00,928 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:48:00,929 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:00,929 DEBUG --- stdout --- 2024-04-10 05:48:00,929 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:48:00,929 DEBUG --- stderr --- 2024-04-10 05:48:00,929 DEBUG 2024-04-10 05:48:00,929 INFO 2024-04-10 05:48:00,929 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb --stdin -- du -k /results/orders/authn-users-4000/stdout.txt 2024-04-10 05:48:01,769 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-10 05:48:01,769 DEBUG --- stdout --- 2024-04-10 05:48:01,769 DEBUG 3992 /results/orders/authn-users-4000/stdout.txt 2024-04-10 05:48:01,769 DEBUG --- stderr --- 2024-04-10 05:48:01,769 DEBUG 2024-04-10 05:48:01,769 INFO - Download file (size 3992k) 2024-04-10 05:48:01,770 INFO 2024-04-10 05:48:01,770 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:48:01,770 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:48:02,084 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:48:02,085 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:02,085 DEBUG --- stdout --- 2024-04-10 05:48:02,085 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:48:02,085 DEBUG --- stderr --- 2024-04-10 05:48:02,085 DEBUG source : /results/orders/authn-users-4000/stdout.txt @ overseer-0-6f8784665d-zq5hb destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/stdout.txt 2024-04-10 05:48:02,086 INFO 2024-04-10 05:48:02,086 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:48:02,086 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:48:02,446 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:48:02,448 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:02,448 DEBUG --- stdout --- 2024-04-10 05:48:02,449 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:48:02,449 DEBUG --- stderr --- 2024-04-10 05:48:02,449 DEBUG 2024-04-10 05:48:02,450 INFO 2024-04-10 05:48:02,450 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6f8784665d-zq5hb:/results/orders/authn-users-4000/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/stdout.txt 2024-04-10 05:48:02,450 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-10 05:48:03,758 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:03,759 DEBUG --- stdout --- 2024-04-10 05:48:03,759 DEBUG tar: Removing leading `/' from member names 2024-04-10 05:48:03,759 DEBUG --- stderr --- 2024-04-10 05:48:03,759 DEBUG ________________________________________________________________________________ [2024-04-10 05:48:03] authn-users-4000 show_cmd : Display order command ________________________________________________________________________________ 2024-04-10 05:48:03,760 INFO 2024-04-10 05:48:03,760 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:48:03,760 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:48:04,098 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:48:04,099 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:04,099 DEBUG --- stdout --- 2024-04-10 05:48:04,099 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:48:04,099 DEBUG --- stderr --- 2024-04-10 05:48:04,099 DEBUG Checking pod: overseer-0-6f8784665d-zq5hb for file exists, if not wait. 2024-04-10 05:48:04,099 INFO 2024-04-10 05:48:04,099 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:48:04,099 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:48:04,456 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:48:04,456 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:04,456 DEBUG --- stdout --- 2024-04-10 05:48:04,456 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:48:04,456 DEBUG --- stderr --- 2024-04-10 05:48:04,456 DEBUG 2024-04-10 05:48:04,457 INFO 2024-04-10 05:48:04,457 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb --stdin -- bash -c 'if [ -f "/results/orders/authn-users-4000/cmd.txt" ]; then echo "/results/orders/authn-users-4000/cmd.txt file found"; exit 0; else echo "/results/orders/authn-users-4000/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/authn-users-4000/cmd.txt file found" 2024-04-10 05:48:04,457 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-10 05:48:05,387 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-10 05:48:05,387 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:05,388 DEBUG --- stdout --- 2024-04-10 05:48:05,388 DEBUG /results/orders/authn-users-4000/cmd.txt file found 2024-04-10 05:48:05,388 DEBUG --- stderr --- 2024-04-10 05:48:05,388 DEBUG 2024-04-10 05:48:05,388 INFO 2024-04-10 05:48:05,388 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:48:05,388 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:48:05,705 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:48:05,705 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:05,705 DEBUG --- stdout --- 2024-04-10 05:48:05,705 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:48:05,705 DEBUG --- stderr --- 2024-04-10 05:48:05,705 DEBUG 2024-04-10 05:48:05,705 INFO 2024-04-10 05:48:05,706 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6f8784665d-zq5hb --stdin -- du -k /results/orders/authn-users-4000/cmd.txt 2024-04-10 05:48:06,532 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-10 05:48:06,533 DEBUG --- stdout --- 2024-04-10 05:48:06,533 DEBUG 4 /results/orders/authn-users-4000/cmd.txt 2024-04-10 05:48:06,533 DEBUG --- stderr --- 2024-04-10 05:48:06,533 DEBUG 2024-04-10 05:48:06,533 INFO - Download file (size 4k) 2024-04-10 05:48:06,534 INFO 2024-04-10 05:48:06,534 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:48:06,534 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:48:06,845 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:48:06,846 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:06,846 DEBUG --- stdout --- 2024-04-10 05:48:06,846 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:48:06,846 DEBUG --- stderr --- 2024-04-10 05:48:06,846 DEBUG source : /results/orders/authn-users-4000/cmd.txt @ overseer-0-6f8784665d-zq5hb destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/cmd.txt 2024-04-10 05:48:06,846 INFO 2024-04-10 05:48:06,846 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-10 05:48:06,846 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-10 05:48:07,159 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-10 05:48:07,159 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:07,159 DEBUG --- stdout --- 2024-04-10 05:48:07,159 DEBUG overseer-0-6f8784665d-zq5hb 2024-04-10 05:48:07,159 DEBUG --- stderr --- 2024-04-10 05:48:07,159 DEBUG 2024-04-10 05:48:07,160 INFO 2024-04-10 05:48:07,160 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6f8784665d-zq5hb:/results/orders/authn-users-4000/cmd.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/cmd.txt 2024-04-10 05:48:07,160 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-10 05:48:07,909 INFO [loop_until]: OK (rc = 0) 2024-04-10 05:48:07,909 DEBUG --- stdout --- 2024-04-10 05:48:07,909 DEBUG tar: Removing leading `/' from member names 2024-04-10 05:48:07,909 DEBUG --- stderr --- 2024-04-10 05:48:07,909 DEBUG 2024-04-10 05:48:07,909 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/cmd.txt is small (1 lines), printing all lines: 2024-04-10 05:48:07,909 DEBUG ----- output ----- 2024-04-10 05:48:07,909 DEBUG /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling-open/ --run-description "am.AMAuthN@medium" --results-folder /results/gatling/authn-users-4000 --extra-run-jvm-options "-Xmx4G" --no-reports 2024-04-10 05:48:07,909 INFO ________________________________________________________________________________ [2024-04-10 05:48:07] authn-users-4000 show_rc : Display rc order ________________________________________________________________________________ 2024-04-10 05:48:07,910 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/rc.txt is small (1 lines), printing all lines: 2024-04-10 05:48:07,910 DEBUG ----- output ----- 2024-04-10 05:48:07,910 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-04-10 05:48:07,910 INFO ________________________________________________________________________________ [2024-04-10 05:48:07] authn-users-4000 show_stdout : Display stdout order ________________________________________________________________________________ 2024-04-10 05:48:07,925 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/stdout.txt is 73052 lines): 2024-04-10 05:48:07,925 DEBUG ----- output ----- 2024-04-10 05:48:07,925 INFO GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling 2024-04-10 05:48:07,925 INFO Gatling 3.10.5 is available! (you're using 3.9.5) 2024-04-10 05:48:07,925 INFO Simulation com.forgerock.gatling.Loadtest started... 2024-04-10 05:48:07,925 INFO 2024-04-10 05:48:07,925 INFO ================================================================================ 2024-04-10 05:48:07,925 INFO 2024-04-10 05:45:37 5s elapsed 2024-04-10 05:48:07,925 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,925 INFO > Global (OK=1663 KO=0 ) 2024-04-10 05:48:07,925 INFO > userRestLogin (OK=1663 KO=0 ) 2024-04-10 05:48:07,925 INFO 2024-04-10 05:48:07,925 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,925 INFO [- ] 0% 2024-04-10 05:48:07,925 INFO waiting: 14456943 / active: 9 / done: 1663 2024-04-10 05:48:07,925 INFO ================================================================================ 2024-04-10 05:48:07,925 INFO 2024-04-10 05:48:07,925 INFO 2024-04-10 05:48:07,925 INFO ================================================================================ 2024-04-10 05:48:07,925 INFO 2024-04-10 05:45:42 10s elapsed 2024-04-10 05:48:07,925 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,925 INFO > Global (OK=6659 KO=0 ) 2024-04-10 05:48:07,925 INFO > userRestLogin (OK=6659 KO=0 ) 2024-04-10 05:48:07,925 INFO 2024-04-10 05:48:07,925 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,925 INFO [- ] 0% 2024-04-10 05:48:07,925 INFO waiting: 14451940 / active: 16 / done: 6659 2024-04-10 05:48:07,925 INFO ================================================================================ 2024-04-10 05:48:07,925 INFO 2024-04-10 05:48:07,925 INFO 2024-04-10 05:48:07,925 INFO ================================================================================ 2024-04-10 05:48:07,926 INFO 2024-04-10 05:45:47 15s elapsed 2024-04-10 05:48:07,926 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,926 INFO > Global (OK=14989 KO=0 ) 2024-04-10 05:48:07,926 INFO > userRestLogin (OK=14989 KO=0 ) 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,926 INFO [- ] 0% 2024-04-10 05:48:07,926 INFO waiting: 14443600 / active: 26 / done: 14989 2024-04-10 05:48:07,926 INFO ================================================================================ 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO ================================================================================ 2024-04-10 05:48:07,926 INFO 2024-04-10 05:45:52 20s elapsed 2024-04-10 05:48:07,926 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,926 INFO > Global (OK=26645 KO=0 ) 2024-04-10 05:48:07,926 INFO > userRestLogin (OK=26645 KO=0 ) 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,926 INFO [- ] 0% 2024-04-10 05:48:07,926 INFO waiting: 14431927 / active: 43 / done: 26645 2024-04-10 05:48:07,926 INFO ================================================================================ 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO ================================================================================ 2024-04-10 05:48:07,926 INFO 2024-04-10 05:45:57 25s elapsed 2024-04-10 05:48:07,926 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,926 INFO > Global (OK=41609 KO=0 ) 2024-04-10 05:48:07,926 INFO > userRestLogin (OK=41609 KO=0 ) 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,926 INFO [- ] 0% 2024-04-10 05:48:07,926 INFO waiting: 14416933 / active: 73 / done: 41609 2024-04-10 05:48:07,926 INFO ================================================================================ 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO 2024-04-10 05:48:07,926 INFO ================================================================================ 2024-04-10 05:48:07,926 INFO 2024-04-10 05:46:02 30s elapsed 2024-04-10 05:48:07,926 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,926 INFO > Global (OK=59805 KO=0 ) 2024-04-10 05:48:07,927 INFO > userRestLogin (OK=59805 KO=0 ) 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,927 INFO [- ] 0% 2024-04-10 05:48:07,927 INFO waiting: 14398677 / active: 143 / done: 59795 2024-04-10 05:48:07,927 INFO ================================================================================ 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO ================================================================================ 2024-04-10 05:48:07,927 INFO 2024-04-10 05:46:07 35s elapsed 2024-04-10 05:48:07,927 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,927 INFO > Global (OK=79517 KO=0 ) 2024-04-10 05:48:07,927 INFO > userRestLogin (OK=79517 KO=0 ) 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,927 INFO [- ] 0% 2024-04-10 05:48:07,927 INFO waiting: 14378968 / active: 131 / done: 79516 2024-04-10 05:48:07,927 INFO ================================================================================ 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO ================================================================================ 2024-04-10 05:48:07,927 INFO 2024-04-10 05:46:12 40s elapsed 2024-04-10 05:48:07,927 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,927 INFO > Global (OK=98643 KO=0 ) 2024-04-10 05:48:07,927 INFO > userRestLogin (OK=98643 KO=0 ) 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,927 INFO [- ] 0% 2024-04-10 05:48:07,927 INFO waiting: 14359212 / active: 761 / done: 98642 2024-04-10 05:48:07,927 INFO ================================================================================ 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO 2024-04-10 05:48:07,927 INFO [...] 2024-04-10 05:48:07,951 INFO

502 Bad Gateway

2024-04-10 05:48:07,951 INFO
nginx
2024-04-10 05:48:07,951 INFO 2024-04-10 05:48:07,951 INFO 2024-04-10 05:48:07,951 INFO 2024-04-10 05:48:07,951 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-04-10 05:48:07,951 INFO 06:46:01.322 [ERROR] i.g.c.action.If - 'if-2' failed to execute: j.u.NoSuchElementException: No attribute named 'auth_resp_code' is defined 2024-04-10 05:48:07,951 INFO 06:46:01.322 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-04-10 05:48:07,951 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-04-10 05:48:07,951 INFO Request: 2024-04-10 05:48:07,951 INFO userRestLogin: KO status.find.in(200,201,202,203,204,205,206,207,208,209,304,401), but actually found 502 2024-04-10 05:48:07,951 INFO ========================= 2024-04-10 05:48:07,951 INFO Session: 2024-04-10 05:48:07,951 INFO Session(am.AMAuthN,14447311,HashMap(gatling.http.cache.baseUrl -> https://xlou.iam.xlou-cdm.engineeringpit.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@24e536e7, username -> user.783454, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@60f7b979, gatling.http.referer -> https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/realms/root/authenticate, gatling.http.cookies -> CookieJar(Map(CookieKey(route,xlou.iam.xlou-cdm.engineeringpit.com,/am) -> StoredCookie(route=1712727960.435.162104.658123|f60edb382037eb2df1e800d563ad78a7, path=/am, secure, HTTPOnly,true,false,1712727961322))), password -> T35tr0ck123),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$788/0x00007fe8446b9338@5969b5d0,io.netty.channel.epoll.EpollEventLoop@5d332969) 2024-04-10 05:48:07,951 INFO ========================= 2024-04-10 05:48:07,951 INFO HTTP request: 2024-04-10 05:48:07,951 INFO POST https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/realms/root/authenticate 2024-04-10 05:48:07,951 INFO headers: 2024-04-10 05:48:07,951 INFO Accept-API-Version: resource=2.0, protocol=1.0 2024-04-10 05:48:07,951 INFO X-OpenAM-Username: user.783454 2024-04-10 05:48:07,951 INFO X-OpenAM-Password: T35tr0ck123 2024-04-10 05:48:07,951 INFO accept: */* 2024-04-10 05:48:07,951 INFO host: xlou.iam.xlou-cdm.engineeringpit.com 2024-04-10 05:48:07,951 INFO content-length: 0 2024-04-10 05:48:07,951 INFO ========================= 2024-04-10 05:48:07,951 INFO HTTP response: 2024-04-10 05:48:07,951 INFO status: 2024-04-10 05:48:07,951 INFO 502 Bad Gateway 2024-04-10 05:48:07,951 INFO headers: 2024-04-10 05:48:07,951 INFO Date: Wed, 10 Apr 2024 05:46:01 GMT 2024-04-10 05:48:07,952 INFO Content-Type: text/html 2024-04-10 05:48:07,952 INFO Content-Length: 150 2024-04-10 05:48:07,952 INFO Connection: keep-alive 2024-04-10 05:48:07,952 INFO Set-Cookie: route=1712727960.435.162104.658123|f60edb382037eb2df1e800d563ad78a7; Path=/am; Secure; HttpOnly 2024-04-10 05:48:07,952 INFO Strict-Transport-Security: max-age=15724800; includeSubDomains 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO body: 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO 502 Bad Gateway 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO

502 Bad Gateway

2024-04-10 05:48:07,952 INFO
nginx
2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-04-10 05:48:07,952 INFO 06:46:01.322 [ERROR] i.g.c.action.If - 'if-2' failed to execute: j.u.NoSuchElementException: No attribute named 'auth_resp_code' is defined 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO ================================================================================ 2024-04-10 05:48:07,952 INFO 2024-04-10 06:46:02 3630s elapsed 2024-04-10 05:48:07,952 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,952 INFO > Global (OK=14449447 KO=1592 ) 2024-04-10 05:48:07,952 INFO > userRestLogin (OK=14449447 KO=1592 ) 2024-04-10 05:48:07,952 INFO ---- Errors -------------------------------------------------------------------- 2024-04-10 05:48:07,952 INFO > status.find.in(200,201,202,203,204,205,206,207,208,209,304,401 1416 (88.94%) 2024-04-10 05:48:07,952 INFO ), but actually found 502 2024-04-10 05:48:07,952 INFO > Request timeout to xlou.iam.xlou-cdm.engineeringpit.com/34.148 176 (11.06%) 2024-04-10 05:48:07,952 INFO .47.242:443 after 60000 ms 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,952 INFO [#########################################################################-] 99% 2024-04-10 05:48:07,952 INFO waiting: 0 / active: 7576 / done: 14451039 2024-04-10 05:48:07,952 INFO ================================================================================ 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO 2024-04-10 05:48:07,952 INFO ================================================================================ 2024-04-10 05:48:07,952 INFO 2024-04-10 06:46:06 3634s elapsed 2024-04-10 05:48:07,952 INFO ---- Requests ------------------------------------------------------------------ 2024-04-10 05:48:07,952 INFO > Global (OK=14457023 KO=1592 ) 2024-04-10 05:48:07,952 INFO > userRestLogin (OK=14457023 KO=1592 ) 2024-04-10 05:48:07,953 INFO ---- Errors -------------------------------------------------------------------- 2024-04-10 05:48:07,953 INFO > status.find.in(200,201,202,203,204,205,206,207,208,209,304,401 1416 (88.94%) 2024-04-10 05:48:07,953 INFO ), but actually found 502 2024-04-10 05:48:07,953 INFO > Request timeout to xlou.iam.xlou-cdm.engineeringpit.com/34.148 176 (11.06%) 2024-04-10 05:48:07,953 INFO .47.242:443 after 60000 ms 2024-04-10 05:48:07,953 INFO 2024-04-10 05:48:07,953 INFO ---- am.AMAuthN ---------------------------------------------------------------- 2024-04-10 05:48:07,953 INFO [##########################################################################]100% 2024-04-10 05:48:07,953 INFO waiting: 0 / active: 0 / done: 14458615 2024-04-10 05:48:07,953 INFO ================================================================================ 2024-04-10 05:48:07,953 INFO 2024-04-10 05:48:07,953 INFO Simulation com.forgerock.gatling.Loadtest completed in 3634 seconds 2024-04-10 05:48:07,953 INFO 2024-04-10 05:48:07,953 INFO ---------------------- 2024-04-10 05:48:07,953 INFO [10/Apr/2024 06:46:06] Create tar file authn-users-4000.tar.gz 2024-04-10 05:48:07,953 INFO ---------------------- 2024-04-10 05:48:07,953 INFO RESULTS_FOLDER=/results/gatling/ 2024-04-10 05:48:07,953 INFO RESULT_FOLDER=authn-users-4000 2024-04-10 05:48:07,953 INFO SIMULATION_PATH=authn-users-4000/loadtest-20240410044531709 2024-04-10 05:48:07,953 INFO PWD=/results/gatling/authn-users-4000/loadtest-20240410044531709 2024-04-10 05:48:07,953 INFO [cmd] tar -czvf /results/gatling//authn-users-4000.tar.gz --exclude=simulation.log * 2024-04-10 05:48:07,953 INFO /results/gatling 2024-04-10 05:48:07,953 INFO 2024-04-10 05:48:07,953 INFO ---------------------- 2024-04-10 05:48:07,953 INFO [10/Apr/2024 06:46:06] Update /results/gatling//latest 2024-04-10 05:48:07,953 INFO ---------------------- 2024-04-10 05:48:07,953 INFO 2024-04-10 05:48:07,953 INFO ---------------------- 2024-04-10 05:48:07,953 INFO [10/Apr/2024 06:46:06] Update /results/gatling//latest.tar.gz 2024-04-10 05:48:07,953 INFO ---------------------- 2024-04-10 05:48:07,953 INFO ________________________________________________________________________________ [2024-04-10 05:48:07] authn-users-4000 show_stderr : Display stderr order ________________________________________________________________________________ 2024-04-10 05:48:07,954 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/07_Scenario_AuthN/07_authn-users-4000/stderr.txt is small (0 lines), printing all lines: 2024-04-10 05:48:07,954 DEBUG ----- output ----- 2024-04-10 05:48:07,954 DEBUG 2024-04-10 05:48:07,954 INFO ________________________________________________________________________________ [2024-04-10 05:48:07] authn-users-4000 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-04-10 05:48:08] authn-users-4000 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-04-10 05:48:08] authn-users-4000 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped