--Task-- name: benchmark-400 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-300'] preceding_task: benchmark-300 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 400} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock 2025-09-16 09:37:43,687 INFO 2025-09-16 09:37:43,687 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-16 09:37:43,687 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-16 09:37:43,967 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-16 09:37:43,968 INFO [loop_until]: OK (rc = 0) 2025-09-16 09:37:43,968 DEBUG --- stdout --- 2025-09-16 09:37:43,968 DEBUG overseer-0-57d79d468-khs5t 2025-09-16 09:37:43,968 DEBUG --- stderr --- 2025-09-16 09:37:43,968 DEBUG 2025-09-16 09:37:43,968 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-09-16 09:37:43 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-09-16 09:37:43 - INFO: timeout was calculated based on simulation duration parameter 2025-09-16 09:37:43 - INFO: Interval for this Task has changed to 2m (120 seconds) 2025-09-16 09:37:43 - INFO: interval was set to Task default because it was unset, based on self.timeout value because task is allowed to stop by itself Pod log file : /results/orders/benchmark-400/stdout.txt Pod log : /results/orders/benchmark-400 ________________________________________________________________________________ [2025-09-16 09:37:43] benchmark-400 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-haproxy" --results-folder="/results/gatling/benchmark-400" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-09-16 09:37:43] benchmark-400 create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json { "name": "benchmark-400", "command": " /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-haproxy\" --results-folder=\"/results/gatling/benchmark-400\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-400" } ________________________________________________________________________________ [2025-09-16 09:37:43] benchmark-400 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-09-16 09:37:43,976 INFO 2025-09-16 09:37:43,976 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-09-16 09:37:43,976 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-09-16 09:37:44,188 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 09:37:44,188 INFO [loop_until]: OK (rc = 0) 2025-09-16 09:37:44,188 DEBUG --- stdout --- 2025-09-16 09:37:44,188 DEBUG WAITING 2025-09-16 09:37:44,188 DEBUG --- stderr --- 2025-09-16 09:37:44,188 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 34 0 --:--:-- --:--:-- --:--:-- 34 ________________________________________________________________________________ [2025-09-16 09:37:44] benchmark-400 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-09-16 09:37:44,189 INFO 2025-09-16 09:37:44,189 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-16 09:37:44,189 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-16 09:37:44,472 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-16 09:37:44,472 INFO [loop_until]: OK (rc = 0) 2025-09-16 09:37:44,472 DEBUG --- stdout --- 2025-09-16 09:37:44,473 DEBUG overseer-0-57d79d468-khs5t 2025-09-16 09:37:44,473 DEBUG --- stderr --- 2025-09-16 09:37:44,473 DEBUG 2025-09-16 09:37:44,473 INFO 2025-09-16 09:37:44,473 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json overseer-0-57d79d468-khs5t:/results/orders/order.json 2025-09-16 09:37:44,473 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-16 09:37:45,364 INFO [loop_until]: OK (rc = 0) 2025-09-16 09:37:45,365 DEBUG --- stdout --- 2025-09-16 09:37:45,365 DEBUG 2025-09-16 09:37:45,365 DEBUG --- stderr --- 2025-09-16 09:37:45,365 DEBUG Order has been successfully forwarded to overseer 2025-09-16 09:37:45 - INFO: Check if Gatling simulation started successfully 2025-09-16 09:37:45,365 INFO 2025-09-16 09:37:45,365 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- head --lines 5000 /results/orders/benchmark-400/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-09-16 09:37:45,365 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-09-16 09:37:45,908 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-16 09:37:51,460 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-16 09:37:57,015 INFO [loop_until]: Function succeeded after 11s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-16 09:38:02,555 INFO [loop_until]: Function succeeded after 17s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-16 09:38:08,110 INFO [loop_until]: Function succeeded after 22s (rc=0) - expected pattern found 2025-09-16 09:38:08,110 INFO [loop_until]: OK (rc = 0) 2025-09-16 09:38:08,110 DEBUG --- stdout --- 2025-09-16 09:38:08,110 DEBUG 2025-09-16 10:37:47,638 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpcpiaaz1p 2025-09-16 10:37:47,642 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-09-16 09:38:08,110 DEBUG --- stderr --- 2025-09-16 09:38:08,110 DEBUG ________________________________________________________________________________ [2025-09-16 09:38:08] benchmark-400 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 01s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 02s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 03s, retry Order is running since 30m 03s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 04s, retry Order is running since 38m 04s, retry Order is running since 40m 05s, retry Order is running since 42m 05s, retry Order is running since 44m 05s, retry Order is running since 46m 06s, retry Order is running since 48m 06s, retry Order is running since 50m 06s, retry Order is running since 52m 06s, retry Order is running since 54m 07s, retry Order is running since 56m 07s, retry Order is running since 58m 07s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-09-16 10:38:15] benchmark-400 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-09-16 10:38:15,994 INFO 2025-09-16 10:38:15,994 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-16 10:38:15,994 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-16 10:38:16,310 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-16 10:38:16,310 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:16,310 DEBUG --- stdout --- 2025-09-16 10:38:16,310 DEBUG overseer-0-57d79d468-khs5t 2025-09-16 10:38:16,310 DEBUG --- stderr --- 2025-09-16 10:38:16,310 DEBUG 2025-09-16 10:38:16,310 INFO 2025-09-16 10:38:16,310 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- rm -f /results/orders/order.json 2025-09-16 10:38:16,310 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-16 10:38:16,914 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:16,914 DEBUG --- stdout --- 2025-09-16 10:38:16,914 DEBUG 2025-09-16 10:38:16,914 DEBUG --- stderr --- 2025-09-16 10:38:16,914 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-09-16 10:38:16] benchmark-400 download_logs : Download individual order files ________________________________________________________________________________ 2025-09-16 10:38:16 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json 2025-09-16 10:38:16,915 INFO 2025-09-16 10:38:16,915 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-16 10:38:16,915 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-16 10:38:17,199 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-16 10:38:17,199 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:17,199 DEBUG --- stdout --- 2025-09-16 10:38:17,199 DEBUG overseer-0-57d79d468-khs5t 2025-09-16 10:38:17,199 DEBUG --- stderr --- 2025-09-16 10:38:17,199 DEBUG Checking if file exists on pod 'overseer-0-57d79d468-khs5t', wait max 3 minutes if not. 2025-09-16 10:38:17,200 INFO 2025-09-16 10:38:17,200 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- bash -c 'if [ -f "/results/orders/benchmark-400/rc.txt" ]; then echo "/results/orders/benchmark-400/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-400/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/rc.txt file found" 2025-09-16 10:38:17,200 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-16 10:38:17,755 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 10:38:17,755 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:17,755 DEBUG --- stdout --- 2025-09-16 10:38:17,755 DEBUG /results/orders/benchmark-400/rc.txt file found 2025-09-16 10:38:17,755 DEBUG --- stderr --- 2025-09-16 10:38:17,755 DEBUG 2025-09-16 10:38:17,755 INFO 2025-09-16 10:38:17,755 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- du -k /results/orders/benchmark-400/rc.txt | grep "^\d+ .+$" 2025-09-16 10:38:17,755 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-16 10:38:18,321 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 10:38:18,321 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:18,321 DEBUG --- stdout --- 2025-09-16 10:38:18,321 DEBUG 4 /results/orders/benchmark-400/rc.txt 2025-09-16 10:38:18,321 DEBUG --- stderr --- 2025-09-16 10:38:18,322 DEBUG - Download file (size 4kB) source : /results/orders/benchmark-400/rc.txt @ overseer-0-57d79d468-khs5t destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt 2025-09-16 10:38:18,322 INFO 2025-09-16 10:38:18,322 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-57d79d468-khs5t:/results/orders/benchmark-400/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt 2025-09-16 10:38:18,322 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-16 10:38:18,849 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:18,849 DEBUG --- stdout --- 2025-09-16 10:38:18,849 DEBUG tar: Removing leading `/' from member names 2025-09-16 10:38:18,849 DEBUG --- stderr --- 2025-09-16 10:38:18,849 DEBUG 2025-09-16 10:38:18,849 INFO 2025-09-16 10:38:18,850 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-16 10:38:18,850 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-16 10:38:19,133 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-16 10:38:19,133 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:19,133 DEBUG --- stdout --- 2025-09-16 10:38:19,133 DEBUG overseer-0-57d79d468-khs5t 2025-09-16 10:38:19,133 DEBUG --- stderr --- 2025-09-16 10:38:19,133 DEBUG Checking if file exists on pod 'overseer-0-57d79d468-khs5t', wait max 3 minutes if not. 2025-09-16 10:38:19,134 INFO 2025-09-16 10:38:19,134 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- bash -c 'if [ -f "/results/orders/benchmark-400/stderr.txt" ]; then echo "/results/orders/benchmark-400/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-400/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/stderr.txt file found" 2025-09-16 10:38:19,134 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-16 10:38:19,673 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 10:38:19,673 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:19,674 DEBUG --- stdout --- 2025-09-16 10:38:19,674 DEBUG /results/orders/benchmark-400/stderr.txt file found 2025-09-16 10:38:19,674 DEBUG --- stderr --- 2025-09-16 10:38:19,674 DEBUG 2025-09-16 10:38:19,674 INFO 2025-09-16 10:38:19,674 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- du -k /results/orders/benchmark-400/stderr.txt | grep "^\d+ .+$" 2025-09-16 10:38:19,674 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-16 10:38:20,225 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 10:38:20,225 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:20,225 DEBUG --- stdout --- 2025-09-16 10:38:20,225 DEBUG 0 /results/orders/benchmark-400/stderr.txt 2025-09-16 10:38:20,225 DEBUG --- stderr --- 2025-09-16 10:38:20,225 DEBUG - Download file (size 0B) source : /results/orders/benchmark-400/stderr.txt @ overseer-0-57d79d468-khs5t destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt 2025-09-16 10:38:20,226 INFO 2025-09-16 10:38:20,226 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-57d79d468-khs5t:/results/orders/benchmark-400/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt 2025-09-16 10:38:20,226 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-16 10:38:20,774 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:20,774 DEBUG --- stdout --- 2025-09-16 10:38:20,774 DEBUG tar: Removing leading `/' from member names 2025-09-16 10:38:20,774 DEBUG --- stderr --- 2025-09-16 10:38:20,774 DEBUG 2025-09-16 10:38:20,775 INFO 2025-09-16 10:38:20,775 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-16 10:38:20,775 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-16 10:38:21,055 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-16 10:38:21,055 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:21,055 DEBUG --- stdout --- 2025-09-16 10:38:21,055 DEBUG overseer-0-57d79d468-khs5t 2025-09-16 10:38:21,055 DEBUG --- stderr --- 2025-09-16 10:38:21,056 DEBUG Checking if file exists on pod 'overseer-0-57d79d468-khs5t', wait max 3 minutes if not. 2025-09-16 10:38:21,056 INFO 2025-09-16 10:38:21,056 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- bash -c 'if [ -f "/results/orders/benchmark-400/stdout.txt" ]; then echo "/results/orders/benchmark-400/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-400/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/stdout.txt file found" 2025-09-16 10:38:21,056 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-16 10:38:21,597 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 10:38:21,597 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:21,597 DEBUG --- stdout --- 2025-09-16 10:38:21,597 DEBUG /results/orders/benchmark-400/stdout.txt file found 2025-09-16 10:38:21,597 DEBUG --- stderr --- 2025-09-16 10:38:21,597 DEBUG 2025-09-16 10:38:21,598 INFO 2025-09-16 10:38:21,598 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- du -k /results/orders/benchmark-400/stdout.txt | grep "^\d+ .+$" 2025-09-16 10:38:21,598 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-16 10:38:22,322 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 10:38:22,322 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:22,322 DEBUG --- stdout --- 2025-09-16 10:38:22,322 DEBUG 595984 /results/orders/benchmark-400/stdout.txt 2025-09-16 10:38:22,323 DEBUG --- stderr --- 2025-09-16 10:38:22,323 DEBUG - Download file (size 595.984MB exceeds limit of 100MB, only first 1000 and last 1000 lines will be downloaded) source : /results/orders/benchmark-400/stdout.txt @ overseer-0-57d79d468-khs5t destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stdout.txt 2025-09-16 10:38:22,323 INFO 2025-09-16 10:38:22,323 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- head -n 1000 /results/orders/benchmark-400/stdout.txt 2025-09-16 10:38:23,058 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-09-16 10:38:23,058 DEBUG --- stdout --- 2025-09-16 10:38:23,059 DEBUG [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (1000 lines): 2025-09-16 10:38:23,059 DEBUG ----- output ----- 2025-09-16 10:37:47,638 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpcpiaaz1p 2025-09-16 10:37:47,642 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 10:38:08.170 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 10:38:08.181 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2b8ac863, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@7f56af90, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, 96cfd110-9b78-496a-985e-5badb5bdedb7 -> 0),KO,List(ExitOnCompleteLoopBlock(96cfd110-9b78-496a-985e-5badb5bdedb7)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@3be86379,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Tue, 16 Sep 2025 09:38:08 GMT x-forgerock-transactionid: 78186ed1-b4fe-4a13-b427-aa552fe8c315 strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 10:38:08.184 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 10:38:08.285 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.286 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.410 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:08.453 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.453 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.619 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.619 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.787 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.787 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.889 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:08.954 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.954 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.972 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.972 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.004 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.005 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.055 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.055 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.084 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:09.105 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.105 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.117 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.118 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.128 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:09.155 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.156 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.206 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.206 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.245 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined [...] 10:38:15.010 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.011 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.020 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.020 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.030 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.030 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.040 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.040 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.050 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.050 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.053 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.056 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.060 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.060 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.068 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.070 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.070 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.080 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.080 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.090 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.090 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.097 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.100 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.100 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.110 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.110 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.110 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.120 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.120 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.130 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.130 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.130 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.140 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.140 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.150 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.150 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.159 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.160 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.160 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.170 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.170 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.180 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.180 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.184 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.189 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.190 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.190 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.200 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.200 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.210 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.210 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.220 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.220 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.230 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.230 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.237 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.238 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.240 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.240 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.250 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.250 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.260 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.260 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.261 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.270 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.270 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.280 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.280 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.290 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.290 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.291 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.298 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.300 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.300 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.310 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.310 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.320 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:15.320 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:15.320 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:15.330 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 2025-09-16 10:38:23,059 DEBUG --- stderr --- 2025-09-16 10:38:23,059 DEBUG 2025-09-16 10:38:23,059 INFO 2025-09-16 10:38:23,059 INFO 2025-09-16 10:38:23,059 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- tail -n 1000 /results/orders/benchmark-400/stdout.txt 2025-09-16 10:38:23,749 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-09-16 10:38:23,750 DEBUG --- stdout --- 2025-09-16 10:38:23,750 DEBUG [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (1000 lines): 2025-09-16 10:38:23,751 DEBUG ----- output ----- > UI IDM features (OK=307280 KO=4 ) > UI IDM login (OK=307271 KO=13 ) > UI IDM privilege (OK=307280 KO=4 ) > UI IDM dashboard (OK=307283 KO=0 ) > UI IDM managed user schema (OK=307282 KO=0 ) > UI IDM user (OK=307281 KO=0 ) > UI IDM oidcToken (OK=307280 KO=7 ) > userinfo (OK=307274 KO=0 ) > UI-Logout (OK=307278 KO=1 ) > UI-Logout Redirect 1 (OK=307274 KO=0 ) > UI AM revoke1 (OK=307263 KO=1 ) > UI AM revoke2 (OK=307264 KO=1 ) > UI AM endsession (OK=307265 KO=1 ) > loginTreeWorkflow_restLoginInitiate (OK=51414 KO=0 ) > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=51414 KO=0 ) > restloginProgressiveProfileCallback (OK=3637 KO=0 ) > loginTreeWorkflow_restloginProgressiveProfileCallback (OK=612 KO=0 ) ---- Errors -------------------------------------------------------------------- > EvalPolicy: No attribute named 'tokenIdCookieName' is defined 462370 (98.83%) > jsonPath($.tokenId).find.exists, found nothing 5364 ( 1.15%) > i.n.c.ConnectTimeoutException: connection timed out after 1000 56 ( 0.01%) 0 ms: openam-perf-haproxy.forgeblocks.com/34.120.144.60:443 > status.find.in([200, 209], 304), found 502 10 ( 0.00%) > status.find.in([200, 209], 304), found 401 9 ( 0.00%) > userinfo: No attribute named 'access_token' is defined 9 ( 0.00%) > UI AM revoke1: No attribute named 'access_token' is defined 9 ( 0.00%) > headerRegex((location,#id_token=(.*))).find.exists, found noth 7 ( 0.00%) ing > UI AM revoke2: No attribute named 'access_token_2' is defined 7 ( 0.00%) > UI AM endsession: No attribute named 'id_token_2' is defined 7 ( 0.00%) > i.n.h.s.SslHandshakeTimeoutException: handshake timed out afte 2 ( 0.00%) r 10000ms > status.find.is(200), but actually found 502 2 ( 0.00%) ---- getToken ------------------------------------------------------------------ [--------------------------------------------------------------------------] 0% waiting: 0 / active: 1 / done: 0 ---- idc.benchmark.Mix2024 ----------------------------------------------------- [#########################################################################-] 99% waiting: 11905 / active: 104 / done: 1436945 ================================================================================ 11:38:07.941 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.941 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.942 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 11:38:07.942 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.942 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.944 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.944 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.946 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.946 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.948 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.948 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.952 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.952 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.953 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.953 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.953 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.953 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.955 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 1437046: j.i.IOException: Premature close 11:38:07.955 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1437027: j.i.IOException: Premature close 11:38:07.955 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI AM validateGoto' failed for user 1436943: j.i.IOException: Premature close 11:38:07.955 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 1437054: j.i.IOException: Premature close 11:38:07.955 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1437029: j.i.IOException: Premature close 11:38:07.955 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1437044: j.i.IOException: Premature close 11:38:07.955 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 1437036: j.i.IOException: Premature close 11:38:07.955 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginInitiate: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1437046,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, username -> user.9845946, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@1a92b6de, fake-user-agent -> Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@6e8212f6),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@2a9baf17,io.netty.channel.epoll.EpollEventLoop@5b057c8c) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/authenticate headers: accept: application/json content-type: application/json [...] 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1437030: j.i.IOException: Premature close 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: userRestlogin: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1437030,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4903d0b7, username -> user.8931513, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@41de695d, password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@2a9baf17,io.netty.channel.epoll.EpollEventLoop@5b057c8c) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: Content-Type: apppliation/json Accept-API-Version: resource=2.0, protocol=1.0 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 X-OpenAM-Username: user.8931513 X-OpenAM-Password: Pa_ssw0rd accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 11:38:07.959 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI AM validateGoto' failed for user 1436950: j.i.IOException: Premature close 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI AM validateGoto: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1436950,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, username -> user.2128011, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@6119720c, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, callbacks -> {"tokenId":"EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758019087861), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758019087861))), password -> Pa_ssw0rd, fake-ip -> 191.56.240.94, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@158d0fa0, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@42dce3ce, tokenId -> EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@2a9baf17,io.netty.channel.epoll.EpollEventLoop@5b057c8c) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/users?_action=validateGoto headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Accept-API-Version: resource=2.1, protocol=1.0 referer: https://openam-perf-haproxy.forgeblocks.com/am/ accept: */* cookie: amlbcookie=01; d0d18cac672abbc=EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..* origin: https://openam-perf-haproxy.forgeblocks.com host: openam-perf-haproxy.forgeblocks.com content-length: 0 cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM version' failed for user 1436790: j.i.IOException: Premature close 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI IDM version: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1436790,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiI4ZWY2ZTMyZC0wMGNkLTQzM2MtOGViMC1hMThkYWU1NGE4NjQiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiMTc5ZTM0ZTYtODljYy00MDcxLTg2MDQtZjNlNmFkY2U3ZmVlLTY3MTU0MDI2Iiwic3VibmFtZSI6IjhlZjZlMzJkLTAwY2QtNDMzYy04ZWIwLWExOGRhZTU0YTg2NCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJUVkxiUG5Va3psSEdkX3VDOXRPektCbW5RY00iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgwMTkwODcsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgwMTkwODcsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MDIyNjg3LCJpYXQiOjE3NTgwMTkwODcsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6ImtNLTNGaklZQ0w4bU10em9ubDVfd2l0akJPNCJ9.gXg7poyIVHsWlkB9xyGADjSzofaE1BP3JtUXQCA7xgc, username -> user.7899198, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiI4ZWY2ZTMyZC0wMGNkLTQzM2MtOGViMC1hMThkYWU1NGE4NjQiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNzAyMzM4MDYtNmI5MS00ZWY0LWEyMDctYzZkMTczOGI3Y2VmLTY3MDIzMzc5Iiwic3VibmFtZSI6IjhlZjZlMzJkLTAwY2QtNDMzYy04ZWIwLWExOGRhZTU0YTg2NCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJtSF9FaWVaVmdlUmplUDh1RWRGV1pZYUR3UU0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgwMTkwODcsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgwMTkwODcsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MDIyNjg3LCJpYXQiOjE3NTgwMTkwODcsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6InhuMXdmNlZpMWFNMEFLRkFQb3BIM2Y3dmRWayJ9.2jze_kXQv3oI4G3dsktTCKvoiVF5RTJkDH0ApKeFSg4, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@683c0d3f, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, authcode -> -hHke1k2-A9ehznEP9jxNwwJdyo, callbacks -> {"tokenId":"lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758019087440), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758019087440))), user_uuid -> 8ef6e32d-00cd-433c-8eb0-a18dae54a864, password -> Pa_ssw0rd, challenge -> PQrZ5iVEyifHNz0b7Jjh01fdAi2AajDacLxE8h_ngbM, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, fake-ip -> 113.90.31.224, verifier -> NTEwODY0MDYyOTExNTk1Nzc0, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@38c3049e, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@37e8611e, tokenId -> lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@2a9baf17,io.netty.channel.epoll.EpollEventLoop@5b057c8c) ========================= HTTP request: GET https://openam-perf-haproxy.forgeblocks.com/openidm/info/version headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..* host: openam-perf-haproxy.forgeblocks.com cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 11:38:07.960 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.960 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.961 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.961 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 2025-09-16 11:38:08,064 INFO Gatling simulation run ended successfully 2025-09-16 11:38:08,065 DEBUG No archive name provided. No archive will be created 2025-09-16 10:38:23,751 DEBUG --- stderr --- 2025-09-16 10:38:23,751 DEBUG 2025-09-16 10:38:23,751 INFO ________________________________________________________________________________ [2025-09-16 10:38:23] benchmark-400 show_cmd : Display order command ________________________________________________________________________________ 2025-09-16 10:38:23,752 INFO 2025-09-16 10:38:23,752 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-16 10:38:23,752 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-16 10:38:24,041 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-16 10:38:24,041 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:24,041 DEBUG --- stdout --- 2025-09-16 10:38:24,041 DEBUG overseer-0-57d79d468-khs5t 2025-09-16 10:38:24,041 DEBUG --- stderr --- 2025-09-16 10:38:24,041 DEBUG Checking if file exists on pod 'overseer-0-57d79d468-khs5t', wait max 3 minutes if not. 2025-09-16 10:38:24,042 INFO 2025-09-16 10:38:24,042 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- bash -c 'if [ -f "/results/orders/benchmark-400/cmd.txt" ]; then echo "/results/orders/benchmark-400/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-400/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/cmd.txt file found" 2025-09-16 10:38:24,042 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-16 10:38:24,601 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 10:38:24,602 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:24,602 DEBUG --- stdout --- 2025-09-16 10:38:24,602 DEBUG /results/orders/benchmark-400/cmd.txt file found 2025-09-16 10:38:24,602 DEBUG --- stderr --- 2025-09-16 10:38:24,602 DEBUG 2025-09-16 10:38:24,602 INFO 2025-09-16 10:38:24,602 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- du -k /results/orders/benchmark-400/cmd.txt | grep "^\d+ .+$" 2025-09-16 10:38:24,602 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-16 10:38:25,145 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-16 10:38:25,145 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:25,145 DEBUG --- stdout --- 2025-09-16 10:38:25,145 DEBUG 4 /results/orders/benchmark-400/cmd.txt 2025-09-16 10:38:25,145 DEBUG --- stderr --- 2025-09-16 10:38:25,145 DEBUG - Download file (size 4kB) source : /results/orders/benchmark-400/cmd.txt @ overseer-0-57d79d468-khs5t destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt 2025-09-16 10:38:25,145 INFO 2025-09-16 10:38:25,145 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-57d79d468-khs5t:/results/orders/benchmark-400/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt 2025-09-16 10:38:25,145 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-16 10:38:25,726 INFO [loop_until]: OK (rc = 0) 2025-09-16 10:38:25,726 DEBUG --- stdout --- 2025-09-16 10:38:25,726 DEBUG tar: Removing leading `/' from member names 2025-09-16 10:38:25,726 DEBUG --- stderr --- 2025-09-16 10:38:25,726 DEBUG 2025-09-16 10:38:25,726 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt is small (1 lines), printing all lines: 2025-09-16 10:38:25,726 INFO ----- output ----- /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-haproxy" --results-folder="/results/gatling/benchmark-400" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-09-16 10:38:25] benchmark-400 show_rc : Display rc order ________________________________________________________________________________ 2025-09-16 10:38:25,727 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt is small (1 lines), printing all lines: 2025-09-16 10:38:25,727 INFO ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2025-09-16 10:38:25] benchmark-400 show_stdout : Display stdout order ________________________________________________________________________________ 2025-09-16 10:38:25,727 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stdout.txt is 2010 lines): 2025-09-16 10:38:25,728 INFO ----- output ----- NOTE: This file was too big so it was truncated. Only first 1000 and last 1000 lines are present. ------------------------------------------------------------ 2025-09-16 10:37:47,638 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpcpiaaz1p 2025-09-16 10:37:47,642 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 10:38:08.170 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 10:38:08.181 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2b8ac863, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@7f56af90, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, 96cfd110-9b78-496a-985e-5badb5bdedb7 -> 0),KO,List(ExitOnCompleteLoopBlock(96cfd110-9b78-496a-985e-5badb5bdedb7)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@3be86379,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Tue, 16 Sep 2025 09:38:08 GMT x-forgerock-transactionid: 78186ed1-b4fe-4a13-b427-aa552fe8c315 strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 10:38:08.184 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 10:38:08.285 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.286 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.410 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:08.453 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.453 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.619 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.619 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.787 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.787 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.889 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:08.954 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.954 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:08.972 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:08.972 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.004 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.005 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.055 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.055 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.084 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:09.105 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.105 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.117 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.118 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.128 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:09.155 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.156 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.206 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.206 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.245 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:09.256 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.256 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.257 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 10:38:09.306 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.307 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.356 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.357 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.406 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.406 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.456 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.456 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.506 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.506 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.556 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 10:38:09.556 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 10:38:09.599 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined [...] headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiI4ZWY2ZTMyZC0wMGNkLTQzM2MtOGViMC1hMThkYWU1NGE4NjQiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNzAyMzM4MDYtNmI5MS00ZWY0LWEyMDctYzZkMTczOGI3Y2VmLTY3MDIzMzc5Iiwic3VibmFtZSI6IjhlZjZlMzJkLTAwY2QtNDMzYy04ZWIwLWExOGRhZTU0YTg2NCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJtSF9FaWVaVmdlUmplUDh1RWRGV1pZYUR3UU0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgwMTkwODcsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgwMTkwODcsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MDIyNjg3LCJpYXQiOjE3NTgwMTkwODcsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6InhuMXdmNlZpMWFNMEFLRkFQb3BIM2Y3dmRWayJ9.2jze_kXQv3oI4G3dsktTCKvoiVF5RTJkDH0ApKeFSg4 Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..* origin: https://openam-perf-haproxy.forgeblocks.com host: openam-perf-haproxy.forgeblocks.com content-length: 0 cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 11:38:07.959 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.959 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.959 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.959 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1437030: j.i.IOException: Premature close 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: userRestlogin: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1437030,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4903d0b7, username -> user.8931513, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@41de695d, password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@2a9baf17,io.netty.channel.epoll.EpollEventLoop@5b057c8c) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: Content-Type: apppliation/json Accept-API-Version: resource=2.0, protocol=1.0 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 X-OpenAM-Username: user.8931513 X-OpenAM-Password: Pa_ssw0rd accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 11:38:07.959 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI AM validateGoto' failed for user 1436950: j.i.IOException: Premature close 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI AM validateGoto: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1436950,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, username -> user.2128011, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@6119720c, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, callbacks -> {"tokenId":"EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758019087861), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758019087861))), password -> Pa_ssw0rd, fake-ip -> 191.56.240.94, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@158d0fa0, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@42dce3ce, tokenId -> EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@2a9baf17,io.netty.channel.epoll.EpollEventLoop@5b057c8c) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/users?_action=validateGoto headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Accept-API-Version: resource=2.1, protocol=1.0 referer: https://openam-perf-haproxy.forgeblocks.com/am/ accept: */* cookie: amlbcookie=01; d0d18cac672abbc=EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..* origin: https://openam-perf-haproxy.forgeblocks.com host: openam-perf-haproxy.forgeblocks.com content-length: 0 cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=EBdFDvHnRc1_y6T-3d4ueKveQXw.*AAJTSQACMDIAAlNLABx6K3RRQUF0ajM2Smg0R1BwUnhRdFpndEVzSDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM version' failed for user 1436790: j.i.IOException: Premature close 11:38:07.959 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI IDM version: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1436790,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiI4ZWY2ZTMyZC0wMGNkLTQzM2MtOGViMC1hMThkYWU1NGE4NjQiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiMTc5ZTM0ZTYtODljYy00MDcxLTg2MDQtZjNlNmFkY2U3ZmVlLTY3MTU0MDI2Iiwic3VibmFtZSI6IjhlZjZlMzJkLTAwY2QtNDMzYy04ZWIwLWExOGRhZTU0YTg2NCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJUVkxiUG5Va3psSEdkX3VDOXRPektCbW5RY00iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgwMTkwODcsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgwMTkwODcsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MDIyNjg3LCJpYXQiOjE3NTgwMTkwODcsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6ImtNLTNGaklZQ0w4bU10em9ubDVfd2l0akJPNCJ9.gXg7poyIVHsWlkB9xyGADjSzofaE1BP3JtUXQCA7xgc, username -> user.7899198, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiI4ZWY2ZTMyZC0wMGNkLTQzM2MtOGViMC1hMThkYWU1NGE4NjQiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNzAyMzM4MDYtNmI5MS00ZWY0LWEyMDctYzZkMTczOGI3Y2VmLTY3MDIzMzc5Iiwic3VibmFtZSI6IjhlZjZlMzJkLTAwY2QtNDMzYy04ZWIwLWExOGRhZTU0YTg2NCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJtSF9FaWVaVmdlUmplUDh1RWRGV1pZYUR3UU0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgwMTkwODcsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgwMTkwODcsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MDIyNjg3LCJpYXQiOjE3NTgwMTkwODcsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6InhuMXdmNlZpMWFNMEFLRkFQb3BIM2Y3dmRWayJ9.2jze_kXQv3oI4G3dsktTCKvoiVF5RTJkDH0ApKeFSg4, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@683c0d3f, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, authcode -> -hHke1k2-A9ehznEP9jxNwwJdyo, callbacks -> {"tokenId":"lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758019087440), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758019087440))), user_uuid -> 8ef6e32d-00cd-433c-8eb0-a18dae54a864, password -> Pa_ssw0rd, challenge -> PQrZ5iVEyifHNz0b7Jjh01fdAi2AajDacLxE8h_ngbM, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, fake-ip -> 113.90.31.224, verifier -> NTEwODY0MDYyOTExNTk1Nzc0, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@38c3049e, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@37e8611e, tokenId -> lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b838469bb38@2a9baf17,io.netty.channel.epoll.EpollEventLoop@5b057c8c) ========================= HTTP request: GET https://openam-perf-haproxy.forgeblocks.com/openidm/info/version headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..* host: openam-perf-haproxy.forgeblocks.com cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=lWJ55TckqotkvtQ2qa9mDj5Dt7U.*AAJTSQACMDIAAlNLABxGL0EwSXlOQW1JaVY5enJIUGh6RlcxMGluS2s9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 11:38:07.960 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.960 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 11:38:07.961 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 11:38:07.961 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 2025-09-16 11:38:08,064 INFO Gatling simulation run ended successfully 2025-09-16 11:38:08,065 DEBUG No archive name provided. No archive will be created ________________________________________________________________________________ [2025-09-16 10:38:25] benchmark-400 show_stderr : Display stderr order ________________________________________________________________________________ 2025-09-16 10:38:25,728 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt is small (0 lines), printing all lines: 2025-09-16 10:38:25,728 INFO ----- output ----- ________________________________________________________________________________ [2025-09-16 10:38:25] benchmark-400 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-09-16 10:38:25] benchmark-400 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-09-16 10:38:25] benchmark-400 post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped