--Task-- name: benchmark-400 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-300'] preceding_task: benchmark-300 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 400} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock 2025-09-22 04:56:48,010 INFO 2025-09-22 04:56:48,010 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 04:56:48,010 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 04:56:48,284 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 04:56:48,284 INFO [loop_until]: OK (rc = 0) 2025-09-22 04:56:48,284 DEBUG --- stdout --- 2025-09-22 04:56:48,285 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 04:56:48,285 DEBUG --- stderr --- 2025-09-22 04:56:48,285 DEBUG 2025-09-22 04:56:48,285 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-09-22 04:56:48 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-09-22 04:56:48 - INFO: timeout was calculated based on simulation duration parameter 2025-09-22 04:56:48 - INFO: Interval for this Task has changed to 2m (120 seconds) 2025-09-22 04:56:48 - INFO: interval was set to Task default because it was unset, based on self.timeout value because task is allowed to stop by itself Pod log file : /results/orders/benchmark-400/stdout.txt Pod log : /results/orders/benchmark-400 ________________________________________________________________________________ [2025-09-22 04:56:48] benchmark-400 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-haproxy" --results-folder="/results/gatling/benchmark-400" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-09-22 04:56:48] benchmark-400 create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json { "name": "benchmark-400", "command": " /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-haproxy\" --results-folder=\"/results/gatling/benchmark-400\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-400" } ________________________________________________________________________________ [2025-09-22 04:56:48] benchmark-400 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-09-22 04:56:48,293 INFO 2025-09-22 04:56:48,294 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-09-22 04:56:48,294 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-09-22 04:56:48,502 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 04:56:48,502 INFO [loop_until]: OK (rc = 0) 2025-09-22 04:56:48,502 DEBUG --- stdout --- 2025-09-22 04:56:48,502 DEBUG WAITING 2025-09-22 04:56:48,502 DEBUG --- stderr --- 2025-09-22 04:56:48,502 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 35 0 --:--:-- --:--:-- --:--:-- 35 ________________________________________________________________________________ [2025-09-22 04:56:48] benchmark-400 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-09-22 04:56:48,503 INFO 2025-09-22 04:56:48,503 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 04:56:48,503 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 04:56:48,787 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 04:56:48,787 INFO [loop_until]: OK (rc = 0) 2025-09-22 04:56:48,787 DEBUG --- stdout --- 2025-09-22 04:56:48,787 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 04:56:48,787 DEBUG --- stderr --- 2025-09-22 04:56:48,787 DEBUG 2025-09-22 04:56:48,788 INFO 2025-09-22 04:56:48,788 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json overseer-0-7c788db448-z46mc:/results/orders/order.json 2025-09-22 04:56:48,788 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 04:56:49,711 INFO [loop_until]: OK (rc = 0) 2025-09-22 04:56:49,711 DEBUG --- stdout --- 2025-09-22 04:56:49,712 DEBUG 2025-09-22 04:56:49,712 DEBUG --- stderr --- 2025-09-22 04:56:49,712 DEBUG Order has been successfully forwarded to overseer 2025-09-22 04:56:49 - INFO: Check if Gatling simulation started successfully 2025-09-22 04:56:49,712 INFO 2025-09-22 04:56:49,712 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- head --lines 5000 /results/orders/benchmark-400/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-09-22 04:56:49,712 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-09-22 04:56:50,259 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-22 04:56:55,817 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-22 04:57:01,370 INFO [loop_until]: Function succeeded after 11s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-22 04:57:06,903 INFO [loop_until]: Function succeeded after 17s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-22 04:57:12,508 INFO [loop_until]: Function succeeded after 22s (rc=0) - expected pattern found 2025-09-22 04:57:12,508 INFO [loop_until]: OK (rc = 0) 2025-09-22 04:57:12,508 DEBUG --- stdout --- 2025-09-22 04:57:12,508 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input string (203 lines): 2025-09-22 04:57:12,508 DEBUG ----- output ----- 2025-09-22 05:56:51,942 DEBUG Creating results folder /results/gatling/benchmark-400 2025-09-22 05:56:51,951 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpmu683phl 2025-09-22 05:56:51,955 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 05:57:09.503 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 05:57:09.513 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@343d13f9, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@455f6433, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, 06dd096b-1156-4b38-b000-3ed3108e4533 -> 0),KO,List(ExitOnCompleteLoopBlock(06dd096b-1156-4b38-b000-3ed3108e4533)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@486b9746,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Mon, 22 Sep 2025 04:57:09 GMT x-forgerock-transactionid: 3926faea-6775-4483-8935-ba8c1513e35e strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 05:57:09.516 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 05:57:09.618 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.618 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:09.751 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:09.785 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.785 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:09.951 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.952 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.119 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.119 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.286 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.286 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.299 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.299 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.387 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.387 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.437 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.437 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.450 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.450 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.487 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.488 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.502 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.537 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.538 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.588 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.588 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.638 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.638 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.688 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.688 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.690 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.738 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.738 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.752 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.788 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.788 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.801 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.838 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.838 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.888 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.888 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.897 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.938 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.938 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.988 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.988 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one [...] 05:57:11.088 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.088 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.138 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.139 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.188 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.188 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.238 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.238 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.252 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:11.289 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.289 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.311 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.311 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.340 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.341 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.359 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:11.370 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.370 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.396 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:11.399 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.400 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.429 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.430 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.458 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.459 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.487 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.488 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.490 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:11.517 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.518 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.522 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:11.546 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.547 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.576 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.577 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.605 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.606 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.634 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.635 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.640 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:11.665 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.665 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.694 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.694 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.724 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.724 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.753 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.753 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.783 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.783 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.812 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.812 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.841 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.841 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.871 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.871 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.900 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.900 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.930 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.930 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.959 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.959 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:11.988 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:11.988 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.018 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.018 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.043 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:12.047 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.047 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.061 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:12.077 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.077 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.093 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:12.106 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.106 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.135 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.135 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.165 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.165 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.194 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.194 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.203 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:12.224 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.224 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.234 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:12.253 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.253 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.258 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:12.282 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.282 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.303 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.303 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.325 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.325 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.347 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.347 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.368 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.368 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:12.390 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:12.391 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 2025-09-22 04:57:12,508 DEBUG --- stderr --- 2025-09-22 04:57:12,508 DEBUG ________________________________________________________________________________ [2025-09-22 04:57:12] benchmark-400 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 01s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 02s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 03s, retry Order is running since 30m 03s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 04s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 05s, retry Order is running since 44m 05s, retry Order is running since 46m 06s, retry Order is running since 48m 06s, retry Order is running since 50m 06s, retry Order is running since 52m 06s, retry Order is running since 54m 07s, retry Order is running since 56m 07s, retry Order is running since 58m 07s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-09-22 05:57:20] benchmark-400 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-09-22 05:57:20,537 INFO 2025-09-22 05:57:20,537 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 05:57:20,537 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 05:57:20,847 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 05:57:20,847 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:20,847 DEBUG --- stdout --- 2025-09-22 05:57:20,847 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 05:57:20,847 DEBUG --- stderr --- 2025-09-22 05:57:20,847 DEBUG 2025-09-22 05:57:20,847 INFO 2025-09-22 05:57:20,847 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- rm -f /results/orders/order.json 2025-09-22 05:57:20,847 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 05:57:21,444 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:21,444 DEBUG --- stdout --- 2025-09-22 05:57:21,444 DEBUG 2025-09-22 05:57:21,444 DEBUG --- stderr --- 2025-09-22 05:57:21,444 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-09-22 05:57:21] benchmark-400 download_logs : Download individual order files ________________________________________________________________________________ 2025-09-22 05:57:21 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json 2025-09-22 05:57:21,445 INFO 2025-09-22 05:57:21,445 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 05:57:21,445 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 05:57:21,726 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 05:57:21,726 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:21,726 DEBUG --- stdout --- 2025-09-22 05:57:21,726 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 05:57:21,726 DEBUG --- stderr --- 2025-09-22 05:57:21,726 DEBUG Checking if file exists on pod 'overseer-0-7c788db448-z46mc', wait max 3 minutes if not. 2025-09-22 05:57:21,727 INFO 2025-09-22 05:57:21,727 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- bash -c 'if [ -f "/results/orders/benchmark-400/rc.txt" ]; then echo "/results/orders/benchmark-400/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-400/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/rc.txt file found" 2025-09-22 05:57:21,727 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 05:57:22,640 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 05:57:22,640 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:22,640 DEBUG --- stdout --- 2025-09-22 05:57:22,640 DEBUG /results/orders/benchmark-400/rc.txt file found 2025-09-22 05:57:22,640 DEBUG --- stderr --- 2025-09-22 05:57:22,640 DEBUG 2025-09-22 05:57:22,641 INFO 2025-09-22 05:57:22,641 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- du -k /results/orders/benchmark-400/rc.txt | grep "^\d+ .+$" 2025-09-22 05:57:22,641 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-22 05:57:23,190 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 05:57:23,190 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:23,190 DEBUG --- stdout --- 2025-09-22 05:57:23,190 DEBUG 4 /results/orders/benchmark-400/rc.txt 2025-09-22 05:57:23,190 DEBUG --- stderr --- 2025-09-22 05:57:23,190 DEBUG - Download file (size 4kB) source : /results/orders/benchmark-400/rc.txt @ overseer-0-7c788db448-z46mc destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt 2025-09-22 05:57:23,191 INFO 2025-09-22 05:57:23,191 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7c788db448-z46mc:/results/orders/benchmark-400/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt 2025-09-22 05:57:23,191 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-22 05:57:23,726 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:23,726 DEBUG --- stdout --- 2025-09-22 05:57:23,726 DEBUG tar: Removing leading `/' from member names 2025-09-22 05:57:23,726 DEBUG --- stderr --- 2025-09-22 05:57:23,726 DEBUG 2025-09-22 05:57:23,726 INFO 2025-09-22 05:57:23,726 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 05:57:23,726 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 05:57:24,008 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 05:57:24,008 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:24,008 DEBUG --- stdout --- 2025-09-22 05:57:24,008 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 05:57:24,008 DEBUG --- stderr --- 2025-09-22 05:57:24,008 DEBUG Checking if file exists on pod 'overseer-0-7c788db448-z46mc', wait max 3 minutes if not. 2025-09-22 05:57:24,009 INFO 2025-09-22 05:57:24,009 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- bash -c 'if [ -f "/results/orders/benchmark-400/stderr.txt" ]; then echo "/results/orders/benchmark-400/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-400/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/stderr.txt file found" 2025-09-22 05:57:24,009 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 05:57:24,563 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 05:57:24,563 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:24,563 DEBUG --- stdout --- 2025-09-22 05:57:24,563 DEBUG /results/orders/benchmark-400/stderr.txt file found 2025-09-22 05:57:24,563 DEBUG --- stderr --- 2025-09-22 05:57:24,563 DEBUG 2025-09-22 05:57:24,563 INFO 2025-09-22 05:57:24,563 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- du -k /results/orders/benchmark-400/stderr.txt | grep "^\d+ .+$" 2025-09-22 05:57:24,563 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-22 05:57:25,098 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 05:57:25,098 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:25,098 DEBUG --- stdout --- 2025-09-22 05:57:25,098 DEBUG 0 /results/orders/benchmark-400/stderr.txt 2025-09-22 05:57:25,098 DEBUG --- stderr --- 2025-09-22 05:57:25,098 DEBUG - Download file (size 0B) source : /results/orders/benchmark-400/stderr.txt @ overseer-0-7c788db448-z46mc destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt 2025-09-22 05:57:25,099 INFO 2025-09-22 05:57:25,099 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7c788db448-z46mc:/results/orders/benchmark-400/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt 2025-09-22 05:57:25,099 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-22 05:57:25,628 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:25,628 DEBUG --- stdout --- 2025-09-22 05:57:25,628 DEBUG tar: Removing leading `/' from member names 2025-09-22 05:57:25,628 DEBUG --- stderr --- 2025-09-22 05:57:25,628 DEBUG 2025-09-22 05:57:25,629 INFO 2025-09-22 05:57:25,629 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 05:57:25,629 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 05:57:25,914 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 05:57:25,914 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:25,914 DEBUG --- stdout --- 2025-09-22 05:57:25,914 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 05:57:25,914 DEBUG --- stderr --- 2025-09-22 05:57:25,914 DEBUG Checking if file exists on pod 'overseer-0-7c788db448-z46mc', wait max 3 minutes if not. 2025-09-22 05:57:25,915 INFO 2025-09-22 05:57:25,915 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- bash -c 'if [ -f "/results/orders/benchmark-400/stdout.txt" ]; then echo "/results/orders/benchmark-400/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-400/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/stdout.txt file found" 2025-09-22 05:57:25,915 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 05:57:26,460 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 05:57:26,460 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:26,460 DEBUG --- stdout --- 2025-09-22 05:57:26,461 DEBUG /results/orders/benchmark-400/stdout.txt file found 2025-09-22 05:57:26,461 DEBUG --- stderr --- 2025-09-22 05:57:26,461 DEBUG 2025-09-22 05:57:26,461 INFO 2025-09-22 05:57:26,461 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- du -k /results/orders/benchmark-400/stdout.txt | grep "^\d+ .+$" 2025-09-22 05:57:26,461 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-22 05:57:27,008 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 05:57:27,008 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:27,008 DEBUG --- stdout --- 2025-09-22 05:57:27,008 DEBUG 885016 /results/orders/benchmark-400/stdout.txt 2025-09-22 05:57:27,008 DEBUG --- stderr --- 2025-09-22 05:57:27,008 DEBUG - Download file (size 885.016MB exceeds limit of 100MB, only first 1000 and last 1000 lines will be downloaded) source : /results/orders/benchmark-400/stdout.txt @ overseer-0-7c788db448-z46mc destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stdout.txt 2025-09-22 05:57:27,009 INFO 2025-09-22 05:57:27,009 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- head -n 1000 /results/orders/benchmark-400/stdout.txt 2025-09-22 05:57:27,733 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-09-22 05:57:27,733 DEBUG --- stdout --- 2025-09-22 05:57:27,734 DEBUG [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (1000 lines): 2025-09-22 05:57:27,734 DEBUG ----- output ----- 2025-09-22 05:56:51,942 DEBUG Creating results folder /results/gatling/benchmark-400 2025-09-22 05:56:51,951 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpmu683phl 2025-09-22 05:56:51,955 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 05:57:09.503 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 05:57:09.513 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@343d13f9, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@455f6433, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, 06dd096b-1156-4b38-b000-3ed3108e4533 -> 0),KO,List(ExitOnCompleteLoopBlock(06dd096b-1156-4b38-b000-3ed3108e4533)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@486b9746,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Mon, 22 Sep 2025 04:57:09 GMT x-forgerock-transactionid: 3926faea-6775-4483-8935-ba8c1513e35e strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 05:57:09.516 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 05:57:09.618 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.618 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:09.751 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:09.785 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.785 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:09.951 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.952 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.119 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.119 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.286 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.286 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.299 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.299 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.387 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.387 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.437 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.437 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.450 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.450 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.487 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.488 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.502 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.537 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.538 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.588 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.588 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one [...] pragma: no-cache set-cookie: amlbcookie=01; Path=/; Domain=openam-perf-haproxy.forgeblocks.com; Secure; HttpOnly; SameSite=none content-type: application/json Content-Length: 5283 date: Mon, 22 Sep 2025 04:57:15 GMT x-forgerock-transactionid: ebdd5b7c-244d-4c1b-8217-fb20cd0db08c strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"authId":"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ3aGl0ZWxpc3Qtc3RhdGUiOiJkODI5NGFjOC0yYTk1LTQ3NTQtOGI1My05OGJjZDczZDM4NTEiLCJvdGsiOiJxcXVka2VocjJobHVwcDI2Y2dzaHNxcmw4OSIsInJlYWxtIjoiL2FscGhhIiwic2Vzc2lvbklkIjoiKkFBSlRTUUFDTURJQUJIUjVjR1VBQ0VwWFZGOUJWVlJJQUFKVE1RQUNNREUuKmV5SjBlWEFpT2lKS1YxUWlMQ0pqZEhraU9pSktWMVFpTENKaGJHY2lPaUpJVXpJMU5pSjkuWlhsS01HVllRV2xQYVVwTFZqRlJhVXhEU214aWJVMXBUMmxLUWsxVVNUUlJNRXBFVEZWb1ZFMXFWVEpKYVhkcFdWZDRia2xxYjJsYVIyeDVTVzR3TGk1cGFXeE1hSGw1VmtGeE0xQlRNalJOVjBNdFpVRkJMbmR2YlRKelkzbHpSekJqWWxoVWRHaG5lazFHYjFGSGVtSlhWbWg1UTFwT1dqUkRkRjg0YlRWb2FuaDBkelZ6YUVacWJHeEZkVTVrYUZWYVUySnJlRTlQYms5emNVNWhkVmR2TlZKT1Z6QkxhSEJPTW5kSGVVeFRRMUJOUkRaM01taEJkVVZEZDNkeE5saDJZVzlSZFdkbVpVSm9UakU1U0ZaRmFUUlRkMlp3ZVRWdGNrYzVVbk5PUjFCZk1FWmZNVFJTYlRoTWNXcDRMVE5zZUZnMU9FRklkbUZmYjJobU9YWk9VekZxV2s5VFQzaE5hVmh0TW5sRFZuWTBjbmc0U2pGbFZWRTVXaloxVFUxSlNEQk9WV1Y2YXpRM01qZzFXRkpKV21rMVJISm5TbUk0WDBWS1ZuSlBWbmx6YjBkUE5tRkNWMDExTkRNMFEwcEZTR2czUTJ0QmMySTFZM0Z0TkhSU2FEQlJPR1U1UkhCZk9WWjJhVEkyZG14T04wbDFkVzFuT1dWcFlrRnFWREUxWWs1Qk5VeE5kbWxVVldoWFdrbFBkMlphUVROcWVHZE5WSGhTTlRkT04ySTFYekZSYkZoQlNuQlRRbWhJVG1KcFNGZFpWRTUwVnpFM1psVjZXbDlQTW5wa1RXWkxabXM1VEhCU1duTnBhMkpqV25wRU5tbGpZMlkyV25WSlh6QkRVRVIwTTFNMk1rcGxSR1JxVDNKT1kySmlVRFE0Vkdnd1ZHVkxkVFJqYm5jM09FMHhZMHN5WmpSSGNuZDNiekJrVDJaTmNXNVBjSFJhZEZWNU5qaFFiWFV3VVhoYVZsbDRURWhKZDJkRFJ6UjZObmN4WkZSdGNWZzRkakZHUVhCWE5HRlphREpCWDBGNlltNVJiRVptWTJGVmREa3lSazFHZW05TGFERXlTWGsxYW5kc1VYQTVSMkpPUjBwUFQyaHRSa2g0YzFCYWRrMWhZa3RQYjAxemJXUndUVVpLVVZRdFZ6TjZibmczTFU5cE1HUk5aVU16YW1nNFFWZHNaV1ZRWkhWMGNHUnRkSFZNZEVkTFVXMXlSWGN5VW1aTk5HNVpNMk10VDFORE5tZFZWMHRXWW5wMVFUSkRaM1ZET0ZkelNqVXRURWhpU0c1WVR6QlhNbXB5TVc1akxVUllVa0phUjJaUlFWOVhWbFJhVmxCNFlsRkZORUpvUVMwelRXRm1jelJyTkV0aWVsZDZOa1Y1VVVsNE1tOVdiRUZvVWpKd2RsTnRjaTFMWTJ0cVZrZFJUR3Q1VmtGeWF6VnFOV05TT1dzeVNsQndTREl4WjNBeFJFcE5aakk0YW1RelJrbFdlV1F6YkhabFdGcEVlV05sWDBFek1qUndZMk5VYlhGT05EQnlka2RJYVc5UldEQnJPV0kyTUhndFp6TkxhM0JyUVhOemFWSmhOV1kzUW1GeVpHbElabHBMVTBwSWQzZFdSSE51ZWpKTGVHOVpPRTFHWkdwYU5XZFNNRWx2T0d3dGFrRk1RVWRTT1cxelVtVk5SbGswV2xwdWREVnpZa0oxUkhkQlQwbzNha0ppVTNCYVQyTmlkRXhCWDFsUVNXdzRVMWxHYTNad2NGVmpkbVZDTTNWd1VHMXFhbXc0VUhsbFdEVTRVRU5rTVdaMVZsTkJUVVJDU0dWT2VVTmpjeTFCUzJkaGVHeEhYekpzV1hCSVdTMXhWMDFuV0Rkd1NISmxVUzFpTlhSSFdGaFJNVGRzYVVsSlVuSmpUSFozYlZGbldrNXFPVXh1ZWpObFpqTXRNRVpUU210MlREVlRha1pUYlhwRFN6TmplRUZwYldGaVJrZHFVM1ZGVERaUlNteGxXVW8wVDAxclJuVmxjSEpQUmpKQlUwczJSVWxxWkZBNFpVaFBSamhyVG5ScVkwUmtVMDExUmtvMmJUZzVhR2gyV1hGSGRtSjJMVTVTU1RsSFMwYzJWRUYxWlhGa1JsZzRWWGs1UjFwUVVuRXdNVjlNVVVwdmFrMVpZMWhrV2xabllUZ3hkbHBYY0VwVk5GTm9ibGRHVkU5dVdHMU9WSHBwYUdnMmVEaElUSGRrT1VnMlUzRXlTR3hyUmsxaVNuQmhSbmx6VW1aZmJUSmpha1Y0WTFkVmJ6RmhWa1V3VVVodWNYWTVjbGxqWjFVMmRGbEVZV2xETUY5cVNFNWZiWGN5UTJGWVdWSkVOV1ZIT0RSamJ6bFVZbkp1YXpZMFdXbExkME4wZDNOTVlXSmFORzlmYkRoeVdqVnphalZMVUU5Rk9HaFZNWGQwWm01eU9EbE5iRFJrTUdWc1RUWjJWa3gxU25KTFNrVkZVVFpZWVVJMU1pMVdaRzlyVUVoRWFEVllUR1ZPTFZWU09HVjVUMmN4VEVWUWVWRjFabE5pY0ZSTGVUWndORXhaVkZsa1pFTnFhWGhPTkRFM2VuZHVhVVp2VDNGVlREWXhOemwxYm1OdE5XZG9iRTl0TjJaS1MyRXpRbTk1U1VaeVdVa3lhMDlGYTJSemFHRlJSVFJVWm1Gb1RWQnVaMkZrUW1oRFdqUlpVV1ZHTW5aWlExTnFaRTlOVUZjMFVYZHpkMkZ5YUV0alJXMXVkeTFWUm1kNGRqQTBWbXR2TlZKMmJsQk1PRXBOVldOT05pMTZkVEpaWVZVd0xVMHpNazgxYXpWa1MwdEhiR3BhWlUxMVdWRjVObk13VkhBemEwUkJhMWRtYlRGdmJYZGZla001VFcweFNHVXdVR2RtYlhZd1MxOTFVUzFKT0ZCdVduWmtZV1l6VkhCYWNGQXphV2xOYkRoS1ltWkRhVmhGVWpsV1IxRmtOVFJYWVZSRmR6UllTSGRWWjFwcE5XeDBWRzlHWm1oa05UZE9jM2N0UTB4WU5XUkhSMEYzT1VGNllqazVlRkJwYldoSlRsbEJObmRrVFUwd2MyVTNRVTVSZWpWRFJXWmhWbXBhVFZobVgzTlZlV0l4TjNsTGJWOWxZMFJ0TWtkNk5YWkVlbWxsUzBsVlJHeHdja1EyTFc1SVgwTXllWEJKTlVkcVlsZENTVWd3TlZJeWRVMVRRVEF3TFZWTFdYbFNiSEI2WDNabkxUWmpTRk5RYkdoUVVVaHFaMDV1YVVwaWMxcFZZVmh1UjI5S2JXOWFlRkl3UlVoU1UwcFRTM294YlZKcVduVkhja1JoVURaeWVrdEtZMUIzV1ZGb2FXWmZaV2Q1WnpWUU0wcHVSRzV5UjI5NGFtbGxXVWx0Y1hKblVURnZNMnB3TjJKTmQydGpVbEZHWTNKcGFWRnJSVFpWYlZOQllqbG1WRmgwY1RsVWJVUlVUakpyYnpJM1NscEhibXRJZEdaNmJVcFFMV0ptUTJsSmRFSjRaM05sWm5OdlNWRlFjWGRMZVdVeFgzazNPV2RhTVdsUFUybGFSWE5WUWxsNlFtdHpVMWxqYmpOcFYyZG1kWFpYWVZkRFJWZFRlbXcwZFVGT1RuUmliMnBST0ZCUWNYbzVlRXhOYTFBMWVuWTFaemR5WjBoQlMyWlhkak5GYm01WGQxSnZSR1JSZG5ZM1kxSmhObk5SZG5SbWIxcDVaelJHTFhCdVFXWnRPQzFLVW01Q1dtWnhMVGhoWjNwMVRITnhYM00zUTNZdE1ucFVWVUZpVkhwek9ERmlZVEEzYkVJdFduQlNRUzVuYjNCU1dYSklkVzFDYldGdVkweG5ZVU13ZERsQi51ZDViRno2ZFpvRUxkUVF1R2FrNmRVdTBkNXhNemg1U1htaVNORUZVaTdFIiwiZXhwIjoxNzU4NTE3MzM1LCJpYXQiOjE3NTg1MTcwMzV9.0NTNYc62hNryvy8HGk4HEy28l__OKYjlA1WqMF-vkuk","callbacks":[{"type":"BooleanAttributeInputCallback","output":[{"name":"name","value":"preferences/updates"},{"name":"prompt","value":"Send me news and updates"},{"name":"required","value":false},{"name":"policies","value":{}},{"name":"failedPolicies","value":[]},{"name":"validateOnly","value":false},{"name":"value","value":false}],"input":[{"name":"IDToken1","value":false},{"name":"IDToken1validateOnly","value":false}],"_id":2},{"type":"BooleanAttributeInputCallback","output":[{"name":"name","value":"preferences/marketing"},{"name":"prompt","value":"Send me special offers and services"},{"name":"required","value":false},{"name":"policies","value":{}},{"name":"failedPolicies","value":[]},{"name":"validateOnly","value":false},{"name":"value","value":false}],"input":[{"name":"IDToken2","value":false},{"name":"IDToken2validateOnly","value":false}],"_id":3}],"header":"Please select your preferences"} <<<<<<<<<<<<<<<<<<<<<<<<< 05:57:15.743 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:15.748 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.748 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.758 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.759 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.771 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.771 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.783 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.783 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.794 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.794 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.795 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:15.797 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:15.806 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.806 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.817 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.817 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.829 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.829 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.841 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.841 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.852 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.852 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.864 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.864 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.876 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.876 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.882 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:15.887 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.887 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.887 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:15.899 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.899 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.910 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.910 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.922 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.922 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.934 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:15.934 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:15.944 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 290: jsonPath($.tokenId).find.exists, found nothing 05:57:15.945 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: userRestlogin: KO jsonPath($.tokenId).find.exists, found nothing ========================= Session: Session(idc.benchmark.Mix2024,290,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@7c0c1b7e, username -> user.2928746, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@30f6ffc5, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758517035943))), password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@14f5da2c) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: Content-Type: apppliation/json Accept-API-Version: resource=2.0, protocol=1.0 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 X-OpenAM-Username: user.2928746 X-OpenAM-Password: Pa_ssw0rd accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 200 OK headers: 2025-09-22 05:57:27,734 DEBUG --- stderr --- 2025-09-22 05:57:27,734 DEBUG 2025-09-22 05:57:27,734 INFO 2025-09-22 05:57:27,734 INFO 2025-09-22 05:57:27,735 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- tail -n 1000 /results/orders/benchmark-400/stdout.txt 2025-09-22 05:57:28,471 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-09-22 05:57:28,471 DEBUG --- stdout --- 2025-09-22 05:57:28,471 DEBUG [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (1000 lines): 2025-09-22 05:57:28,471 DEBUG ----- output ----- referer: https://openam-perf-haproxy.forgeblocks.com/am/ accept: */* cookie: amlbcookie=01; d0d18cac672abbc=eqeyx__uL2RkFcbmeYxTFluU-XQ.*AAJTSQACMDIAAlNLABxSKzZkMDhHeW9uT0FUTzY2N0tpenFZSDBEYTQ9AAR0eXBlAANDVFMAAlMxAAIwMQ..* origin: https://openam-perf-haproxy.forgeblocks.com host: openam-perf-haproxy.forgeblocks.com content-length: 0 cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=eqeyx__uL2RkFcbmeYxTFluU-XQ.*AAJTSQACMDIAAlNLABxSKzZkMDhHeW9uT0FUTzY2N0tpenFZSDBEYTQ9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.284 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1435138: j.i.IOException: Premature close 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM login' failed for user 1434870: j.i.IOException: Premature close 06:57:09.284 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginInitiate: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1435149,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, username -> user.9417758, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@4392a6a2, fake-user-agent -> Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 34.103.234.20, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@de5e54),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@1e1d3956) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login headers: accept: application/json content-type: application/json user-agent: Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 X-Forwarded-For: 34.103.234.20 host: openam-perf-haproxy.forgeblocks.com content-length: 0 body:StringChunksRequestBody{charset=UTF-8, content=} ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI IDM login: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1434870,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJkY2VkOTc4Yy01MDk2LTRkYTctODhkZi1lZDI4MjczNTAyNTUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiZjc2NzIzODctZGFiNi00MWI5LThjYTctYmM3MGVlZDc5YmZiLTIwNDY1MDEzNCIsInN1Ym5hbWUiOiJkY2VkOTc4Yy01MDk2LTRkYTctODhkZi1lZDI4MjczNTAyNTUiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLWhhcHJveHkuZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIvcmVhbG1zL3Jvb3QvcmVhbG1zL2FscGhhIiwidG9rZW5OYW1lIjoiYWNjZXNzX3Rva2VuIiwidG9rZW5fdHlwZSI6IkJlYXJlciIsImF1dGhHcmFudElkIjoicDh0MXJiMTJVaVZlNUNfbVFXSXV4SVdxVUtJIiwibm9uY2UiOiIxMjM0IiwiY2xpZW50X2lkIjoiZW5kVXNlclVJQ2xpZW50IiwiYXVkIjoiZW5kVXNlclVJQ2xpZW50IiwibmJmIjoxNzU4NTIwNjI4LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsib3BlbmlkIiwiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzU4NTIwNjI4LCJyZWFsbSI6Ii9hbHBoYSIsImV4cCI6MTc1ODUyNDIyOCwiaWF0IjoxNzU4NTIwNjI4LCJleHBpcmVzX2luIjozNjAwLCJqdGkiOiJEVFZmSEZqTjJ2NFlxLVBENzJ4ZlZaa0JKLVEifQ.5o2qClKuNWdzw30KfH0ANaDGoxsqcZGcabrfR-7TJ5U, username -> user.5453230, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJkY2VkOTc4Yy01MDk2LTRkYTctODhkZi1lZDI4MjczNTAyNTUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiZjc2NzIzODctZGFiNi00MWI5LThjYTctYmM3MGVlZDc5YmZiLTIwNDY1MTg1NCIsInN1Ym5hbWUiOiJkY2VkOTc4Yy01MDk2LTRkYTctODhkZi1lZDI4MjczNTAyNTUiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLWhhcHJveHkuZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIvcmVhbG1zL3Jvb3QvcmVhbG1zL2FscGhhIiwidG9rZW5OYW1lIjoiYWNjZXNzX3Rva2VuIiwidG9rZW5fdHlwZSI6IkJlYXJlciIsImF1dGhHcmFudElkIjoidGF6ZjE1dFNGb2xkYXFEUWUxbXZYMGRSWWlVIiwibm9uY2UiOiIxMjM0IiwiY2xpZW50X2lkIjoiZW5kVXNlclVJQ2xpZW50IiwiYXVkIjoiZW5kVXNlclVJQ2xpZW50IiwibmJmIjoxNzU4NTIwNjI5LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzU4NTIwNjI4LCJyZWFsbSI6Ii9hbHBoYSIsImV4cCI6MTc1ODUyNDIyOSwiaWF0IjoxNzU4NTIwNjI5LCJleHBpcmVzX2luIjozNjAwLCJqdGkiOiJNSlNQRFJnNllhZlFTV1M1X3lSVGl0RnB4YVkifQ.G-1Rr8kCTEcnvhPzA61dJi2UR0Vz7OJoAny5kLhyCZY, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@704c1d9d, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, authcode -> eWo1eFoWbABQCeCJ_pSUDrweYE0, callbacks -> {"tokenId":"AqX0MQw2k2L4Q25hhuB8em9X4Og.*AAJTSQACMDIAAlNLABxmNUtXVjhML0hoejJFZm5Hc1pNdU5HdUQxc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758520628708), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=AqX0MQw2k2L4Q25hhuB8em9X4Og.*AAJTSQACMDIAAlNLABxmNUtXVjhML0hoejJFZm5Hc1pNdU5HdUQxc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758520628708))), user_uuid -> dced978c-5096-4da7-88df-ed2827350255, password -> Pa_ssw0rd, challenge -> pfUdrsGZC_tNz30S0X4yB45mwYSXc6L4egWUdm3sv9w, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, fake-ip -> 55.209.144.240, verifier -> NjkxMzcyMDAzNTcwMDQyODIxOQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4aff7b50, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@640fa54, tokenId -> AqX0MQw2k2L4Q25hhuB8em9X4Og.*AAJTSQACMDIAAlNLABxmNUtXVjhML0hoejJFZm5Hc1pNdU5HdUQxc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@5b057c8c) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/openidm/authentication?_action=login headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJkY2VkOTc4Yy01MDk2LTRkYTctODhkZi1lZDI4MjczNTAyNTUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiZjc2NzIzODctZGFiNi00MWI5LThjYTctYmM3MGVlZDc5YmZiLTIwNDY1MTg1NCIsInN1Ym5hbWUiOiJkY2VkOTc4Yy01MDk2LTRkYTctODhkZi1lZDI4MjczNTAyNTUiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLWhhcHJveHkuZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIvcmVhbG1zL3Jvb3QvcmVhbG1zL2FscGhhIiwidG9rZW5OYW1lIjoiYWNjZXNzX3Rva2VuIiwidG9rZW5fdHlwZSI6IkJlYXJlciIsImF1dGhHcmFudElkIjoidGF6ZjE1dFNGb2xkYXFEUWUxbXZYMGRSWWlVIiwibm9uY2UiOiIxMjM0IiwiY2xpZW50X2lkIjoiZW5kVXNlclVJQ2xpZW50IiwiYXVkIjoiZW5kVXNlclVJQ2xpZW50IiwibmJmIjoxNzU4NTIwNjI5LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzU4NTIwNjI4LCJyZWFsbSI6Ii9hbHBoYSIsImV4cCI6MTc1ODUyNDIyOSwiaWF0IjoxNzU4NTIwNjI5LCJleHBpcmVzX2luIjozNjAwLCJqdGkiOiJNSlNQRFJnNllhZlFTV1M1X3lSVGl0RnB4YVkifQ.G-1Rr8kCTEcnvhPzA61dJi2UR0Vz7OJoAny5kLhyCZY Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=AqX0MQw2k2L4Q25hhuB8em9X4Og.*AAJTSQACMDIAAlNLABxmNUtXVjhML0hoejJFZm5Hc1pNdU5HdUQxc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..* origin: https://openam-perf-haproxy.forgeblocks.com host: openam-perf-haproxy.forgeblocks.com content-length: 0 cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=AqX0MQw2k2L4Q25hhuB8em9X4Og.*AAJTSQACMDIAAlNLABxmNUtXVjhML0hoejJFZm5Hc1pNdU5HdUQxc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 1435148: j.i.IOException: Premature close 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM privilege' failed for user 1434870: j.i.IOException: Premature close 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1435129: j.i.IOException: Premature close 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM login' failed for user 1434871: j.i.IOException: Premature close 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1435128: j.i.IOException: Premature close 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 1435146: j.i.IOException: Premature close 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 1435153: j.i.IOException: Premature close 06:57:09.285 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: userRestlogin: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1435147,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4aa6e0a5, username -> user.2684765, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@1c90633b, password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@650eab8) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: [...] cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=ZFt3YZ3nl6GCHU7Em3KPGvAPoRo.*AAJTSQACMDIAAlNLABxyUndobjcyM05YdkN6S1FVTjVBS2ErRWUwQmc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1435113: j.i.IOException: Premature close 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'loginTreeWorkflow_restLoginInitiate' failed for user 1435151: j.i.IOException: Premature close 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: userRestlogin: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1435113,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@35176d79, username -> user.2686417, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@4b20578a, password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@5b7ea70d) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: Content-Type: apppliation/json Accept-API-Version: resource=2.0, protocol=1.0 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 X-OpenAM-Username: user.2686417 X-OpenAM-Password: Pa_ssw0rd accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.287 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: loginTreeWorkflow_restLoginInitiate: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1435151,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, username -> user.2339172, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@7960f9c7, fake-user-agent -> Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 93.247.105.81, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4048e4a1),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login headers: accept: application/json content-type: application/json user-agent: Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 X-Forwarded-For: 93.247.105.81 host: openam-perf-haproxy.forgeblocks.com content-length: 0 body:StringChunksRequestBody{charset=UTF-8, content=} ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.287 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 06:57:09.288 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 06:57:09.288 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1435135: j.i.IOException: Premature close 06:57:09.288 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: userRestlogin: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1435135,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@41b66edc, username -> user.2416733, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@17a75454, password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: Content-Type: apppliation/json Accept-API-Version: resource=2.0, protocol=1.0 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 X-OpenAM-Username: user.2416733 X-OpenAM-Password: Pa_ssw0rd accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.288 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 2025-09-22 06:57:09,388 INFO Gatling simulation run ended successfully 2025-09-22 06:57:09,388 DEBUG No archive name provided. No archive will be created 2025-09-22 05:57:28,471 DEBUG --- stderr --- 2025-09-22 05:57:28,472 DEBUG 2025-09-22 05:57:28,472 INFO ________________________________________________________________________________ [2025-09-22 05:57:28] benchmark-400 show_cmd : Display order command ________________________________________________________________________________ 2025-09-22 05:57:28,473 INFO 2025-09-22 05:57:28,473 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 05:57:28,473 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 05:57:28,752 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 05:57:28,752 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:28,752 DEBUG --- stdout --- 2025-09-22 05:57:28,752 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 05:57:28,752 DEBUG --- stderr --- 2025-09-22 05:57:28,752 DEBUG Checking if file exists on pod 'overseer-0-7c788db448-z46mc', wait max 3 minutes if not. 2025-09-22 05:57:28,753 INFO 2025-09-22 05:57:28,753 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- bash -c 'if [ -f "/results/orders/benchmark-400/cmd.txt" ]; then echo "/results/orders/benchmark-400/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-400/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/cmd.txt file found" 2025-09-22 05:57:28,753 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 05:57:29,288 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 05:57:29,288 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:29,289 DEBUG --- stdout --- 2025-09-22 05:57:29,289 DEBUG /results/orders/benchmark-400/cmd.txt file found 2025-09-22 05:57:29,289 DEBUG --- stderr --- 2025-09-22 05:57:29,289 DEBUG 2025-09-22 05:57:29,289 INFO 2025-09-22 05:57:29,289 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- du -k /results/orders/benchmark-400/cmd.txt | grep "^\d+ .+$" 2025-09-22 05:57:29,289 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-22 05:57:29,834 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 05:57:29,834 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:29,834 DEBUG --- stdout --- 2025-09-22 05:57:29,835 DEBUG 4 /results/orders/benchmark-400/cmd.txt 2025-09-22 05:57:29,835 DEBUG --- stderr --- 2025-09-22 05:57:29,835 DEBUG - Download file (size 4kB) source : /results/orders/benchmark-400/cmd.txt @ overseer-0-7c788db448-z46mc destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt 2025-09-22 05:57:29,835 INFO 2025-09-22 05:57:29,835 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7c788db448-z46mc:/results/orders/benchmark-400/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt 2025-09-22 05:57:29,835 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-22 05:57:30,376 INFO [loop_until]: OK (rc = 0) 2025-09-22 05:57:30,376 DEBUG --- stdout --- 2025-09-22 05:57:30,376 DEBUG tar: Removing leading `/' from member names 2025-09-22 05:57:30,376 DEBUG --- stderr --- 2025-09-22 05:57:30,376 DEBUG 2025-09-22 05:57:30,376 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt is small (1 lines), printing all lines: 2025-09-22 05:57:30,376 INFO ----- output ----- /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-haproxy" --results-folder="/results/gatling/benchmark-400" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-09-22 05:57:30] benchmark-400 show_rc : Display rc order ________________________________________________________________________________ 2025-09-22 05:57:30,377 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt is small (1 lines), printing all lines: 2025-09-22 05:57:30,377 INFO ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2025-09-22 05:57:30] benchmark-400 show_stdout : Display stdout order ________________________________________________________________________________ 2025-09-22 05:57:30,377 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stdout.txt is 2010 lines): 2025-09-22 05:57:30,377 INFO ----- output ----- NOTE: This file was too big so it was truncated. Only first 1000 and last 1000 lines are present. ------------------------------------------------------------ 2025-09-22 05:56:51,942 DEBUG Creating results folder /results/gatling/benchmark-400 2025-09-22 05:56:51,951 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpmu683phl 2025-09-22 05:56:51,955 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 05:57:09.503 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 05:57:09.513 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@343d13f9, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@455f6433, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, 06dd096b-1156-4b38-b000-3ed3108e4533 -> 0),KO,List(ExitOnCompleteLoopBlock(06dd096b-1156-4b38-b000-3ed3108e4533)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@486b9746,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Mon, 22 Sep 2025 04:57:09 GMT x-forgerock-transactionid: 3926faea-6775-4483-8935-ba8c1513e35e strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 05:57:09.516 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 05:57:09.618 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.618 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:09.751 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:09.785 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.785 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:09.951 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:09.952 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.119 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.119 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.286 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.286 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.299 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.299 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.387 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.387 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.437 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.437 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.450 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.450 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.487 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.488 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.502 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.537 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.538 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.588 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.588 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.638 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.638 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.688 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.688 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.690 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.738 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.738 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.752 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.788 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.788 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.801 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 05:57:10.838 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.838 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.888 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 05:57:10.888 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 05:57:10.897 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined [...] 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI IDM privilege: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1434871,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiIxNTViM2MwNC0zZTk0LTQzYWUtOTg4Ny1mYjUwZTljNzdjN2IiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYzRlNmY4NmMtNWE3Zi00ZmJmLTk3ODgtYTc2MzcxOWQ0ZWI2LTIwNDQ0ODc5NSIsInN1Ym5hbWUiOiIxNTViM2MwNC0zZTk0LTQzYWUtOTg4Ny1mYjUwZTljNzdjN2IiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLWhhcHJveHkuZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIvcmVhbG1zL3Jvb3QvcmVhbG1zL2FscGhhIiwidG9rZW5OYW1lIjoiYWNjZXNzX3Rva2VuIiwidG9rZW5fdHlwZSI6IkJlYXJlciIsImF1dGhHcmFudElkIjoiSzRPX2ZQNFo2YmFFeEd5NzlEeVpTU1o0c1I0Iiwibm9uY2UiOiIxMjM0IiwiY2xpZW50X2lkIjoiZW5kVXNlclVJQ2xpZW50IiwiYXVkIjoiZW5kVXNlclVJQ2xpZW50IiwibmJmIjoxNzU4NTIwNjI4LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsib3BlbmlkIiwiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzU4NTIwNjI4LCJyZWFsbSI6Ii9hbHBoYSIsImV4cCI6MTc1ODUyNDIyOCwiaWF0IjoxNzU4NTIwNjI4LCJleHBpcmVzX2luIjozNjAwLCJqdGkiOiJqWVdrVERkS2VrdG0tM3paR01XUlJVWFlPN0UifQ.0CMlQM81f3fheYRZp6D3BsAgMOYJQBOalfBb5dt0D9A, username -> user.5402276, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiIxNTViM2MwNC0zZTk0LTQzYWUtOTg4Ny1mYjUwZTljNzdjN2IiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYzRlNmY4NmMtNWE3Zi00ZmJmLTk3ODgtYTc2MzcxOWQ0ZWI2LTIwNDQ1MDY0OSIsInN1Ym5hbWUiOiIxNTViM2MwNC0zZTk0LTQzYWUtOTg4Ny1mYjUwZTljNzdjN2IiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLWhhcHJveHkuZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIvcmVhbG1zL3Jvb3QvcmVhbG1zL2FscGhhIiwidG9rZW5OYW1lIjoiYWNjZXNzX3Rva2VuIiwidG9rZW5fdHlwZSI6IkJlYXJlciIsImF1dGhHcmFudElkIjoiTkRqOG5yRDNPdjlnMkdFUU8xZ1RJcE9nak04Iiwibm9uY2UiOiIxMjM0IiwiY2xpZW50X2lkIjoiZW5kVXNlclVJQ2xpZW50IiwiYXVkIjoiZW5kVXNlclVJQ2xpZW50IiwibmJmIjoxNzU4NTIwNjI5LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzU4NTIwNjI4LCJyZWFsbSI6Ii9hbHBoYSIsImV4cCI6MTc1ODUyNDIyOSwiaWF0IjoxNzU4NTIwNjI5LCJleHBpcmVzX2luIjozNjAwLCJqdGkiOiJrVVpSRGNhVFcwMG1KYUtJVlZRUzNOczR3TlkifQ.TqBxbTryeIESzSXArVT91Qu147WPFocKauoT1y6ZLKM, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@22d79c5a, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, authcode -> yIILst-QEKiAVjWdjMgjI5ckI30, callbacks -> {"tokenId":"ZFt3YZ3nl6GCHU7Em3KPGvAPoRo.*AAJTSQACMDIAAlNLABxyUndobjcyM05YdkN6S1FVTjVBS2ErRWUwQmc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758520628708), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=ZFt3YZ3nl6GCHU7Em3KPGvAPoRo.*AAJTSQACMDIAAlNLABxyUndobjcyM05YdkN6S1FVTjVBS2ErRWUwQmc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758520628708))), user_uuid -> 155b3c04-3e94-43ae-9887-fb50e9c77c7b, password -> Pa_ssw0rd, challenge -> T5sXsNIr21IYxNMSfQiInQ8rPzHGp02Kih1quPyd4V0, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, fake-ip -> 33.123.176.14, verifier -> LTU1MTcwMjY5MzU1MTQzMTg5OTY, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@6ee755c3, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@5fd6957, tokenId -> ZFt3YZ3nl6GCHU7Em3KPGvAPoRo.*AAJTSQACMDIAAlNLABxyUndobjcyM05YdkN6S1FVTjVBS2ErRWUwQmc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@1eb6749b) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/openidm/privilege?_action=listPrivileges headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiIxNTViM2MwNC0zZTk0LTQzYWUtOTg4Ny1mYjUwZTljNzdjN2IiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYzRlNmY4NmMtNWE3Zi00ZmJmLTk3ODgtYTc2MzcxOWQ0ZWI2LTIwNDQ1MDY0OSIsInN1Ym5hbWUiOiIxNTViM2MwNC0zZTk0LTQzYWUtOTg4Ny1mYjUwZTljNzdjN2IiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLWhhcHJveHkuZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIvcmVhbG1zL3Jvb3QvcmVhbG1zL2FscGhhIiwidG9rZW5OYW1lIjoiYWNjZXNzX3Rva2VuIiwidG9rZW5fdHlwZSI6IkJlYXJlciIsImF1dGhHcmFudElkIjoiTkRqOG5yRDNPdjlnMkdFUU8xZ1RJcE9nak04Iiwibm9uY2UiOiIxMjM0IiwiY2xpZW50X2lkIjoiZW5kVXNlclVJQ2xpZW50IiwiYXVkIjoiZW5kVXNlclVJQ2xpZW50IiwibmJmIjoxNzU4NTIwNjI5LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzU4NTIwNjI4LCJyZWFsbSI6Ii9hbHBoYSIsImV4cCI6MTc1ODUyNDIyOSwiaWF0IjoxNzU4NTIwNjI5LCJleHBpcmVzX2luIjozNjAwLCJqdGkiOiJrVVpSRGNhVFcwMG1KYUtJVlZRUzNOczR3TlkifQ.TqBxbTryeIESzSXArVT91Qu147WPFocKauoT1y6ZLKM Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=ZFt3YZ3nl6GCHU7Em3KPGvAPoRo.*AAJTSQACMDIAAlNLABxyUndobjcyM05YdkN6S1FVTjVBS2ErRWUwQmc9AAR0eXBlAANDVFMAAlMxAAIwMQ..* origin: https://openam-perf-haproxy.forgeblocks.com host: openam-perf-haproxy.forgeblocks.com content-length: 0 cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=ZFt3YZ3nl6GCHU7Em3KPGvAPoRo.*AAJTSQACMDIAAlNLABxyUndobjcyM05YdkN6S1FVTjVBS2ErRWUwQmc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1435113: j.i.IOException: Premature close 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'loginTreeWorkflow_restLoginInitiate' failed for user 1435151: j.i.IOException: Premature close 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: userRestlogin: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1435113,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@35176d79, username -> user.2686417, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@4b20578a, password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@5b7ea70d) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: Content-Type: apppliation/json Accept-API-Version: resource=2.0, protocol=1.0 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 X-OpenAM-Username: user.2686417 X-OpenAM-Password: Pa_ssw0rd accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.287 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 06:57:09.287 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: loginTreeWorkflow_restLoginInitiate: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1435151,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, username -> user.2339172, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@7960f9c7, fake-user-agent -> Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 93.247.105.81, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4048e4a1),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login headers: accept: application/json content-type: application/json user-agent: Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 X-Forwarded-For: 93.247.105.81 host: openam-perf-haproxy.forgeblocks.com content-length: 0 body:StringChunksRequestBody{charset=UTF-8, content=} ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.287 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 06:57:09.288 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 06:57:09.288 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'userRestlogin' failed for user 1435135: j.i.IOException: Premature close 06:57:09.288 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: userRestlogin: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1435135,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@41b66edc, username -> user.2416733, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@17a75454, password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007b20746a07a0@35167d8c,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: Content-Type: apppliation/json Accept-API-Version: resource=2.0, protocol=1.0 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 X-OpenAM-Username: user.2416733 X-OpenAM-Password: Pa_ssw0rd accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 06:57:09.288 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 2025-09-22 06:57:09,388 INFO Gatling simulation run ended successfully 2025-09-22 06:57:09,388 DEBUG No archive name provided. No archive will be created ________________________________________________________________________________ [2025-09-22 05:57:30] benchmark-400 show_stderr : Display stderr order ________________________________________________________________________________ 2025-09-22 05:57:30,378 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt is small (0 lines), printing all lines: 2025-09-22 05:57:30,378 INFO ----- output ----- ________________________________________________________________________________ [2025-09-22 05:57:30] benchmark-400 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-09-22 05:57:30] benchmark-400 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-09-22 05:57:30] benchmark-400 post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped