--Task-- name: benchmark-400 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-300'] preceding_task: benchmark-300 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 400} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock 2025-09-19 19:38:29,609 INFO 2025-09-19 19:38:29,609 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-19 19:38:29,609 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-19 19:38:29,889 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-19 19:38:29,889 INFO [loop_until]: OK (rc = 0) 2025-09-19 19:38:29,889 DEBUG --- stdout --- 2025-09-19 19:38:29,889 DEBUG overseer-0-57d79d468-khs5t 2025-09-19 19:38:29,889 DEBUG --- stderr --- 2025-09-19 19:38:29,889 DEBUG 2025-09-19 19:38:29,889 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-09-19 19:38:29 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-09-19 19:38:29 - INFO: timeout was calculated based on simulation duration parameter 2025-09-19 19:38:29 - INFO: Interval for this Task has changed to 2m (120 seconds) 2025-09-19 19:38:29 - INFO: interval was set to Task default because it was unset, based on self.timeout value because task is allowed to stop by itself Pod log file : /results/orders/benchmark-400/stdout.txt Pod log : /results/orders/benchmark-400 ________________________________________________________________________________ [2025-09-19 19:38:29] benchmark-400 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-haproxy" --results-folder="/results/gatling/benchmark-400" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-09-19 19:38:29] benchmark-400 create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json { "name": "benchmark-400", "command": " /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-haproxy\" --results-folder=\"/results/gatling/benchmark-400\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-400" } ________________________________________________________________________________ [2025-09-19 19:38:29] benchmark-400 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-09-19 19:38:29,898 INFO 2025-09-19 19:38:29,898 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-09-19 19:38:29,898 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-09-19 19:38:30,106 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 19:38:30,106 INFO [loop_until]: OK (rc = 0) 2025-09-19 19:38:30,106 DEBUG --- stdout --- 2025-09-19 19:38:30,107 DEBUG WAITING 2025-09-19 19:38:30,107 DEBUG --- stderr --- 2025-09-19 19:38:30,107 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 35 0 --:--:-- --:--:-- --:--:-- 35 ________________________________________________________________________________ [2025-09-19 19:38:30] benchmark-400 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-09-19 19:38:30,107 INFO 2025-09-19 19:38:30,107 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-19 19:38:30,107 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-19 19:38:30,392 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-19 19:38:30,392 INFO [loop_until]: OK (rc = 0) 2025-09-19 19:38:30,392 DEBUG --- stdout --- 2025-09-19 19:38:30,392 DEBUG overseer-0-57d79d468-khs5t 2025-09-19 19:38:30,393 DEBUG --- stderr --- 2025-09-19 19:38:30,393 DEBUG 2025-09-19 19:38:30,393 INFO 2025-09-19 19:38:30,393 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json overseer-0-57d79d468-khs5t:/results/orders/order.json 2025-09-19 19:38:30,393 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-19 19:38:31,327 INFO [loop_until]: OK (rc = 0) 2025-09-19 19:38:31,327 DEBUG --- stdout --- 2025-09-19 19:38:31,327 DEBUG 2025-09-19 19:38:31,327 DEBUG --- stderr --- 2025-09-19 19:38:31,327 DEBUG Order has been successfully forwarded to overseer 2025-09-19 19:38:31 - INFO: Check if Gatling simulation started successfully 2025-09-19 19:38:31,327 INFO 2025-09-19 19:38:31,327 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- head --lines 5000 /results/orders/benchmark-400/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-09-19 19:38:31,327 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-09-19 19:38:31,877 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-19 19:38:37,577 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-19 19:38:43,175 INFO [loop_until]: Function succeeded after 11s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-19 19:38:48,720 INFO [loop_until]: Function succeeded after 17s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-19 19:38:54,279 INFO [loop_until]: Function succeeded after 22s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-19 19:38:59,969 INFO [loop_until]: Function succeeded after 28s (rc=0) - expected pattern found 2025-09-19 19:38:59,969 INFO [loop_until]: OK (rc = 0) 2025-09-19 19:38:59,969 DEBUG --- stdout --- 2025-09-19 19:38:59,969 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input string (509 lines): 2025-09-19 19:38:59,969 DEBUG ----- output ----- 2025-09-19 20:38:33,644 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp85q473fg 2025-09-19 20:38:33,648 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 20:38:54.921 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 20:38:54.933 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@37191542, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@3ef7ca12, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, dd546c78-dbdc-4aca-8227-630c571555b9 -> 0),KO,List(ExitOnCompleteLoopBlock(dd546c78-dbdc-4aca-8227-630c571555b9)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@701de9b7,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Fri, 19 Sep 2025 19:38:54 GMT x-forgerock-transactionid: a9abf6b4-031d-45b8-941d-1c94e005fa63 strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 20:38:54.936 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 20:38:55.004 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.004 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.171 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.171 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.338 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.505 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.506 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.673 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.673 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.685 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.686 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.773 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.774 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.823 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.824 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.836 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.837 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.874 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.874 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.876 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:55.924 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.925 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.974 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.975 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.990 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:56.024 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:56.024 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.024 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.074 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.075 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.125 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.125 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.174 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.175 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.224 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.225 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.274 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.275 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.324 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.325 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.340 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:56.374 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.375 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.424 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.425 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.426 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined [...] 20:38:59.485 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.485 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.502 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.502 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.516 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:59.519 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.519 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.535 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.535 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.548 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:59.552 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.552 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.569 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.569 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.585 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.585 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.602 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.603 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.619 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.619 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.635 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.635 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.645 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:59.652 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.653 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one ================================================================================ 2025-09-19 19:38:59 GMT 5s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=1030 KO=1 ) > authAsPolicyAdmin (OK=0 KO=1 ) > restLoginInitiate (OK=99 KO=0 ) > restLoginUsernamePasswordCallback (OK=31 KO=0 ) > UI-Post-Login - stage 1 (OK=31 KO=0 ) > UI-Post-Login - stage 1 Redirect 1 (OK=31 KO=0 ) > UI AM idFromSession (OK=31 KO=0 ) > UI AM validateGoto (OK=31 KO=0 ) > User Authorize PKCE stage (OK=59 KO=0 ) > User AccessToken PKCE stage (OK=58 KO=0 ) > UI-Post-Login - stage 2 (OK=29 KO=0 ) > UI-Post-Login - stage 2 Redirect 1 (OK=29 KO=0 ) > UI Enduser appAuthHelper1 (OK=29 KO=0 ) > UI Enduser appAuthHelper2 (OK=29 KO=0 ) > UI-Post-Login - stage 3 (OK=28 KO=0 ) > UI-Post-Login - stage 3 Redirect 1 (OK=28 KO=0 ) > UI IDM uiconfig (OK=27 KO=0 ) > UI Enduser sessioncheck (OK=27 KO=0 ) > userRestlogin (OK=51 KO=0 ) > UI IDM version (OK=27 KO=0 ) > UI IDM features (OK=27 KO=0 ) > UI IDM privilege (OK=27 KO=0 ) > UI IDM login (OK=27 KO=0 ) > UI IDM managed user schema (OK=27 KO=0 ) > UI IDM dashboard (OK=27 KO=0 ) > UI IDM user (OK=27 KO=0 ) > UI IDM oidcToken (OK=26 KO=0 ) > userinfo (OK=26 KO=0 ) > UI-Logout (OK=25 KO=0 ) > UI-Logout Redirect 1 (OK=24 KO=0 ) > UI AM revoke1 (OK=24 KO=0 ) > UI AM revoke2 (OK=24 KO=0 ) > UI AM endsession (OK=24 KO=0 ) > loginTreeWorkflow_restLoginInitiate (OK=10 KO=0 ) > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=10 KO=0 ) ---- Errors -------------------------------------------------------------------- > EvalPolicy: No attribute named 'tokenIdCookieName' is defined 51 (98.08%) > status.find.in([200, 209], 304), found 401 1 ( 1.92%) ---- getToken ------------------------------------------------------------------ [--------------------------------------------------------------------------] 0% waiting: 0 / active: 1 / done: 0 ---- idc.benchmark.Mix2024 ----------------------------------------------------- [- ] 0% waiting: 1446258 / active: 13 / done: 153 ================================================================================ 20:38:59.668 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.668 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.681 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.681 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.686 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:59.686 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:59.695 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.696 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.708 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.708 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.722 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.735 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.735 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.748 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:59.749 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.749 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.762 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.763 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.776 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.776 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:59.780 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:59.789 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:59.789 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 2025-09-19 19:38:59,969 DEBUG --- stderr --- 2025-09-19 19:38:59,969 DEBUG ________________________________________________________________________________ [2025-09-19 19:38:59] benchmark-400 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 01s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 02s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 03s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 04s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 05s, retry Order is running since 44m 05s, retry Order is running since 46m 06s, retry Order is running since 48m 06s, retry Order is running since 50m 06s, retry Order is running since 52m 06s, retry Order is running since 54m 07s, retry Order is running since 56m 07s, retry Order is running since 58m 07s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-09-19 20:39:08] benchmark-400 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-09-19 20:39:08,037 INFO 2025-09-19 20:39:08,037 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-19 20:39:08,037 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-19 20:39:08,358 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-19 20:39:08,358 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:08,358 DEBUG --- stdout --- 2025-09-19 20:39:08,358 DEBUG overseer-0-57d79d468-khs5t 2025-09-19 20:39:08,358 DEBUG --- stderr --- 2025-09-19 20:39:08,358 DEBUG 2025-09-19 20:39:08,358 INFO 2025-09-19 20:39:08,358 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- rm -f /results/orders/order.json 2025-09-19 20:39:08,358 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-19 20:39:08,957 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:08,957 DEBUG --- stdout --- 2025-09-19 20:39:08,957 DEBUG 2025-09-19 20:39:08,957 DEBUG --- stderr --- 2025-09-19 20:39:08,957 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-09-19 20:39:08] benchmark-400 download_logs : Download individual order files ________________________________________________________________________________ 2025-09-19 20:39:08 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/order.json 2025-09-19 20:39:08,957 INFO 2025-09-19 20:39:08,957 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-19 20:39:08,958 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-19 20:39:09,241 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-19 20:39:09,241 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:09,241 DEBUG --- stdout --- 2025-09-19 20:39:09,241 DEBUG overseer-0-57d79d468-khs5t 2025-09-19 20:39:09,241 DEBUG --- stderr --- 2025-09-19 20:39:09,241 DEBUG Checking if file exists on pod 'overseer-0-57d79d468-khs5t', wait max 3 minutes if not. 2025-09-19 20:39:09,242 INFO 2025-09-19 20:39:09,242 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- bash -c 'if [ -f "/results/orders/benchmark-400/rc.txt" ]; then echo "/results/orders/benchmark-400/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-400/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/rc.txt file found" 2025-09-19 20:39:09,242 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-19 20:39:09,785 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 20:39:09,786 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:09,786 DEBUG --- stdout --- 2025-09-19 20:39:09,786 DEBUG /results/orders/benchmark-400/rc.txt file found 2025-09-19 20:39:09,786 DEBUG --- stderr --- 2025-09-19 20:39:09,786 DEBUG 2025-09-19 20:39:09,786 INFO 2025-09-19 20:39:09,786 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- du -k /results/orders/benchmark-400/rc.txt | grep "^\d+ .+$" 2025-09-19 20:39:09,786 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-19 20:39:10,339 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 20:39:10,340 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:10,340 DEBUG --- stdout --- 2025-09-19 20:39:10,340 DEBUG 4 /results/orders/benchmark-400/rc.txt 2025-09-19 20:39:10,340 DEBUG --- stderr --- 2025-09-19 20:39:10,340 DEBUG - Download file (size 4kB) source : /results/orders/benchmark-400/rc.txt @ overseer-0-57d79d468-khs5t destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt 2025-09-19 20:39:10,340 INFO 2025-09-19 20:39:10,340 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-57d79d468-khs5t:/results/orders/benchmark-400/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt 2025-09-19 20:39:10,340 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-19 20:39:10,879 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:10,880 DEBUG --- stdout --- 2025-09-19 20:39:10,880 DEBUG tar: Removing leading `/' from member names 2025-09-19 20:39:10,880 DEBUG --- stderr --- 2025-09-19 20:39:10,880 DEBUG 2025-09-19 20:39:10,880 INFO 2025-09-19 20:39:10,880 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-19 20:39:10,880 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-19 20:39:11,168 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-19 20:39:11,168 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:11,168 DEBUG --- stdout --- 2025-09-19 20:39:11,168 DEBUG overseer-0-57d79d468-khs5t 2025-09-19 20:39:11,168 DEBUG --- stderr --- 2025-09-19 20:39:11,168 DEBUG Checking if file exists on pod 'overseer-0-57d79d468-khs5t', wait max 3 minutes if not. 2025-09-19 20:39:11,169 INFO 2025-09-19 20:39:11,169 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- bash -c 'if [ -f "/results/orders/benchmark-400/stderr.txt" ]; then echo "/results/orders/benchmark-400/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-400/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/stderr.txt file found" 2025-09-19 20:39:11,169 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-19 20:39:11,715 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 20:39:11,715 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:11,715 DEBUG --- stdout --- 2025-09-19 20:39:11,715 DEBUG /results/orders/benchmark-400/stderr.txt file found 2025-09-19 20:39:11,715 DEBUG --- stderr --- 2025-09-19 20:39:11,715 DEBUG 2025-09-19 20:39:11,715 INFO 2025-09-19 20:39:11,715 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- du -k /results/orders/benchmark-400/stderr.txt | grep "^\d+ .+$" 2025-09-19 20:39:11,715 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-19 20:39:12,273 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 20:39:12,273 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:12,273 DEBUG --- stdout --- 2025-09-19 20:39:12,273 DEBUG 0 /results/orders/benchmark-400/stderr.txt 2025-09-19 20:39:12,273 DEBUG --- stderr --- 2025-09-19 20:39:12,274 DEBUG - Download file (size 0B) source : /results/orders/benchmark-400/stderr.txt @ overseer-0-57d79d468-khs5t destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt 2025-09-19 20:39:12,274 INFO 2025-09-19 20:39:12,274 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-57d79d468-khs5t:/results/orders/benchmark-400/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt 2025-09-19 20:39:12,274 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-19 20:39:12,818 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:12,818 DEBUG --- stdout --- 2025-09-19 20:39:12,818 DEBUG tar: Removing leading `/' from member names 2025-09-19 20:39:12,818 DEBUG --- stderr --- 2025-09-19 20:39:12,818 DEBUG 2025-09-19 20:39:12,818 INFO 2025-09-19 20:39:12,818 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-19 20:39:12,818 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-19 20:39:13,104 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-19 20:39:13,104 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:13,104 DEBUG --- stdout --- 2025-09-19 20:39:13,104 DEBUG overseer-0-57d79d468-khs5t 2025-09-19 20:39:13,104 DEBUG --- stderr --- 2025-09-19 20:39:13,104 DEBUG Checking if file exists on pod 'overseer-0-57d79d468-khs5t', wait max 3 minutes if not. 2025-09-19 20:39:13,105 INFO 2025-09-19 20:39:13,105 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- bash -c 'if [ -f "/results/orders/benchmark-400/stdout.txt" ]; then echo "/results/orders/benchmark-400/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-400/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/stdout.txt file found" 2025-09-19 20:39:13,105 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-19 20:39:13,643 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 20:39:13,643 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:13,643 DEBUG --- stdout --- 2025-09-19 20:39:13,643 DEBUG /results/orders/benchmark-400/stdout.txt file found 2025-09-19 20:39:13,643 DEBUG --- stderr --- 2025-09-19 20:39:13,643 DEBUG 2025-09-19 20:39:13,643 INFO 2025-09-19 20:39:13,643 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- du -k /results/orders/benchmark-400/stdout.txt | grep "^\d+ .+$" 2025-09-19 20:39:13,643 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-19 20:39:14,208 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 20:39:14,208 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:14,208 DEBUG --- stdout --- 2025-09-19 20:39:14,208 DEBUG 595048 /results/orders/benchmark-400/stdout.txt 2025-09-19 20:39:14,208 DEBUG --- stderr --- 2025-09-19 20:39:14,208 DEBUG - Download file (size 595.048MB exceeds limit of 100MB, only first 1000 and last 1000 lines will be downloaded) source : /results/orders/benchmark-400/stdout.txt @ overseer-0-57d79d468-khs5t destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stdout.txt 2025-09-19 20:39:14,208 INFO 2025-09-19 20:39:14,208 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- head -n 1000 /results/orders/benchmark-400/stdout.txt 2025-09-19 20:39:14,943 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-09-19 20:39:14,943 DEBUG --- stdout --- 2025-09-19 20:39:14,943 DEBUG [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (1000 lines): 2025-09-19 20:39:14,943 DEBUG ----- output ----- 2025-09-19 20:38:33,644 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp85q473fg 2025-09-19 20:38:33,648 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 20:38:54.921 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 20:38:54.933 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@37191542, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@3ef7ca12, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, dd546c78-dbdc-4aca-8227-630c571555b9 -> 0),KO,List(ExitOnCompleteLoopBlock(dd546c78-dbdc-4aca-8227-630c571555b9)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@701de9b7,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Fri, 19 Sep 2025 19:38:54 GMT x-forgerock-transactionid: a9abf6b4-031d-45b8-941d-1c94e005fa63 strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 20:38:54.936 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 20:38:55.004 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.004 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.171 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.171 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.338 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.505 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.506 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.673 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.673 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.685 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.686 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.773 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.774 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.823 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.824 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.836 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.837 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.874 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.874 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.876 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:55.924 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.925 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.974 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.975 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.990 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:56.024 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined [...] 20:39:01.738 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.738 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.748 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.749 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.758 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.758 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.766 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:01.768 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.768 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.778 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.778 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.787 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:01.788 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.788 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.791 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:01.798 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.798 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.808 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.808 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.818 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.818 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.828 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.828 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.838 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.838 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.848 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.849 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.858 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.859 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.868 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:01.868 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.868 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.878 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.878 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.888 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.888 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.895 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:01.898 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.898 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.908 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.909 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.918 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.919 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.928 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.929 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.932 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:01.938 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.939 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.948 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.948 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.955 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:01.958 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.959 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.968 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.969 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.978 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.979 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.988 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:01.988 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.988 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:01.998 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:01.999 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:02.007 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:02.008 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:02.009 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:02.018 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:02.019 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:02.028 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:02.029 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:02.038 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:02.039 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:02.048 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:02.049 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:02.053 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:39:02.058 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:02.059 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:02.068 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:02.069 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:39:02.078 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:39:02.079 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 2025-09-19 20:39:14,943 DEBUG --- stderr --- 2025-09-19 20:39:14,943 DEBUG 2025-09-19 20:39:14,943 INFO 2025-09-19 20:39:14,943 INFO 2025-09-19 20:39:14,944 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- tail -n 1000 /results/orders/benchmark-400/stdout.txt 2025-09-19 20:39:15,635 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-09-19 20:39:15,635 DEBUG --- stdout --- 2025-09-19 20:39:15,635 DEBUG [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (1000 lines): 2025-09-19 20:39:15,635 DEBUG ----- output ----- > UI IDM features (OK=307551 KO=0 ) > UI IDM privilege (OK=307546 KO=5 ) > UI IDM login (OK=307546 KO=5 ) > UI IDM managed user schema (OK=307551 KO=0 ) > UI IDM dashboard (OK=307550 KO=1 ) > UI IDM user (OK=307549 KO=1 ) > UI IDM oidcToken (OK=307548 KO=6 ) > userinfo (OK=307542 KO=0 ) > UI-Logout (OK=307549 KO=0 ) > UI-Logout Redirect 1 (OK=307547 KO=0 ) > UI AM revoke1 (OK=307529 KO=0 ) > UI AM revoke2 (OK=307530 KO=3 ) > UI AM endsession (OK=307531 KO=2 ) > loginTreeWorkflow_restLoginInitiate (OK=51171 KO=0 ) > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=51171 KO=0 ) > restloginProgressiveProfileCallback (OK=3672 KO=0 ) > loginTreeWorkflow_restloginProgressiveProfileCallback (OK=599 KO=0 ) ---- Errors -------------------------------------------------------------------- > EvalPolicy: No attribute named 'tokenIdCookieName' is defined 461292 (98.83%) > jsonPath($.tokenId).find.exists, found nothing 5369 ( 1.15%) > status.find.in([200, 209], 304), found 502 21 ( 0.00%) > i.n.c.ConnectTimeoutException: connection timed out after 1000 14 ( 0.00%) 0 ms: openam-perf-haproxy.forgeblocks.com/34.120.144.60:443 > userinfo: No attribute named 'access_token' is defined 9 ( 0.00%) > UI AM revoke1: No attribute named 'access_token' is defined 9 ( 0.00%) > status.find.in([200, 209], 304), found 401 8 ( 0.00%) > headerRegex((location,#id_token=(.*))).find.exists, found noth 6 ( 0.00%) ing > UI AM revoke2: No attribute named 'access_token_2' is defined 6 ( 0.00%) > UI AM endsession: No attribute named 'id_token_2' is defined 6 ( 0.00%) > i.n.h.s.SslHandshakeTimeoutException: handshake timed out afte 4 ( 0.00%) r 10000ms > status.find.is(200), but actually found 502 4 ( 0.00%) > Request timeout to openam-perf-haproxy.forgeblocks.com/34.120. 3 ( 0.00%) 144.60:443 after 60000 ms > status.find.is(302), but actually found 502 1 ( 0.00%) ---- getToken ------------------------------------------------------------------ [--------------------------------------------------------------------------] 0% waiting: 0 / active: 1 / done: 0 ---- idc.benchmark.Mix2024 ----------------------------------------------------- [#########################################################################-] 99% waiting: 12135 / active: 119 / done: 1434170 ================================================================================ ================================================================================ 2025-09-19 20:38:54 GMT 3600s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=11018772 KO=5430 ) > authAsPolicyAdmin (OK=0 KO=2 ) > restLoginInitiate (OK=921786 KO=9 ) > restLoginUsernamePasswordCallback (OK=307607 KO=2 ) > UI-Post-Login - stage 1 (OK=307611 KO=0 ) > UI-Post-Login - stage 1 Redirect 1 (OK=307608 KO=0 ) > UI AM idFromSession (OK=307598 KO=7 ) > UI AM validateGoto (OK=307600 KO=4 ) > User Authorize PKCE stage (OK=615152 KO=1 ) > User AccessToken PKCE stage (OK=615140 KO=2 ) > UI-Post-Login - stage 2 (OK=307583 KO=0 ) > UI-Post-Login - stage 2 Redirect 1 (OK=307577 KO=2 ) > UI Enduser appAuthHelper1 (OK=307572 KO=1 ) > UI Enduser appAuthHelper2 (OK=307572 KO=1 ) > UI-Post-Login - stage 3 (OK=307558 KO=0 ) > UI-Post-Login - stage 3 Redirect 1 (OK=307554 KO=0 ) > UI IDM uiconfig (OK=307552 KO=1 ) > UI Enduser sessioncheck (OK=307552 KO=0 ) > userRestlogin (OK=455918 KO=5374 ) > UI IDM version (OK=307550 KO=1 ) > UI IDM features (OK=307551 KO=0 ) > UI IDM privilege (OK=307546 KO=5 ) > UI IDM login (OK=307546 KO=5 ) > UI IDM managed user schema (OK=307551 KO=0 ) > UI IDM dashboard (OK=307550 KO=1 ) > UI IDM user (OK=307549 KO=1 ) > UI IDM oidcToken (OK=307548 KO=6 ) > userinfo (OK=307542 KO=0 ) > UI-Logout (OK=307549 KO=0 ) > UI-Logout Redirect 1 (OK=307547 KO=0 ) [...] >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginInitiate: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1434287,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, username -> user.9091646, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@336469ba, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@1c419efc),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@48a0f760,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login headers: accept: application/json content-type: application/json user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0 X-Forwarded-For: 42.42.42.42 host: openam-perf-haproxy.forgeblocks.com content-length: 0 body:StringChunksRequestBody{charset=UTF-8, content=} ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM login' failed for user 1433999: j.i.IOException: Premature close 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI IDM login: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1433999,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYzRlNmY4NmMtNWE3Zi00ZmJmLTk3ODgtYTc2MzcxOWQ0ZWI2LTY2ODg3NTUyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJFUGQzeTFkTFdIT3BMcExoSVJnaUZ4OWpoOUEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IjVVa2tvU1lvZWNKNDlJUVlrTW5WRk5UX3NHNCJ9.HbJ593ikcfr_SP3o1v2kA94X5yHDkhro9-gddTxF4gs, username -> user.9345366, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNWVlMjIzMWEtZjcyMS00ZjhkLWExNjMtNWI5N2NhOGViOTM0LTY3MDEzMjAyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRlZyRmhQZGpacmxaZWxoOWZhTmpDTW1pUlEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IkJ6WVZwdC13bEhJdGZVQjhleEp3S1phdDZCRSJ9.WbAt1l-sdm7eKdEt9NpOpOSPrdDIJRIVqJov7NOA5eY, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2810f351, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, authcode -> vFO_H8752IMD9wm7I-s1t8eH6KA, callbacks -> {"tokenId":"kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758314334103), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758314334103))), user_uuid -> a5cfb416-37fe-4b03-8485-ae02a7be88a0, password -> Pa_ssw0rd, challenge -> ZZzpe0ZrB1OgX1icQH89Fp2tePGd2EIsLpAAHaarUs8, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, fake-ip -> 240.16.228.57, verifier -> LTcwMjE2MzY3MDk4OTQ5OTU2MQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@1b566bf9, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@68239688, tokenId -> kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@48a0f760,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/openidm/authentication?_action=login headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNWVlMjIzMWEtZjcyMS00ZjhkLWExNjMtNWI5N2NhOGViOTM0LTY3MDEzMjAyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRlZyRmhQZGpacmxaZWxoOWZhTmpDTW1pUlEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IkJ6WVZwdC13bEhJdGZVQjhleEp3S1phdDZCRSJ9.WbAt1l-sdm7eKdEt9NpOpOSPrdDIJRIVqJov7NOA5eY Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..* origin: https://openam-perf-haproxy.forgeblocks.com host: openam-perf-haproxy.forgeblocks.com content-length: 0 cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM features' failed for user 1433999: j.i.IOException: Premature close 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI IDM features: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1433999,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYzRlNmY4NmMtNWE3Zi00ZmJmLTk3ODgtYTc2MzcxOWQ0ZWI2LTY2ODg3NTUyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJFUGQzeTFkTFdIT3BMcExoSVJnaUZ4OWpoOUEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IjVVa2tvU1lvZWNKNDlJUVlrTW5WRk5UX3NHNCJ9.HbJ593ikcfr_SP3o1v2kA94X5yHDkhro9-gddTxF4gs, username -> user.9345366, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNWVlMjIzMWEtZjcyMS00ZjhkLWExNjMtNWI5N2NhOGViOTM0LTY3MDEzMjAyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRlZyRmhQZGpacmxaZWxoOWZhTmpDTW1pUlEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IkJ6WVZwdC13bEhJdGZVQjhleEp3S1phdDZCRSJ9.WbAt1l-sdm7eKdEt9NpOpOSPrdDIJRIVqJov7NOA5eY, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2810f351, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, authcode -> vFO_H8752IMD9wm7I-s1t8eH6KA, callbacks -> {"tokenId":"kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758314334103), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758314334103))), user_uuid -> a5cfb416-37fe-4b03-8485-ae02a7be88a0, password -> Pa_ssw0rd, challenge -> ZZzpe0ZrB1OgX1icQH89Fp2tePGd2EIsLpAAHaarUs8, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, fake-ip -> 240.16.228.57, verifier -> LTcwMjE2MzY3MDk4OTQ5OTU2MQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@1b566bf9, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@68239688, tokenId -> kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@48a0f760,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: GET https://openam-perf-haproxy.forgeblocks.com/openidm/info/features?_queryFilter=true headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNWVlMjIzMWEtZjcyMS00ZjhkLWExNjMtNWI5N2NhOGViOTM0LTY3MDEzMjAyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRlZyRmhQZGpacmxaZWxoOWZhTmpDTW1pUlEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IkJ6WVZwdC13bEhJdGZVQjhleEp3S1phdDZCRSJ9.WbAt1l-sdm7eKdEt9NpOpOSPrdDIJRIVqJov7NOA5eY Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..* host: openam-perf-haproxy.forgeblocks.com cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 21:38:54.672 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 21:38:54.672 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 21:38:54.674 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 21:38:54.674 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 21:38:54.677 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 21:38:54.677 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 2025-09-19 21:38:54,786 INFO Gatling simulation run ended successfully 2025-09-19 21:38:54,786 DEBUG No archive name provided. No archive will be created 2025-09-19 20:39:15,635 DEBUG --- stderr --- 2025-09-19 20:39:15,635 DEBUG 2025-09-19 20:39:15,635 INFO ________________________________________________________________________________ [2025-09-19 20:39:15] benchmark-400 show_cmd : Display order command ________________________________________________________________________________ 2025-09-19 20:39:15,636 INFO 2025-09-19 20:39:15,636 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-19 20:39:15,636 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-19 20:39:15,918 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-19 20:39:15,918 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:15,918 DEBUG --- stdout --- 2025-09-19 20:39:15,918 DEBUG overseer-0-57d79d468-khs5t 2025-09-19 20:39:15,918 DEBUG --- stderr --- 2025-09-19 20:39:15,918 DEBUG Checking if file exists on pod 'overseer-0-57d79d468-khs5t', wait max 3 minutes if not. 2025-09-19 20:39:15,919 INFO 2025-09-19 20:39:15,919 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- bash -c 'if [ -f "/results/orders/benchmark-400/cmd.txt" ]; then echo "/results/orders/benchmark-400/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-400/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-400/cmd.txt file found" 2025-09-19 20:39:15,919 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-19 20:39:16,470 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 20:39:16,470 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:16,470 DEBUG --- stdout --- 2025-09-19 20:39:16,470 DEBUG /results/orders/benchmark-400/cmd.txt file found 2025-09-19 20:39:16,470 DEBUG --- stderr --- 2025-09-19 20:39:16,470 DEBUG 2025-09-19 20:39:16,471 INFO 2025-09-19 20:39:16,471 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-57d79d468-khs5t -- du -k /results/orders/benchmark-400/cmd.txt | grep "^\d+ .+$" 2025-09-19 20:39:16,471 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-19 20:39:17,028 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-19 20:39:17,028 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:17,028 DEBUG --- stdout --- 2025-09-19 20:39:17,028 DEBUG 4 /results/orders/benchmark-400/cmd.txt 2025-09-19 20:39:17,028 DEBUG --- stderr --- 2025-09-19 20:39:17,028 DEBUG - Download file (size 4kB) source : /results/orders/benchmark-400/cmd.txt @ overseer-0-57d79d468-khs5t destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt 2025-09-19 20:39:17,029 INFO 2025-09-19 20:39:17,029 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-57d79d468-khs5t:/results/orders/benchmark-400/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt 2025-09-19 20:39:17,029 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-19 20:39:17,564 INFO [loop_until]: OK (rc = 0) 2025-09-19 20:39:17,564 DEBUG --- stdout --- 2025-09-19 20:39:17,564 DEBUG tar: Removing leading `/' from member names 2025-09-19 20:39:17,564 DEBUG --- stderr --- 2025-09-19 20:39:17,564 DEBUG 2025-09-19 20:39:17,564 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/cmd.txt is small (1 lines), printing all lines: 2025-09-19 20:39:17,564 INFO ----- output ----- /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-haproxy" --results-folder="/results/gatling/benchmark-400" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-09-19 20:39:17] benchmark-400 show_rc : Display rc order ________________________________________________________________________________ 2025-09-19 20:39:17,564 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/rc.txt is small (1 lines), printing all lines: 2025-09-19 20:39:17,564 INFO ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2025-09-19 20:39:17] benchmark-400 show_stdout : Display stdout order ________________________________________________________________________________ 2025-09-19 20:39:17,565 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stdout.txt is 2010 lines): 2025-09-19 20:39:17,565 INFO ----- output ----- NOTE: This file was too big so it was truncated. Only first 1000 and last 1000 lines are present. ------------------------------------------------------------ 2025-09-19 20:38:33,644 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp85q473fg 2025-09-19 20:38:33,648 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-400" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=400 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 20:38:54.921 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 20:38:54.933 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@37191542, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@3ef7ca12, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, dd546c78-dbdc-4aca-8227-630c571555b9 -> 0),KO,List(ExitOnCompleteLoopBlock(dd546c78-dbdc-4aca-8227-630c571555b9)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@701de9b7,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Fri, 19 Sep 2025 19:38:54 GMT x-forgerock-transactionid: a9abf6b4-031d-45b8-941d-1c94e005fa63 strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 20:38:54.936 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 20:38:55.004 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.004 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.171 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.171 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.337 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.338 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.505 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.506 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.673 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.673 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.685 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.686 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.773 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.774 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.823 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.824 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.836 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.837 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.874 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.874 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.876 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:55.924 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.925 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.974 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:55.975 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:55.990 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:56.024 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:56.024 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.024 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.074 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.075 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.125 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.125 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.174 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.175 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.224 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.225 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.274 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.275 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.324 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 20:38:56.325 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 20:38:56.340 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 20:38:56.374 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one [...] Session(idc.benchmark.Mix2024,1434291,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@62e8bc10, username -> user.6515123, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@9fa7ca6, password -> Pa_ssw0rd),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@48a0f760,io.netty.channel.epoll.EpollEventLoop@12dae582) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: Content-Type: apppliation/json Accept-API-Version: resource=2.0, protocol=1.0 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 X-OpenAM-Username: user.6515123 X-OpenAM-Password: Pa_ssw0rd accept: */* host: openam-perf-haproxy.forgeblocks.com ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 1434287: j.i.IOException: Premature close 21:38:54.671 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 21:38:54.671 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 21:38:54.671 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: restLoginInitiate: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1434287,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, username -> user.9091646, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@336469ba, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@1c419efc),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@48a0f760,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login headers: accept: application/json content-type: application/json user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0 X-Forwarded-For: 42.42.42.42 host: openam-perf-haproxy.forgeblocks.com content-length: 0 body:StringChunksRequestBody{charset=UTF-8, content=} ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM login' failed for user 1433999: j.i.IOException: Premature close 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI IDM login: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1433999,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYzRlNmY4NmMtNWE3Zi00ZmJmLTk3ODgtYTc2MzcxOWQ0ZWI2LTY2ODg3NTUyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJFUGQzeTFkTFdIT3BMcExoSVJnaUZ4OWpoOUEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IjVVa2tvU1lvZWNKNDlJUVlrTW5WRk5UX3NHNCJ9.HbJ593ikcfr_SP3o1v2kA94X5yHDkhro9-gddTxF4gs, username -> user.9345366, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNWVlMjIzMWEtZjcyMS00ZjhkLWExNjMtNWI5N2NhOGViOTM0LTY3MDEzMjAyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRlZyRmhQZGpacmxaZWxoOWZhTmpDTW1pUlEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IkJ6WVZwdC13bEhJdGZVQjhleEp3S1phdDZCRSJ9.WbAt1l-sdm7eKdEt9NpOpOSPrdDIJRIVqJov7NOA5eY, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2810f351, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, authcode -> vFO_H8752IMD9wm7I-s1t8eH6KA, callbacks -> {"tokenId":"kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758314334103), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758314334103))), user_uuid -> a5cfb416-37fe-4b03-8485-ae02a7be88a0, password -> Pa_ssw0rd, challenge -> ZZzpe0ZrB1OgX1icQH89Fp2tePGd2EIsLpAAHaarUs8, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, fake-ip -> 240.16.228.57, verifier -> LTcwMjE2MzY3MDk4OTQ5OTU2MQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@1b566bf9, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@68239688, tokenId -> kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@48a0f760,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/openidm/authentication?_action=login headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNWVlMjIzMWEtZjcyMS00ZjhkLWExNjMtNWI5N2NhOGViOTM0LTY3MDEzMjAyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRlZyRmhQZGpacmxaZWxoOWZhTmpDTW1pUlEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IkJ6WVZwdC13bEhJdGZVQjhleEp3S1phdDZCRSJ9.WbAt1l-sdm7eKdEt9NpOpOSPrdDIJRIVqJov7NOA5eY Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..* origin: https://openam-perf-haproxy.forgeblocks.com host: openam-perf-haproxy.forgeblocks.com content-length: 0 cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM features' failed for user 1433999: j.i.IOException: Premature close 21:38:54.671 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UI IDM features: KO j.i.IOException: Premature close ========================= Session: Session(idc.benchmark.Mix2024,1433999,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYzRlNmY4NmMtNWE3Zi00ZmJmLTk3ODgtYTc2MzcxOWQ0ZWI2LTY2ODg3NTUyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJFUGQzeTFkTFdIT3BMcExoSVJnaUZ4OWpoOUEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IjVVa2tvU1lvZWNKNDlJUVlrTW5WRk5UX3NHNCJ9.HbJ593ikcfr_SP3o1v2kA94X5yHDkhro9-gddTxF4gs, username -> user.9345366, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNWVlMjIzMWEtZjcyMS00ZjhkLWExNjMtNWI5N2NhOGViOTM0LTY3MDEzMjAyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRlZyRmhQZGpacmxaZWxoOWZhTmpDTW1pUlEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IkJ6WVZwdC13bEhJdGZVQjhleEp3S1phdDZCRSJ9.WbAt1l-sdm7eKdEt9NpOpOSPrdDIJRIVqJov7NOA5eY, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2810f351, gatling.http.referer -> https://openam-perf-haproxy.forgeblocks.com/am/, authcode -> vFO_H8752IMD9wm7I-s1t8eH6KA, callbacks -> {"tokenId":"kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758314334103), CookieKey(d0d18cac672abbc,openam-perf-haproxy.forgeblocks.com,/) -> StoredCookie(d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1758314334103))), user_uuid -> a5cfb416-37fe-4b03-8485-ae02a7be88a0, password -> Pa_ssw0rd, challenge -> ZZzpe0ZrB1OgX1icQH89Fp2tePGd2EIsLpAAHaarUs8, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, fake-ip -> 240.16.228.57, verifier -> LTcwMjE2MzY3MDk4OTQ5OTU2MQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@1b566bf9, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@68239688, tokenId -> kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d995c69bb38@48a0f760,io.netty.channel.epoll.EpollEventLoop@4e28bdd1) ========================= HTTP request: GET https://openam-perf-haproxy.forgeblocks.com/openidm/info/features?_queryFilter=true headers: user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 referer: https://openam-perf-haproxy.forgeblocks.com/am/ Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhNWNmYjQxNi0zN2ZlLTRiMDMtODQ4NS1hZTAyYTdiZTg4YTAiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiNWVlMjIzMWEtZjcyMS00ZjhkLWExNjMtNWI5N2NhOGViOTM0LTY3MDEzMjAyIiwic3VibmFtZSI6ImE1Y2ZiNDE2LTM3ZmUtNGIwMy04NDg1LWFlMDJhN2JlODhhMCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtaGFwcm94eS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRlZyRmhQZGpacmxaZWxoOWZhTmpDTW1pUlEiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3NTgzMTQzMzQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3NTgzMTQzMzQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzU4MzE3OTM0LCJpYXQiOjE3NTgzMTQzMzQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IkJ6WVZwdC13bEhJdGZVQjhleEp3S1phdDZCRSJ9.WbAt1l-sdm7eKdEt9NpOpOSPrdDIJRIVqJov7NOA5eY Accept-Api-Version: accept: */* cookie: amlbcookie=01; d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..* host: openam-perf-haproxy.forgeblocks.com cookies: amlbcookie=01, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None d0d18cac672abbc=kSxQgSA_JO2shdKoU8d-kEn51dM.*AAJTSQACMDIAAlNLABxHYVF0TFBjUzhsUzZ6MVVvOXdRMHFqNERITHM9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-haproxy.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 21:38:54.672 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 21:38:54.672 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 21:38:54.674 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 21:38:54.674 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 21:38:54.677 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 21:38:54.677 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 2025-09-19 21:38:54,786 INFO Gatling simulation run ended successfully 2025-09-19 21:38:54,786 DEBUG No archive name provided. No archive will be created ________________________________________________________________________________ [2025-09-19 20:39:17] benchmark-400 show_stderr : Display stderr order ________________________________________________________________________________ 2025-09-19 20:39:17,565 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-400/stderr.txt is small (0 lines), printing all lines: 2025-09-19 20:39:17,565 INFO ----- output ----- ________________________________________________________________________________ [2025-09-19 20:39:17] benchmark-400 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-09-19 20:39:17] benchmark-400 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-09-19 20:39:17] benchmark-400 post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped