--Task-- name: benchmark-10 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 10} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock 2025-09-22 00:53:56,849 INFO 2025-09-22 00:53:56,849 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 00:53:56,849 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 00:53:57,161 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 00:53:57,161 INFO [loop_until]: OK (rc = 0) 2025-09-22 00:53:57,161 DEBUG --- stdout --- 2025-09-22 00:53:57,161 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 00:53:57,161 DEBUG --- stderr --- 2025-09-22 00:53:57,161 DEBUG 2025-09-22 00:53:57,161 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-09-22 00:53:57 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-09-22 00:53:57 - INFO: timeout was calculated based on simulation duration parameter 2025-09-22 00:53:57 - INFO: Interval for this Task has changed to 2m (120 seconds) 2025-09-22 00:53:57 - INFO: interval was set to Task default because it was unset, based on self.timeout value because task is allowed to stop by itself Pod log file : /results/orders/benchmark-10/stdout.txt Pod log : /results/orders/benchmark-10 2025-09-22 00:53:57 - INFO: Get overseer pod resources requests memory 2025-09-22 00:53:57,993 INFO 2025-09-22 00:53:57,993 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-7c788db448-z46mc --output jsonpath={.spec.containers[].resources.requests.memory} 2025-09-22 00:53:57,993 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 00:53:58,292 INFO [loop_until]: OK (rc = 0) 2025-09-22 00:53:58,292 DEBUG --- stdout --- 2025-09-22 00:53:58,292 DEBUG 4Gi 2025-09-22 00:53:58,292 DEBUG --- stderr --- 2025-09-22 00:53:58,292 DEBUG ________________________________________________________________________________ [2025-09-22 00:53:58] benchmark-10 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-haproxy" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-09-22 00:53:58] benchmark-10 create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json { "name": "benchmark-10", "command": " /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-haproxy\" --results-folder=\"/results/gatling/benchmark-10\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-10" } ________________________________________________________________________________ [2025-09-22 00:53:58] benchmark-10 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-09-22 00:53:58,301 INFO 2025-09-22 00:53:58,301 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-09-22 00:53:58,301 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-09-22 00:53:58,583 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 00:53:58,584 INFO [loop_until]: OK (rc = 0) 2025-09-22 00:53:58,584 DEBUG --- stdout --- 2025-09-22 00:53:58,584 DEBUG WAITING 2025-09-22 00:53:58,584 DEBUG --- stderr --- 2025-09-22 00:53:58,584 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 25 0 --:--:-- --:--:-- --:--:-- 25 ________________________________________________________________________________ [2025-09-22 00:53:58] benchmark-10 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-09-22 00:53:58,584 INFO 2025-09-22 00:53:58,584 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 00:53:58,584 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 00:53:58,870 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 00:53:58,870 INFO [loop_until]: OK (rc = 0) 2025-09-22 00:53:58,870 DEBUG --- stdout --- 2025-09-22 00:53:58,870 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 00:53:58,870 DEBUG --- stderr --- 2025-09-22 00:53:58,870 DEBUG 2025-09-22 00:53:58,871 INFO 2025-09-22 00:53:58,871 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json overseer-0-7c788db448-z46mc:/results/orders/order.json 2025-09-22 00:53:58,871 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 00:53:59,809 INFO [loop_until]: OK (rc = 0) 2025-09-22 00:53:59,809 DEBUG --- stdout --- 2025-09-22 00:53:59,809 DEBUG 2025-09-22 00:53:59,809 DEBUG --- stderr --- 2025-09-22 00:53:59,809 DEBUG Order has been successfully forwarded to overseer 2025-09-22 00:53:59 - INFO: Check if Gatling simulation started successfully 2025-09-22 00:53:59,810 INFO 2025-09-22 00:53:59,810 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- head --lines 5000 /results/orders/benchmark-10/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-09-22 00:53:59,810 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-09-22 00:54:00,362 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-22 00:54:05,899 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-22 00:54:11,450 INFO [loop_until]: Function succeeded after 11s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-22 00:54:17,003 INFO [loop_until]: Function succeeded after 17s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-09-22 00:54:22,620 INFO [loop_until]: Function succeeded after 22s (rc=0) - expected pattern found 2025-09-22 00:54:22,620 INFO [loop_until]: OK (rc = 0) 2025-09-22 00:54:22,620 DEBUG --- stdout --- 2025-09-22 00:54:22,621 DEBUG 2025-09-22 01:54:02,546 DEBUG Creating results folder /results/gatling/benchmark-10 2025-09-22 01:54:02,555 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpaftt6tly 2025-09-22 01:54:02,559 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 01:54:19.936 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 01:54:19.947 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@20789950, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@33b8257f, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, 5b8bcfdd-56ad-4b0c-93bc-bd2810065040 -> 0),KO,List(ExitOnCompleteLoopBlock(5b8bcfdd-56ad-4b0c-93bc-bd2810065040)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007951e0692510@12d989c4,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Mon, 22 Sep 2025 00:54:19 GMT x-forgerock-transactionid: 273d04a4-e485-4669-8180-c0e33ea9003f strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 01:54:19.949 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 01:54:21.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 01:54:21.724 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 2025-09-22 00:54:22,621 DEBUG --- stderr --- 2025-09-22 00:54:22,622 DEBUG ________________________________________________________________________________ [2025-09-22 00:54:22] benchmark-10 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 01s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 03s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 04s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 05s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 06s, retry Order is running since 50m 06s, retry Order is running since 52m 07s, retry Order is running since 54m 07s, retry Order is running since 56m 07s, retry Order is running since 58m 07s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-09-22 01:54:30] benchmark-10 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-09-22 01:54:30,847 INFO 2025-09-22 01:54:30,847 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 01:54:30,847 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 01:54:31,153 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 01:54:31,153 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:31,153 DEBUG --- stdout --- 2025-09-22 01:54:31,153 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 01:54:31,153 DEBUG --- stderr --- 2025-09-22 01:54:31,153 DEBUG 2025-09-22 01:54:31,154 INFO 2025-09-22 01:54:31,154 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- rm -f /results/orders/order.json 2025-09-22 01:54:31,154 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 01:54:31,815 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:31,815 DEBUG --- stdout --- 2025-09-22 01:54:31,815 DEBUG 2025-09-22 01:54:31,816 DEBUG --- stderr --- 2025-09-22 01:54:31,816 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-09-22 01:54:31] benchmark-10 download_logs : Download individual order files ________________________________________________________________________________ 2025-09-22 01:54:31 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json 2025-09-22 01:54:31,816 INFO 2025-09-22 01:54:31,816 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 01:54:31,816 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 01:54:32,099 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 01:54:32,099 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:32,099 DEBUG --- stdout --- 2025-09-22 01:54:32,099 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 01:54:32,099 DEBUG --- stderr --- 2025-09-22 01:54:32,099 DEBUG Checking if file exists on pod 'overseer-0-7c788db448-z46mc', wait max 3 minutes if not. 2025-09-22 01:54:32,100 INFO 2025-09-22 01:54:32,100 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- bash -c 'if [ -f "/results/orders/benchmark-10/rc.txt" ]; then echo "/results/orders/benchmark-10/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-10/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/rc.txt file found" 2025-09-22 01:54:32,100 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 01:54:32,650 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 01:54:32,650 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:32,650 DEBUG --- stdout --- 2025-09-22 01:54:32,650 DEBUG /results/orders/benchmark-10/rc.txt file found 2025-09-22 01:54:32,650 DEBUG --- stderr --- 2025-09-22 01:54:32,650 DEBUG 2025-09-22 01:54:32,650 INFO 2025-09-22 01:54:32,650 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- du -k /results/orders/benchmark-10/rc.txt | grep "^\d+ .+$" 2025-09-22 01:54:32,650 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-22 01:54:33,202 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 01:54:33,202 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:33,202 DEBUG --- stdout --- 2025-09-22 01:54:33,202 DEBUG 4 /results/orders/benchmark-10/rc.txt 2025-09-22 01:54:33,202 DEBUG --- stderr --- 2025-09-22 01:54:33,202 DEBUG - Download file (size 4kB) source : /results/orders/benchmark-10/rc.txt @ overseer-0-7c788db448-z46mc destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2025-09-22 01:54:33,203 INFO 2025-09-22 01:54:33,203 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7c788db448-z46mc:/results/orders/benchmark-10/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2025-09-22 01:54:33,203 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-22 01:54:33,732 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:33,732 DEBUG --- stdout --- 2025-09-22 01:54:33,732 DEBUG tar: Removing leading `/' from member names 2025-09-22 01:54:33,732 DEBUG --- stderr --- 2025-09-22 01:54:33,732 DEBUG 2025-09-22 01:54:33,732 INFO 2025-09-22 01:54:33,732 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 01:54:33,732 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 01:54:34,013 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 01:54:34,013 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:34,013 DEBUG --- stdout --- 2025-09-22 01:54:34,013 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 01:54:34,013 DEBUG --- stderr --- 2025-09-22 01:54:34,013 DEBUG Checking if file exists on pod 'overseer-0-7c788db448-z46mc', wait max 3 minutes if not. 2025-09-22 01:54:34,014 INFO 2025-09-22 01:54:34,014 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- bash -c 'if [ -f "/results/orders/benchmark-10/stderr.txt" ]; then echo "/results/orders/benchmark-10/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stderr.txt file found" 2025-09-22 01:54:34,014 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 01:54:34,543 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 01:54:34,544 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:34,544 DEBUG --- stdout --- 2025-09-22 01:54:34,544 DEBUG /results/orders/benchmark-10/stderr.txt file found 2025-09-22 01:54:34,544 DEBUG --- stderr --- 2025-09-22 01:54:34,544 DEBUG 2025-09-22 01:54:34,544 INFO 2025-09-22 01:54:34,544 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- du -k /results/orders/benchmark-10/stderr.txt | grep "^\d+ .+$" 2025-09-22 01:54:34,544 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-22 01:54:35,087 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 01:54:35,087 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:35,088 DEBUG --- stdout --- 2025-09-22 01:54:35,088 DEBUG 0 /results/orders/benchmark-10/stderr.txt 2025-09-22 01:54:35,088 DEBUG --- stderr --- 2025-09-22 01:54:35,088 DEBUG - Download file (size 0B) source : /results/orders/benchmark-10/stderr.txt @ overseer-0-7c788db448-z46mc destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2025-09-22 01:54:35,088 INFO 2025-09-22 01:54:35,088 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7c788db448-z46mc:/results/orders/benchmark-10/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2025-09-22 01:54:35,088 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-22 01:54:35,618 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:35,618 DEBUG --- stdout --- 2025-09-22 01:54:35,618 DEBUG 2025-09-22 01:54:35,618 DEBUG --- stderr --- 2025-09-22 01:54:35,618 DEBUG 2025-09-22 01:54:35,618 INFO 2025-09-22 01:54:35,618 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 01:54:35,618 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 01:54:35,898 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 01:54:35,898 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:35,898 DEBUG --- stdout --- 2025-09-22 01:54:35,898 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 01:54:35,898 DEBUG --- stderr --- 2025-09-22 01:54:35,898 DEBUG Checking if file exists on pod 'overseer-0-7c788db448-z46mc', wait max 3 minutes if not. 2025-09-22 01:54:35,899 INFO 2025-09-22 01:54:35,899 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- bash -c 'if [ -f "/results/orders/benchmark-10/stdout.txt" ]; then echo "/results/orders/benchmark-10/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stdout.txt file found" 2025-09-22 01:54:35,899 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 01:54:36,448 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 01:54:36,448 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:36,448 DEBUG --- stdout --- 2025-09-22 01:54:36,448 DEBUG /results/orders/benchmark-10/stdout.txt file found 2025-09-22 01:54:36,448 DEBUG --- stderr --- 2025-09-22 01:54:36,448 DEBUG 2025-09-22 01:54:36,448 INFO 2025-09-22 01:54:36,448 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- du -k /results/orders/benchmark-10/stdout.txt | grep "^\d+ .+$" 2025-09-22 01:54:36,448 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-22 01:54:36,978 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 01:54:36,978 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:36,978 DEBUG --- stdout --- 2025-09-22 01:54:36,978 DEBUG 21712 /results/orders/benchmark-10/stdout.txt 2025-09-22 01:54:36,978 DEBUG --- stderr --- 2025-09-22 01:54:36,978 DEBUG - Download file (size 21.712MB) source : /results/orders/benchmark-10/stdout.txt @ overseer-0-7c788db448-z46mc destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2025-09-22 01:54:36,978 INFO 2025-09-22 01:54:36,978 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7c788db448-z46mc:/results/orders/benchmark-10/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2025-09-22 01:54:36,978 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-22 01:54:38,503 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:38,504 DEBUG --- stdout --- 2025-09-22 01:54:38,504 DEBUG tar: Removing leading `/' from member names 2025-09-22 01:54:38,504 DEBUG --- stderr --- 2025-09-22 01:54:38,504 DEBUG ________________________________________________________________________________ [2025-09-22 01:54:38] benchmark-10 show_cmd : Display order command ________________________________________________________________________________ 2025-09-22 01:54:38,504 INFO 2025-09-22 01:54:38,504 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-09-22 01:54:38,504 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-09-22 01:54:38,782 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-09-22 01:54:38,782 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:38,782 DEBUG --- stdout --- 2025-09-22 01:54:38,782 DEBUG overseer-0-7c788db448-z46mc 2025-09-22 01:54:38,782 DEBUG --- stderr --- 2025-09-22 01:54:38,782 DEBUG Checking if file exists on pod 'overseer-0-7c788db448-z46mc', wait max 3 minutes if not. 2025-09-22 01:54:38,783 INFO 2025-09-22 01:54:38,783 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- bash -c 'if [ -f "/results/orders/benchmark-10/cmd.txt" ]; then echo "/results/orders/benchmark-10/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-10/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/cmd.txt file found" 2025-09-22 01:54:38,783 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-09-22 01:54:39,328 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 01:54:39,328 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:39,328 DEBUG --- stdout --- 2025-09-22 01:54:39,328 DEBUG /results/orders/benchmark-10/cmd.txt file found 2025-09-22 01:54:39,328 DEBUG --- stderr --- 2025-09-22 01:54:39,328 DEBUG 2025-09-22 01:54:39,328 INFO 2025-09-22 01:54:39,328 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7c788db448-z46mc -- du -k /results/orders/benchmark-10/cmd.txt | grep "^\d+ .+$" 2025-09-22 01:54:39,328 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-09-22 01:54:39,861 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-09-22 01:54:39,861 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:39,861 DEBUG --- stdout --- 2025-09-22 01:54:39,861 DEBUG 4 /results/orders/benchmark-10/cmd.txt 2025-09-22 01:54:39,861 DEBUG --- stderr --- 2025-09-22 01:54:39,861 DEBUG - Download file (size 4kB) source : /results/orders/benchmark-10/cmd.txt @ overseer-0-7c788db448-z46mc destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2025-09-22 01:54:39,862 INFO 2025-09-22 01:54:39,862 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7c788db448-z46mc:/results/orders/benchmark-10/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2025-09-22 01:54:39,862 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-09-22 01:54:40,394 INFO [loop_until]: OK (rc = 0) 2025-09-22 01:54:40,394 DEBUG --- stdout --- 2025-09-22 01:54:40,394 DEBUG 2025-09-22 01:54:40,394 DEBUG --- stderr --- 2025-09-22 01:54:40,394 DEBUG 2025-09-22 01:54:40,394 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt is small (1 lines), printing all lines: 2025-09-22 01:54:40,394 INFO ----- output ----- /lodestar/lodestar.py perf run-gatling --mvn-quiet --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-haproxy" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-09-22 01:54:40] benchmark-10 show_rc : Display rc order ________________________________________________________________________________ 2025-09-22 01:54:40,395 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt is small (1 lines), printing all lines: 2025-09-22 01:54:40,395 INFO ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2025-09-22 01:54:40] benchmark-10 show_stdout : Display stdout order ________________________________________________________________________________ 2025-09-22 01:54:40,416 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt is 154312 lines): 2025-09-22 01:54:40,443 INFO ----- output ----- 2025-09-22 01:54:02,546 DEBUG Creating results folder /results/gatling/benchmark-10 2025-09-22 01:54:02,555 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpaftt6tly 2025-09-22 01:54:02,559 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode --quiet -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-haproxy.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-haproxy.forgeblocks.com -Dlogin_cookie=d0d18cac672abbc -Dnum_users=10000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 01:54:19.936 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'authAsPolicyAdmin' failed for user 1: status.find.in([200, 209], 304), found 401 01:54:19.947 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: authAsPolicyAdmin: KO status.find.in([200, 209], 304), found 401 ========================= Session: Session(getToken,1,Map(gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@20789950, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@33b8257f, gatling.http.cache.baseUrl -> https://openam-perf-haproxy.forgeblocks.com:443, 5b8bcfdd-56ad-4b0c-93bc-bd2810065040 -> 0),KO,List(ExitOnCompleteLoopBlock(5b8bcfdd-56ad-4b0c-93bc-bd2810065040)),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007951e0692510@12d989c4,io.netty.channel.epoll.EpollEventLoop@f79a760) ========================= HTTP request: POST https://openam-perf-haproxy.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate headers: X-OpenAM-Username: policyAdmin Content-Type: application/json Accept-API-Version: resource=2.0, protocol=1.0 X-OpenAM-Password: Pa_ssw0rd user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 accept: */* host: openam-perf-haproxy.forgeblocks.com content-length: 0 ========================= HTTP response: version: HTTP/1.1 status: 401 Unauthorized headers: x-frame-options: SAMEORIGIN content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' x-content-type-options: nosniff cache-control: private content-api-version: resource=2.1 expires: 0 pragma: no-cache content-type: application/json Content-Length: 62 date: Mon, 22 Sep 2025 00:54:19 GMT x-forgerock-transactionid: 273d04a4-e485-4669-8180-c0e33ea9003f strict-transport-security: max-age=31536000; includeSubDomains; preload; x-robots-tag: none Via: 1.1 google Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 body: {"code":401,"reason":"Unauthorized","message":"Login failure"} <<<<<<<<<<<<<<<<<<<<<<<<< 01:54:19.949 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-8' crashed with 'j.u.NoSuchElementException: No attribute named 'policyEvalTokenId' is defined', forwarding to the next one 01:54:21.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 01:54:21.724 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 01:54:22.717 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 01:54:22.718 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 01:54:23.718 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 01:54:23.718 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one 01:54:23.858 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request EvalPolicy: No attribute named 'tokenIdCookieName' is defined 01:54:24.218 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-200' crashed with 'j.u.NoSuchElementException: key not found: policyEvalTokenId', forwarding to the next one 01:54:24.219 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-199' crashed with 'j.u.NoSuchElementException: key not found: tokenIdCookieName', forwarding to the next one ================================================================================ 2025-09-22 00:54:24 GMT 5s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=35 KO=1 ) > authAsPolicyAdmin (OK=0 KO=1 ) > restLoginInitiate (OK=3 KO=0 ) > restLoginUsernamePasswordCallback (OK=1 KO=0 ) > UI-Post-Login - stage 1 (OK=1 KO=0 ) > UI-Post-Login - stage 1 Redirect 1 (OK=1 KO=0 ) > UI AM idFromSession (OK=1 KO=0 ) > UI AM validateGoto (OK=1 KO=0 ) > User Authorize PKCE stage (OK=2 KO=0 ) > User AccessToken PKCE stage (OK=2 KO=0 ) > UI-Post-Login - stage 2 (OK=1 KO=0 ) > UI-Post-Login - stage 2 Redirect 1 (OK=1 KO=0 ) > UI Enduser appAuthHelper2 (OK=1 KO=0 ) > UI Enduser appAuthHelper1 (OK=1 KO=0 ) > UI-Post-Login - stage 3 (OK=1 KO=0 ) > UI-Post-Login - stage 3 Redirect 1 (OK=1 KO=0 ) > UI Enduser sessioncheck (OK=1 KO=0 ) > UI IDM uiconfig (OK=1 KO=0 ) > UI IDM version (OK=1 KO=0 ) > UI IDM features (OK=1 KO=0 ) > UI IDM login (OK=1 KO=0 ) > UI IDM privilege (OK=1 KO=0 ) > UI IDM managed user schema (OK=1 KO=0 ) > UI IDM dashboard (OK=1 KO=0 ) > UI IDM user (OK=1 KO=0 ) > UI IDM oidcToken (OK=1 KO=0 ) > userinfo (OK=1 KO=0 ) > UI-Logout (OK=1 KO=0 ) > UI-Logout Redirect 1 (OK=1 KO=0 ) > UI AM revoke1 (OK=1 KO=0 ) > UI AM revoke2 (OK=1 KO=0 ) > UI AM endsession (OK=1 KO=0 ) > userRestlogin (OK=1 KO=0 ) ---- Errors -------------------------------------------------------------------- > status.find.in([200, 209], 304), found 401 1 (50.00%) [...] > User Authorize PKCE stage (OK=15382 KO=0 ) > User AccessToken PKCE stage (OK=15381 KO=0 ) > UI-Post-Login - stage 2 (OK=7690 KO=0 ) > UI-Post-Login - stage 2 Redirect 1 (OK=7690 KO=0 ) > UI Enduser appAuthHelper2 (OK=7690 KO=0 ) > UI Enduser appAuthHelper1 (OK=7690 KO=0 ) > UI-Post-Login - stage 3 (OK=7690 KO=0 ) > UI-Post-Login - stage 3 Redirect 1 (OK=7690 KO=0 ) > UI Enduser sessioncheck (OK=7690 KO=0 ) > UI IDM uiconfig (OK=7690 KO=0 ) > UI IDM version (OK=7690 KO=0 ) > UI IDM features (OK=7690 KO=0 ) > UI IDM login (OK=7690 KO=0 ) > UI IDM privilege (OK=7689 KO=1 ) > UI IDM managed user schema (OK=7690 KO=0 ) > UI IDM dashboard (OK=7690 KO=0 ) > UI IDM user (OK=7690 KO=0 ) > UI IDM oidcToken (OK=7690 KO=0 ) > userinfo (OK=7690 KO=0 ) > UI-Logout (OK=7690 KO=0 ) > UI-Logout Redirect 1 (OK=7690 KO=0 ) > UI AM revoke1 (OK=7690 KO=0 ) > UI AM revoke2 (OK=7690 KO=0 ) > UI AM endsession (OK=7690 KO=0 ) > userRestlogin (OK=10888 KO=674 ) > restloginProgressiveProfileCallback (OK=448 KO=0 ) > loginTreeWorkflow_restLoginInitiate (OK=1275 KO=0 ) > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1275 KO=0 ) > loginTreeWorkflow_restloginProgressiveProfileCallback (OK=62 KO=0 ) ---- Errors -------------------------------------------------------------------- > EvalPolicy: No attribute named 'tokenIdCookieName' is defined 11562 (94.47%) > jsonPath($.tokenId).find.exists, found nothing 674 ( 5.51%) > status.find.in([200, 209], 304), found 401 2 ( 0.02%) > status.find.in([200, 209], 304), found 502 1 ( 0.01%) ---- getToken ------------------------------------------------------------------ [--------------------------------------------------------------------------] 0% waiting: 0 / active: 1 / done: 0 ---- idc.benchmark.Mix2024 ----------------------------------------------------- [#########################################################################-] 99% waiting: 307 / active: 3 / done: 35746 ================================================================================ ================================================================================ 2025-09-22 01:54:19 GMT 3600s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=275262 KO=677 ) > authAsPolicyAdmin (OK=0 KO=2 ) > restLoginInitiate (OK=22912 KO=0 ) > restLoginUsernamePasswordCallback (OK=7692 KO=0 ) > UI-Post-Login - stage 1 (OK=7692 KO=0 ) > UI-Post-Login - stage 1 Redirect 1 (OK=7692 KO=0 ) > UI AM idFromSession (OK=7692 KO=0 ) > UI AM validateGoto (OK=7692 KO=0 ) > User Authorize PKCE stage (OK=15382 KO=0 ) > User AccessToken PKCE stage (OK=15381 KO=0 ) > UI-Post-Login - stage 2 (OK=7690 KO=0 ) > UI-Post-Login - stage 2 Redirect 1 (OK=7690 KO=0 ) > UI Enduser appAuthHelper2 (OK=7690 KO=0 ) > UI Enduser appAuthHelper1 (OK=7690 KO=0 ) > UI-Post-Login - stage 3 (OK=7690 KO=0 ) > UI-Post-Login - stage 3 Redirect 1 (OK=7690 KO=0 ) > UI Enduser sessioncheck (OK=7690 KO=0 ) > UI IDM uiconfig (OK=7690 KO=0 ) > UI IDM version (OK=7690 KO=0 ) > UI IDM features (OK=7690 KO=0 ) > UI IDM login (OK=7690 KO=0 ) > UI IDM privilege (OK=7689 KO=1 ) > UI IDM managed user schema (OK=7690 KO=0 ) > UI IDM dashboard (OK=7690 KO=0 ) > UI IDM user (OK=7690 KO=0 ) > UI IDM oidcToken (OK=7690 KO=0 ) > userinfo (OK=7690 KO=0 ) > UI-Logout (OK=7690 KO=0 ) > UI-Logout Redirect 1 (OK=7690 KO=0 ) > UI AM revoke1 (OK=7690 KO=0 ) > UI AM revoke2 (OK=7690 KO=0 ) > UI AM endsession (OK=7690 KO=0 ) > userRestlogin (OK=10888 KO=674 ) > restloginProgressiveProfileCallback (OK=448 KO=0 ) > loginTreeWorkflow_restLoginInitiate (OK=1275 KO=0 ) > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1275 KO=0 ) > loginTreeWorkflow_restloginProgressiveProfileCallback (OK=62 KO=0 ) ---- Errors -------------------------------------------------------------------- > EvalPolicy: No attribute named 'tokenIdCookieName' is defined 11562 (94.47%) > jsonPath($.tokenId).find.exists, found nothing 674 ( 5.51%) > status.find.in([200, 209], 304), found 401 2 ( 0.02%) > status.find.in([200, 209], 304), found 502 1 ( 0.01%) ---- getToken ------------------------------------------------------------------ [--------------------------------------------------------------------------] 0% waiting: 0 / active: 1 / done: 0 ---- idc.benchmark.Mix2024 ----------------------------------------------------- [#########################################################################-] 99% waiting: 307 / active: 3 / done: 35746 ================================================================================ 2025-09-22 02:54:19,795 INFO Gatling simulation run ended successfully 2025-09-22 02:54:19,795 DEBUG No archive name provided. No archive will be created ________________________________________________________________________________ [2025-09-22 01:54:40] benchmark-10 show_stderr : Display stderr order ________________________________________________________________________________ 2025-09-22 01:54:40,444 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt is small (0 lines), printing all lines: 2025-09-22 01:54:40,444 INFO ----- output ----- ________________________________________________________________________________ [2025-09-22 01:54:40] benchmark-10 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-09-22 01:54:40] benchmark-10 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-09-22 01:54:40] benchmark-10 post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped