--Task-- name: benchmark-50 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-10'] preceding_task: benchmark-10 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 50} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-16 19:36:20] benchmark-50 pre : N/A ________________________________________________________________________________ 2025-01-16 19:36:20,532 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-16 19:36:20 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-16 19:36:20 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-50/stdout.txt Pod log : /results/orders/benchmark-50 2025-01-16 19:36:20,533 INFO 2025-01-16 19:36:20,533 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:20,533 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:20,809 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:20,809 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:20,809 DEBUG --- stdout --- 2025-01-16 19:36:20,809 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:20,809 DEBUG --- stderr --- 2025-01-16 19:36:20,809 DEBUG ________________________________________________________________________________ [2025-01-16 19:36:20] benchmark-50 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-16 19:36:20,809 INFO 2025-01-16 19:36:20,809 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:20,809 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:21,084 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:21,084 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:21,084 DEBUG --- stdout --- 2025-01-16 19:36:21,084 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:21,084 DEBUG --- stderr --- 2025-01-16 19:36:21,084 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-50" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-16 19:36:21] benchmark-50 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-16 19:36:21,084 INFO 2025-01-16 19:36:21,084 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:21,084 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:21,360 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:21,360 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:21,361 DEBUG --- stdout --- 2025-01-16 19:36:21,361 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:21,361 DEBUG --- stderr --- 2025-01-16 19:36:21,361 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/order.json { "name": "benchmark-50", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-50\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-50" } ________________________________________________________________________________ [2025-01-16 19:36:21] benchmark-50 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-16 19:36:21,364 INFO 2025-01-16 19:36:21,364 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-16 19:36:21,364 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-16 19:36:21,637 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 19:36:21,637 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:21,637 DEBUG --- stdout --- 2025-01-16 19:36:21,637 DEBUG WAITING 2025-01-16 19:36:21,637 DEBUG --- stderr --- 2025-01-16 19:36:21,637 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 26 0 --:--:-- --:--:-- --:--:-- 26 ________________________________________________________________________________ [2025-01-16 19:36:21] benchmark-50 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-16 19:36:21,637 INFO 2025-01-16 19:36:21,637 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:21,637 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:21,913 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:21,913 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:21,913 DEBUG --- stdout --- 2025-01-16 19:36:21,913 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:21,913 DEBUG --- stderr --- 2025-01-16 19:36:21,913 DEBUG 2025-01-16 19:36:21,913 INFO 2025-01-16 19:36:21,913 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-16 19:36:21,913 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 19:36:23,268 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:23,268 DEBUG --- stdout --- 2025-01-16 19:36:23,268 DEBUG 2025-01-16 19:36:23,268 DEBUG --- stderr --- 2025-01-16 19:36:23,268 DEBUG Order has been successfully forwarded to overseer 2025-01-16 19:36:23 - INFO: Check if Gatling simulation started successfully 2025-01-16 19:36:23,269 INFO 2025-01-16 19:36:23,269 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:23,269 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:23,544 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:23,544 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:23,544 DEBUG --- stdout --- 2025-01-16 19:36:23,544 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:23,545 DEBUG --- stderr --- 2025-01-16 19:36:23,545 DEBUG 2025-01-16 19:36:23,545 INFO 2025-01-16 19:36:23,546 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-50/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-16 19:36:23,546 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-16 19:36:24,278 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 19:36:30,013 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 19:36:35,751 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 19:36:41,545 INFO [loop_until]: Function succeeded after 17s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 19:36:47,291 INFO [loop_until]: Function succeeded after 23s (rc=0) - expected pattern found 2025-01-16 19:36:47,291 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:47,291 DEBUG --- stdout --- 2025-01-16 19:36:47,291 DEBUG 2025-01-16 19:36:24,273 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmprgttljyl 2025-01-16 19:36:24,275 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-50" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmprgttljyl/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmprgttljyl/target/test-classes ... [INFO] compile in 11.6 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... ================================================================================ 2025-01-16 19:36:46 GMT 4s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=196 KO=0 ) > restLoginInitiate (OK=19 KO=0 ) > restLoginUsernamePasswordCallback (OK=19 KO=0 ) > Skip 2FA (OK=12 KO=0 ) > User Authorize PKCE stage (OK=21 KO=0 ) > UI-Post-Login - stage 1 (OK=4 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > UI-Post-Login - stage 1 Redirect 1 (OK=4 KO=0 ) > UI AM idFromSession (OK=4 KO=0 ) > getIdToken (OK=1 KO=0 ) > UI AM validateGoto (OK=4 KO=0 ) > getIdToken Redirect 1 (OK=1 KO=0 ) > createOrganization (OK=1 KO=0 ) > UI-Post-Login - stage 2 (OK=4 KO=0 ) > queryOrganization (OK=1 KO=0 ) > UI-Post-Login - stage 2 Redirect 1 (OK=4 KO=0 ) > UI Enduser appAuthHelper1 (OK=4 KO=0 ) > deleteOrganization (OK=1 KO=0 ) > UI Enduser appAuthHelper2 (OK=4 KO=0 ) > UI-Post-Login - stage 3 (OK=3 KO=0 ) > UI-Post-Login - stage 3 Redirect 1 (OK=3 KO=0 ) > RootUserinfo (OK=14 KO=0 ) > UI Enduser sessioncheck (OK=2 KO=0 ) > UI IDM uiconfig (OK=2 KO=0 ) > UI IDM version (OK=2 KO=0 ) > UI IDM login (OK=2 KO=0 ) > UI IDM features (OK=2 KO=0 ) > UI IDM privilege (OK=2 KO=0 ) > UI IDM managed user schema (OK=2 KO=0 ) > UI IDM dashboard (OK=2 KO=0 ) > UI IDM user (OK=2 KO=0 ) > UI IDM oidcToken (OK=2 KO=0 ) > userinfo (OK=2 KO=0 ) > UI-Logout (OK=2 KO=0 ) > UI-Logout Redirect 1 (OK=2 KO=0 ) > UI AM revoke1 (OK=2 KO=0 ) > UI AM revoke2 (OK=2 KO=0 ) > UI AM endsession (OK=2 KO=0 ) > GetUUid (OK=4 KO=0 ) > GetOpenidConfig (OK=4 KO=0 ) > CreatePolicy (OK=4 KO=0 ) > tokenUserinfo (OK=2 KO=0 ) > loginTreeWorkflow_restLoginInitiate (OK=1 KO=0 ) > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1 KO=0 ) ---- idc.benchmark.Mix2024 ----------------------------------------------------- [- ] 0% waiting: 180265 / active: 14 / done: 6 ================================================================================ 2025-01-16 19:36:47,291 DEBUG --- stderr --- 2025-01-16 19:36:47,291 DEBUG ________________________________________________________________________________ [2025-01-16 19:36:47] benchmark-50 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-16 20:36:56] benchmark-50 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-16 20:36:56,288 INFO 2025-01-16 20:36:56,288 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:36:56,288 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:36:56,589 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:36:56,589 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:36:56,589 DEBUG --- stdout --- 2025-01-16 20:36:56,589 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:36:56,589 DEBUG --- stderr --- 2025-01-16 20:36:56,589 DEBUG 2025-01-16 20:36:56,589 INFO 2025-01-16 20:36:56,589 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-16 20:36:56,589 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 20:36:57,394 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:36:57,394 DEBUG --- stdout --- 2025-01-16 20:36:57,395 DEBUG 2025-01-16 20:36:57,395 DEBUG --- stderr --- 2025-01-16 20:36:57,395 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-16 20:36:57] benchmark-50 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-16 20:36:57 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/order.json 2025-01-16 20:36:57,395 INFO 2025-01-16 20:36:57,395 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:36:57,395 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:36:57,671 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:36:57,671 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:36:57,671 DEBUG --- stdout --- 2025-01-16 20:36:57,671 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:36:57,671 DEBUG --- stderr --- 2025-01-16 20:36:57,671 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 20:36:57,671 INFO 2025-01-16 20:36:57,671 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:36:57,671 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:36:57,946 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:36:57,946 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:36:57,947 DEBUG --- stdout --- 2025-01-16 20:36:57,947 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:36:57,947 DEBUG --- stderr --- 2025-01-16 20:36:57,947 DEBUG 2025-01-16 20:36:57,947 INFO 2025-01-16 20:36:57,947 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-50/rc.txt" ]; then echo "/results/orders/benchmark-50/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-50/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-50/rc.txt file found" 2025-01-16 20:36:57,947 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 20:36:58,749 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 20:36:58,749 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:36:58,749 DEBUG --- stdout --- 2025-01-16 20:36:58,749 DEBUG /results/orders/benchmark-50/rc.txt file found 2025-01-16 20:36:58,749 DEBUG --- stderr --- 2025-01-16 20:36:58,749 DEBUG 2025-01-16 20:36:58,749 INFO 2025-01-16 20:36:58,749 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:36:58,749 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:36:59,027 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:36:59,027 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:36:59,027 DEBUG --- stdout --- 2025-01-16 20:36:59,028 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:36:59,028 DEBUG --- stderr --- 2025-01-16 20:36:59,028 DEBUG 2025-01-16 20:36:59,028 INFO 2025-01-16 20:36:59,028 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-50/rc.txt 2025-01-16 20:36:59,835 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 20:36:59,835 DEBUG --- stdout --- 2025-01-16 20:36:59,835 DEBUG 4 /results/orders/benchmark-50/rc.txt 2025-01-16 20:36:59,835 DEBUG --- stderr --- 2025-01-16 20:36:59,835 DEBUG 2025-01-16 20:36:59,835 INFO - Download file (size 4k) 2025-01-16 20:36:59,835 INFO 2025-01-16 20:36:59,835 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:36:59,835 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:00,110 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:00,111 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:00,112 DEBUG --- stdout --- 2025-01-16 20:37:00,112 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:00,112 DEBUG --- stderr --- 2025-01-16 20:37:00,112 DEBUG source : /results/orders/benchmark-50/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/rc.txt 2025-01-16 20:37:00,112 INFO 2025-01-16 20:37:00,112 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:00,112 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:00,386 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:00,387 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:00,387 DEBUG --- stdout --- 2025-01-16 20:37:00,387 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:00,387 DEBUG --- stderr --- 2025-01-16 20:37:00,387 DEBUG 2025-01-16 20:37:00,387 INFO 2025-01-16 20:37:00,387 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-50/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/rc.txt 2025-01-16 20:37:00,387 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 20:37:01,109 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:01,109 DEBUG --- stdout --- 2025-01-16 20:37:01,109 DEBUG tar: Removing leading `/' from member names 2025-01-16 20:37:01,109 DEBUG --- stderr --- 2025-01-16 20:37:01,109 DEBUG 2025-01-16 20:37:01,109 INFO 2025-01-16 20:37:01,109 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:01,109 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:01,402 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:01,402 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:01,403 DEBUG --- stdout --- 2025-01-16 20:37:01,403 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:01,403 DEBUG --- stderr --- 2025-01-16 20:37:01,403 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 20:37:01,403 INFO 2025-01-16 20:37:01,403 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:01,403 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:01,682 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:01,682 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:01,682 DEBUG --- stdout --- 2025-01-16 20:37:01,682 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:01,682 DEBUG --- stderr --- 2025-01-16 20:37:01,682 DEBUG 2025-01-16 20:37:01,683 INFO 2025-01-16 20:37:01,683 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-50/stderr.txt" ]; then echo "/results/orders/benchmark-50/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-50/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-50/stderr.txt file found" 2025-01-16 20:37:01,683 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 20:37:02,486 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 20:37:02,486 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:02,486 DEBUG --- stdout --- 2025-01-16 20:37:02,486 DEBUG /results/orders/benchmark-50/stderr.txt file found 2025-01-16 20:37:02,486 DEBUG --- stderr --- 2025-01-16 20:37:02,487 DEBUG 2025-01-16 20:37:02,487 INFO 2025-01-16 20:37:02,487 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:02,487 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:02,763 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:02,764 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:02,764 DEBUG --- stdout --- 2025-01-16 20:37:02,764 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:02,764 DEBUG --- stderr --- 2025-01-16 20:37:02,764 DEBUG 2025-01-16 20:37:02,764 INFO 2025-01-16 20:37:02,764 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-50/stderr.txt 2025-01-16 20:37:03,569 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 20:37:03,569 DEBUG --- stdout --- 2025-01-16 20:37:03,569 DEBUG 0 /results/orders/benchmark-50/stderr.txt 2025-01-16 20:37:03,569 DEBUG --- stderr --- 2025-01-16 20:37:03,569 DEBUG 2025-01-16 20:37:03,569 INFO - Download file (size 0k) 2025-01-16 20:37:03,570 INFO 2025-01-16 20:37:03,570 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:03,570 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:03,847 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:03,847 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:03,847 DEBUG --- stdout --- 2025-01-16 20:37:03,847 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:03,847 DEBUG --- stderr --- 2025-01-16 20:37:03,847 DEBUG source : /results/orders/benchmark-50/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stderr.txt 2025-01-16 20:37:03,847 INFO 2025-01-16 20:37:03,847 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:03,847 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:04,123 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:04,123 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:04,123 DEBUG --- stdout --- 2025-01-16 20:37:04,123 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:04,124 DEBUG --- stderr --- 2025-01-16 20:37:04,124 DEBUG 2025-01-16 20:37:04,124 INFO 2025-01-16 20:37:04,124 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-50/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stderr.txt 2025-01-16 20:37:04,124 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 20:37:04,855 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:04,855 DEBUG --- stdout --- 2025-01-16 20:37:04,855 DEBUG tar: Removing leading `/' from member names 2025-01-16 20:37:04,856 DEBUG --- stderr --- 2025-01-16 20:37:04,856 DEBUG 2025-01-16 20:37:04,856 INFO 2025-01-16 20:37:04,856 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:04,856 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:05,134 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:05,134 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:05,134 DEBUG --- stdout --- 2025-01-16 20:37:05,134 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:05,134 DEBUG --- stderr --- 2025-01-16 20:37:05,134 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 20:37:05,135 INFO 2025-01-16 20:37:05,135 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:05,135 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:05,411 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:05,411 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:05,411 DEBUG --- stdout --- 2025-01-16 20:37:05,411 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:05,411 DEBUG --- stderr --- 2025-01-16 20:37:05,411 DEBUG 2025-01-16 20:37:05,412 INFO 2025-01-16 20:37:05,412 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-50/stdout.txt" ]; then echo "/results/orders/benchmark-50/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-50/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-50/stdout.txt file found" 2025-01-16 20:37:05,412 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 20:37:06,229 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 20:37:06,229 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:06,229 DEBUG --- stdout --- 2025-01-16 20:37:06,229 DEBUG /results/orders/benchmark-50/stdout.txt file found 2025-01-16 20:37:06,229 DEBUG --- stderr --- 2025-01-16 20:37:06,229 DEBUG 2025-01-16 20:37:06,229 INFO 2025-01-16 20:37:06,229 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:06,230 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:06,506 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:06,506 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:06,506 DEBUG --- stdout --- 2025-01-16 20:37:06,506 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:06,506 DEBUG --- stderr --- 2025-01-16 20:37:06,506 DEBUG 2025-01-16 20:37:06,506 INFO 2025-01-16 20:37:06,507 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-50/stdout.txt 2025-01-16 20:37:07,321 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 20:37:07,321 DEBUG --- stdout --- 2025-01-16 20:37:07,321 DEBUG 4744 /results/orders/benchmark-50/stdout.txt 2025-01-16 20:37:07,321 DEBUG --- stderr --- 2025-01-16 20:37:07,321 DEBUG 2025-01-16 20:37:07,321 INFO - Download file (size 4744k) 2025-01-16 20:37:07,321 INFO 2025-01-16 20:37:07,321 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:07,321 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:07,599 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:07,599 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:07,599 DEBUG --- stdout --- 2025-01-16 20:37:07,599 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:07,599 DEBUG --- stderr --- 2025-01-16 20:37:07,599 DEBUG source : /results/orders/benchmark-50/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stdout.txt 2025-01-16 20:37:07,599 INFO 2025-01-16 20:37:07,599 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:07,599 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:07,875 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:07,875 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:07,875 DEBUG --- stdout --- 2025-01-16 20:37:07,875 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:07,875 DEBUG --- stderr --- 2025-01-16 20:37:07,875 DEBUG 2025-01-16 20:37:07,875 INFO 2025-01-16 20:37:07,875 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-50/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stdout.txt 2025-01-16 20:37:07,876 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 20:37:09,133 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:09,133 DEBUG --- stdout --- 2025-01-16 20:37:09,133 DEBUG tar: Removing leading `/' from member names 2025-01-16 20:37:09,133 DEBUG --- stderr --- 2025-01-16 20:37:09,133 DEBUG ________________________________________________________________________________ [2025-01-16 20:37:09] benchmark-50 show_cmd : Display order command ________________________________________________________________________________ 2025-01-16 20:37:09,133 INFO 2025-01-16 20:37:09,133 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:09,133 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:09,409 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:09,409 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:09,409 DEBUG --- stdout --- 2025-01-16 20:37:09,409 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:09,409 DEBUG --- stderr --- 2025-01-16 20:37:09,409 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 20:37:09,409 INFO 2025-01-16 20:37:09,409 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:09,409 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:09,688 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:09,688 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:09,688 DEBUG --- stdout --- 2025-01-16 20:37:09,688 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:09,688 DEBUG --- stderr --- 2025-01-16 20:37:09,688 DEBUG 2025-01-16 20:37:09,689 INFO 2025-01-16 20:37:09,689 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-50/cmd.txt" ]; then echo "/results/orders/benchmark-50/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-50/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-50/cmd.txt file found" 2025-01-16 20:37:09,689 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 20:37:10,569 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 20:37:10,569 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:10,569 DEBUG --- stdout --- 2025-01-16 20:37:10,569 DEBUG /results/orders/benchmark-50/cmd.txt file found 2025-01-16 20:37:10,569 DEBUG --- stderr --- 2025-01-16 20:37:10,569 DEBUG 2025-01-16 20:37:10,569 INFO 2025-01-16 20:37:10,569 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:10,569 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:10,847 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:10,847 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:10,847 DEBUG --- stdout --- 2025-01-16 20:37:10,847 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:10,847 DEBUG --- stderr --- 2025-01-16 20:37:10,847 DEBUG 2025-01-16 20:37:10,847 INFO 2025-01-16 20:37:10,848 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-50/cmd.txt 2025-01-16 20:37:11,655 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 20:37:11,655 DEBUG --- stdout --- 2025-01-16 20:37:11,655 DEBUG 4 /results/orders/benchmark-50/cmd.txt 2025-01-16 20:37:11,655 DEBUG --- stderr --- 2025-01-16 20:37:11,655 DEBUG 2025-01-16 20:37:11,655 INFO - Download file (size 4k) 2025-01-16 20:37:11,656 INFO 2025-01-16 20:37:11,656 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:11,656 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:11,932 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:11,932 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:11,932 DEBUG --- stdout --- 2025-01-16 20:37:11,932 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:11,932 DEBUG --- stderr --- 2025-01-16 20:37:11,932 DEBUG source : /results/orders/benchmark-50/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/cmd.txt 2025-01-16 20:37:11,932 INFO 2025-01-16 20:37:11,932 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 20:37:11,932 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 20:37:12,208 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 20:37:12,208 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:12,208 DEBUG --- stdout --- 2025-01-16 20:37:12,208 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 20:37:12,208 DEBUG --- stderr --- 2025-01-16 20:37:12,208 DEBUG 2025-01-16 20:37:12,208 INFO 2025-01-16 20:37:12,208 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-50/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/cmd.txt 2025-01-16 20:37:12,208 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 20:37:12,937 INFO [loop_until]: OK (rc = 0) 2025-01-16 20:37:12,937 DEBUG --- stdout --- 2025-01-16 20:37:12,937 DEBUG tar: Removing leading `/' from member names 2025-01-16 20:37:12,937 DEBUG --- stderr --- 2025-01-16 20:37:12,937 DEBUG 2025-01-16 20:37:12,937 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/cmd.txt is small (1 lines), printing all lines: 2025-01-16 20:37:12,937 DEBUG ----- output ----- 2025-01-16 20:37:12,937 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-50" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=Pa_ssw0rd" 2025-01-16 20:37:12,937 INFO ________________________________________________________________________________ [2025-01-16 20:37:12] benchmark-50 show_rc : Display rc order ________________________________________________________________________________ 2025-01-16 20:37:12,937 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/rc.txt is small (1 lines), printing all lines: 2025-01-16 20:37:12,937 DEBUG ----- output ----- 2025-01-16 20:37:12,937 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-16 20:37:12,937 INFO ________________________________________________________________________________ [2025-01-16 20:37:12] benchmark-50 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-16 20:37:12,944 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stdout.txt is 59986 lines): 2025-01-16 20:37:12,944 DEBUG ----- output ----- 2025-01-16 20:37:12,944 INFO 2025-01-16 19:36:24,273 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmprgttljyl 2025-01-16 20:37:12,944 INFO 2025-01-16 19:36:24,275 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-50" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=**** 2025-01-16 20:37:12,944 INFO [INFO] Scanning for projects... 2025-01-16 20:37:12,944 INFO [INFO] 2025-01-16 20:37:12,944 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-16 20:37:12,944 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-16 20:37:12,944 INFO [INFO] from pom.xml 2025-01-16 20:37:12,944 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-16 20:37:12,944 INFO [INFO] 2025-01-16 20:37:12,944 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-16 20:37:12,944 INFO [INFO] 2025-01-16 20:37:12,944 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-16 20:37:12,944 INFO [INFO] skip non existing resourceDirectory /tmp/tmprgttljyl/src/main/resources 2025-01-16 20:37:12,944 INFO [INFO] 2025-01-16 20:37:12,944 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-16 20:37:12,944 INFO [INFO] No sources to compile 2025-01-16 20:37:12,944 INFO [INFO] 2025-01-16 20:37:12,944 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-16 20:37:12,944 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-16 20:37:12,945 INFO [INFO] 2025-01-16 20:37:12,945 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-16 20:37:12,945 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-16 20:37:12,945 INFO [INFO] 2025-01-16 20:37:12,945 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-16 20:37:12,945 INFO [INFO] compiling 38 Scala sources to /tmp/tmprgttljyl/target/test-classes ... 2025-01-16 20:37:12,945 INFO [INFO] compile in 11.6 s 2025-01-16 20:37:12,945 INFO [INFO] 2025-01-16 20:37:12,945 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-16 20:37:12,945 INFO [INFO] 2025-01-16 20:37:12,945 INFO [INFO] 2025-01-16 20:37:12,945 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-16 20:37:12,945 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-16 20:37:12,945 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-16 20:37:12,945 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-16 20:37:12,945 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-16 20:37:12,945 INFO 2025-01-16 20:37:12,945 INFO ================================================================================ 2025-01-16 20:37:12,945 INFO 2025-01-16 19:36:46 GMT 4s elapsed 2025-01-16 20:37:12,945 INFO ---- Requests ------------------------------------------------------------------ 2025-01-16 20:37:12,945 INFO > Global (OK=196 KO=0 ) 2025-01-16 20:37:12,945 INFO > restLoginInitiate (OK=19 KO=0 ) 2025-01-16 20:37:12,945 INFO > restLoginUsernamePasswordCallback (OK=19 KO=0 ) 2025-01-16 20:37:12,945 INFO > Skip 2FA (OK=12 KO=0 ) 2025-01-16 20:37:12,945 INFO > User Authorize PKCE stage (OK=21 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI-Post-Login - stage 1 (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > User AccessToken PKCE stage (OK=20 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI AM idFromSession (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > getIdToken (OK=1 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI AM validateGoto (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > getIdToken Redirect 1 (OK=1 KO=0 ) 2025-01-16 20:37:12,945 INFO > createOrganization (OK=1 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI-Post-Login - stage 2 (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > queryOrganization (OK=1 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI Enduser appAuthHelper1 (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > deleteOrganization (OK=1 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI Enduser appAuthHelper2 (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI-Post-Login - stage 3 (OK=3 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=3 KO=0 ) 2025-01-16 20:37:12,945 INFO > RootUserinfo (OK=14 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI Enduser sessioncheck (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM uiconfig (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM version (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM login (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM features (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM privilege (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM managed user schema (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM dashboard (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM user (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI IDM oidcToken (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > userinfo (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI-Logout (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI-Logout Redirect 1 (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI AM revoke1 (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI AM revoke2 (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > UI AM endsession (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > GetUUid (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > GetOpenidConfig (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > CreatePolicy (OK=4 KO=0 ) 2025-01-16 20:37:12,945 INFO > tokenUserinfo (OK=2 KO=0 ) 2025-01-16 20:37:12,945 INFO > loginTreeWorkflow_restLoginInitiate (OK=1 KO=0 ) 2025-01-16 20:37:12,945 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2025-01-16 20:37:12,946 INFO 2025-01-16 20:37:12,946 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-16 20:37:12,946 INFO [- ] 0% 2025-01-16 20:37:12,946 INFO waiting: 180265 / active: 14 / done: 6 2025-01-16 20:37:12,946 INFO ================================================================================ 2025-01-16 20:37:12,946 INFO 2025-01-16 20:37:12,946 INFO 2025-01-16 20:37:12,946 INFO ================================================================================ 2025-01-16 20:37:12,946 INFO 2025-01-16 19:36:51 GMT 9s elapsed 2025-01-16 20:37:12,946 INFO ---- Requests ------------------------------------------------------------------ 2025-01-16 20:37:12,946 INFO > Global (OK=936 KO=0 ) 2025-01-16 20:37:12,946 INFO > restLoginInitiate (OK=79 KO=0 ) 2025-01-16 20:37:12,946 INFO > restLoginUsernamePasswordCallback (OK=78 KO=0 ) 2025-01-16 20:37:12,946 INFO > Skip 2FA (OK=48 KO=0 ) 2025-01-16 20:37:12,946 INFO > User Authorize PKCE stage (OK=91 KO=0 ) 2025-01-16 20:37:12,946 INFO > UI-Post-Login - stage 1 (OK=15 KO=0 ) 2025-01-16 20:37:12,946 INFO > User AccessToken PKCE stage (OK=90 KO=0 ) 2025-01-16 20:37:12,946 INFO [...] 2025-01-16 20:37:12,954 INFO > UI IDM version (OK=38319 KO=34 ) 2025-01-16 20:37:12,955 INFO > UI IDM login (OK=38333 KO=19 ) 2025-01-16 20:37:12,955 INFO > UI IDM features (OK=38335 KO=18 ) 2025-01-16 20:37:12,955 INFO > UI IDM privilege (OK=38334 KO=19 ) 2025-01-16 20:37:12,955 INFO > UI IDM managed user schema (OK=38351 KO=0 ) 2025-01-16 20:37:12,955 INFO > UI IDM dashboard (OK=38351 KO=0 ) 2025-01-16 20:37:12,955 INFO > UI IDM user (OK=38351 KO=0 ) 2025-01-16 20:37:12,955 INFO > UI IDM oidcToken (OK=38352 KO=21 ) 2025-01-16 20:37:12,955 INFO > userinfo (OK=38352 KO=0 ) 2025-01-16 20:37:12,955 INFO > UI-Logout (OK=38372 KO=0 ) 2025-01-16 20:37:12,955 INFO > UI-Logout Redirect 1 (OK=38372 KO=0 ) 2025-01-16 20:37:12,955 INFO > UI AM revoke1 (OK=38351 KO=0 ) 2025-01-16 20:37:12,955 INFO > UI AM revoke2 (OK=38350 KO=0 ) 2025-01-16 20:37:12,955 INFO > UI AM endsession (OK=38351 KO=0 ) 2025-01-16 20:37:12,955 INFO > GetUUid (OK=57456 KO=0 ) 2025-01-16 20:37:12,955 INFO > GetOpenidConfig (OK=172102 KO=1 ) 2025-01-16 20:37:12,955 INFO > CreatePolicy (OK=57445 KO=9 ) 2025-01-16 20:37:12,955 INFO > tokenUserinfo (OK=38300 KO=0 ) 2025-01-16 20:37:12,955 INFO > loginTreeWorkflow_restLoginInitiate (OK=6300 KO=6 ) 2025-01-16 20:37:12,955 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=6300 KO=0 ) 2025-01-16 20:37:12,955 INFO > ReadPolicy (OK=57354 KO=4 ) 2025-01-16 20:37:12,955 INFO > DeletePolicy (OK=57279 KO=8 ) 2025-01-16 20:37:12,955 INFO ---- Errors -------------------------------------------------------------------- 2025-01-16 20:37:12,955 INFO > i.n.h.s.SslHandshakeTimeoutException: handshake timed out afte 219 (58.71%) 2025-01-16 20:37:12,955 INFO r 10000ms 2025-01-16 20:37:12,955 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 22 ( 5.90%) 2025-01-16 20:37:12,955 INFO 2025-01-16 20:37:12,955 INFO > status.find.in([200, 209], 304), found 401 21 ( 5.63%) 2025-01-16 20:37:12,955 INFO > headerRegex((location,#id_token=(.*))).find.exists, found noth 21 ( 5.63%) 2025-01-16 20:37:12,955 INFO ing 2025-01-16 20:37:12,955 INFO > userinfo: No attribute named 'access_token' is defined 21 ( 5.63%) 2025-01-16 20:37:12,955 INFO > UI AM revoke1: No attribute named 'access_token' is defined 21 ( 5.63%) 2025-01-16 20:37:12,955 INFO > UI AM endsession: No attribute named 'id_token_2' is defined 21 ( 5.63%) 2025-01-16 20:37:12,955 INFO > status.find.in([200, 209], 304), found 404 12 ( 3.22%) 2025-01-16 20:37:12,955 INFO > status.find.in([200, 209], 304), found 409 9 ( 2.41%) 2025-01-16 20:37:12,955 INFO > status.find.is(200), but actually found 502 3 ( 0.80%) 2025-01-16 20:37:12,955 INFO > status.find.is(302), but actually found 502 1 ( 0.27%) 2025-01-16 20:37:12,955 INFO > status.find.in([200, 209], 304), found 400 1 ( 0.27%) 2025-01-16 20:37:12,955 INFO > Request timeout to openam-perf-200m.forgeblocks.com/34.107.203 1 ( 0.27%) 2025-01-16 20:37:12,955 INFO .37:443 after 60000 ms 2025-01-16 20:37:12,955 INFO 2025-01-16 20:37:12,955 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-16 20:37:12,955 INFO [#########################################################################-] 99% 2025-01-16 20:37:12,955 INFO waiting: 1457 / active: 226 / done: 178602 2025-01-16 20:37:12,955 INFO ================================================================================ 2025-01-16 20:37:12,955 INFO 2025-01-16 20:37:12,955 INFO 20:36:41.726 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 178827: j.i.IOException: Premature close 2025-01-16 20:37:12,955 INFO 20:36:41.726 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 178828: j.i.IOException: Premature close 2025-01-16 20:37:12,955 INFO 20:36:41.726 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-16 20:37:12,955 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-16 20:37:12,955 INFO Request: 2025-01-16 20:37:12,955 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-16 20:37:12,955 INFO ========================= 2025-01-16 20:37:12,955 INFO Session: 2025-01-16 20:37:12,955 INFO Session(idc.benchmark.Mix2024,178828,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.12402478, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@17db3c5e, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1, password -> Pa_ssw0rd, fake-ip -> 131.115.83.165, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@3d5a9360),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007e512c69a0e0@40605e01,io.netty.channel.epoll.EpollEventLoop@30f5a68a) 2025-01-16 20:37:12,955 INFO ========================= 2025-01-16 20:37:12,955 INFO HTTP request: 2025-01-16 20:37:12,955 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-16 20:37:12,955 INFO headers: 2025-01-16 20:37:12,956 INFO accept: application/json 2025-01-16 20:37:12,956 INFO content-type: application/json 2025-01-16 20:37:12,956 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1 2025-01-16 20:37:12,956 INFO X-Forwarded-For: 131.115.83.165 2025-01-16 20:37:12,956 INFO host: openam-perf-200m.forgeblocks.com 2025-01-16 20:37:12,956 INFO content-length: 0 2025-01-16 20:37:12,956 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-16 20:37:12,956 INFO ========================= 2025-01-16 20:37:12,956 INFO HTTP response: 2025-01-16 20:37:12,956 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 20:37:12,956 INFO 20:36:41.726 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-16 20:37:12,956 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-16 20:37:12,956 INFO Request: 2025-01-16 20:37:12,956 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-16 20:37:12,956 INFO ========================= 2025-01-16 20:37:12,956 INFO Session: 2025-01-16 20:37:12,956 INFO Session(idc.benchmark.Mix2024,178827,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.55484953, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@7a64c123, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@5652d777),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007e512c69a0e0@40605e01,io.netty.channel.epoll.EpollEventLoop@650eab8) 2025-01-16 20:37:12,956 INFO ========================= 2025-01-16 20:37:12,956 INFO HTTP request: 2025-01-16 20:37:12,956 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-16 20:37:12,956 INFO headers: 2025-01-16 20:37:12,956 INFO accept: application/json 2025-01-16 20:37:12,956 INFO content-type: application/json 2025-01-16 20:37:12,956 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 2025-01-16 20:37:12,956 INFO X-Forwarded-For: 42.42.42.42 2025-01-16 20:37:12,956 INFO host: openam-perf-200m.forgeblocks.com 2025-01-16 20:37:12,956 INFO content-length: 0 2025-01-16 20:37:12,956 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-16 20:37:12,956 INFO ========================= 2025-01-16 20:37:12,956 INFO HTTP response: 2025-01-16 20:37:12,956 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 20:37:12,956 INFO 20:36:41.726 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-163' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-16 20:37:12,956 INFO 20:36:41.726 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-133' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-16 20:37:12,956 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 20:37:12,956 INFO [INFO] BUILD SUCCESS 2025-01-16 20:37:12,956 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 20:37:12,956 INFO [INFO] Total time: 01:00 h 2025-01-16 20:37:12,956 INFO [INFO] Finished at: 2025-01-16T20:36:41Z 2025-01-16 20:37:12,956 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 20:37:12,956 INFO 2025-01-16 20:36:41,832 INFO Gatling simulation run ended successfully 2025-01-16 20:37:12,956 INFO 2025-01-16 20:36:41,833 DEBUG No archive name provided. No archive will be created 2025-01-16 20:37:12,956 INFO ________________________________________________________________________________ [2025-01-16 20:37:12] benchmark-50 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-16 20:37:12,956 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stderr.txt is small (0 lines), printing all lines: 2025-01-16 20:37:12,956 DEBUG ----- output ----- 2025-01-16 20:37:12,956 DEBUG 2025-01-16 20:37:12,956 INFO ________________________________________________________________________________ [2025-01-16 20:37:12] benchmark-50 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-16 20:37:13] benchmark-50 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-16 20:37:13] benchmark-50 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped