--Task-- name: benchmark-90 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-50'] preceding_task: benchmark-50 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 90} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-17 06:25:26] benchmark-90 pre : N/A ________________________________________________________________________________ 2025-01-17 06:25:26,487 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-17 06:25:26 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-17 06:25:26 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-90/stdout.txt Pod log : /results/orders/benchmark-90 2025-01-17 06:25:26,487 INFO 2025-01-17 06:25:26,487 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:26,487 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:26,767 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:26,767 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:26,767 DEBUG --- stdout --- 2025-01-17 06:25:26,768 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:26,768 DEBUG --- stderr --- 2025-01-17 06:25:26,768 DEBUG ________________________________________________________________________________ [2025-01-17 06:25:26] benchmark-90 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-17 06:25:26,769 INFO 2025-01-17 06:25:26,770 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:26,770 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:27,053 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:27,053 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:27,053 DEBUG --- stdout --- 2025-01-17 06:25:27,053 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:27,053 DEBUG --- stderr --- 2025-01-17 06:25:27,053 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-90" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=90 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-17 06:25:27] benchmark-90 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-17 06:25:27,054 INFO 2025-01-17 06:25:27,054 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:27,054 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:27,333 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:27,333 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:27,333 DEBUG --- stdout --- 2025-01-17 06:25:27,333 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:27,333 DEBUG --- stderr --- 2025-01-17 06:25:27,333 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/order.json { "name": "benchmark-90", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-90\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=90 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-90" } ________________________________________________________________________________ [2025-01-17 06:25:27] benchmark-90 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-17 06:25:27,337 INFO 2025-01-17 06:25:27,337 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-17 06:25:27,337 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 06:25:27,554 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 06:25:27,554 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:27,554 DEBUG --- stdout --- 2025-01-17 06:25:27,554 DEBUG WAITING 2025-01-17 06:25:27,554 DEBUG --- stderr --- 2025-01-17 06:25:27,554 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-01-17 06:25:27] benchmark-90 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-17 06:25:27,555 INFO 2025-01-17 06:25:27,555 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:27,555 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:27,834 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:27,834 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:27,834 DEBUG --- stdout --- 2025-01-17 06:25:27,834 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:27,834 DEBUG --- stderr --- 2025-01-17 06:25:27,834 DEBUG 2025-01-17 06:25:27,834 INFO 2025-01-17 06:25:27,834 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-17 06:25:27,834 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 06:25:29,208 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:29,208 DEBUG --- stdout --- 2025-01-17 06:25:29,208 DEBUG 2025-01-17 06:25:29,208 DEBUG --- stderr --- 2025-01-17 06:25:29,208 DEBUG Order has been successfully forwarded to overseer 2025-01-17 06:25:29 - INFO: Check if Gatling simulation started successfully 2025-01-17 06:25:29,208 INFO 2025-01-17 06:25:29,208 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:29,208 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:29,488 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:29,488 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:29,488 DEBUG --- stdout --- 2025-01-17 06:25:29,488 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:29,488 DEBUG --- stderr --- 2025-01-17 06:25:29,488 DEBUG 2025-01-17 06:25:29,489 INFO 2025-01-17 06:25:29,489 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-90/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-17 06:25:29,489 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 06:25:30,227 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 06:25:35,971 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 06:25:41,745 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 06:25:47,476 INFO [loop_until]: Function succeeded after 17s (rc=0) - expected pattern found 2025-01-17 06:25:47,476 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:47,476 DEBUG --- stdout --- 2025-01-17 06:25:47,476 DEBUG 2025-01-17 06:25:30,262 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp0j142krv 2025-01-17 06:25:30,265 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-90" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=90 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmp0j142krv/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmp0j142krv/target/test-classes ... [INFO] compile in 11.4 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 06:25:47,476 DEBUG --- stderr --- 2025-01-17 06:25:47,476 DEBUG ________________________________________________________________________________ [2025-01-17 06:25:47] benchmark-90 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 04s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 05s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 07s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 08s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 09s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-17 07:25:56] benchmark-90 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-17 07:25:56,840 INFO 2025-01-17 07:25:56,840 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:25:56,840 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:25:57,140 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:25:57,140 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:25:57,140 DEBUG --- stdout --- 2025-01-17 07:25:57,140 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:25:57,140 DEBUG --- stderr --- 2025-01-17 07:25:57,140 DEBUG 2025-01-17 07:25:57,140 INFO 2025-01-17 07:25:57,140 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-17 07:25:57,140 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 07:25:57,923 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:25:57,923 DEBUG --- stdout --- 2025-01-17 07:25:57,923 DEBUG 2025-01-17 07:25:57,923 DEBUG --- stderr --- 2025-01-17 07:25:57,923 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-17 07:25:57] benchmark-90 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-17 07:25:57 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/order.json 2025-01-17 07:25:57,923 INFO 2025-01-17 07:25:57,923 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:25:57,923 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:25:58,202 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:25:58,202 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:25:58,202 DEBUG --- stdout --- 2025-01-17 07:25:58,202 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:25:58,202 DEBUG --- stderr --- 2025-01-17 07:25:58,202 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 07:25:58,202 INFO 2025-01-17 07:25:58,202 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:25:58,202 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:25:58,483 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:25:58,483 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:25:58,483 DEBUG --- stdout --- 2025-01-17 07:25:58,483 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:25:58,483 DEBUG --- stderr --- 2025-01-17 07:25:58,483 DEBUG 2025-01-17 07:25:58,484 INFO 2025-01-17 07:25:58,484 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-90/rc.txt" ]; then echo "/results/orders/benchmark-90/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-90/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-90/rc.txt file found" 2025-01-17 07:25:58,484 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 07:25:59,278 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 07:25:59,278 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:25:59,278 DEBUG --- stdout --- 2025-01-17 07:25:59,278 DEBUG /results/orders/benchmark-90/rc.txt file found 2025-01-17 07:25:59,278 DEBUG --- stderr --- 2025-01-17 07:25:59,278 DEBUG 2025-01-17 07:25:59,279 INFO 2025-01-17 07:25:59,279 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:25:59,279 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:25:59,557 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:25:59,557 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:25:59,557 DEBUG --- stdout --- 2025-01-17 07:25:59,557 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:25:59,557 DEBUG --- stderr --- 2025-01-17 07:25:59,557 DEBUG 2025-01-17 07:25:59,557 INFO 2025-01-17 07:25:59,557 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-90/rc.txt 2025-01-17 07:26:00,358 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 07:26:00,358 DEBUG --- stdout --- 2025-01-17 07:26:00,358 DEBUG 4 /results/orders/benchmark-90/rc.txt 2025-01-17 07:26:00,358 DEBUG --- stderr --- 2025-01-17 07:26:00,358 DEBUG 2025-01-17 07:26:00,358 INFO - Download file (size 4k) 2025-01-17 07:26:00,359 INFO 2025-01-17 07:26:00,359 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:00,359 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:00,640 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:00,640 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:00,640 DEBUG --- stdout --- 2025-01-17 07:26:00,640 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:00,640 DEBUG --- stderr --- 2025-01-17 07:26:00,640 DEBUG source : /results/orders/benchmark-90/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/rc.txt 2025-01-17 07:26:00,640 INFO 2025-01-17 07:26:00,640 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:00,640 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:00,918 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:00,918 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:00,918 DEBUG --- stdout --- 2025-01-17 07:26:00,918 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:00,918 DEBUG --- stderr --- 2025-01-17 07:26:00,918 DEBUG 2025-01-17 07:26:00,919 INFO 2025-01-17 07:26:00,919 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-90/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/rc.txt 2025-01-17 07:26:00,919 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 07:26:01,680 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:01,680 DEBUG --- stdout --- 2025-01-17 07:26:01,680 DEBUG tar: Removing leading `/' from member names 2025-01-17 07:26:01,680 DEBUG --- stderr --- 2025-01-17 07:26:01,680 DEBUG 2025-01-17 07:26:01,680 INFO 2025-01-17 07:26:01,680 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:01,680 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:01,959 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:01,959 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:01,959 DEBUG --- stdout --- 2025-01-17 07:26:01,959 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:01,959 DEBUG --- stderr --- 2025-01-17 07:26:01,959 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 07:26:01,959 INFO 2025-01-17 07:26:01,959 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:01,959 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:02,237 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:02,238 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:02,238 DEBUG --- stdout --- 2025-01-17 07:26:02,238 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:02,238 DEBUG --- stderr --- 2025-01-17 07:26:02,238 DEBUG 2025-01-17 07:26:02,238 INFO 2025-01-17 07:26:02,238 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-90/stderr.txt" ]; then echo "/results/orders/benchmark-90/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-90/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-90/stderr.txt file found" 2025-01-17 07:26:02,238 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 07:26:03,042 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 07:26:03,042 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:03,042 DEBUG --- stdout --- 2025-01-17 07:26:03,043 DEBUG /results/orders/benchmark-90/stderr.txt file found 2025-01-17 07:26:03,043 DEBUG --- stderr --- 2025-01-17 07:26:03,043 DEBUG 2025-01-17 07:26:03,043 INFO 2025-01-17 07:26:03,043 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:03,043 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:03,323 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:03,324 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:03,324 DEBUG --- stdout --- 2025-01-17 07:26:03,324 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:03,324 DEBUG --- stderr --- 2025-01-17 07:26:03,324 DEBUG 2025-01-17 07:26:03,324 INFO 2025-01-17 07:26:03,324 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-90/stderr.txt 2025-01-17 07:26:04,126 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 07:26:04,126 DEBUG --- stdout --- 2025-01-17 07:26:04,126 DEBUG 0 /results/orders/benchmark-90/stderr.txt 2025-01-17 07:26:04,126 DEBUG --- stderr --- 2025-01-17 07:26:04,126 DEBUG 2025-01-17 07:26:04,126 INFO - Download file (size 0k) 2025-01-17 07:26:04,127 INFO 2025-01-17 07:26:04,127 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:04,127 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:04,405 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:04,405 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:04,405 DEBUG --- stdout --- 2025-01-17 07:26:04,405 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:04,405 DEBUG --- stderr --- 2025-01-17 07:26:04,405 DEBUG source : /results/orders/benchmark-90/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/stderr.txt 2025-01-17 07:26:04,406 INFO 2025-01-17 07:26:04,406 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:04,406 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:04,684 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:04,685 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:04,685 DEBUG --- stdout --- 2025-01-17 07:26:04,685 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:04,685 DEBUG --- stderr --- 2025-01-17 07:26:04,685 DEBUG 2025-01-17 07:26:04,685 INFO 2025-01-17 07:26:04,685 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-90/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/stderr.txt 2025-01-17 07:26:04,685 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 07:26:05,410 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:05,410 DEBUG --- stdout --- 2025-01-17 07:26:05,410 DEBUG tar: Removing leading `/' from member names 2025-01-17 07:26:05,410 DEBUG --- stderr --- 2025-01-17 07:26:05,410 DEBUG 2025-01-17 07:26:05,411 INFO 2025-01-17 07:26:05,411 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:05,411 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:05,693 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:05,693 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:05,693 DEBUG --- stdout --- 2025-01-17 07:26:05,693 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:05,693 DEBUG --- stderr --- 2025-01-17 07:26:05,693 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 07:26:05,693 INFO 2025-01-17 07:26:05,693 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:05,693 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:05,971 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:05,971 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:05,971 DEBUG --- stdout --- 2025-01-17 07:26:05,971 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:05,971 DEBUG --- stderr --- 2025-01-17 07:26:05,971 DEBUG 2025-01-17 07:26:05,972 INFO 2025-01-17 07:26:05,972 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-90/stdout.txt" ]; then echo "/results/orders/benchmark-90/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-90/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-90/stdout.txt file found" 2025-01-17 07:26:05,972 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 07:26:06,773 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 07:26:06,773 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:06,773 DEBUG --- stdout --- 2025-01-17 07:26:06,773 DEBUG /results/orders/benchmark-90/stdout.txt file found 2025-01-17 07:26:06,773 DEBUG --- stderr --- 2025-01-17 07:26:06,773 DEBUG 2025-01-17 07:26:06,773 INFO 2025-01-17 07:26:06,773 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:06,773 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:07,055 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:07,055 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:07,055 DEBUG --- stdout --- 2025-01-17 07:26:07,055 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:07,055 DEBUG --- stderr --- 2025-01-17 07:26:07,055 DEBUG 2025-01-17 07:26:07,055 INFO 2025-01-17 07:26:07,055 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-90/stdout.txt 2025-01-17 07:26:07,863 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 07:26:07,864 DEBUG --- stdout --- 2025-01-17 07:26:07,864 DEBUG 4260 /results/orders/benchmark-90/stdout.txt 2025-01-17 07:26:07,864 DEBUG --- stderr --- 2025-01-17 07:26:07,864 DEBUG 2025-01-17 07:26:07,864 INFO - Download file (size 4260k) 2025-01-17 07:26:07,864 INFO 2025-01-17 07:26:07,864 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:07,864 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:08,166 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:08,166 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:08,166 DEBUG --- stdout --- 2025-01-17 07:26:08,166 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:08,166 DEBUG --- stderr --- 2025-01-17 07:26:08,166 DEBUG source : /results/orders/benchmark-90/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/stdout.txt 2025-01-17 07:26:08,166 INFO 2025-01-17 07:26:08,166 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:08,166 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:08,443 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:08,443 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:08,443 DEBUG --- stdout --- 2025-01-17 07:26:08,444 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:08,444 DEBUG --- stderr --- 2025-01-17 07:26:08,444 DEBUG 2025-01-17 07:26:08,444 INFO 2025-01-17 07:26:08,444 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-90/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/stdout.txt 2025-01-17 07:26:08,444 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 07:26:09,702 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:09,703 DEBUG --- stdout --- 2025-01-17 07:26:09,703 DEBUG tar: Removing leading `/' from member names 2025-01-17 07:26:09,703 DEBUG --- stderr --- 2025-01-17 07:26:09,703 DEBUG ________________________________________________________________________________ [2025-01-17 07:26:09] benchmark-90 show_cmd : Display order command ________________________________________________________________________________ 2025-01-17 07:26:09,703 INFO 2025-01-17 07:26:09,703 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:09,703 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:09,980 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:09,980 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:09,980 DEBUG --- stdout --- 2025-01-17 07:26:09,980 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:09,980 DEBUG --- stderr --- 2025-01-17 07:26:09,980 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 07:26:09,981 INFO 2025-01-17 07:26:09,981 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:09,981 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:10,279 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:10,279 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:10,279 DEBUG --- stdout --- 2025-01-17 07:26:10,279 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:10,279 DEBUG --- stderr --- 2025-01-17 07:26:10,279 DEBUG 2025-01-17 07:26:10,280 INFO 2025-01-17 07:26:10,280 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-90/cmd.txt" ]; then echo "/results/orders/benchmark-90/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-90/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-90/cmd.txt file found" 2025-01-17 07:26:10,280 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 07:26:11,081 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 07:26:11,081 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:11,081 DEBUG --- stdout --- 2025-01-17 07:26:11,081 DEBUG /results/orders/benchmark-90/cmd.txt file found 2025-01-17 07:26:11,081 DEBUG --- stderr --- 2025-01-17 07:26:11,081 DEBUG 2025-01-17 07:26:11,082 INFO 2025-01-17 07:26:11,082 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:11,082 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:11,361 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:11,361 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:11,361 DEBUG --- stdout --- 2025-01-17 07:26:11,361 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:11,361 DEBUG --- stderr --- 2025-01-17 07:26:11,361 DEBUG 2025-01-17 07:26:11,361 INFO 2025-01-17 07:26:11,361 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-90/cmd.txt 2025-01-17 07:26:12,168 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 07:26:12,168 DEBUG --- stdout --- 2025-01-17 07:26:12,168 DEBUG 4 /results/orders/benchmark-90/cmd.txt 2025-01-17 07:26:12,168 DEBUG --- stderr --- 2025-01-17 07:26:12,168 DEBUG 2025-01-17 07:26:12,168 INFO - Download file (size 4k) 2025-01-17 07:26:12,168 INFO 2025-01-17 07:26:12,168 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:12,168 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:12,445 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:12,445 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:12,445 DEBUG --- stdout --- 2025-01-17 07:26:12,446 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:12,446 DEBUG --- stderr --- 2025-01-17 07:26:12,446 DEBUG source : /results/orders/benchmark-90/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/cmd.txt 2025-01-17 07:26:12,446 INFO 2025-01-17 07:26:12,446 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:12,446 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:12,725 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:12,725 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:12,725 DEBUG --- stdout --- 2025-01-17 07:26:12,725 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:12,725 DEBUG --- stderr --- 2025-01-17 07:26:12,725 DEBUG 2025-01-17 07:26:12,726 INFO 2025-01-17 07:26:12,726 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-90/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/cmd.txt 2025-01-17 07:26:12,726 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 07:26:13,486 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:13,486 DEBUG --- stdout --- 2025-01-17 07:26:13,487 DEBUG tar: Removing leading `/' from member names 2025-01-17 07:26:13,487 DEBUG --- stderr --- 2025-01-17 07:26:13,487 DEBUG 2025-01-17 07:26:13,487 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/cmd.txt is small (1 lines), printing all lines: 2025-01-17 07:26:13,487 DEBUG ----- output ----- 2025-01-17 07:26:13,487 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-90" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=90 -Duser_password=Pa_ssw0rd" 2025-01-17 07:26:13,487 INFO ________________________________________________________________________________ [2025-01-17 07:26:13] benchmark-90 show_rc : Display rc order ________________________________________________________________________________ 2025-01-17 07:26:13,487 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/rc.txt is small (1 lines), printing all lines: 2025-01-17 07:26:13,487 DEBUG ----- output ----- 2025-01-17 07:26:13,487 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-17 07:26:13,487 INFO ________________________________________________________________________________ [2025-01-17 07:26:13] benchmark-90 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-17 07:26:13,493 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/stdout.txt is 57112 lines): 2025-01-17 07:26:13,493 DEBUG ----- output ----- 2025-01-17 07:26:13,493 INFO 2025-01-17 06:25:30,262 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp0j142krv 2025-01-17 07:26:13,493 INFO 2025-01-17 06:25:30,265 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-90" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=90 -Duser_password=**** 2025-01-17 07:26:13,493 INFO [INFO] Scanning for projects... 2025-01-17 07:26:13,493 INFO [INFO] 2025-01-17 07:26:13,493 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-17 07:26:13,493 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-17 07:26:13,493 INFO [INFO] from pom.xml 2025-01-17 07:26:13,493 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-17 07:26:13,493 INFO [INFO] 2025-01-17 07:26:13,493 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-17 07:26:13,493 INFO [INFO] 2025-01-17 07:26:13,493 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-17 07:26:13,493 INFO [INFO] skip non existing resourceDirectory /tmp/tmp0j142krv/src/main/resources 2025-01-17 07:26:13,493 INFO [INFO] 2025-01-17 07:26:13,493 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-17 07:26:13,493 INFO [INFO] No sources to compile 2025-01-17 07:26:13,493 INFO [INFO] 2025-01-17 07:26:13,493 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-17 07:26:13,493 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-17 07:26:13,494 INFO [INFO] 2025-01-17 07:26:13,494 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-17 07:26:13,494 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-17 07:26:13,494 INFO [INFO] 2025-01-17 07:26:13,494 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-17 07:26:13,494 INFO [INFO] compiling 38 Scala sources to /tmp/tmp0j142krv/target/test-classes ... 2025-01-17 07:26:13,494 INFO [INFO] compile in 11.4 s 2025-01-17 07:26:13,494 INFO [INFO] 2025-01-17 07:26:13,494 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-17 07:26:13,494 INFO [INFO] 2025-01-17 07:26:13,494 INFO [INFO] 2025-01-17 07:26:13,494 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-17 07:26:13,494 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-17 07:26:13,494 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-17 07:26:13,494 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-17 07:26:13,494 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 07:26:13,494 INFO 2025-01-17 07:26:13,494 INFO ================================================================================ 2025-01-17 07:26:13,494 INFO 2025-01-17 06:25:52 GMT 5s elapsed 2025-01-17 07:26:13,494 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 07:26:13,494 INFO > Global (OK=409 KO=0 ) 2025-01-17 07:26:13,494 INFO > restLoginInitiate (OK=37 KO=0 ) 2025-01-17 07:26:13,494 INFO > restLoginUsernamePasswordCallback (OK=36 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI-Post-Login - stage 1 (OK=8 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=8 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI AM idFromSession (OK=7 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI AM validateGoto (OK=7 KO=0 ) 2025-01-17 07:26:13,494 INFO > User Authorize PKCE stage (OK=40 KO=0 ) 2025-01-17 07:26:13,494 INFO > User AccessToken PKCE stage (OK=39 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI-Post-Login - stage 2 (OK=7 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=7 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI Enduser appAuthHelper1 (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI Enduser appAuthHelper2 (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI-Post-Login - stage 3 (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM uiconfig (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI Enduser sessioncheck (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM version (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM features (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM login (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM privilege (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM dashboard (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM managed user schema (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM user (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI IDM oidcToken (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > userinfo (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI-Logout (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI-Logout Redirect 1 (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI AM revoke1 (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI AM revoke2 (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > UI AM endsession (OK=6 KO=0 ) 2025-01-17 07:26:13,494 INFO > Skip 2FA (OK=23 KO=0 ) 2025-01-17 07:26:13,494 INFO > GetUUid (OK=12 KO=0 ) 2025-01-17 07:26:13,494 INFO > GetOpenidConfig (OK=12 KO=0 ) 2025-01-17 07:26:13,494 INFO > CreatePolicy (OK=12 KO=0 ) 2025-01-17 07:26:13,494 INFO > RootUserinfo (OK=10 KO=0 ) 2025-01-17 07:26:13,494 INFO > tokenUserinfo (OK=4 KO=0 ) 2025-01-17 07:26:13,494 INFO > getIdToken (OK=4 KO=0 ) 2025-01-17 07:26:13,494 INFO > getIdToken Redirect 1 (OK=4 KO=0 ) 2025-01-17 07:26:13,494 INFO > createOrganization (OK=4 KO=0 ) 2025-01-17 07:26:13,494 INFO > queryOrganization (OK=4 KO=0 ) 2025-01-17 07:26:13,494 INFO > deleteOrganization (OK=4 KO=0 ) 2025-01-17 07:26:13,495 INFO 2025-01-17 07:26:13,495 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 07:26:13,495 INFO [- ] 0% 2025-01-17 07:26:13,495 INFO waiting: 325757 / active: 24 / done: 13 2025-01-17 07:26:13,495 INFO ================================================================================ 2025-01-17 07:26:13,495 INFO 2025-01-17 07:26:13,495 INFO 2025-01-17 07:26:13,495 INFO ================================================================================ 2025-01-17 07:26:13,495 INFO 2025-01-17 06:25:57 GMT 10s elapsed 2025-01-17 07:26:13,495 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 07:26:13,495 INFO > Global (OK=1793 KO=0 ) 2025-01-17 07:26:13,495 INFO > restLoginInitiate (OK=146 KO=0 ) 2025-01-17 07:26:13,495 INFO > restLoginUsernamePasswordCallback (OK=144 KO=0 ) 2025-01-17 07:26:13,495 INFO > UI-Post-Login - stage 1 (OK=34 KO=0 ) 2025-01-17 07:26:13,495 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=34 KO=0 ) 2025-01-17 07:26:13,495 INFO > UI AM idFromSession (OK=33 KO=0 ) 2025-01-17 07:26:13,495 INFO > UI AM validateGoto (OK=33 KO=0 ) 2025-01-17 07:26:13,495 INFO > User Authorize PKCE stage (OK=169 KO=0 ) 2025-01-17 07:26:13,495 INFO > User AccessToken PKCE stage (OK=166 KO=0 ) 2025-01-17 07:26:13,495 INFO [...] 2025-01-17 07:26:13,503 INFO Request: 2025-01-17 07:26:13,503 INFO UI AM validateGoto: KO j.i.IOException: Premature close 2025-01-17 07:26:13,503 INFO ========================= 2025-01-17 07:26:13,503 INFO Session: 2025-01-17 07:26:13,503 INFO Session(idc.benchmark.Mix2024,323052,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.30772288, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@74db1679, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, callbacks -> {"tokenId":"iMSGRnznmLNgGIrzjFoafyC-jeM.*AAJTSQACMDIAAlNLABxLVzBoaHdNbVM2WkxlRUJMYXByeldrQSs4QzQ9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737098747278), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=iMSGRnznmLNgGIrzjFoafyC-jeM.*AAJTSQACMDIAAlNLABxLVzBoaHdNbVM2WkxlRUJMYXByeldrQSs4QzQ9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737098747278))), password -> Pa_ssw0rd, fake-ip -> 237.174.35.149, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@11a1af9a, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@3a7d3f9e, tokenId -> iMSGRnznmLNgGIrzjFoafyC-jeM.*AAJTSQACMDIAAlNLABxLVzBoaHdNbVM2WkxlRUJMYXByeldrQSs4QzQ9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.140 Safari/537.36 Edge/17.17134),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x000079837069b320@2074b320,io.netty.channel.epoll.EpollEventLoop@30f5a68a) 2025-01-17 07:26:13,503 INFO ========================= 2025-01-17 07:26:13,503 INFO HTTP request: 2025-01-17 07:26:13,503 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/users?_action=validateGoto 2025-01-17 07:26:13,503 INFO headers: 2025-01-17 07:26:13,503 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-17 07:26:13,503 INFO Accept-API-Version: resource=2.1, protocol=1.0 2025-01-17 07:26:13,503 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-17 07:26:13,503 INFO accept: */* 2025-01-17 07:26:13,503 INFO cookie: amlbcookie=01; 15892ffd844ef80=iMSGRnznmLNgGIrzjFoafyC-jeM.*AAJTSQACMDIAAlNLABxLVzBoaHdNbVM2WkxlRUJMYXByeldrQSs4QzQ9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-17 07:26:13,503 INFO origin: https://openam-perf-200m.forgeblocks.com 2025-01-17 07:26:13,503 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 07:26:13,503 INFO content-length: 0 2025-01-17 07:26:13,503 INFO cookies: 2025-01-17 07:26:13,503 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 07:26:13,503 INFO 15892ffd844ef80=iMSGRnznmLNgGIrzjFoafyC-jeM.*AAJTSQACMDIAAlNLABxLVzBoaHdNbVM2WkxlRUJMYXByeldrQSs4QzQ9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 07:26:13,503 INFO ========================= 2025-01-17 07:26:13,503 INFO HTTP response: 2025-01-17 07:26:13,503 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 07:26:13,504 INFO 07:25:47.383 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 07:26:13,504 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 07:26:13,504 INFO Request: 2025-01-17 07:26:13,504 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 07:26:13,504 INFO ========================= 2025-01-17 07:26:13,504 INFO Session: 2025-01-17 07:26:13,504 INFO Session(idc.benchmark.Mix2024,323077,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.12437217, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@4e8cf461, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0, password -> Pa_ssw0rd, fake-ip -> 62.235.249.160, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@42285507),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x000079837069b320@2074b320,io.netty.channel.epoll.EpollEventLoop@619bfe29) 2025-01-17 07:26:13,504 INFO ========================= 2025-01-17 07:26:13,504 INFO HTTP request: 2025-01-17 07:26:13,504 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2025-01-17 07:26:13,504 INFO headers: 2025-01-17 07:26:13,504 INFO accept: application/json 2025-01-17 07:26:13,504 INFO content-type: application/json 2025-01-17 07:26:13,504 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0 2025-01-17 07:26:13,504 INFO X-Forwarded-For: 62.235.249.160 2025-01-17 07:26:13,504 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 07:26:13,504 INFO content-length: 0 2025-01-17 07:26:13,504 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 07:26:13,504 INFO ========================= 2025-01-17 07:26:13,504 INFO HTTP response: 2025-01-17 07:26:13,504 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 07:26:13,504 INFO 07:25:47.383 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 07:26:13,504 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 07:26:13,504 INFO Request: 2025-01-17 07:26:13,504 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 07:26:13,504 INFO ========================= 2025-01-17 07:26:13,504 INFO Session: 2025-01-17 07:26:13,504 INFO Session(idc.benchmark.Mix2024,323074,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.25584850, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@4730e9da, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0, password -> Pa_ssw0rd, fake-ip -> 62.40.94.111, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4aad921d),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x000079837069b320@2074b320,io.netty.channel.epoll.EpollEventLoop@14f5da2c) 2025-01-17 07:26:13,504 INFO ========================= 2025-01-17 07:26:13,504 INFO HTTP request: 2025-01-17 07:26:13,504 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-17 07:26:13,504 INFO headers: 2025-01-17 07:26:13,504 INFO accept: application/json 2025-01-17 07:26:13,504 INFO content-type: application/json 2025-01-17 07:26:13,504 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0 2025-01-17 07:26:13,504 INFO X-Forwarded-For: 62.40.94.111 2025-01-17 07:26:13,504 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 07:26:13,504 INFO content-length: 0 2025-01-17 07:26:13,504 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 07:26:13,504 INFO ========================= 2025-01-17 07:26:13,504 INFO HTTP response: 2025-01-17 07:26:13,504 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 07:26:13,504 INFO 07:25:47.383 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 07:26:13,504 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 07:26:13,504 INFO Request: 2025-01-17 07:26:13,504 INFO UI AM validateGoto: KO j.i.IOException: Premature close 2025-01-17 07:26:13,504 INFO ========================= 2025-01-17 07:26:13,504 INFO Session: 2025-01-17 07:26:13,504 INFO Session(idc.benchmark.Mix2024,323050,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.37976973, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@39198af5, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, callbacks -> {"tokenId":"2pAEw6Z13BeXpFW-uPdDVhg-n2k.*AAJTSQACMDIAAlNLABxRdlY5dGRRRUg0U20reDB2YkhCYXBFcmVLL0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737098747274), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=2pAEw6Z13BeXpFW-uPdDVhg-n2k.*AAJTSQACMDIAAlNLABxRdlY5dGRRRUg0U20reDB2YkhCYXBFcmVLL0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737098747274))), password -> Pa_ssw0rd, fake-ip -> 0.81.217.222, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4b8a1087, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@49da35aa, tokenId -> 2pAEw6Z13BeXpFW-uPdDVhg-n2k.*AAJTSQACMDIAAlNLABxRdlY5dGRRRUg0U20reDB2YkhCYXBFcmVLL0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x000079837069b320@2074b320,io.netty.channel.epoll.EpollEventLoop@2bef51f2) 2025-01-17 07:26:13,504 INFO ========================= 2025-01-17 07:26:13,504 INFO HTTP request: 2025-01-17 07:26:13,504 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/users?_action=validateGoto 2025-01-17 07:26:13,504 INFO headers: 2025-01-17 07:26:13,504 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-17 07:26:13,504 INFO Accept-API-Version: resource=2.1, protocol=1.0 2025-01-17 07:26:13,504 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-17 07:26:13,504 INFO accept: */* 2025-01-17 07:26:13,504 INFO cookie: amlbcookie=01; 15892ffd844ef80=2pAEw6Z13BeXpFW-uPdDVhg-n2k.*AAJTSQACMDIAAlNLABxRdlY5dGRRRUg0U20reDB2YkhCYXBFcmVLL0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-17 07:26:13,504 INFO origin: https://openam-perf-200m.forgeblocks.com 2025-01-17 07:26:13,504 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 07:26:13,505 INFO content-length: 0 2025-01-17 07:26:13,505 INFO cookies: 2025-01-17 07:26:13,505 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 07:26:13,505 INFO 15892ffd844ef80=2pAEw6Z13BeXpFW-uPdDVhg-n2k.*AAJTSQACMDIAAlNLABxRdlY5dGRRRUg0U20reDB2YkhCYXBFcmVLL0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 07:26:13,505 INFO ========================= 2025-01-17 07:26:13,505 INFO HTTP response: 2025-01-17 07:26:13,505 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 07:26:13,505 INFO 07:25:47.383 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 07:26:13,505 INFO 07:25:47.384 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-163' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 07:26:13,505 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 07:26:13,505 INFO [INFO] BUILD SUCCESS 2025-01-17 07:26:13,505 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 07:26:13,505 INFO [INFO] Total time: 01:00 h 2025-01-17 07:26:13,505 INFO [INFO] Finished at: 2025-01-17T07:25:47Z 2025-01-17 07:26:13,505 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 07:26:13,505 INFO 2025-01-17 07:25:47,478 INFO Gatling simulation run ended successfully 2025-01-17 07:26:13,505 INFO 2025-01-17 07:25:47,478 DEBUG No archive name provided. No archive will be created 2025-01-17 07:26:13,505 INFO ________________________________________________________________________________ [2025-01-17 07:26:13] benchmark-90 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-17 07:26:13,505 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/03_benchmark-90/stderr.txt is small (0 lines), printing all lines: 2025-01-17 07:26:13,505 DEBUG ----- output ----- 2025-01-17 07:26:13,505 DEBUG 2025-01-17 07:26:13,505 INFO ________________________________________________________________________________ [2025-01-17 07:26:13] benchmark-90 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-17 07:26:13] benchmark-90 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-17 07:26:13] benchmark-90 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped