--Task-- name: benchmark-120 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-90'] preceding_task: benchmark-90 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 120} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-17 07:26:14] benchmark-120 pre : N/A ________________________________________________________________________________ 2025-01-17 07:26:14,349 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-17 07:26:14 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-17 07:26:14 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-120/stdout.txt Pod log : /results/orders/benchmark-120 2025-01-17 07:26:14,350 INFO 2025-01-17 07:26:14,350 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:14,350 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:14,628 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:14,628 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:14,628 DEBUG --- stdout --- 2025-01-17 07:26:14,628 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:14,628 DEBUG --- stderr --- 2025-01-17 07:26:14,628 DEBUG ________________________________________________________________________________ [2025-01-17 07:26:14] benchmark-120 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-17 07:26:14,628 INFO 2025-01-17 07:26:14,628 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:14,628 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:14,905 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:14,905 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:14,905 DEBUG --- stdout --- 2025-01-17 07:26:14,905 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:14,905 DEBUG --- stderr --- 2025-01-17 07:26:14,905 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-120" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=120 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-17 07:26:14] benchmark-120 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-17 07:26:14,906 INFO 2025-01-17 07:26:14,906 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:14,906 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:15,181 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:15,181 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:15,181 DEBUG --- stdout --- 2025-01-17 07:26:15,181 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:15,181 DEBUG --- stderr --- 2025-01-17 07:26:15,181 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/order.json { "name": "benchmark-120", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-120\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=120 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-120" } ________________________________________________________________________________ [2025-01-17 07:26:15] benchmark-120 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-17 07:26:15,184 INFO 2025-01-17 07:26:15,184 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-17 07:26:15,184 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 07:26:15,400 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 07:26:15,401 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:15,401 DEBUG --- stdout --- 2025-01-17 07:26:15,401 DEBUG WAITING 2025-01-17 07:26:15,401 DEBUG --- stderr --- 2025-01-17 07:26:15,401 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-01-17 07:26:15] benchmark-120 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-17 07:26:15,401 INFO 2025-01-17 07:26:15,401 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:15,401 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:15,678 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:15,678 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:15,678 DEBUG --- stdout --- 2025-01-17 07:26:15,678 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:15,678 DEBUG --- stderr --- 2025-01-17 07:26:15,678 DEBUG 2025-01-17 07:26:15,678 INFO 2025-01-17 07:26:15,678 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-17 07:26:15,678 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 07:26:17,042 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:17,042 DEBUG --- stdout --- 2025-01-17 07:26:17,042 DEBUG 2025-01-17 07:26:17,042 DEBUG --- stderr --- 2025-01-17 07:26:17,042 DEBUG Order has been successfully forwarded to overseer 2025-01-17 07:26:17 - INFO: Check if Gatling simulation started successfully 2025-01-17 07:26:17,042 INFO 2025-01-17 07:26:17,042 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 07:26:17,042 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 07:26:17,320 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 07:26:17,320 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:17,320 DEBUG --- stdout --- 2025-01-17 07:26:17,321 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 07:26:17,321 DEBUG --- stderr --- 2025-01-17 07:26:17,321 DEBUG 2025-01-17 07:26:17,321 INFO 2025-01-17 07:26:17,321 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-120/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-17 07:26:17,321 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 07:26:18,049 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 07:26:23,837 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 07:26:29,579 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 07:26:35,314 INFO [loop_until]: Function succeeded after 17s (rc=0) - expected pattern found 2025-01-17 07:26:35,314 INFO [loop_until]: OK (rc = 0) 2025-01-17 07:26:35,314 DEBUG --- stdout --- 2025-01-17 07:26:35,314 DEBUG 2025-01-17 07:26:18,167 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp4umkca8d 2025-01-17 07:26:18,169 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-120" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=120 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmp4umkca8d/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmp4umkca8d/target/test-classes ... [INFO] compile in 11.1 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 07:26:35,314 DEBUG --- stderr --- 2025-01-17 07:26:35,314 DEBUG ________________________________________________________________________________ [2025-01-17 07:26:35] benchmark-120 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 07s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-17 08:26:44] benchmark-120 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-17 08:26:44,142 INFO 2025-01-17 08:26:44,143 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:44,143 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:44,444 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:44,444 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:44,444 DEBUG --- stdout --- 2025-01-17 08:26:44,444 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:44,444 DEBUG --- stderr --- 2025-01-17 08:26:44,444 DEBUG 2025-01-17 08:26:44,444 INFO 2025-01-17 08:26:44,444 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-17 08:26:44,444 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 08:26:45,235 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:45,235 DEBUG --- stdout --- 2025-01-17 08:26:45,235 DEBUG 2025-01-17 08:26:45,236 DEBUG --- stderr --- 2025-01-17 08:26:45,236 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-17 08:26:45] benchmark-120 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-17 08:26:45 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/order.json 2025-01-17 08:26:45,236 INFO 2025-01-17 08:26:45,236 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:45,236 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:45,518 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:45,518 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:45,518 DEBUG --- stdout --- 2025-01-17 08:26:45,518 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:45,518 DEBUG --- stderr --- 2025-01-17 08:26:45,518 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 08:26:45,518 INFO 2025-01-17 08:26:45,518 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:45,518 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:45,796 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:45,796 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:45,796 DEBUG --- stdout --- 2025-01-17 08:26:45,796 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:45,796 DEBUG --- stderr --- 2025-01-17 08:26:45,796 DEBUG 2025-01-17 08:26:45,797 INFO 2025-01-17 08:26:45,797 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-120/rc.txt" ]; then echo "/results/orders/benchmark-120/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-120/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-120/rc.txt file found" 2025-01-17 08:26:45,797 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 08:26:46,592 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 08:26:46,592 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:46,592 DEBUG --- stdout --- 2025-01-17 08:26:46,592 DEBUG /results/orders/benchmark-120/rc.txt file found 2025-01-17 08:26:46,592 DEBUG --- stderr --- 2025-01-17 08:26:46,592 DEBUG 2025-01-17 08:26:46,592 INFO 2025-01-17 08:26:46,592 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:46,592 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:46,870 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:46,870 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:46,870 DEBUG --- stdout --- 2025-01-17 08:26:46,870 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:46,870 DEBUG --- stderr --- 2025-01-17 08:26:46,870 DEBUG 2025-01-17 08:26:46,870 INFO 2025-01-17 08:26:46,870 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-120/rc.txt 2025-01-17 08:26:47,672 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 08:26:47,672 DEBUG --- stdout --- 2025-01-17 08:26:47,672 DEBUG 4 /results/orders/benchmark-120/rc.txt 2025-01-17 08:26:47,672 DEBUG --- stderr --- 2025-01-17 08:26:47,672 DEBUG 2025-01-17 08:26:47,672 INFO - Download file (size 4k) 2025-01-17 08:26:47,673 INFO 2025-01-17 08:26:47,673 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:47,673 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:47,951 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:47,951 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:47,951 DEBUG --- stdout --- 2025-01-17 08:26:47,951 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:47,951 DEBUG --- stderr --- 2025-01-17 08:26:47,951 DEBUG source : /results/orders/benchmark-120/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/rc.txt 2025-01-17 08:26:47,951 INFO 2025-01-17 08:26:47,951 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:47,951 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:48,228 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:48,228 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:48,228 DEBUG --- stdout --- 2025-01-17 08:26:48,228 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:48,228 DEBUG --- stderr --- 2025-01-17 08:26:48,228 DEBUG 2025-01-17 08:26:48,229 INFO 2025-01-17 08:26:48,229 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-120/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/rc.txt 2025-01-17 08:26:48,229 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 08:26:48,988 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:48,988 DEBUG --- stdout --- 2025-01-17 08:26:48,988 DEBUG tar: Removing leading `/' from member names 2025-01-17 08:26:48,988 DEBUG --- stderr --- 2025-01-17 08:26:48,988 DEBUG 2025-01-17 08:26:48,988 INFO 2025-01-17 08:26:48,988 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:48,988 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:49,266 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:49,266 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:49,266 DEBUG --- stdout --- 2025-01-17 08:26:49,266 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:49,266 DEBUG --- stderr --- 2025-01-17 08:26:49,266 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 08:26:49,266 INFO 2025-01-17 08:26:49,266 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:49,266 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:49,546 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:49,546 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:49,546 DEBUG --- stdout --- 2025-01-17 08:26:49,546 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:49,546 DEBUG --- stderr --- 2025-01-17 08:26:49,546 DEBUG 2025-01-17 08:26:49,547 INFO 2025-01-17 08:26:49,547 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-120/stderr.txt" ]; then echo "/results/orders/benchmark-120/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-120/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-120/stderr.txt file found" 2025-01-17 08:26:49,547 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 08:26:50,347 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 08:26:50,347 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:50,347 DEBUG --- stdout --- 2025-01-17 08:26:50,347 DEBUG /results/orders/benchmark-120/stderr.txt file found 2025-01-17 08:26:50,347 DEBUG --- stderr --- 2025-01-17 08:26:50,347 DEBUG 2025-01-17 08:26:50,348 INFO 2025-01-17 08:26:50,348 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:50,348 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:50,625 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:50,625 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:50,625 DEBUG --- stdout --- 2025-01-17 08:26:50,625 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:50,625 DEBUG --- stderr --- 2025-01-17 08:26:50,625 DEBUG 2025-01-17 08:26:50,626 INFO 2025-01-17 08:26:50,626 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-120/stderr.txt 2025-01-17 08:26:51,423 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 08:26:51,423 DEBUG --- stdout --- 2025-01-17 08:26:51,423 DEBUG 0 /results/orders/benchmark-120/stderr.txt 2025-01-17 08:26:51,423 DEBUG --- stderr --- 2025-01-17 08:26:51,423 DEBUG 2025-01-17 08:26:51,423 INFO - Download file (size 0k) 2025-01-17 08:26:51,423 INFO 2025-01-17 08:26:51,423 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:51,423 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:51,699 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:51,699 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:51,699 DEBUG --- stdout --- 2025-01-17 08:26:51,699 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:51,699 DEBUG --- stderr --- 2025-01-17 08:26:51,699 DEBUG source : /results/orders/benchmark-120/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/stderr.txt 2025-01-17 08:26:51,699 INFO 2025-01-17 08:26:51,699 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:51,699 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:51,975 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:51,975 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:51,975 DEBUG --- stdout --- 2025-01-17 08:26:51,975 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:51,975 DEBUG --- stderr --- 2025-01-17 08:26:51,975 DEBUG 2025-01-17 08:26:51,976 INFO 2025-01-17 08:26:51,976 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-120/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/stderr.txt 2025-01-17 08:26:51,976 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 08:26:52,746 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:52,746 DEBUG --- stdout --- 2025-01-17 08:26:52,746 DEBUG tar: Removing leading `/' from member names 2025-01-17 08:26:52,746 DEBUG --- stderr --- 2025-01-17 08:26:52,746 DEBUG 2025-01-17 08:26:52,746 INFO 2025-01-17 08:26:52,746 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:52,746 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:53,022 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:53,022 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:53,022 DEBUG --- stdout --- 2025-01-17 08:26:53,022 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:53,022 DEBUG --- stderr --- 2025-01-17 08:26:53,022 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 08:26:53,022 INFO 2025-01-17 08:26:53,022 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:53,022 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:53,299 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:53,299 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:53,299 DEBUG --- stdout --- 2025-01-17 08:26:53,299 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:53,299 DEBUG --- stderr --- 2025-01-17 08:26:53,299 DEBUG 2025-01-17 08:26:53,300 INFO 2025-01-17 08:26:53,300 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-120/stdout.txt" ]; then echo "/results/orders/benchmark-120/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-120/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-120/stdout.txt file found" 2025-01-17 08:26:53,300 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 08:26:54,117 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 08:26:54,117 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:54,117 DEBUG --- stdout --- 2025-01-17 08:26:54,117 DEBUG /results/orders/benchmark-120/stdout.txt file found 2025-01-17 08:26:54,118 DEBUG --- stderr --- 2025-01-17 08:26:54,118 DEBUG 2025-01-17 08:26:54,118 INFO 2025-01-17 08:26:54,118 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:54,118 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:54,395 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:54,395 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:54,395 DEBUG --- stdout --- 2025-01-17 08:26:54,395 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:54,395 DEBUG --- stderr --- 2025-01-17 08:26:54,395 DEBUG 2025-01-17 08:26:54,395 INFO 2025-01-17 08:26:54,395 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-120/stdout.txt 2025-01-17 08:26:55,227 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 08:26:55,227 DEBUG --- stdout --- 2025-01-17 08:26:55,227 DEBUG 4408 /results/orders/benchmark-120/stdout.txt 2025-01-17 08:26:55,227 DEBUG --- stderr --- 2025-01-17 08:26:55,227 DEBUG 2025-01-17 08:26:55,228 INFO - Download file (size 4408k) 2025-01-17 08:26:55,228 INFO 2025-01-17 08:26:55,228 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:55,228 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:55,510 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:55,510 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:55,510 DEBUG --- stdout --- 2025-01-17 08:26:55,510 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:55,510 DEBUG --- stderr --- 2025-01-17 08:26:55,510 DEBUG source : /results/orders/benchmark-120/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/stdout.txt 2025-01-17 08:26:55,510 INFO 2025-01-17 08:26:55,510 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:55,510 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:55,787 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:55,787 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:55,787 DEBUG --- stdout --- 2025-01-17 08:26:55,787 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:55,787 DEBUG --- stderr --- 2025-01-17 08:26:55,787 DEBUG 2025-01-17 08:26:55,788 INFO 2025-01-17 08:26:55,788 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-120/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/stdout.txt 2025-01-17 08:26:55,788 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 08:26:57,046 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:57,046 DEBUG --- stdout --- 2025-01-17 08:26:57,046 DEBUG tar: Removing leading `/' from member names 2025-01-17 08:26:57,046 DEBUG --- stderr --- 2025-01-17 08:26:57,046 DEBUG ________________________________________________________________________________ [2025-01-17 08:26:57] benchmark-120 show_cmd : Display order command ________________________________________________________________________________ 2025-01-17 08:26:57,047 INFO 2025-01-17 08:26:57,047 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:57,047 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:57,324 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:57,324 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:57,324 DEBUG --- stdout --- 2025-01-17 08:26:57,324 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:57,325 DEBUG --- stderr --- 2025-01-17 08:26:57,325 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 08:26:57,325 INFO 2025-01-17 08:26:57,325 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:57,325 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:57,602 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:57,602 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:57,602 DEBUG --- stdout --- 2025-01-17 08:26:57,602 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:57,602 DEBUG --- stderr --- 2025-01-17 08:26:57,602 DEBUG 2025-01-17 08:26:57,603 INFO 2025-01-17 08:26:57,603 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-120/cmd.txt" ]; then echo "/results/orders/benchmark-120/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-120/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-120/cmd.txt file found" 2025-01-17 08:26:57,603 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 08:26:58,404 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 08:26:58,404 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:58,404 DEBUG --- stdout --- 2025-01-17 08:26:58,404 DEBUG /results/orders/benchmark-120/cmd.txt file found 2025-01-17 08:26:58,404 DEBUG --- stderr --- 2025-01-17 08:26:58,404 DEBUG 2025-01-17 08:26:58,404 INFO 2025-01-17 08:26:58,404 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:58,404 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:58,681 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:58,681 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:58,681 DEBUG --- stdout --- 2025-01-17 08:26:58,681 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:58,681 DEBUG --- stderr --- 2025-01-17 08:26:58,681 DEBUG 2025-01-17 08:26:58,681 INFO 2025-01-17 08:26:58,681 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-120/cmd.txt 2025-01-17 08:26:59,468 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 08:26:59,468 DEBUG --- stdout --- 2025-01-17 08:26:59,468 DEBUG 4 /results/orders/benchmark-120/cmd.txt 2025-01-17 08:26:59,468 DEBUG --- stderr --- 2025-01-17 08:26:59,468 DEBUG 2025-01-17 08:26:59,468 INFO - Download file (size 4k) 2025-01-17 08:26:59,468 INFO 2025-01-17 08:26:59,468 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:59,468 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:26:59,745 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:26:59,745 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:26:59,745 DEBUG --- stdout --- 2025-01-17 08:26:59,745 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:26:59,745 DEBUG --- stderr --- 2025-01-17 08:26:59,745 DEBUG source : /results/orders/benchmark-120/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/cmd.txt 2025-01-17 08:26:59,745 INFO 2025-01-17 08:26:59,745 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:26:59,745 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:27:00,023 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:27:00,023 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:00,023 DEBUG --- stdout --- 2025-01-17 08:27:00,023 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:27:00,023 DEBUG --- stderr --- 2025-01-17 08:27:00,023 DEBUG 2025-01-17 08:27:00,023 INFO 2025-01-17 08:27:00,023 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-120/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/cmd.txt 2025-01-17 08:27:00,023 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 08:27:00,785 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:00,785 DEBUG --- stdout --- 2025-01-17 08:27:00,785 DEBUG tar: Removing leading `/' from member names 2025-01-17 08:27:00,785 DEBUG --- stderr --- 2025-01-17 08:27:00,785 DEBUG 2025-01-17 08:27:00,785 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/cmd.txt is small (1 lines), printing all lines: 2025-01-17 08:27:00,785 DEBUG ----- output ----- 2025-01-17 08:27:00,785 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-120" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=120 -Duser_password=Pa_ssw0rd" 2025-01-17 08:27:00,785 INFO ________________________________________________________________________________ [2025-01-17 08:27:00] benchmark-120 show_rc : Display rc order ________________________________________________________________________________ 2025-01-17 08:27:00,786 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/rc.txt is small (1 lines), printing all lines: 2025-01-17 08:27:00,786 DEBUG ----- output ----- 2025-01-17 08:27:00,786 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-17 08:27:00,786 INFO ________________________________________________________________________________ [2025-01-17 08:27:00] benchmark-120 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-17 08:27:00,792 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/stdout.txt is 55336 lines): 2025-01-17 08:27:00,792 DEBUG ----- output ----- 2025-01-17 08:27:00,792 INFO 2025-01-17 07:26:18,167 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp4umkca8d 2025-01-17 08:27:00,792 INFO 2025-01-17 07:26:18,169 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-120" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=120 -Duser_password=**** 2025-01-17 08:27:00,792 INFO [INFO] Scanning for projects... 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-17 08:27:00,792 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-17 08:27:00,792 INFO [INFO] from pom.xml 2025-01-17 08:27:00,792 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-17 08:27:00,792 INFO [INFO] skip non existing resourceDirectory /tmp/tmp4umkca8d/src/main/resources 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-17 08:27:00,792 INFO [INFO] No sources to compile 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-17 08:27:00,792 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-17 08:27:00,792 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-17 08:27:00,792 INFO [INFO] compiling 38 Scala sources to /tmp/tmp4umkca8d/target/test-classes ... 2025-01-17 08:27:00,792 INFO [INFO] compile in 11.1 s 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] 2025-01-17 08:27:00,792 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-17 08:27:00,792 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-17 08:27:00,792 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-17 08:27:00,792 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-17 08:27:00,793 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 08:27:00,793 INFO 2025-01-17 08:27:00,793 INFO ================================================================================ 2025-01-17 08:27:00,793 INFO 2025-01-17 07:26:39 GMT 5s elapsed 2025-01-17 08:27:00,793 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 08:27:00,793 INFO > Global (OK=471 KO=0 ) 2025-01-17 08:27:00,793 INFO > restLoginInitiate (OK=46 KO=0 ) 2025-01-17 08:27:00,793 INFO > restLoginUsernamePasswordCallback (OK=45 KO=0 ) 2025-01-17 08:27:00,793 INFO > Skip 2FA (OK=23 KO=0 ) 2025-01-17 08:27:00,793 INFO > User Authorize PKCE stage (OK=49 KO=0 ) 2025-01-17 08:27:00,793 INFO > User AccessToken PKCE stage (OK=48 KO=0 ) 2025-01-17 08:27:00,793 INFO > GetUUid (OK=16 KO=0 ) 2025-01-17 08:27:00,793 INFO > GetOpenidConfig (OK=16 KO=0 ) 2025-01-17 08:27:00,793 INFO > CreatePolicy (OK=16 KO=0 ) 2025-01-17 08:27:00,793 INFO > tokenUserinfo (OK=10 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI-Post-Login - stage 1 (OK=11 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=11 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI AM idFromSession (OK=10 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI AM validateGoto (OK=10 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI-Post-Login - stage 2 (OK=8 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=8 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI Enduser appAuthHelper1 (OK=8 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI Enduser appAuthHelper2 (OK=8 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI-Post-Login - stage 3 (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > RootUserinfo (OK=14 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI Enduser sessioncheck (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM uiconfig (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM version (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM features (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM privilege (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM login (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM dashboard (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM user (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM managed user schema (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI IDM oidcToken (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > userinfo (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI-Logout (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI-Logout Redirect 1 (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI AM revoke1 (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI AM revoke2 (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > UI AM endsession (OK=6 KO=0 ) 2025-01-17 08:27:00,793 INFO > loginTreeWorkflow_restLoginInitiate (OK=3 KO=0 ) 2025-01-17 08:27:00,793 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=3 KO=0 ) 2025-01-17 08:27:00,793 INFO 2025-01-17 08:27:00,793 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 08:27:00,793 INFO [- ] 0% 2025-01-17 08:27:00,793 INFO waiting: 432733 / active: 31 / done: 19 2025-01-17 08:27:00,793 INFO ================================================================================ 2025-01-17 08:27:00,793 INFO 2025-01-17 08:27:00,793 INFO 2025-01-17 08:27:00,793 INFO ================================================================================ 2025-01-17 08:27:00,793 INFO 2025-01-17 07:26:44 GMT 10s elapsed 2025-01-17 08:27:00,793 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 08:27:00,793 INFO > Global (OK=2115 KO=0 ) 2025-01-17 08:27:00,793 INFO > restLoginInitiate (OK=188 KO=0 ) 2025-01-17 08:27:00,793 INFO > restLoginUsernamePasswordCallback (OK=185 KO=0 ) 2025-01-17 08:27:00,793 INFO > Skip 2FA (OK=105 KO=0 ) 2025-01-17 08:27:00,793 INFO > User Authorize PKCE stage (OK=212 KO=0 ) 2025-01-17 08:27:00,793 INFO > User AccessToken PKCE stage (OK=211 KO=0 ) 2025-01-17 08:27:00,793 INFO > GetUUid (OK=62 KO=0 ) 2025-01-17 08:27:00,793 INFO > GetOpenidConfig (OK=78 KO=0 ) 2025-01-17 08:27:00,794 INFO > CreatePolicy (OK=61 KO=0 ) 2025-01-17 08:27:00,794 INFO > tokenUserinfo (OK=44 KO=0 ) 2025-01-17 08:27:00,794 INFO > UI-Post-Login - stage 1 (OK=32 KO=0 ) 2025-01-17 08:27:00,794 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=32 KO=0 ) 2025-01-17 08:27:00,794 INFO [...] 2025-01-17 08:27:00,802 INFO UI IDM features: KO j.i.IOException: Premature close 2025-01-17 08:27:00,802 INFO ========================= 2025-01-17 08:27:00,802 INFO Session: 2025-01-17 08:27:00,802 INFO Session(idc.benchmark.Mix2024,429079,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiNjNlMWRkOS1iY2E2LTQxYjMtYmZjNS1mYTBiYWE5MjYxYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiOWM3YWQ3ZTctYTk1Zi00NDIyLWE3YjItYzA1ZDcwNTA2ZjdjLTM3NDExMTkxIiwic3VibmFtZSI6ImI2M2UxZGQ5LWJjYTYtNDFiMy1iZmM1LWZhMGJhYTkyNjFhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJ6NUNMN21KVUk4T0txMk13dnZPM3JmTTlNMXciLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDIzOTQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDIzOTQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA1OTk0LCJpYXQiOjE3MzcxMDIzOTQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IlBEMWtoY1VjOW95X3pWWVlDRXFsWU9mZl9hYyJ9.mdSA4yQdQYNPBgTz_LKcvmMBADwVzBhIXZLMbsB5oWw, username -> user.23817030, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiNjNlMWRkOS1iY2E2LTQxYjMtYmZjNS1mYTBiYWE5MjYxYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiODJjY2M2ZDItMDhmMS00N2VmLTlmMjMtOTZkOTA3ZGZlMmRlLTM4MDMxNjQzIiwic3VibmFtZSI6ImI2M2UxZGQ5LWJjYTYtNDFiMy1iZmM1LWZhMGJhYTkyNjFhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJCVDJzY1hDZVJCNzRPcTYwOVo5T0o4ZHZKN1UiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDIzOTQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDIzOTQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA1OTk0LCJpYXQiOjE3MzcxMDIzOTQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6ImpkN21WenRfLUE0SHdtLTBVVGUxTml0WmdacyJ9.vBZ95eVQJV5cgr7a0yKKspWEQcuTDHeTsAq_NPBwucs, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@50b7066b, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, authcode -> WYj_U7R7c7Vj1T5kB5NTC9ES_is, callbacks -> {"tokenId":"_Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737102394422), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=_Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737102394422))), user_uuid -> b63e1dd9-bca6-41b3-bfc5-fa0baa9261ae, password -> Pa_ssw0rd, challenge -> H8ddmnnKuuJXrNKxjWwMDf03OjMwjcXIcXKgOxRizIc, gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, fake-ip -> 4.255.216.143, verifier -> NTQyMzE0NzgzNzYzODI1NTI5Mg, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@3910c987, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@2460ec8f, tokenId -> _Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007c19d469b068@3e53049,io.netty.channel.epoll.EpollEventLoop@1eb6749b) 2025-01-17 08:27:00,802 INFO ========================= 2025-01-17 08:27:00,802 INFO HTTP request: 2025-01-17 08:27:00,802 INFO GET https://openam-perf-200m.forgeblocks.com/openidm/info/features?_queryFilter=true 2025-01-17 08:27:00,802 INFO headers: 2025-01-17 08:27:00,802 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-17 08:27:00,802 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-17 08:27:00,802 INFO Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiNjNlMWRkOS1iY2E2LTQxYjMtYmZjNS1mYTBiYWE5MjYxYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiODJjY2M2ZDItMDhmMS00N2VmLTlmMjMtOTZkOTA3ZGZlMmRlLTM4MDMxNjQzIiwic3VibmFtZSI6ImI2M2UxZGQ5LWJjYTYtNDFiMy1iZmM1LWZhMGJhYTkyNjFhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJCVDJzY1hDZVJCNzRPcTYwOVo5T0o4ZHZKN1UiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDIzOTQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDIzOTQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA1OTk0LCJpYXQiOjE3MzcxMDIzOTQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6ImpkN21WenRfLUE0SHdtLTBVVGUxTml0WmdacyJ9.vBZ95eVQJV5cgr7a0yKKspWEQcuTDHeTsAq_NPBwucs 2025-01-17 08:27:00,802 INFO Accept-Api-Version: 2025-01-17 08:27:00,802 INFO accept: */* 2025-01-17 08:27:00,802 INFO cookie: amlbcookie=01; 15892ffd844ef80=_Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-17 08:27:00,802 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 08:27:00,802 INFO cookies: 2025-01-17 08:27:00,802 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 08:27:00,802 INFO 15892ffd844ef80=_Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 08:27:00,802 INFO ========================= 2025-01-17 08:27:00,802 INFO HTTP response: 2025-01-17 08:27:00,802 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 08:27:00,802 INFO 08:26:34.984 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 08:27:00,802 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 08:27:00,802 INFO Request: 2025-01-17 08:27:00,802 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 08:27:00,802 INFO ========================= 2025-01-17 08:27:00,802 INFO Session: 2025-01-17 08:27:00,802 INFO Session(idc.benchmark.Mix2024,429173,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.38509703, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@52f4b64f, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9, password -> Pa_ssw0rd, fake-ip -> 188.243.191.76, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@105a908a),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007c19d469b068@3e53049,io.netty.channel.epoll.EpollEventLoop@619bfe29) 2025-01-17 08:27:00,802 INFO ========================= 2025-01-17 08:27:00,802 INFO HTTP request: 2025-01-17 08:27:00,802 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2025-01-17 08:27:00,802 INFO headers: 2025-01-17 08:27:00,802 INFO accept: application/json 2025-01-17 08:27:00,802 INFO content-type: application/json 2025-01-17 08:27:00,802 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9 2025-01-17 08:27:00,802 INFO X-Forwarded-For: 188.243.191.76 2025-01-17 08:27:00,802 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 08:27:00,802 INFO content-length: 0 2025-01-17 08:27:00,802 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 08:27:00,802 INFO ========================= 2025-01-17 08:27:00,802 INFO HTTP response: 2025-01-17 08:27:00,802 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 08:27:00,802 INFO 08:26:34.984 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 08:27:00,802 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 08:27:00,802 INFO Request: 2025-01-17 08:27:00,802 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 08:27:00,802 INFO ========================= 2025-01-17 08:27:00,803 INFO Session: 2025-01-17 08:27:00,803 INFO Session(idc.benchmark.Mix2024,429169,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.25752698, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@1d04c5e4, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9, password -> Pa_ssw0rd, fake-ip -> 206.50.72.144, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@9a76d75),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007c19d469b068@3e53049,io.netty.channel.epoll.EpollEventLoop@f79a760) 2025-01-17 08:27:00,803 INFO ========================= 2025-01-17 08:27:00,803 INFO HTTP request: 2025-01-17 08:27:00,803 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2025-01-17 08:27:00,803 INFO headers: 2025-01-17 08:27:00,803 INFO accept: application/json 2025-01-17 08:27:00,803 INFO content-type: application/json 2025-01-17 08:27:00,803 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9 2025-01-17 08:27:00,803 INFO X-Forwarded-For: 206.50.72.144 2025-01-17 08:27:00,803 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 08:27:00,803 INFO content-length: 0 2025-01-17 08:27:00,803 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 08:27:00,803 INFO ========================= 2025-01-17 08:27:00,803 INFO HTTP response: 2025-01-17 08:27:00,803 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 08:27:00,803 INFO 08:26:34.984 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 08:27:00,803 INFO 08:26:34.984 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 08:27:00,803 INFO 08:26:34.985 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM privilege' failed for user 429079: j.i.IOException: Premature close 2025-01-17 08:27:00,803 INFO 08:26:34.985 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 08:27:00,803 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 08:27:00,803 INFO Request: 2025-01-17 08:27:00,803 INFO UI IDM privilege: KO j.i.IOException: Premature close 2025-01-17 08:27:00,803 INFO ========================= 2025-01-17 08:27:00,803 INFO Session: 2025-01-17 08:27:00,803 INFO Session(idc.benchmark.Mix2024,429079,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiNjNlMWRkOS1iY2E2LTQxYjMtYmZjNS1mYTBiYWE5MjYxYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiOWM3YWQ3ZTctYTk1Zi00NDIyLWE3YjItYzA1ZDcwNTA2ZjdjLTM3NDExMTkxIiwic3VibmFtZSI6ImI2M2UxZGQ5LWJjYTYtNDFiMy1iZmM1LWZhMGJhYTkyNjFhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJ6NUNMN21KVUk4T0txMk13dnZPM3JmTTlNMXciLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDIzOTQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDIzOTQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA1OTk0LCJpYXQiOjE3MzcxMDIzOTQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IlBEMWtoY1VjOW95X3pWWVlDRXFsWU9mZl9hYyJ9.mdSA4yQdQYNPBgTz_LKcvmMBADwVzBhIXZLMbsB5oWw, username -> user.23817030, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiNjNlMWRkOS1iY2E2LTQxYjMtYmZjNS1mYTBiYWE5MjYxYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiODJjY2M2ZDItMDhmMS00N2VmLTlmMjMtOTZkOTA3ZGZlMmRlLTM4MDMxNjQzIiwic3VibmFtZSI6ImI2M2UxZGQ5LWJjYTYtNDFiMy1iZmM1LWZhMGJhYTkyNjFhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJCVDJzY1hDZVJCNzRPcTYwOVo5T0o4ZHZKN1UiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDIzOTQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDIzOTQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA1OTk0LCJpYXQiOjE3MzcxMDIzOTQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6ImpkN21WenRfLUE0SHdtLTBVVGUxTml0WmdacyJ9.vBZ95eVQJV5cgr7a0yKKspWEQcuTDHeTsAq_NPBwucs, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@50b7066b, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, authcode -> WYj_U7R7c7Vj1T5kB5NTC9ES_is, callbacks -> {"tokenId":"_Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737102394422), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=_Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737102394422))), user_uuid -> b63e1dd9-bca6-41b3-bfc5-fa0baa9261ae, password -> Pa_ssw0rd, challenge -> H8ddmnnKuuJXrNKxjWwMDf03OjMwjcXIcXKgOxRizIc, gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, fake-ip -> 4.255.216.143, verifier -> NTQyMzE0NzgzNzYzODI1NTI5Mg, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@3910c987, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@2460ec8f, tokenId -> _Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007c19d469b068@3e53049,io.netty.channel.epoll.EpollEventLoop@1eb6749b) 2025-01-17 08:27:00,803 INFO ========================= 2025-01-17 08:27:00,803 INFO HTTP request: 2025-01-17 08:27:00,803 INFO POST https://openam-perf-200m.forgeblocks.com/openidm/privilege?_action=listPrivileges 2025-01-17 08:27:00,803 INFO headers: 2025-01-17 08:27:00,803 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-17 08:27:00,803 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-17 08:27:00,803 INFO Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiNjNlMWRkOS1iY2E2LTQxYjMtYmZjNS1mYTBiYWE5MjYxYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiODJjY2M2ZDItMDhmMS00N2VmLTlmMjMtOTZkOTA3ZGZlMmRlLTM4MDMxNjQzIiwic3VibmFtZSI6ImI2M2UxZGQ5LWJjYTYtNDFiMy1iZmM1LWZhMGJhYTkyNjFhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJCVDJzY1hDZVJCNzRPcTYwOVo5T0o4ZHZKN1UiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDIzOTQsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDIzOTQsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA1OTk0LCJpYXQiOjE3MzcxMDIzOTQsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6ImpkN21WenRfLUE0SHdtLTBVVGUxTml0WmdacyJ9.vBZ95eVQJV5cgr7a0yKKspWEQcuTDHeTsAq_NPBwucs 2025-01-17 08:27:00,803 INFO Accept-Api-Version: 2025-01-17 08:27:00,803 INFO accept: */* 2025-01-17 08:27:00,803 INFO cookie: amlbcookie=01; 15892ffd844ef80=_Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-17 08:27:00,803 INFO origin: https://openam-perf-200m.forgeblocks.com 2025-01-17 08:27:00,803 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 08:27:00,803 INFO content-length: 0 2025-01-17 08:27:00,803 INFO cookies: 2025-01-17 08:27:00,803 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 08:27:00,803 INFO 15892ffd844ef80=_Zp82LMtWB0TVW8QevLv0vgbtZ0.*AAJTSQACMDIAAlNLABxtMWs5V1M5NnFDeXVHZTJ5Z1RwTXZGdiszZ3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 08:27:00,803 INFO ========================= 2025-01-17 08:27:00,803 INFO HTTP response: 2025-01-17 08:27:00,803 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 08:27:00,803 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 08:27:00,803 INFO [INFO] BUILD SUCCESS 2025-01-17 08:27:00,803 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 08:27:00,803 INFO [INFO] Total time: 01:00 h 2025-01-17 08:27:00,803 INFO [INFO] Finished at: 2025-01-17T08:26:35Z 2025-01-17 08:27:00,803 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 08:27:00,803 INFO 2025-01-17 08:26:35,072 INFO Gatling simulation run ended successfully 2025-01-17 08:27:00,803 INFO 2025-01-17 08:26:35,073 DEBUG No archive name provided. No archive will be created 2025-01-17 08:27:00,803 INFO ________________________________________________________________________________ [2025-01-17 08:27:00] benchmark-120 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-17 08:27:00,804 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/04_benchmark-120/stderr.txt is small (0 lines), printing all lines: 2025-01-17 08:27:00,804 DEBUG ----- output ----- 2025-01-17 08:27:00,804 DEBUG 2025-01-17 08:27:00,804 INFO ________________________________________________________________________________ [2025-01-17 08:27:00] benchmark-120 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-17 08:27:00] benchmark-120 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-17 08:27:00] benchmark-120 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped