--Task-- name: benchmark-50 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-10'] preceding_task: benchmark-10 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 50} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-17 05:24:38] benchmark-50 pre : N/A ________________________________________________________________________________ 2025-01-17 05:24:38,595 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-17 05:24:38 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-17 05:24:38 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-50/stdout.txt Pod log : /results/orders/benchmark-50 2025-01-17 05:24:38,595 INFO 2025-01-17 05:24:38,595 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:38,595 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:38,874 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:38,874 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:38,874 DEBUG --- stdout --- 2025-01-17 05:24:38,874 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:38,874 DEBUG --- stderr --- 2025-01-17 05:24:38,874 DEBUG ________________________________________________________________________________ [2025-01-17 05:24:38] benchmark-50 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-17 05:24:38,875 INFO 2025-01-17 05:24:38,875 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:38,875 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:39,152 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:39,152 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:39,152 DEBUG --- stdout --- 2025-01-17 05:24:39,152 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:39,152 DEBUG --- stderr --- 2025-01-17 05:24:39,152 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-50" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-17 05:24:39] benchmark-50 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-17 05:24:39,152 INFO 2025-01-17 05:24:39,152 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:39,152 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:39,431 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:39,431 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:39,431 DEBUG --- stdout --- 2025-01-17 05:24:39,431 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:39,431 DEBUG --- stderr --- 2025-01-17 05:24:39,431 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/order.json { "name": "benchmark-50", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-50\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-50" } ________________________________________________________________________________ [2025-01-17 05:24:39] benchmark-50 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-17 05:24:39,434 INFO 2025-01-17 05:24:39,434 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-17 05:24:39,434 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 05:24:39,651 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 05:24:39,651 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:39,651 DEBUG --- stdout --- 2025-01-17 05:24:39,651 DEBUG WAITING 2025-01-17 05:24:39,651 DEBUG --- stderr --- 2025-01-17 05:24:39,651 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-01-17 05:24:39] benchmark-50 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-17 05:24:39,652 INFO 2025-01-17 05:24:39,652 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:39,652 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:39,936 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:39,936 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:39,936 DEBUG --- stdout --- 2025-01-17 05:24:39,936 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:39,936 DEBUG --- stderr --- 2025-01-17 05:24:39,936 DEBUG 2025-01-17 05:24:39,937 INFO 2025-01-17 05:24:39,937 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-17 05:24:39,937 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 05:24:41,395 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:41,395 DEBUG --- stdout --- 2025-01-17 05:24:41,395 DEBUG 2025-01-17 05:24:41,395 DEBUG --- stderr --- 2025-01-17 05:24:41,395 DEBUG Order has been successfully forwarded to overseer 2025-01-17 05:24:41 - INFO: Check if Gatling simulation started successfully 2025-01-17 05:24:41,395 INFO 2025-01-17 05:24:41,395 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:41,395 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:41,676 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:41,676 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:41,676 DEBUG --- stdout --- 2025-01-17 05:24:41,676 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:41,676 DEBUG --- stderr --- 2025-01-17 05:24:41,676 DEBUG 2025-01-17 05:24:41,676 INFO 2025-01-17 05:24:41,676 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-50/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-17 05:24:41,676 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 05:24:42,420 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 05:24:48,158 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 05:24:53,896 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 05:24:59,646 INFO [loop_until]: Function succeeded after 17s (rc=0) - expected pattern found 2025-01-17 05:24:59,646 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:59,646 DEBUG --- stdout --- 2025-01-17 05:24:59,646 DEBUG 2025-01-17 05:24:42,330 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpkqo6v95v 2025-01-17 05:24:42,333 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-50" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpkqo6v95v/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmpkqo6v95v/target/test-classes ... [INFO] compile in 11.2 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 05:24:59,646 DEBUG --- stderr --- 2025-01-17 05:24:59,646 DEBUG ________________________________________________________________________________ [2025-01-17 05:24:59] benchmark-50 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-17 06:25:08] benchmark-50 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-17 06:25:08,799 INFO 2025-01-17 06:25:08,799 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:08,799 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:09,102 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:09,102 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:09,102 DEBUG --- stdout --- 2025-01-17 06:25:09,102 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:09,102 DEBUG --- stderr --- 2025-01-17 06:25:09,102 DEBUG 2025-01-17 06:25:09,102 INFO 2025-01-17 06:25:09,102 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-17 06:25:09,102 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 06:25:09,932 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:09,932 DEBUG --- stdout --- 2025-01-17 06:25:09,932 DEBUG 2025-01-17 06:25:09,932 DEBUG --- stderr --- 2025-01-17 06:25:09,932 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-17 06:25:09] benchmark-50 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-17 06:25:09 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/order.json 2025-01-17 06:25:09,932 INFO 2025-01-17 06:25:09,932 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:09,932 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:10,217 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:10,217 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:10,217 DEBUG --- stdout --- 2025-01-17 06:25:10,217 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:10,217 DEBUG --- stderr --- 2025-01-17 06:25:10,217 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 06:25:10,217 INFO 2025-01-17 06:25:10,217 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:10,217 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:10,499 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:10,499 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:10,499 DEBUG --- stdout --- 2025-01-17 06:25:10,499 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:10,499 DEBUG --- stderr --- 2025-01-17 06:25:10,499 DEBUG 2025-01-17 06:25:10,500 INFO 2025-01-17 06:25:10,500 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-50/rc.txt" ]; then echo "/results/orders/benchmark-50/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-50/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-50/rc.txt file found" 2025-01-17 06:25:10,500 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 06:25:11,304 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 06:25:11,305 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:11,305 DEBUG --- stdout --- 2025-01-17 06:25:11,305 DEBUG /results/orders/benchmark-50/rc.txt file found 2025-01-17 06:25:11,305 DEBUG --- stderr --- 2025-01-17 06:25:11,305 DEBUG 2025-01-17 06:25:11,306 INFO 2025-01-17 06:25:11,306 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:11,306 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:11,585 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:11,585 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:11,585 DEBUG --- stdout --- 2025-01-17 06:25:11,585 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:11,585 DEBUG --- stderr --- 2025-01-17 06:25:11,585 DEBUG 2025-01-17 06:25:11,585 INFO 2025-01-17 06:25:11,586 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-50/rc.txt 2025-01-17 06:25:12,393 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 06:25:12,393 DEBUG --- stdout --- 2025-01-17 06:25:12,393 DEBUG 4 /results/orders/benchmark-50/rc.txt 2025-01-17 06:25:12,393 DEBUG --- stderr --- 2025-01-17 06:25:12,393 DEBUG 2025-01-17 06:25:12,393 INFO - Download file (size 4k) 2025-01-17 06:25:12,393 INFO 2025-01-17 06:25:12,393 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:12,393 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:12,673 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:12,673 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:12,673 DEBUG --- stdout --- 2025-01-17 06:25:12,673 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:12,673 DEBUG --- stderr --- 2025-01-17 06:25:12,673 DEBUG source : /results/orders/benchmark-50/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/rc.txt 2025-01-17 06:25:12,673 INFO 2025-01-17 06:25:12,673 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:12,673 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:12,954 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:12,954 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:12,954 DEBUG --- stdout --- 2025-01-17 06:25:12,954 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:12,954 DEBUG --- stderr --- 2025-01-17 06:25:12,954 DEBUG 2025-01-17 06:25:12,955 INFO 2025-01-17 06:25:12,955 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-50/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/rc.txt 2025-01-17 06:25:12,955 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 06:25:13,729 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:13,729 DEBUG --- stdout --- 2025-01-17 06:25:13,729 DEBUG tar: Removing leading `/' from member names 2025-01-17 06:25:13,729 DEBUG --- stderr --- 2025-01-17 06:25:13,729 DEBUG 2025-01-17 06:25:13,729 INFO 2025-01-17 06:25:13,729 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:13,729 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:14,008 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:14,008 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:14,008 DEBUG --- stdout --- 2025-01-17 06:25:14,008 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:14,008 DEBUG --- stderr --- 2025-01-17 06:25:14,008 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 06:25:14,009 INFO 2025-01-17 06:25:14,009 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:14,009 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:14,288 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:14,288 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:14,288 DEBUG --- stdout --- 2025-01-17 06:25:14,288 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:14,288 DEBUG --- stderr --- 2025-01-17 06:25:14,288 DEBUG 2025-01-17 06:25:14,289 INFO 2025-01-17 06:25:14,289 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-50/stderr.txt" ]; then echo "/results/orders/benchmark-50/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-50/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-50/stderr.txt file found" 2025-01-17 06:25:14,289 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 06:25:15,100 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 06:25:15,100 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:15,100 DEBUG --- stdout --- 2025-01-17 06:25:15,100 DEBUG /results/orders/benchmark-50/stderr.txt file found 2025-01-17 06:25:15,100 DEBUG --- stderr --- 2025-01-17 06:25:15,100 DEBUG 2025-01-17 06:25:15,100 INFO 2025-01-17 06:25:15,100 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:15,100 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:15,379 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:15,379 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:15,379 DEBUG --- stdout --- 2025-01-17 06:25:15,379 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:15,379 DEBUG --- stderr --- 2025-01-17 06:25:15,379 DEBUG 2025-01-17 06:25:15,379 INFO 2025-01-17 06:25:15,379 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-50/stderr.txt 2025-01-17 06:25:16,181 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 06:25:16,182 DEBUG --- stdout --- 2025-01-17 06:25:16,182 DEBUG 0 /results/orders/benchmark-50/stderr.txt 2025-01-17 06:25:16,182 DEBUG --- stderr --- 2025-01-17 06:25:16,182 DEBUG 2025-01-17 06:25:16,182 INFO - Download file (size 0k) 2025-01-17 06:25:16,182 INFO 2025-01-17 06:25:16,182 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:16,182 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:16,461 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:16,461 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:16,461 DEBUG --- stdout --- 2025-01-17 06:25:16,461 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:16,461 DEBUG --- stderr --- 2025-01-17 06:25:16,461 DEBUG source : /results/orders/benchmark-50/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stderr.txt 2025-01-17 06:25:16,462 INFO 2025-01-17 06:25:16,462 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:16,462 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:16,739 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:16,740 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:16,740 DEBUG --- stdout --- 2025-01-17 06:25:16,740 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:16,740 DEBUG --- stderr --- 2025-01-17 06:25:16,740 DEBUG 2025-01-17 06:25:16,740 INFO 2025-01-17 06:25:16,740 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-50/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stderr.txt 2025-01-17 06:25:16,740 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 06:25:17,503 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:17,503 DEBUG --- stdout --- 2025-01-17 06:25:17,503 DEBUG tar: Removing leading `/' from member names 2025-01-17 06:25:17,503 DEBUG --- stderr --- 2025-01-17 06:25:17,503 DEBUG 2025-01-17 06:25:17,504 INFO 2025-01-17 06:25:17,504 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:17,504 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:17,785 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:17,785 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:17,785 DEBUG --- stdout --- 2025-01-17 06:25:17,785 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:17,785 DEBUG --- stderr --- 2025-01-17 06:25:17,785 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 06:25:17,786 INFO 2025-01-17 06:25:17,786 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:17,786 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:18,066 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:18,066 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:18,066 DEBUG --- stdout --- 2025-01-17 06:25:18,066 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:18,066 DEBUG --- stderr --- 2025-01-17 06:25:18,066 DEBUG 2025-01-17 06:25:18,067 INFO 2025-01-17 06:25:18,067 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-50/stdout.txt" ]; then echo "/results/orders/benchmark-50/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-50/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-50/stdout.txt file found" 2025-01-17 06:25:18,067 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 06:25:18,869 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 06:25:18,870 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:18,870 DEBUG --- stdout --- 2025-01-17 06:25:18,870 DEBUG /results/orders/benchmark-50/stdout.txt file found 2025-01-17 06:25:18,870 DEBUG --- stderr --- 2025-01-17 06:25:18,870 DEBUG 2025-01-17 06:25:18,870 INFO 2025-01-17 06:25:18,870 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:18,870 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:19,147 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:19,147 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:19,147 DEBUG --- stdout --- 2025-01-17 06:25:19,147 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:19,147 DEBUG --- stderr --- 2025-01-17 06:25:19,147 DEBUG 2025-01-17 06:25:19,147 INFO 2025-01-17 06:25:19,148 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-50/stdout.txt 2025-01-17 06:25:19,960 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 06:25:19,960 DEBUG --- stdout --- 2025-01-17 06:25:19,960 DEBUG 3552 /results/orders/benchmark-50/stdout.txt 2025-01-17 06:25:19,960 DEBUG --- stderr --- 2025-01-17 06:25:19,960 DEBUG 2025-01-17 06:25:19,960 INFO - Download file (size 3552k) 2025-01-17 06:25:19,960 INFO 2025-01-17 06:25:19,960 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:19,960 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:20,240 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:20,240 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:20,240 DEBUG --- stdout --- 2025-01-17 06:25:20,240 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:20,240 DEBUG --- stderr --- 2025-01-17 06:25:20,240 DEBUG source : /results/orders/benchmark-50/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stdout.txt 2025-01-17 06:25:20,240 INFO 2025-01-17 06:25:20,240 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:20,240 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:20,519 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:20,519 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:20,519 DEBUG --- stdout --- 2025-01-17 06:25:20,519 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:20,519 DEBUG --- stderr --- 2025-01-17 06:25:20,519 DEBUG 2025-01-17 06:25:20,519 INFO 2025-01-17 06:25:20,519 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-50/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stdout.txt 2025-01-17 06:25:20,519 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 06:25:21,747 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:21,747 DEBUG --- stdout --- 2025-01-17 06:25:21,747 DEBUG tar: Removing leading `/' from member names 2025-01-17 06:25:21,747 DEBUG --- stderr --- 2025-01-17 06:25:21,747 DEBUG ________________________________________________________________________________ [2025-01-17 06:25:21] benchmark-50 show_cmd : Display order command ________________________________________________________________________________ 2025-01-17 06:25:21,747 INFO 2025-01-17 06:25:21,747 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:21,747 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:22,050 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:22,050 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:22,050 DEBUG --- stdout --- 2025-01-17 06:25:22,050 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:22,050 DEBUG --- stderr --- 2025-01-17 06:25:22,050 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 06:25:22,050 INFO 2025-01-17 06:25:22,051 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:22,051 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:22,331 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:22,331 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:22,331 DEBUG --- stdout --- 2025-01-17 06:25:22,331 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:22,331 DEBUG --- stderr --- 2025-01-17 06:25:22,331 DEBUG 2025-01-17 06:25:22,332 INFO 2025-01-17 06:25:22,332 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-50/cmd.txt" ]; then echo "/results/orders/benchmark-50/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-50/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-50/cmd.txt file found" 2025-01-17 06:25:22,332 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 06:25:23,132 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 06:25:23,133 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:23,133 DEBUG --- stdout --- 2025-01-17 06:25:23,133 DEBUG /results/orders/benchmark-50/cmd.txt file found 2025-01-17 06:25:23,133 DEBUG --- stderr --- 2025-01-17 06:25:23,133 DEBUG 2025-01-17 06:25:23,133 INFO 2025-01-17 06:25:23,133 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:23,133 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:23,409 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:23,409 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:23,409 DEBUG --- stdout --- 2025-01-17 06:25:23,410 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:23,410 DEBUG --- stderr --- 2025-01-17 06:25:23,410 DEBUG 2025-01-17 06:25:23,410 INFO 2025-01-17 06:25:23,410 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-50/cmd.txt 2025-01-17 06:25:24,218 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 06:25:24,218 DEBUG --- stdout --- 2025-01-17 06:25:24,218 DEBUG 4 /results/orders/benchmark-50/cmd.txt 2025-01-17 06:25:24,218 DEBUG --- stderr --- 2025-01-17 06:25:24,218 DEBUG 2025-01-17 06:25:24,218 INFO - Download file (size 4k) 2025-01-17 06:25:24,218 INFO 2025-01-17 06:25:24,218 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:24,218 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:24,495 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:24,496 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:24,496 DEBUG --- stdout --- 2025-01-17 06:25:24,496 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:24,496 DEBUG --- stderr --- 2025-01-17 06:25:24,496 DEBUG source : /results/orders/benchmark-50/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/cmd.txt 2025-01-17 06:25:24,496 INFO 2025-01-17 06:25:24,496 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 06:25:24,496 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 06:25:24,786 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 06:25:24,786 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:24,786 DEBUG --- stdout --- 2025-01-17 06:25:24,786 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 06:25:24,786 DEBUG --- stderr --- 2025-01-17 06:25:24,786 DEBUG 2025-01-17 06:25:24,787 INFO 2025-01-17 06:25:24,787 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-50/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/cmd.txt 2025-01-17 06:25:24,787 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 06:25:25,629 INFO [loop_until]: OK (rc = 0) 2025-01-17 06:25:25,629 DEBUG --- stdout --- 2025-01-17 06:25:25,629 DEBUG tar: Removing leading `/' from member names 2025-01-17 06:25:25,629 DEBUG --- stderr --- 2025-01-17 06:25:25,629 DEBUG 2025-01-17 06:25:25,629 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/cmd.txt is small (1 lines), printing all lines: 2025-01-17 06:25:25,629 DEBUG ----- output ----- 2025-01-17 06:25:25,629 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-50" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=Pa_ssw0rd" 2025-01-17 06:25:25,629 INFO ________________________________________________________________________________ [2025-01-17 06:25:25] benchmark-50 show_rc : Display rc order ________________________________________________________________________________ 2025-01-17 06:25:25,629 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/rc.txt is small (1 lines), printing all lines: 2025-01-17 06:25:25,629 DEBUG ----- output ----- 2025-01-17 06:25:25,629 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-17 06:25:25,629 INFO ________________________________________________________________________________ [2025-01-17 06:25:25] benchmark-50 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-17 06:25:25,635 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stdout.txt is 48788 lines): 2025-01-17 06:25:25,635 DEBUG ----- output ----- 2025-01-17 06:25:25,635 INFO 2025-01-17 05:24:42,330 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpkqo6v95v 2025-01-17 06:25:25,635 INFO 2025-01-17 05:24:42,333 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-50" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=50 -Duser_password=**** 2025-01-17 06:25:25,635 INFO [INFO] Scanning for projects... 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-17 06:25:25,635 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-17 06:25:25,635 INFO [INFO] from pom.xml 2025-01-17 06:25:25,635 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-17 06:25:25,635 INFO [INFO] skip non existing resourceDirectory /tmp/tmpkqo6v95v/src/main/resources 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-17 06:25:25,635 INFO [INFO] No sources to compile 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-17 06:25:25,635 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-17 06:25:25,635 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-17 06:25:25,635 INFO [INFO] compiling 38 Scala sources to /tmp/tmpkqo6v95v/target/test-classes ... 2025-01-17 06:25:25,635 INFO [INFO] compile in 11.2 s 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] 2025-01-17 06:25:25,635 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-17 06:25:25,636 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-17 06:25:25,636 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-17 06:25:25,636 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-17 06:25:25,636 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 06:25:25,636 INFO 2025-01-17 06:25:25,636 INFO ================================================================================ 2025-01-17 06:25:25,636 INFO 2025-01-17 05:25:04 GMT 5s elapsed 2025-01-17 06:25:25,636 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 06:25:25,636 INFO > Global (OK=122 KO=0 ) 2025-01-17 06:25:25,636 INFO > restLoginInitiate (OK=18 KO=0 ) 2025-01-17 06:25:25,636 INFO > restLoginUsernamePasswordCallback (OK=17 KO=0 ) 2025-01-17 06:25:25,636 INFO > User Authorize PKCE stage (OK=18 KO=0 ) 2025-01-17 06:25:25,636 INFO > User AccessToken PKCE stage (OK=18 KO=0 ) 2025-01-17 06:25:25,636 INFO > tokenUserinfo (OK=7 KO=0 ) 2025-01-17 06:25:25,636 INFO > Skip 2FA (OK=8 KO=0 ) 2025-01-17 06:25:25,636 INFO > getIdToken (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > getIdToken Redirect 1 (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > createOrganization (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > queryOrganization (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > deleteOrganization (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > RootUserinfo (OK=3 KO=0 ) 2025-01-17 06:25:25,636 INFO > loginTreeWorkflow_restLoginInitiate (OK=2 KO=0 ) 2025-01-17 06:25:25,636 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=2 KO=0 ) 2025-01-17 06:25:25,636 INFO > GetUUid (OK=5 KO=0 ) 2025-01-17 06:25:25,636 INFO > GetOpenidConfig (OK=5 KO=0 ) 2025-01-17 06:25:25,636 INFO > CreatePolicy (OK=5 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI-Post-Login - stage 1 (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI AM idFromSession (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI AM validateGoto (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI-Post-Login - stage 2 (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI Enduser appAuthHelper1 (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI Enduser appAuthHelper2 (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO > UI-Post-Login - stage 3 (OK=1 KO=0 ) 2025-01-17 06:25:25,636 INFO 2025-01-17 06:25:25,636 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 06:25:25,636 INFO [- ] 0% 2025-01-17 06:25:25,636 INFO waiting: 180253 / active: 10 / done: 10 2025-01-17 06:25:25,636 INFO ================================================================================ 2025-01-17 06:25:25,636 INFO 2025-01-17 06:25:25,636 INFO 2025-01-17 06:25:25,636 INFO ================================================================================ 2025-01-17 06:25:25,636 INFO 2025-01-17 05:25:09 GMT 10s elapsed 2025-01-17 06:25:25,636 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 06:25:25,636 INFO > Global (OK=834 KO=0 ) 2025-01-17 06:25:25,636 INFO > restLoginInitiate (OK=78 KO=0 ) 2025-01-17 06:25:25,636 INFO > restLoginUsernamePasswordCallback (OK=76 KO=0 ) 2025-01-17 06:25:25,636 INFO > User Authorize PKCE stage (OK=86 KO=0 ) 2025-01-17 06:25:25,636 INFO > User AccessToken PKCE stage (OK=85 KO=0 ) 2025-01-17 06:25:25,636 INFO > tokenUserinfo (OK=19 KO=0 ) 2025-01-17 06:25:25,636 INFO > Skip 2FA (OK=44 KO=0 ) 2025-01-17 06:25:25,636 INFO > getIdToken (OK=6 KO=0 ) 2025-01-17 06:25:25,636 INFO > getIdToken Redirect 1 (OK=6 KO=0 ) 2025-01-17 06:25:25,636 INFO > createOrganization (OK=6 KO=0 ) 2025-01-17 06:25:25,636 INFO > queryOrganization (OK=6 KO=0 ) 2025-01-17 06:25:25,636 INFO > deleteOrganization (OK=6 KO=0 ) 2025-01-17 06:25:25,636 INFO > RootUserinfo (OK=34 KO=0 ) 2025-01-17 06:25:25,636 INFO > loginTreeWorkflow_restLoginInitiate (OK=5 KO=0 ) 2025-01-17 06:25:25,636 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=5 KO=0 ) 2025-01-17 06:25:25,636 INFO > GetUUid (OK=21 KO=0 ) 2025-01-17 06:25:25,636 INFO > GetOpenidConfig (OK=26 KO=0 ) 2025-01-17 06:25:25,637 INFO > CreatePolicy (OK=21 KO=0 ) 2025-01-17 06:25:25,637 INFO > UI-Post-Login - stage 1 (OK=12 KO=0 ) 2025-01-17 06:25:25,637 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=12 KO=0 ) 2025-01-17 06:25:25,637 INFO > UI AM idFromSession (OK=12 KO=0 ) 2025-01-17 06:25:25,637 INFO > UI AM validateGoto (OK=12 KO=0 ) 2025-01-17 06:25:25,637 INFO > UI-Post-Login - stage 2 (OK=12 KO=0 ) 2025-01-17 06:25:25,637 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=12 KO=0 ) 2025-01-17 06:25:25,637 INFO [...] 2025-01-17 06:25:25,643 INFO > UI-Logout Redirect 1 (OK=38210 KO=0 ) 2025-01-17 06:25:25,643 INFO > UI AM revoke2 (OK=38210 KO=0 ) 2025-01-17 06:25:25,643 INFO > UI AM revoke1 (OK=38210 KO=0 ) 2025-01-17 06:25:25,643 INFO > UI AM endsession (OK=38210 KO=0 ) 2025-01-17 06:25:25,644 INFO > ReadPolicy (OK=57445 KO=3 ) 2025-01-17 06:25:25,644 INFO > DeletePolicy (OK=57367 KO=5 ) 2025-01-17 06:25:25,644 INFO ---- Errors -------------------------------------------------------------------- 2025-01-17 06:25:25,644 INFO > status.find.in([200, 209], 304), found 404 8 (38.10%) 2025-01-17 06:25:25,644 INFO > status.find.in([200, 209], 304), found 409 5 (23.81%) 2025-01-17 06:25:25,644 INFO > status.find.is(200), but actually found 502 3 (14.29%) 2025-01-17 06:25:25,644 INFO > createOrganization: No attribute named 'access_token' is defin 1 ( 4.76%) 2025-01-17 06:25:25,644 INFO ed 2025-01-17 06:25:25,644 INFO > queryOrganization: No attribute named 'organization_id' is def 1 ( 4.76%) 2025-01-17 06:25:25,644 INFO ined 2025-01-17 06:25:25,644 INFO > deleteOrganization: No attribute named 'organization_id' is de 1 ( 4.76%) 2025-01-17 06:25:25,644 INFO fined 2025-01-17 06:25:25,644 INFO > status.find.in([200, 209], 304), found 503 1 ( 4.76%) 2025-01-17 06:25:25,644 INFO > status.find.in([200, 209], 304), found 502 1 ( 4.76%) 2025-01-17 06:25:25,644 INFO 2025-01-17 06:25:25,644 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 06:25:25,644 INFO [#########################################################################-] 99% 2025-01-17 06:25:25,644 INFO waiting: 1511 / active: 223 / done: 178539 2025-01-17 06:25:25,644 INFO ================================================================================ 2025-01-17 06:25:25,644 INFO 2025-01-17 06:25:25,644 INFO 06:24:59.135 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 178760: j.i.IOException: Premature close 2025-01-17 06:25:25,644 INFO 06:24:59.135 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 178761: j.i.IOException: Premature close 2025-01-17 06:25:25,644 INFO 06:24:59.135 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 178762: j.i.IOException: Premature close 2025-01-17 06:25:25,644 INFO 06:24:59.136 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 06:25:25,644 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 06:25:25,644 INFO Request: 2025-01-17 06:25:25,644 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 06:25:25,644 INFO ========================= 2025-01-17 06:25:25,644 INFO Session: 2025-01-17 06:25:25,644 INFO Session(idc.benchmark.Mix2024,178760,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.15315559, randomPolicyName -> testPolicy508391, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@346652d1, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@10e70772),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007cfa2469a0e0@1045f778,io.netty.channel.epoll.EpollEventLoop@652a7737) 2025-01-17 06:25:25,644 INFO ========================= 2025-01-17 06:25:25,644 INFO HTTP request: 2025-01-17 06:25:25,644 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-17 06:25:25,644 INFO headers: 2025-01-17 06:25:25,644 INFO accept: application/json 2025-01-17 06:25:25,644 INFO content-type: application/json 2025-01-17 06:25:25,644 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1 2025-01-17 06:25:25,644 INFO X-Forwarded-For: 42.42.42.42 2025-01-17 06:25:25,644 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 06:25:25,644 INFO content-length: 0 2025-01-17 06:25:25,644 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 06:25:25,644 INFO ========================= 2025-01-17 06:25:25,644 INFO HTTP response: 2025-01-17 06:25:25,644 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 06:25:25,644 INFO 06:24:59.136 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 06:25:25,644 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 06:25:25,644 INFO Request: 2025-01-17 06:25:25,644 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 06:25:25,644 INFO ========================= 2025-01-17 06:25:25,644 INFO Session: 2025-01-17 06:25:25,644 INFO Session(idc.benchmark.Mix2024,178762,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.31004347, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@44008329, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1, password -> Pa_ssw0rd, fake-ip -> 231.37.153.91, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@5f5aa8ed),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007cfa2469a0e0@1045f778,io.netty.channel.epoll.EpollEventLoop@2bef51f2) 2025-01-17 06:25:25,644 INFO ========================= 2025-01-17 06:25:25,644 INFO HTTP request: 2025-01-17 06:25:25,644 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login 2025-01-17 06:25:25,644 INFO headers: 2025-01-17 06:25:25,644 INFO accept: application/json 2025-01-17 06:25:25,644 INFO content-type: application/json 2025-01-17 06:25:25,644 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1 2025-01-17 06:25:25,644 INFO X-Forwarded-For: 231.37.153.91 2025-01-17 06:25:25,644 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 06:25:25,644 INFO content-length: 0 2025-01-17 06:25:25,644 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 06:25:25,645 INFO ========================= 2025-01-17 06:25:25,645 INFO HTTP response: 2025-01-17 06:25:25,645 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 06:25:25,645 INFO 06:24:59.136 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 06:25:25,645 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 06:25:25,645 INFO Request: 2025-01-17 06:25:25,645 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 06:25:25,645 INFO ========================= 2025-01-17 06:25:25,645 INFO Session: 2025-01-17 06:25:25,645 INFO Session(idc.benchmark.Mix2024,178761,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.4864082, randomPolicyName -> testPolicy69552, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@398ade29, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1, password -> Pa_ssw0rd, fake-ip -> 116.118.92.1, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@65d2bc16),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007cfa2469a0e0@1045f778,io.netty.channel.epoll.EpollEventLoop@5b7ea70d) 2025-01-17 06:25:25,645 INFO ========================= 2025-01-17 06:25:25,645 INFO HTTP request: 2025-01-17 06:25:25,645 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-17 06:25:25,645 INFO headers: 2025-01-17 06:25:25,645 INFO accept: application/json 2025-01-17 06:25:25,645 INFO content-type: application/json 2025-01-17 06:25:25,645 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1 2025-01-17 06:25:25,645 INFO X-Forwarded-For: 116.118.92.1 2025-01-17 06:25:25,645 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 06:25:25,645 INFO content-length: 0 2025-01-17 06:25:25,645 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 06:25:25,645 INFO ========================= 2025-01-17 06:25:25,645 INFO HTTP response: 2025-01-17 06:25:25,645 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 06:25:25,645 INFO 06:24:59.136 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-104' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 06:25:25,645 INFO 06:24:59.136 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-104' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 06:25:25,645 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 06:25:25,645 INFO [INFO] BUILD SUCCESS 2025-01-17 06:25:25,645 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 06:25:25,645 INFO [INFO] Total time: 01:00 h 2025-01-17 06:25:25,645 INFO [INFO] Finished at: 2025-01-17T06:24:59Z 2025-01-17 06:25:25,645 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 06:25:25,645 INFO 2025-01-17 06:24:59,218 INFO Gatling simulation run ended successfully 2025-01-17 06:25:25,645 INFO 2025-01-17 06:24:59,218 DEBUG No archive name provided. No archive will be created 2025-01-17 06:25:25,645 INFO ________________________________________________________________________________ [2025-01-17 06:25:25] benchmark-50 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-17 06:25:25,645 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-50/stderr.txt is small (0 lines), printing all lines: 2025-01-17 06:25:25,645 DEBUG ----- output ----- 2025-01-17 06:25:25,645 DEBUG 2025-01-17 06:25:25,645 INFO ________________________________________________________________________________ [2025-01-17 06:25:25] benchmark-50 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-17 06:25:25] benchmark-50 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-17 06:25:25] benchmark-50 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped