--Task-- name: benchmark-10 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 10} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-16 18:35:31] benchmark-10 pre : N/A ________________________________________________________________________________ 2025-01-16 18:35:31,918 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-16 18:35:31 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-16 18:35:31 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-10/stdout.txt Pod log : /results/orders/benchmark-10 2025-01-16 18:35:32,481 INFO 2025-01-16 18:35:32,481 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 18:35:32,481 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 18:35:32,757 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 18:35:32,757 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:32,757 DEBUG --- stdout --- 2025-01-16 18:35:32,757 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 18:35:32,757 DEBUG --- stderr --- 2025-01-16 18:35:32,757 DEBUG 2025-01-16 18:35:32 - INFO: Get overseer pod resources requests memory 2025-01-16 18:35:32,757 INFO 2025-01-16 18:35:32,757 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-5865b977f-pk2tz --output jsonpath={.spec.containers[].resources.requests.memory} 2025-01-16 18:35:32,757 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 18:35:33,054 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:33,054 DEBUG --- stdout --- 2025-01-16 18:35:33,054 DEBUG 4Gi 2025-01-16 18:35:33,054 DEBUG --- stderr --- 2025-01-16 18:35:33,054 DEBUG ________________________________________________________________________________ [2025-01-16 18:35:33] benchmark-10 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-16 18:35:33,055 INFO 2025-01-16 18:35:33,055 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 18:35:33,055 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 18:35:33,331 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 18:35:33,332 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:33,332 DEBUG --- stdout --- 2025-01-16 18:35:33,332 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 18:35:33,332 DEBUG --- stderr --- 2025-01-16 18:35:33,332 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-16 18:35:33] benchmark-10 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-16 18:35:33,332 INFO 2025-01-16 18:35:33,332 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 18:35:33,332 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 18:35:33,609 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 18:35:33,609 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:33,609 DEBUG --- stdout --- 2025-01-16 18:35:33,609 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 18:35:33,609 DEBUG --- stderr --- 2025-01-16 18:35:33,609 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json { "name": "benchmark-10", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-10\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-10" } ________________________________________________________________________________ [2025-01-16 18:35:33] benchmark-10 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-16 18:35:33,613 INFO 2025-01-16 18:35:33,613 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-16 18:35:33,613 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-16 18:35:33,932 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 18:35:33,932 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:33,932 DEBUG --- stdout --- 2025-01-16 18:35:33,932 DEBUG WAITING 2025-01-16 18:35:33,932 DEBUG --- stderr --- 2025-01-16 18:35:33,932 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 22 0 --:--:-- --:--:-- --:--:-- 22 ________________________________________________________________________________ [2025-01-16 18:35:33] benchmark-10 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-16 18:35:33,932 INFO 2025-01-16 18:35:33,932 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 18:35:33,932 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 18:35:34,208 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 18:35:34,208 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:34,208 DEBUG --- stdout --- 2025-01-16 18:35:34,208 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 18:35:34,208 DEBUG --- stderr --- 2025-01-16 18:35:34,208 DEBUG 2025-01-16 18:35:34,208 INFO 2025-01-16 18:35:34,208 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-16 18:35:34,208 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 18:35:35,585 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:35,585 DEBUG --- stdout --- 2025-01-16 18:35:35,585 DEBUG 2025-01-16 18:35:35,585 DEBUG --- stderr --- 2025-01-16 18:35:35,585 DEBUG Order has been successfully forwarded to overseer 2025-01-16 18:35:35 - INFO: Check if Gatling simulation started successfully 2025-01-16 18:35:35,586 INFO 2025-01-16 18:35:35,586 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 18:35:35,586 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 18:35:35,861 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 18:35:35,861 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:35,861 DEBUG --- stdout --- 2025-01-16 18:35:35,861 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 18:35:35,861 DEBUG --- stderr --- 2025-01-16 18:35:35,861 DEBUG 2025-01-16 18:35:35,862 INFO 2025-01-16 18:35:35,862 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-10/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-16 18:35:35,862 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-16 18:35:36,593 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 18:35:42,324 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 18:35:48,121 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 18:35:53,848 INFO [loop_until]: Function succeeded after 17s (rc=0) - expected pattern found 2025-01-16 18:35:53,849 INFO [loop_until]: OK (rc = 0) 2025-01-16 18:35:53,849 DEBUG --- stdout --- 2025-01-16 18:35:53,849 DEBUG 2025-01-16 18:35:36,614 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpwl_tj7ax 2025-01-16 18:35:36,616 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpwl_tj7ax/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmpwl_tj7ax/target/test-classes ... [INFO] compile in 11.2 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-01-16 18:35:53,849 DEBUG --- stderr --- 2025-01-16 18:35:53,849 DEBUG ________________________________________________________________________________ [2025-01-16 18:35:53] benchmark-10 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 04s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 05s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 06s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 07s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 08s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 09s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-16 19:36:03] benchmark-10 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-16 19:36:03,108 INFO 2025-01-16 19:36:03,108 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:03,108 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:03,415 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:03,415 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:03,415 DEBUG --- stdout --- 2025-01-16 19:36:03,415 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:03,415 DEBUG --- stderr --- 2025-01-16 19:36:03,416 DEBUG 2025-01-16 19:36:03,416 INFO 2025-01-16 19:36:03,416 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-16 19:36:03,416 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 19:36:04,205 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:04,205 DEBUG --- stdout --- 2025-01-16 19:36:04,205 DEBUG 2025-01-16 19:36:04,205 DEBUG --- stderr --- 2025-01-16 19:36:04,205 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-16 19:36:04] benchmark-10 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-16 19:36:04 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json 2025-01-16 19:36:04,206 INFO 2025-01-16 19:36:04,206 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:04,206 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:04,482 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:04,482 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:04,482 DEBUG --- stdout --- 2025-01-16 19:36:04,482 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:04,482 DEBUG --- stderr --- 2025-01-16 19:36:04,482 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 19:36:04,483 INFO 2025-01-16 19:36:04,483 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:04,483 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:04,763 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:04,763 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:04,763 DEBUG --- stdout --- 2025-01-16 19:36:04,763 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:04,763 DEBUG --- stderr --- 2025-01-16 19:36:04,763 DEBUG 2025-01-16 19:36:04,764 INFO 2025-01-16 19:36:04,764 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/rc.txt" ]; then echo "/results/orders/benchmark-10/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-10/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/rc.txt file found" 2025-01-16 19:36:04,764 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 19:36:05,574 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 19:36:05,574 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:05,574 DEBUG --- stdout --- 2025-01-16 19:36:05,574 DEBUG /results/orders/benchmark-10/rc.txt file found 2025-01-16 19:36:05,574 DEBUG --- stderr --- 2025-01-16 19:36:05,574 DEBUG 2025-01-16 19:36:05,574 INFO 2025-01-16 19:36:05,574 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:05,574 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:05,851 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:05,851 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:05,851 DEBUG --- stdout --- 2025-01-16 19:36:05,851 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:05,851 DEBUG --- stderr --- 2025-01-16 19:36:05,851 DEBUG 2025-01-16 19:36:05,851 INFO 2025-01-16 19:36:05,852 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-10/rc.txt 2025-01-16 19:36:06,650 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 19:36:06,650 DEBUG --- stdout --- 2025-01-16 19:36:06,651 DEBUG 4 /results/orders/benchmark-10/rc.txt 2025-01-16 19:36:06,651 DEBUG --- stderr --- 2025-01-16 19:36:06,651 DEBUG 2025-01-16 19:36:06,651 INFO - Download file (size 4k) 2025-01-16 19:36:06,651 INFO 2025-01-16 19:36:06,651 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:06,651 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:06,926 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:06,926 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:06,926 DEBUG --- stdout --- 2025-01-16 19:36:06,927 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:06,927 DEBUG --- stderr --- 2025-01-16 19:36:06,927 DEBUG source : /results/orders/benchmark-10/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2025-01-16 19:36:06,927 INFO 2025-01-16 19:36:06,927 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:06,927 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:07,205 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:07,205 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:07,205 DEBUG --- stdout --- 2025-01-16 19:36:07,205 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:07,205 DEBUG --- stderr --- 2025-01-16 19:36:07,205 DEBUG 2025-01-16 19:36:07,206 INFO 2025-01-16 19:36:07,206 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-10/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2025-01-16 19:36:07,206 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 19:36:07,983 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:07,983 DEBUG --- stdout --- 2025-01-16 19:36:07,983 DEBUG tar: Removing leading `/' from member names 2025-01-16 19:36:07,983 DEBUG --- stderr --- 2025-01-16 19:36:07,983 DEBUG 2025-01-16 19:36:07,983 INFO 2025-01-16 19:36:07,983 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:07,983 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:08,259 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:08,259 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:08,259 DEBUG --- stdout --- 2025-01-16 19:36:08,259 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:08,259 DEBUG --- stderr --- 2025-01-16 19:36:08,259 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 19:36:08,260 INFO 2025-01-16 19:36:08,260 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:08,260 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:08,536 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:08,536 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:08,536 DEBUG --- stdout --- 2025-01-16 19:36:08,536 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:08,536 DEBUG --- stderr --- 2025-01-16 19:36:08,536 DEBUG 2025-01-16 19:36:08,537 INFO 2025-01-16 19:36:08,537 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/stderr.txt" ]; then echo "/results/orders/benchmark-10/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stderr.txt file found" 2025-01-16 19:36:08,537 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 19:36:09,330 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 19:36:09,330 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:09,330 DEBUG --- stdout --- 2025-01-16 19:36:09,330 DEBUG /results/orders/benchmark-10/stderr.txt file found 2025-01-16 19:36:09,330 DEBUG --- stderr --- 2025-01-16 19:36:09,330 DEBUG 2025-01-16 19:36:09,330 INFO 2025-01-16 19:36:09,330 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:09,330 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:09,606 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:09,606 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:09,606 DEBUG --- stdout --- 2025-01-16 19:36:09,606 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:09,606 DEBUG --- stderr --- 2025-01-16 19:36:09,606 DEBUG 2025-01-16 19:36:09,606 INFO 2025-01-16 19:36:09,606 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-10/stderr.txt 2025-01-16 19:36:10,438 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 19:36:10,438 DEBUG --- stdout --- 2025-01-16 19:36:10,438 DEBUG 0 /results/orders/benchmark-10/stderr.txt 2025-01-16 19:36:10,438 DEBUG --- stderr --- 2025-01-16 19:36:10,438 DEBUG 2025-01-16 19:36:10,438 INFO - Download file (size 0k) 2025-01-16 19:36:10,438 INFO 2025-01-16 19:36:10,438 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:10,438 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:10,729 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:10,730 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:10,730 DEBUG --- stdout --- 2025-01-16 19:36:10,730 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:10,730 DEBUG --- stderr --- 2025-01-16 19:36:10,730 DEBUG source : /results/orders/benchmark-10/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2025-01-16 19:36:10,730 INFO 2025-01-16 19:36:10,730 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:10,730 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:11,009 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:11,009 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:11,009 DEBUG --- stdout --- 2025-01-16 19:36:11,010 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:11,010 DEBUG --- stderr --- 2025-01-16 19:36:11,010 DEBUG 2025-01-16 19:36:11,010 INFO 2025-01-16 19:36:11,010 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-10/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2025-01-16 19:36:11,010 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 19:36:11,728 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:11,728 DEBUG --- stdout --- 2025-01-16 19:36:11,728 DEBUG tar: Removing leading `/' from member names 2025-01-16 19:36:11,728 DEBUG --- stderr --- 2025-01-16 19:36:11,728 DEBUG 2025-01-16 19:36:11,728 INFO 2025-01-16 19:36:11,728 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:11,728 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:12,003 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:12,003 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:12,003 DEBUG --- stdout --- 2025-01-16 19:36:12,004 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:12,004 DEBUG --- stderr --- 2025-01-16 19:36:12,004 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 19:36:12,004 INFO 2025-01-16 19:36:12,004 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:12,004 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:12,280 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:12,280 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:12,280 DEBUG --- stdout --- 2025-01-16 19:36:12,280 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:12,280 DEBUG --- stderr --- 2025-01-16 19:36:12,280 DEBUG 2025-01-16 19:36:12,281 INFO 2025-01-16 19:36:12,281 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/stdout.txt" ]; then echo "/results/orders/benchmark-10/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stdout.txt file found" 2025-01-16 19:36:12,281 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 19:36:13,087 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 19:36:13,087 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:13,087 DEBUG --- stdout --- 2025-01-16 19:36:13,087 DEBUG /results/orders/benchmark-10/stdout.txt file found 2025-01-16 19:36:13,087 DEBUG --- stderr --- 2025-01-16 19:36:13,087 DEBUG 2025-01-16 19:36:13,087 INFO 2025-01-16 19:36:13,087 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:13,087 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:13,364 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:13,364 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:13,365 DEBUG --- stdout --- 2025-01-16 19:36:13,365 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:13,365 DEBUG --- stderr --- 2025-01-16 19:36:13,365 DEBUG 2025-01-16 19:36:13,365 INFO 2025-01-16 19:36:13,365 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-10/stdout.txt 2025-01-16 19:36:14,171 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 19:36:14,172 DEBUG --- stdout --- 2025-01-16 19:36:14,172 DEBUG 3624 /results/orders/benchmark-10/stdout.txt 2025-01-16 19:36:14,172 DEBUG --- stderr --- 2025-01-16 19:36:14,172 DEBUG 2025-01-16 19:36:14,172 INFO - Download file (size 3624k) 2025-01-16 19:36:14,172 INFO 2025-01-16 19:36:14,172 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:14,172 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:14,447 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:14,447 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:14,447 DEBUG --- stdout --- 2025-01-16 19:36:14,447 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:14,447 DEBUG --- stderr --- 2025-01-16 19:36:14,447 DEBUG source : /results/orders/benchmark-10/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2025-01-16 19:36:14,447 INFO 2025-01-16 19:36:14,447 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:14,447 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:14,723 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:14,723 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:14,723 DEBUG --- stdout --- 2025-01-16 19:36:14,723 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:14,723 DEBUG --- stderr --- 2025-01-16 19:36:14,723 DEBUG 2025-01-16 19:36:14,724 INFO 2025-01-16 19:36:14,724 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-10/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2025-01-16 19:36:14,724 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 19:36:15,944 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:15,944 DEBUG --- stdout --- 2025-01-16 19:36:15,945 DEBUG tar: Removing leading `/' from member names 2025-01-16 19:36:15,945 DEBUG --- stderr --- 2025-01-16 19:36:15,945 DEBUG ________________________________________________________________________________ [2025-01-16 19:36:15] benchmark-10 show_cmd : Display order command ________________________________________________________________________________ 2025-01-16 19:36:15,945 INFO 2025-01-16 19:36:15,945 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:15,945 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:16,221 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:16,221 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:16,221 DEBUG --- stdout --- 2025-01-16 19:36:16,221 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:16,221 DEBUG --- stderr --- 2025-01-16 19:36:16,221 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 19:36:16,221 INFO 2025-01-16 19:36:16,221 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:16,221 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:16,497 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:16,497 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:16,497 DEBUG --- stdout --- 2025-01-16 19:36:16,497 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:16,497 DEBUG --- stderr --- 2025-01-16 19:36:16,497 DEBUG 2025-01-16 19:36:16,498 INFO 2025-01-16 19:36:16,498 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/cmd.txt" ]; then echo "/results/orders/benchmark-10/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-10/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/cmd.txt file found" 2025-01-16 19:36:16,498 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 19:36:17,293 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 19:36:17,293 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:17,293 DEBUG --- stdout --- 2025-01-16 19:36:17,293 DEBUG /results/orders/benchmark-10/cmd.txt file found 2025-01-16 19:36:17,293 DEBUG --- stderr --- 2025-01-16 19:36:17,293 DEBUG 2025-01-16 19:36:17,293 INFO 2025-01-16 19:36:17,293 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:17,293 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:17,573 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:17,573 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:17,573 DEBUG --- stdout --- 2025-01-16 19:36:17,573 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:17,573 DEBUG --- stderr --- 2025-01-16 19:36:17,573 DEBUG 2025-01-16 19:36:17,573 INFO 2025-01-16 19:36:17,573 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-10/cmd.txt 2025-01-16 19:36:18,369 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 19:36:18,369 DEBUG --- stdout --- 2025-01-16 19:36:18,369 DEBUG 4 /results/orders/benchmark-10/cmd.txt 2025-01-16 19:36:18,369 DEBUG --- stderr --- 2025-01-16 19:36:18,369 DEBUG 2025-01-16 19:36:18,369 INFO - Download file (size 4k) 2025-01-16 19:36:18,370 INFO 2025-01-16 19:36:18,370 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:18,370 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:18,646 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:18,646 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:18,646 DEBUG --- stdout --- 2025-01-16 19:36:18,646 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:18,646 DEBUG --- stderr --- 2025-01-16 19:36:18,646 DEBUG source : /results/orders/benchmark-10/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2025-01-16 19:36:18,646 INFO 2025-01-16 19:36:18,646 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 19:36:18,646 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 19:36:18,921 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 19:36:18,921 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:18,921 DEBUG --- stdout --- 2025-01-16 19:36:18,922 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 19:36:18,922 DEBUG --- stderr --- 2025-01-16 19:36:18,922 DEBUG 2025-01-16 19:36:18,922 INFO 2025-01-16 19:36:18,922 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-10/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2025-01-16 19:36:18,922 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 19:36:19,676 INFO [loop_until]: OK (rc = 0) 2025-01-16 19:36:19,677 DEBUG --- stdout --- 2025-01-16 19:36:19,677 DEBUG tar: Removing leading `/' from member names 2025-01-16 19:36:19,677 DEBUG --- stderr --- 2025-01-16 19:36:19,677 DEBUG 2025-01-16 19:36:19,677 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt is small (1 lines), printing all lines: 2025-01-16 19:36:19,677 DEBUG ----- output ----- 2025-01-16 19:36:19,677 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" 2025-01-16 19:36:19,677 INFO ________________________________________________________________________________ [2025-01-16 19:36:19] benchmark-10 show_rc : Display rc order ________________________________________________________________________________ 2025-01-16 19:36:19,677 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt is small (1 lines), printing all lines: 2025-01-16 19:36:19,677 DEBUG ----- output ----- 2025-01-16 19:36:19,677 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-16 19:36:19,677 INFO ________________________________________________________________________________ [2025-01-16 19:36:19] benchmark-10 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-16 19:36:19,682 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt is 49897 lines): 2025-01-16 19:36:19,682 DEBUG ----- output ----- 2025-01-16 19:36:19,682 INFO 2025-01-16 18:35:36,614 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpwl_tj7ax 2025-01-16 19:36:19,682 INFO 2025-01-16 18:35:36,616 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=**** 2025-01-16 19:36:19,682 INFO [INFO] Scanning for projects... 2025-01-16 19:36:19,682 INFO [INFO] 2025-01-16 19:36:19,682 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-16 19:36:19,682 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-16 19:36:19,682 INFO [INFO] from pom.xml 2025-01-16 19:36:19,682 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-16 19:36:19,682 INFO [INFO] 2025-01-16 19:36:19,682 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-16 19:36:19,682 INFO [INFO] 2025-01-16 19:36:19,682 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-16 19:36:19,683 INFO [INFO] skip non existing resourceDirectory /tmp/tmpwl_tj7ax/src/main/resources 2025-01-16 19:36:19,683 INFO [INFO] 2025-01-16 19:36:19,683 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-16 19:36:19,683 INFO [INFO] No sources to compile 2025-01-16 19:36:19,683 INFO [INFO] 2025-01-16 19:36:19,683 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-16 19:36:19,683 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-16 19:36:19,683 INFO [INFO] 2025-01-16 19:36:19,683 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-16 19:36:19,683 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-16 19:36:19,683 INFO [INFO] 2025-01-16 19:36:19,683 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-16 19:36:19,683 INFO [INFO] compiling 38 Scala sources to /tmp/tmpwl_tj7ax/target/test-classes ... 2025-01-16 19:36:19,683 INFO [INFO] compile in 11.2 s 2025-01-16 19:36:19,683 INFO [INFO] 2025-01-16 19:36:19,683 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-16 19:36:19,683 INFO [INFO] 2025-01-16 19:36:19,683 INFO [INFO] 2025-01-16 19:36:19,683 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-16 19:36:19,683 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-16 19:36:19,683 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-16 19:36:19,683 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-16 19:36:19,683 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-16 19:36:19,683 INFO 2025-01-16 19:36:19,683 INFO ================================================================================ 2025-01-16 19:36:19,683 INFO 2025-01-16 18:35:58 GMT 4s elapsed 2025-01-16 19:36:19,683 INFO ---- Requests ------------------------------------------------------------------ 2025-01-16 19:36:19,683 INFO > Global (OK=67 KO=0 ) 2025-01-16 19:36:19,683 INFO > restLoginInitiate (OK=4 KO=0 ) 2025-01-16 19:36:19,683 INFO > restLoginUsernamePasswordCallback (OK=4 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI-Post-Login - stage 1 (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI AM idFromSession (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI AM validateGoto (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > User Authorize PKCE stage (OK=6 KO=0 ) 2025-01-16 19:36:19,683 INFO > User AccessToken PKCE stage (OK=5 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI-Post-Login - stage 2 (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI Enduser appAuthHelper2 (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI Enduser appAuthHelper1 (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI-Post-Login - stage 3 (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM uiconfig (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI Enduser sessioncheck (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM version (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM privilege (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM features (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM login (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM dashboard (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM managed user schema (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM user (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > Skip 2FA (OK=2 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI IDM oidcToken (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > userinfo (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI-Logout (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI-Logout Redirect 1 (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI AM revoke2 (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI AM revoke1 (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > UI AM endsession (OK=1 KO=0 ) 2025-01-16 19:36:19,683 INFO > RootUserinfo (OK=3 KO=0 ) 2025-01-16 19:36:19,683 INFO 2025-01-16 19:36:19,683 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-16 19:36:19,683 INFO [- ] 0% 2025-01-16 19:36:19,684 INFO waiting: 36022 / active: 3 / done: 1 2025-01-16 19:36:19,684 INFO ================================================================================ 2025-01-16 19:36:19,684 INFO 2025-01-16 19:36:19,684 INFO 2025-01-16 19:36:19,684 INFO ================================================================================ 2025-01-16 19:36:19,684 INFO 2025-01-16 18:36:03 GMT 10s elapsed 2025-01-16 19:36:19,684 INFO ---- Requests ------------------------------------------------------------------ 2025-01-16 19:36:19,684 INFO > Global (OK=236 KO=0 ) 2025-01-16 19:36:19,684 INFO > restLoginInitiate (OK=16 KO=0 ) 2025-01-16 19:36:19,684 INFO > restLoginUsernamePasswordCallback (OK=16 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI-Post-Login - stage 1 (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI AM idFromSession (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI AM validateGoto (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > User Authorize PKCE stage (OK=20 KO=0 ) 2025-01-16 19:36:19,684 INFO > User AccessToken PKCE stage (OK=20 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI-Post-Login - stage 2 (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI Enduser appAuthHelper2 (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI Enduser appAuthHelper1 (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI-Post-Login - stage 3 (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI IDM uiconfig (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI Enduser sessioncheck (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO > UI IDM version (OK=5 KO=0 ) 2025-01-16 19:36:19,684 INFO [...] 2025-01-16 19:36:19,691 INFO > UI AM endsession (OK=7659 KO=0 ) 2025-01-16 19:36:19,691 INFO > RootUserinfo (OK=25308 KO=0 ) 2025-01-16 19:36:19,691 INFO > GetUUid (OK=11530 KO=0 ) 2025-01-16 19:36:19,691 INFO > GetOpenidConfig (OK=34545 KO=1 ) 2025-01-16 19:36:19,691 INFO > CreatePolicy (OK=11528 KO=1 ) 2025-01-16 19:36:19,691 INFO > tokenUserinfo (OK=7611 KO=0 ) 2025-01-16 19:36:19,691 INFO > ReadPolicy (OK=11517 KO=1 ) 2025-01-16 19:36:19,691 INFO > getIdToken (OK=2557 KO=0 ) 2025-01-16 19:36:19,691 INFO > getIdToken Redirect 1 (OK=2557 KO=0 ) 2025-01-16 19:36:19,691 INFO > createOrganization (OK=2556 KO=0 ) 2025-01-16 19:36:19,691 INFO > queryOrganization (OK=2556 KO=0 ) 2025-01-16 19:36:19,691 INFO > deleteOrganization (OK=2556 KO=0 ) 2025-01-16 19:36:19,691 INFO > DeletePolicy (OK=11498 KO=1 ) 2025-01-16 19:36:19,691 INFO > loginTreeWorkflow_restLoginInitiate (OK=1280 KO=0 ) 2025-01-16 19:36:19,691 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1280 KO=0 ) 2025-01-16 19:36:19,691 INFO ---- Errors -------------------------------------------------------------------- 2025-01-16 19:36:19,691 INFO > status.find.in([200, 209], 304), found 502 5 (17.86%) 2025-01-16 19:36:19,691 INFO > RootUserinfo: No attribute named 'access_token' is defined 5 (17.86%) 2025-01-16 19:36:19,691 INFO > status.find.is(200), but actually found 502 3 (10.71%) 2025-01-16 19:36:19,691 INFO > status.find.in([200, 209], 304), found 404 2 ( 7.14%) 2025-01-16 19:36:19,691 INFO > userinfo: No attribute named 'access_token' is defined 2 ( 7.14%) 2025-01-16 19:36:19,691 INFO > UI AM revoke1: No attribute named 'access_token' is defined 2 ( 7.14%) 2025-01-16 19:36:19,691 INFO > createOrganization: No attribute named 'access_token' is defin 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO ed 2025-01-16 19:36:19,691 INFO > queryOrganization: No attribute named 'organization_id' is def 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO ined 2025-01-16 19:36:19,691 INFO > deleteOrganization: No attribute named 'organization_id' is de 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO fined 2025-01-16 19:36:19,691 INFO > status.find.in([200, 209], 304), found 401 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO > headerRegex((location,#id_token=(.*))).find.exists, found noth 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO ing 2025-01-16 19:36:19,691 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO 2025-01-16 19:36:19,691 INFO > UI AM endsession: No attribute named 'id_token_2' is defined 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO > status.find.in([200, 209], 304), found 503 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO > i.n.c.ConnectTimeoutException: connection timed out after 1000 1 ( 3.57%) 2025-01-16 19:36:19,691 INFO 0 ms: openam-perf-200m.forgeblocks.com/34.107.203.37:443 2025-01-16 19:36:19,691 INFO 2025-01-16 19:36:19,691 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-16 19:36:19,691 INFO [#########################################################################-] 98% 2025-01-16 19:36:19,691 INFO waiting: 311 / active: 50 / done: 35665 2025-01-16 19:36:19,691 INFO ================================================================================ 2025-01-16 19:36:19,691 INFO 2025-01-16 19:36:19,691 INFO 19:35:53.658 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 35715: j.i.IOException: Premature close 2025-01-16 19:36:19,691 INFO 19:35:53.658 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI AM validateGoto' failed for user 35714: j.i.IOException: Premature close 2025-01-16 19:36:19,692 INFO 19:35:53.659 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-16 19:36:19,692 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-16 19:36:19,692 INFO Request: 2025-01-16 19:36:19,692 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-16 19:36:19,692 INFO ========================= 2025-01-16 19:36:19,692 INFO Session: 2025-01-16 19:36:19,692 INFO Session(idc.benchmark.Mix2024,35715,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.146445407, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@1c0d63b, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@44968d76),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007ed47469a0e0@484888f2,io.netty.channel.epoll.EpollEventLoop@12dae582) 2025-01-16 19:36:19,692 INFO ========================= 2025-01-16 19:36:19,692 INFO HTTP request: 2025-01-16 19:36:19,692 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-16 19:36:19,692 INFO headers: 2025-01-16 19:36:19,692 INFO accept: application/json 2025-01-16 19:36:19,692 INFO content-type: application/json 2025-01-16 19:36:19,692 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0 2025-01-16 19:36:19,692 INFO X-Forwarded-For: 42.42.42.42 2025-01-16 19:36:19,692 INFO host: openam-perf-200m.forgeblocks.com 2025-01-16 19:36:19,692 INFO content-length: 0 2025-01-16 19:36:19,692 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-16 19:36:19,692 INFO ========================= 2025-01-16 19:36:19,692 INFO HTTP response: 2025-01-16 19:36:19,692 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 19:36:19,692 INFO 19:35:53.659 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-16 19:36:19,692 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-16 19:36:19,692 INFO Request: 2025-01-16 19:36:19,692 INFO UI AM validateGoto: KO j.i.IOException: Premature close 2025-01-16 19:36:19,692 INFO ========================= 2025-01-16 19:36:19,692 INFO Session: 2025-01-16 19:36:19,692 INFO Session(idc.benchmark.Mix2024,35714,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.41727572, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@498c1a38, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, callbacks -> {"tokenId":"M7s7J2w6V3ADlnGfNvcIj2Gtccs.*AAJTSQACMDIAAlNLABxNeS9ueTJndHd5eGNYQXRHYlIxaER0QVk3alU9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737056153548), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=M7s7J2w6V3ADlnGfNvcIj2Gtccs.*AAJTSQACMDIAAlNLABxNeS9ueTJndHd5eGNYQXRHYlIxaER0QVk3alU9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737056153548))), password -> Pa_ssw0rd, fake-ip -> 138.231.179.189, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@625986a6, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@3dcb337c, tokenId -> M7s7J2w6V3ADlnGfNvcIj2Gtccs.*AAJTSQACMDIAAlNLABxNeS9ueTJndHd5eGNYQXRHYlIxaER0QVk3alU9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007ed47469a0e0@484888f2,io.netty.channel.epoll.EpollEventLoop@14f5da2c) 2025-01-16 19:36:19,692 INFO ========================= 2025-01-16 19:36:19,692 INFO HTTP request: 2025-01-16 19:36:19,692 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/users?_action=validateGoto 2025-01-16 19:36:19,692 INFO headers: 2025-01-16 19:36:19,692 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-16 19:36:19,692 INFO Accept-API-Version: resource=2.1, protocol=1.0 2025-01-16 19:36:19,692 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-16 19:36:19,692 INFO accept: */* 2025-01-16 19:36:19,692 INFO cookie: amlbcookie=01; 15892ffd844ef80=M7s7J2w6V3ADlnGfNvcIj2Gtccs.*AAJTSQACMDIAAlNLABxNeS9ueTJndHd5eGNYQXRHYlIxaER0QVk3alU9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-16 19:36:19,692 INFO origin: https://openam-perf-200m.forgeblocks.com 2025-01-16 19:36:19,692 INFO host: openam-perf-200m.forgeblocks.com 2025-01-16 19:36:19,692 INFO content-length: 0 2025-01-16 19:36:19,692 INFO cookies: 2025-01-16 19:36:19,692 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-16 19:36:19,692 INFO 15892ffd844ef80=M7s7J2w6V3ADlnGfNvcIj2Gtccs.*AAJTSQACMDIAAlNLABxNeS9ueTJndHd5eGNYQXRHYlIxaER0QVk3alU9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-16 19:36:19,692 INFO ========================= 2025-01-16 19:36:19,692 INFO HTTP response: 2025-01-16 19:36:19,692 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 19:36:19,692 INFO 19:35:53.659 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-133' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-16 19:36:19,692 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 19:36:19,692 INFO [INFO] BUILD SUCCESS 2025-01-16 19:36:19,692 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 19:36:19,692 INFO [INFO] Total time: 01:00 h 2025-01-16 19:36:19,692 INFO [INFO] Finished at: 2025-01-16T19:35:53Z 2025-01-16 19:36:19,692 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 19:36:19,692 INFO 2025-01-16 19:35:53,754 INFO Gatling simulation run ended successfully 2025-01-16 19:36:19,692 INFO 2025-01-16 19:35:53,755 DEBUG No archive name provided. No archive will be created 2025-01-16 19:36:19,692 INFO ________________________________________________________________________________ [2025-01-16 19:36:19] benchmark-10 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-16 19:36:19,693 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt is small (0 lines), printing all lines: 2025-01-16 19:36:19,693 DEBUG ----- output ----- 2025-01-16 19:36:19,693 DEBUG 2025-01-16 19:36:19,693 INFO ________________________________________________________________________________ [2025-01-16 19:36:19] benchmark-10 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-16 19:36:19] benchmark-10 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-16 19:36:19] benchmark-10 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped