--Task-- name: benchmark-170 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-150'] preceding_task: benchmark-150 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 170} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-17 09:27:48] benchmark-170 pre : N/A ________________________________________________________________________________ 2025-01-17 09:27:48,916 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-17 09:27:48 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-17 09:27:48 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-170/stdout.txt Pod log : /results/orders/benchmark-170 2025-01-17 09:27:48,917 INFO 2025-01-17 09:27:48,917 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:48,917 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:49,195 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:49,195 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:49,195 DEBUG --- stdout --- 2025-01-17 09:27:49,195 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:49,195 DEBUG --- stderr --- 2025-01-17 09:27:49,195 DEBUG ________________________________________________________________________________ [2025-01-17 09:27:49] benchmark-170 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-17 09:27:49,195 INFO 2025-01-17 09:27:49,195 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:49,195 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:49,473 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:49,473 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:49,473 DEBUG --- stdout --- 2025-01-17 09:27:49,473 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:49,473 DEBUG --- stderr --- 2025-01-17 09:27:49,473 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-170" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=170 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-17 09:27:49] benchmark-170 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-17 09:27:49,474 INFO 2025-01-17 09:27:49,474 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:49,474 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:49,752 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:49,752 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:49,752 DEBUG --- stdout --- 2025-01-17 09:27:49,752 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:49,752 DEBUG --- stderr --- 2025-01-17 09:27:49,752 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/order.json { "name": "benchmark-170", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-170\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=170 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-170" } ________________________________________________________________________________ [2025-01-17 09:27:49] benchmark-170 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-17 09:27:49,755 INFO 2025-01-17 09:27:49,755 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-17 09:27:49,755 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 09:27:49,972 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 09:27:49,972 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:49,972 DEBUG --- stdout --- 2025-01-17 09:27:49,972 DEBUG WAITING 2025-01-17 09:27:49,972 DEBUG --- stderr --- 2025-01-17 09:27:49,972 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-01-17 09:27:49] benchmark-170 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-17 09:27:49,972 INFO 2025-01-17 09:27:49,972 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:49,972 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:50,253 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:50,253 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:50,253 DEBUG --- stdout --- 2025-01-17 09:27:50,253 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:50,253 DEBUG --- stderr --- 2025-01-17 09:27:50,253 DEBUG 2025-01-17 09:27:50,253 INFO 2025-01-17 09:27:50,253 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-17 09:27:50,253 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 09:27:51,624 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:51,624 DEBUG --- stdout --- 2025-01-17 09:27:51,624 DEBUG 2025-01-17 09:27:51,624 DEBUG --- stderr --- 2025-01-17 09:27:51,624 DEBUG Order has been successfully forwarded to overseer 2025-01-17 09:27:51 - INFO: Check if Gatling simulation started successfully 2025-01-17 09:27:51,625 INFO 2025-01-17 09:27:51,625 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:51,625 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:51,913 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:51,913 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:51,913 DEBUG --- stdout --- 2025-01-17 09:27:51,913 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:51,913 DEBUG --- stderr --- 2025-01-17 09:27:51,913 DEBUG 2025-01-17 09:27:51,913 INFO 2025-01-17 09:27:51,913 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-170/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-17 09:27:51,914 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 09:27:52,643 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 09:27:58,385 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 09:28:04,115 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 09:28:09,922 INFO [loop_until]: Function succeeded after 18s (rc=0) - expected pattern found 2025-01-17 09:28:09,923 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:28:09,923 DEBUG --- stdout --- 2025-01-17 09:28:09,923 DEBUG 2025-01-17 09:27:52,511 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmplev86lik 2025-01-17 09:27:52,513 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-170" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=170 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmplev86lik/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmplev86lik/target/test-classes ... [INFO] compile in 11.3 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 09:28:09,923 DEBUG --- stderr --- 2025-01-17 09:28:09,923 DEBUG ________________________________________________________________________________ [2025-01-17 09:28:09] benchmark-170 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 06s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 07s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-17 10:28:18] benchmark-170 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-17 10:28:18,646 INFO 2025-01-17 10:28:18,646 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:18,646 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:18,941 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:18,941 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:18,941 DEBUG --- stdout --- 2025-01-17 10:28:18,942 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:18,942 DEBUG --- stderr --- 2025-01-17 10:28:18,942 DEBUG 2025-01-17 10:28:18,942 INFO 2025-01-17 10:28:18,942 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-17 10:28:18,942 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 10:28:19,721 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:19,722 DEBUG --- stdout --- 2025-01-17 10:28:19,722 DEBUG 2025-01-17 10:28:19,722 DEBUG --- stderr --- 2025-01-17 10:28:19,722 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-17 10:28:19] benchmark-170 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-17 10:28:19 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/order.json 2025-01-17 10:28:19,722 INFO 2025-01-17 10:28:19,722 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:19,722 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:20,000 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:20,000 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:20,000 DEBUG --- stdout --- 2025-01-17 10:28:20,000 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:20,001 DEBUG --- stderr --- 2025-01-17 10:28:20,001 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 10:28:20,001 INFO 2025-01-17 10:28:20,001 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:20,001 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:20,275 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:20,275 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:20,276 DEBUG --- stdout --- 2025-01-17 10:28:20,276 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:20,276 DEBUG --- stderr --- 2025-01-17 10:28:20,276 DEBUG 2025-01-17 10:28:20,276 INFO 2025-01-17 10:28:20,276 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-170/rc.txt" ]; then echo "/results/orders/benchmark-170/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-170/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-170/rc.txt file found" 2025-01-17 10:28:20,276 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 10:28:21,073 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 10:28:21,073 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:21,073 DEBUG --- stdout --- 2025-01-17 10:28:21,073 DEBUG /results/orders/benchmark-170/rc.txt file found 2025-01-17 10:28:21,073 DEBUG --- stderr --- 2025-01-17 10:28:21,073 DEBUG 2025-01-17 10:28:21,073 INFO 2025-01-17 10:28:21,073 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:21,073 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:21,348 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:21,348 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:21,348 DEBUG --- stdout --- 2025-01-17 10:28:21,348 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:21,348 DEBUG --- stderr --- 2025-01-17 10:28:21,348 DEBUG 2025-01-17 10:28:21,348 INFO 2025-01-17 10:28:21,348 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-170/rc.txt 2025-01-17 10:28:22,141 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 10:28:22,141 DEBUG --- stdout --- 2025-01-17 10:28:22,141 DEBUG 4 /results/orders/benchmark-170/rc.txt 2025-01-17 10:28:22,141 DEBUG --- stderr --- 2025-01-17 10:28:22,141 DEBUG 2025-01-17 10:28:22,141 INFO - Download file (size 4k) 2025-01-17 10:28:22,142 INFO 2025-01-17 10:28:22,142 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:22,142 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:22,417 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:22,418 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:22,418 DEBUG --- stdout --- 2025-01-17 10:28:22,418 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:22,418 DEBUG --- stderr --- 2025-01-17 10:28:22,418 DEBUG source : /results/orders/benchmark-170/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/rc.txt 2025-01-17 10:28:22,418 INFO 2025-01-17 10:28:22,418 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:22,418 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:22,690 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:22,690 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:22,690 DEBUG --- stdout --- 2025-01-17 10:28:22,690 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:22,690 DEBUG --- stderr --- 2025-01-17 10:28:22,690 DEBUG 2025-01-17 10:28:22,691 INFO 2025-01-17 10:28:22,691 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-170/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/rc.txt 2025-01-17 10:28:22,691 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 10:28:23,409 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:23,409 DEBUG --- stdout --- 2025-01-17 10:28:23,409 DEBUG tar: Removing leading `/' from member names 2025-01-17 10:28:23,409 DEBUG --- stderr --- 2025-01-17 10:28:23,409 DEBUG 2025-01-17 10:28:23,409 INFO 2025-01-17 10:28:23,409 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:23,409 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:23,682 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:23,682 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:23,682 DEBUG --- stdout --- 2025-01-17 10:28:23,682 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:23,682 DEBUG --- stderr --- 2025-01-17 10:28:23,682 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 10:28:23,682 INFO 2025-01-17 10:28:23,682 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:23,682 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:23,958 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:23,958 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:23,958 DEBUG --- stdout --- 2025-01-17 10:28:23,958 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:23,958 DEBUG --- stderr --- 2025-01-17 10:28:23,958 DEBUG 2025-01-17 10:28:23,959 INFO 2025-01-17 10:28:23,959 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-170/stderr.txt" ]; then echo "/results/orders/benchmark-170/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-170/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-170/stderr.txt file found" 2025-01-17 10:28:23,959 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 10:28:24,789 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 10:28:24,789 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:24,789 DEBUG --- stdout --- 2025-01-17 10:28:24,789 DEBUG /results/orders/benchmark-170/stderr.txt file found 2025-01-17 10:28:24,789 DEBUG --- stderr --- 2025-01-17 10:28:24,789 DEBUG 2025-01-17 10:28:24,789 INFO 2025-01-17 10:28:24,789 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:24,789 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:25,063 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:25,063 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:25,063 DEBUG --- stdout --- 2025-01-17 10:28:25,063 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:25,063 DEBUG --- stderr --- 2025-01-17 10:28:25,063 DEBUG 2025-01-17 10:28:25,063 INFO 2025-01-17 10:28:25,063 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-170/stderr.txt 2025-01-17 10:28:25,848 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 10:28:25,848 DEBUG --- stdout --- 2025-01-17 10:28:25,848 DEBUG 0 /results/orders/benchmark-170/stderr.txt 2025-01-17 10:28:25,848 DEBUG --- stderr --- 2025-01-17 10:28:25,848 DEBUG 2025-01-17 10:28:25,848 INFO - Download file (size 0k) 2025-01-17 10:28:25,848 INFO 2025-01-17 10:28:25,848 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:25,848 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:26,121 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:26,121 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:26,121 DEBUG --- stdout --- 2025-01-17 10:28:26,121 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:26,121 DEBUG --- stderr --- 2025-01-17 10:28:26,121 DEBUG source : /results/orders/benchmark-170/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/stderr.txt 2025-01-17 10:28:26,121 INFO 2025-01-17 10:28:26,121 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:26,121 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:26,394 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:26,394 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:26,394 DEBUG --- stdout --- 2025-01-17 10:28:26,394 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:26,394 DEBUG --- stderr --- 2025-01-17 10:28:26,394 DEBUG 2025-01-17 10:28:26,395 INFO 2025-01-17 10:28:26,395 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-170/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/stderr.txt 2025-01-17 10:28:26,395 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 10:28:27,144 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:27,144 DEBUG --- stdout --- 2025-01-17 10:28:27,144 DEBUG tar: Removing leading `/' from member names 2025-01-17 10:28:27,144 DEBUG --- stderr --- 2025-01-17 10:28:27,144 DEBUG 2025-01-17 10:28:27,145 INFO 2025-01-17 10:28:27,145 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:27,145 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:27,417 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:27,417 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:27,417 DEBUG --- stdout --- 2025-01-17 10:28:27,417 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:27,417 DEBUG --- stderr --- 2025-01-17 10:28:27,417 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 10:28:27,418 INFO 2025-01-17 10:28:27,418 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:27,418 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:27,693 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:27,693 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:27,693 DEBUG --- stdout --- 2025-01-17 10:28:27,693 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:27,693 DEBUG --- stderr --- 2025-01-17 10:28:27,693 DEBUG 2025-01-17 10:28:27,694 INFO 2025-01-17 10:28:27,694 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-170/stdout.txt" ]; then echo "/results/orders/benchmark-170/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-170/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-170/stdout.txt file found" 2025-01-17 10:28:27,694 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 10:28:28,492 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 10:28:28,492 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:28,492 DEBUG --- stdout --- 2025-01-17 10:28:28,492 DEBUG /results/orders/benchmark-170/stdout.txt file found 2025-01-17 10:28:28,492 DEBUG --- stderr --- 2025-01-17 10:28:28,492 DEBUG 2025-01-17 10:28:28,493 INFO 2025-01-17 10:28:28,493 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:28,493 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:28,765 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:28,765 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:28,765 DEBUG --- stdout --- 2025-01-17 10:28:28,765 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:28,765 DEBUG --- stderr --- 2025-01-17 10:28:28,765 DEBUG 2025-01-17 10:28:28,765 INFO 2025-01-17 10:28:28,765 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-170/stdout.txt 2025-01-17 10:28:29,554 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 10:28:29,554 DEBUG --- stdout --- 2025-01-17 10:28:29,554 DEBUG 6020 /results/orders/benchmark-170/stdout.txt 2025-01-17 10:28:29,554 DEBUG --- stderr --- 2025-01-17 10:28:29,554 DEBUG 2025-01-17 10:28:29,554 INFO - Download file (size 6020k) 2025-01-17 10:28:29,555 INFO 2025-01-17 10:28:29,555 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:29,555 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:29,830 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:29,830 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:29,830 DEBUG --- stdout --- 2025-01-17 10:28:29,830 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:29,830 DEBUG --- stderr --- 2025-01-17 10:28:29,830 DEBUG source : /results/orders/benchmark-170/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/stdout.txt 2025-01-17 10:28:29,830 INFO 2025-01-17 10:28:29,830 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:29,830 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:30,104 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:30,104 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:30,104 DEBUG --- stdout --- 2025-01-17 10:28:30,104 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:30,104 DEBUG --- stderr --- 2025-01-17 10:28:30,104 DEBUG 2025-01-17 10:28:30,104 INFO 2025-01-17 10:28:30,105 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-170/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/stdout.txt 2025-01-17 10:28:30,105 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 10:28:31,372 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:31,373 DEBUG --- stdout --- 2025-01-17 10:28:31,373 DEBUG tar: Removing leading `/' from member names 2025-01-17 10:28:31,373 DEBUG --- stderr --- 2025-01-17 10:28:31,373 DEBUG ________________________________________________________________________________ [2025-01-17 10:28:31] benchmark-170 show_cmd : Display order command ________________________________________________________________________________ 2025-01-17 10:28:31,373 INFO 2025-01-17 10:28:31,373 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:31,373 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:31,648 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:31,648 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:31,648 DEBUG --- stdout --- 2025-01-17 10:28:31,648 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:31,648 DEBUG --- stderr --- 2025-01-17 10:28:31,648 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 10:28:31,648 INFO 2025-01-17 10:28:31,648 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:31,648 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:31,924 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:31,924 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:31,924 DEBUG --- stdout --- 2025-01-17 10:28:31,924 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:31,924 DEBUG --- stderr --- 2025-01-17 10:28:31,924 DEBUG 2025-01-17 10:28:31,925 INFO 2025-01-17 10:28:31,925 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-170/cmd.txt" ]; then echo "/results/orders/benchmark-170/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-170/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-170/cmd.txt file found" 2025-01-17 10:28:31,925 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 10:28:32,715 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 10:28:32,715 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:32,715 DEBUG --- stdout --- 2025-01-17 10:28:32,715 DEBUG /results/orders/benchmark-170/cmd.txt file found 2025-01-17 10:28:32,715 DEBUG --- stderr --- 2025-01-17 10:28:32,715 DEBUG 2025-01-17 10:28:32,715 INFO 2025-01-17 10:28:32,715 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:32,716 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:32,993 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:32,993 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:32,993 DEBUG --- stdout --- 2025-01-17 10:28:32,993 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:32,993 DEBUG --- stderr --- 2025-01-17 10:28:32,993 DEBUG 2025-01-17 10:28:32,993 INFO 2025-01-17 10:28:32,993 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-170/cmd.txt 2025-01-17 10:28:33,778 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 10:28:33,778 DEBUG --- stdout --- 2025-01-17 10:28:33,778 DEBUG 4 /results/orders/benchmark-170/cmd.txt 2025-01-17 10:28:33,778 DEBUG --- stderr --- 2025-01-17 10:28:33,778 DEBUG 2025-01-17 10:28:33,778 INFO - Download file (size 4k) 2025-01-17 10:28:33,778 INFO 2025-01-17 10:28:33,778 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:33,778 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:34,052 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:34,052 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:34,052 DEBUG --- stdout --- 2025-01-17 10:28:34,052 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:34,052 DEBUG --- stderr --- 2025-01-17 10:28:34,052 DEBUG source : /results/orders/benchmark-170/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/cmd.txt 2025-01-17 10:28:34,053 INFO 2025-01-17 10:28:34,053 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 10:28:34,053 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 10:28:34,326 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 10:28:34,326 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:34,326 DEBUG --- stdout --- 2025-01-17 10:28:34,326 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 10:28:34,326 DEBUG --- stderr --- 2025-01-17 10:28:34,326 DEBUG 2025-01-17 10:28:34,327 INFO 2025-01-17 10:28:34,327 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-170/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/cmd.txt 2025-01-17 10:28:34,327 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 10:28:35,076 INFO [loop_until]: OK (rc = 0) 2025-01-17 10:28:35,076 DEBUG --- stdout --- 2025-01-17 10:28:35,076 DEBUG tar: Removing leading `/' from member names 2025-01-17 10:28:35,076 DEBUG --- stderr --- 2025-01-17 10:28:35,076 DEBUG 2025-01-17 10:28:35,076 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/cmd.txt is small (1 lines), printing all lines: 2025-01-17 10:28:35,076 DEBUG ----- output ----- 2025-01-17 10:28:35,076 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-170" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=170 -Duser_password=Pa_ssw0rd" 2025-01-17 10:28:35,076 INFO ________________________________________________________________________________ [2025-01-17 10:28:35] benchmark-170 show_rc : Display rc order ________________________________________________________________________________ 2025-01-17 10:28:35,076 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/rc.txt is small (1 lines), printing all lines: 2025-01-17 10:28:35,076 DEBUG ----- output ----- 2025-01-17 10:28:35,076 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-17 10:28:35,076 INFO ________________________________________________________________________________ [2025-01-17 10:28:35] benchmark-170 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-17 10:28:35,084 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/stdout.txt is 71166 lines): 2025-01-17 10:28:35,085 DEBUG ----- output ----- 2025-01-17 10:28:35,085 INFO 2025-01-17 09:27:52,511 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmplev86lik 2025-01-17 10:28:35,085 INFO 2025-01-17 09:27:52,513 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-170" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=170 -Duser_password=**** 2025-01-17 10:28:35,085 INFO [INFO] Scanning for projects... 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-17 10:28:35,085 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-17 10:28:35,085 INFO [INFO] from pom.xml 2025-01-17 10:28:35,085 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-17 10:28:35,085 INFO [INFO] skip non existing resourceDirectory /tmp/tmplev86lik/src/main/resources 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-17 10:28:35,085 INFO [INFO] No sources to compile 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-17 10:28:35,085 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-17 10:28:35,085 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-17 10:28:35,085 INFO [INFO] compiling 38 Scala sources to /tmp/tmplev86lik/target/test-classes ... 2025-01-17 10:28:35,085 INFO [INFO] compile in 11.3 s 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] 2025-01-17 10:28:35,085 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-17 10:28:35,085 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-17 10:28:35,085 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-17 10:28:35,085 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-17 10:28:35,085 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 10:28:35,085 INFO 2025-01-17 10:28:35,085 INFO ================================================================================ 2025-01-17 10:28:35,085 INFO 2025-01-17 09:28:14 GMT 5s elapsed 2025-01-17 10:28:35,085 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 10:28:35,085 INFO > Global (OK=843 KO=0 ) 2025-01-17 10:28:35,085 INFO > restLoginInitiate (OK=65 KO=0 ) 2025-01-17 10:28:35,085 INFO > restLoginUsernamePasswordCallback (OK=64 KO=0 ) 2025-01-17 10:28:35,085 INFO > Skip 2FA (OK=28 KO=0 ) 2025-01-17 10:28:35,085 INFO > User Authorize PKCE stage (OK=77 KO=0 ) 2025-01-17 10:28:35,085 INFO > User AccessToken PKCE stage (OK=76 KO=0 ) 2025-01-17 10:28:35,085 INFO > RootUserinfo (OK=12 KO=0 ) 2025-01-17 10:28:35,085 INFO > UI-Post-Login - stage 1 (OK=21 KO=0 ) 2025-01-17 10:28:35,085 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=20 KO=0 ) 2025-01-17 10:28:35,085 INFO > UI AM idFromSession (OK=19 KO=0 ) 2025-01-17 10:28:35,085 INFO > UI AM validateGoto (OK=19 KO=0 ) 2025-01-17 10:28:35,085 INFO > UI-Post-Login - stage 2 (OK=18 KO=0 ) 2025-01-17 10:28:35,085 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=18 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI Enduser appAuthHelper1 (OK=18 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI Enduser appAuthHelper2 (OK=18 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI-Post-Login - stage 3 (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI Enduser sessioncheck (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM uiconfig (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM version (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > loginTreeWorkflow_restLoginInitiate (OK=3 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM privilege (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM login (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM features (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM dashboard (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM managed user schema (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM user (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=3 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI IDM oidcToken (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > userinfo (OK=16 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI-Logout (OK=14 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI-Logout Redirect 1 (OK=14 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI AM revoke1 (OK=14 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI AM endsession (OK=14 KO=0 ) 2025-01-17 10:28:35,086 INFO > UI AM revoke2 (OK=14 KO=0 ) 2025-01-17 10:28:35,086 INFO > GetUUid (OK=19 KO=0 ) 2025-01-17 10:28:35,086 INFO > GetOpenidConfig (OK=19 KO=0 ) 2025-01-17 10:28:35,086 INFO > CreatePolicy (OK=19 KO=0 ) 2025-01-17 10:28:35,086 INFO > getIdToken (OK=3 KO=0 ) 2025-01-17 10:28:35,086 INFO > getIdToken Redirect 1 (OK=3 KO=0 ) 2025-01-17 10:28:35,086 INFO > createOrganization (OK=3 KO=0 ) 2025-01-17 10:28:35,086 INFO > queryOrganization (OK=3 KO=0 ) 2025-01-17 10:28:35,086 INFO > deleteOrganization (OK=3 KO=0 ) 2025-01-17 10:28:35,086 INFO > tokenUserinfo (OK=14 KO=0 ) 2025-01-17 10:28:35,086 INFO 2025-01-17 10:28:35,086 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 10:28:35,086 INFO [- ] 0% 2025-01-17 10:28:35,086 INFO waiting: 614474 / active: 36 / done: 34 2025-01-17 10:28:35,086 INFO ================================================================================ 2025-01-17 10:28:35,086 INFO 2025-01-17 10:28:35,086 INFO 2025-01-17 10:28:35,086 INFO ================================================================================ 2025-01-17 10:28:35,086 INFO 2025-01-17 09:28:19 GMT 10s elapsed 2025-01-17 10:28:35,086 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 10:28:35,086 INFO > Global (OK=3523 KO=0 ) 2025-01-17 10:28:35,086 INFO > restLoginInitiate (OK=271 KO=0 ) 2025-01-17 10:28:35,086 INFO > restLoginUsernamePasswordCallback (OK=268 KO=0 ) 2025-01-17 10:28:35,086 INFO > Skip 2FA (OK=146 KO=0 ) 2025-01-17 10:28:35,086 INFO > User Authorize PKCE stage (OK=324 KO=0 ) 2025-01-17 10:28:35,086 INFO > User AccessToken PKCE stage (OK=323 KO=0 ) 2025-01-17 10:28:35,086 INFO > RootUserinfo (OK=110 KO=0 ) 2025-01-17 10:28:35,086 INFO [...] 2025-01-17 10:28:35,098 INFO ========================= 2025-01-17 10:28:35,098 INFO Session: 2025-01-17 10:28:35,098 INFO Session(idc.benchmark.Mix2024,609579,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.38633373, randomPolicyName -> testPolicy714932, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@4f468e5a, fake-user-agent -> Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 69.191.175.234, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@38f40004),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a499c69a0e0@17362f82,io.netty.channel.epoll.EpollEventLoop@650eab8) 2025-01-17 10:28:35,098 INFO ========================= 2025-01-17 10:28:35,099 INFO HTTP request: 2025-01-17 10:28:35,099 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-17 10:28:35,099 INFO headers: 2025-01-17 10:28:35,099 INFO accept: application/json 2025-01-17 10:28:35,099 INFO content-type: application/json 2025-01-17 10:28:35,099 INFO user-agent: Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 2025-01-17 10:28:35,099 INFO X-Forwarded-For: 69.191.175.234 2025-01-17 10:28:35,099 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 10:28:35,099 INFO content-length: 0 2025-01-17 10:28:35,099 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 10:28:35,099 INFO ========================= 2025-01-17 10:28:35,099 INFO HTTP response: 2025-01-17 10:28:35,099 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 10:28:35,099 INFO 10:28:09.581 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-104' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 10:28:35,099 INFO 10:28:09.581 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM login' failed for user 609491: j.i.IOException: Premature close 2025-01-17 10:28:35,099 INFO 10:28:09.581 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 10:28:35,099 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 10:28:35,099 INFO Request: 2025-01-17 10:28:35,099 INFO UI IDM login: KO j.i.IOException: Premature close 2025-01-17 10:28:35,099 INFO ========================= 2025-01-17 10:28:35,099 INFO Session: 2025-01-17 10:28:35,099 INFO Session(idc.benchmark.Mix2024,609491,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiIxMDMzMDJiYy04MTQ3LTRiN2QtYTYyYy1jN2M3Y2E5YjM4ZTgiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiOWM3YWQ3ZTctYTk1Zi00NDIyLWE3YjItYzA1ZDcwNTA2ZjdjLTgxNzcwNjI3Iiwic3VibmFtZSI6IjEwMzMwMmJjLTgxNDctNGI3ZC1hNjJjLWM3YzdjYTliMzhlOCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJzVURHam1OMkZWU042SUstcE8zNjBxOFJUUzQiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDk2ODksImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDk2ODksInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTEzMjg5LCJpYXQiOjE3MzcxMDk2ODksImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IlQyOE8yZWtwcUNLRzdzTGVROXJMQzhSTWljayJ9.shAS0XXwMuVepQ93TzUjPXAQu2jS_UjWRqAgn1qh6WQ, username -> user.1631693, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiIxMDMzMDJiYy04MTQ3LTRiN2QtYTYyYy1jN2M3Y2E5YjM4ZTgiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiOGE3YTUwNzAtM2JlYy00MWVhLTgxNjQtYzYyMWVkZTQ1ZmZmLTgxNjE4OTg1Iiwic3VibmFtZSI6IjEwMzMwMmJjLTgxNDctNGI3ZC1hNjJjLWM3YzdjYTliMzhlOCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRDliNzZBVkdOeEpzclVTS0lLcFNRNDljM3MiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDk2ODksImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDk2ODksInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTEzMjg5LCJpYXQiOjE3MzcxMDk2ODksImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6Il9jTUdWYXJsSlNYaVliUHV6ell0dmNibHRRbyJ9.9ZaAEu1W8lgRe1-SwytN3iDDI5VL-PywkIJ1chU__08, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@1c1caf07, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, authcode -> YncdehNJgnQ8T1T25yleVksmtZI, callbacks -> {"tokenId":"DSwiOgNVW21wkQIT0aiZbOxLVcI.*AAJTSQACMDIAAlNLABwvMSt1YUJsSjhMMi9QSHZtVFFMRHJwSzVwZWs9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737109689029), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=DSwiOgNVW21wkQIT0aiZbOxLVcI.*AAJTSQACMDIAAlNLABwvMSt1YUJsSjhMMi9QSHZtVFFMRHJwSzVwZWs9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737109689029))), user_uuid -> 103302bc-8147-4b7d-a62c-c7c7ca9b38e8, password -> Pa_ssw0rd, challenge -> sHKp7B_BvBo4mBSi9MpPk9rbGofGU3aXwTEI12_m9vY, gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, fake-ip -> 238.169.243.199, verifier -> ODE5MjgzODA2NzUxNjM0NzQ1, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@393db325, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@3e23f607, tokenId -> DSwiOgNVW21wkQIT0aiZbOxLVcI.*AAJTSQACMDIAAlNLABwvMSt1YUJsSjhMMi9QSHZtVFFMRHJwSzVwZWs9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a499c69a0e0@17362f82,io.netty.channel.epoll.EpollEventLoop@12dae582) 2025-01-17 10:28:35,099 INFO ========================= 2025-01-17 10:28:35,099 INFO HTTP request: 2025-01-17 10:28:35,099 INFO POST https://openam-perf-200m.forgeblocks.com/openidm/authentication?_action=login 2025-01-17 10:28:35,099 INFO headers: 2025-01-17 10:28:35,099 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-17 10:28:35,099 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-17 10:28:35,099 INFO Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiIxMDMzMDJiYy04MTQ3LTRiN2QtYTYyYy1jN2M3Y2E5YjM4ZTgiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiOGE3YTUwNzAtM2JlYy00MWVhLTgxNjQtYzYyMWVkZTQ1ZmZmLTgxNjE4OTg1Iiwic3VibmFtZSI6IjEwMzMwMmJjLTgxNDctNGI3ZC1hNjJjLWM3YzdjYTliMzhlOCIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiItRDliNzZBVkdOeEpzclVTS0lLcFNRNDljM3MiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDk2ODksImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDk2ODksInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTEzMjg5LCJpYXQiOjE3MzcxMDk2ODksImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6Il9jTUdWYXJsSlNYaVliUHV6ell0dmNibHRRbyJ9.9ZaAEu1W8lgRe1-SwytN3iDDI5VL-PywkIJ1chU__08 2025-01-17 10:28:35,099 INFO Accept-Api-Version: 2025-01-17 10:28:35,099 INFO accept: */* 2025-01-17 10:28:35,099 INFO cookie: amlbcookie=01; 15892ffd844ef80=DSwiOgNVW21wkQIT0aiZbOxLVcI.*AAJTSQACMDIAAlNLABwvMSt1YUJsSjhMMi9QSHZtVFFMRHJwSzVwZWs9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-17 10:28:35,099 INFO origin: https://openam-perf-200m.forgeblocks.com 2025-01-17 10:28:35,099 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 10:28:35,099 INFO content-length: 0 2025-01-17 10:28:35,099 INFO cookies: 2025-01-17 10:28:35,099 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 10:28:35,099 INFO 15892ffd844ef80=DSwiOgNVW21wkQIT0aiZbOxLVcI.*AAJTSQACMDIAAlNLABwvMSt1YUJsSjhMMi9QSHZtVFFMRHJwSzVwZWs9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 10:28:35,099 INFO ========================= 2025-01-17 10:28:35,099 INFO HTTP response: 2025-01-17 10:28:35,099 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 10:28:35,099 INFO 10:28:09.582 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM features' failed for user 609483: j.i.IOException: Premature close 2025-01-17 10:28:35,099 INFO 10:28:09.582 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 10:28:35,099 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 10:28:35,099 INFO Request: 2025-01-17 10:28:35,099 INFO UI IDM features: KO j.i.IOException: Premature close 2025-01-17 10:28:35,099 INFO ========================= 2025-01-17 10:28:35,099 INFO Session: 2025-01-17 10:28:35,099 INFO Session(idc.benchmark.Mix2024,609483,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhOWMzZWJiOS1lMmVmLTRjM2YtYmMyYS0wN2E2NDVhZTRjYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiODJjY2M2ZDItMDhmMS00N2VmLTlmMjMtOTZkOTA3ZGZlMmRlLTgzMTczMDI4Iiwic3VibmFtZSI6ImE5YzNlYmI5LWUyZWYtNGMzZi1iYzJhLTA3YTY0NWFlNGNhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJGdHRQZUJoYkE2LU5XcjFRRTVhM3QyQ1NkdzQiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDk2ODksImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDk2ODgsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTEzMjg5LCJpYXQiOjE3MzcxMDk2ODksImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6InNjQ0R1bDhiU2FURWlnV04zRTBPamkxdE9mcyJ9.92xipIH-tovHAH-oRinITCuY8OOgyzydhA-7T74qatU, username -> user.41983572, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhOWMzZWJiOS1lMmVmLTRjM2YtYmMyYS0wN2E2NDVhZTRjYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiODJjY2M2ZDItMDhmMS00N2VmLTlmMjMtOTZkOTA3ZGZlMmRlLTgzMTc0Mjg4Iiwic3VibmFtZSI6ImE5YzNlYmI5LWUyZWYtNGMzZi1iYzJhLTA3YTY0NWFlNGNhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJfekJlWTRNNWQwa25uYWJOZFItakNjRFRNODAiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDk2ODksImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDk2ODgsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTEzMjg5LCJpYXQiOjE3MzcxMDk2ODksImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IldwU29SY1JyVks2NTRZcHVoQS0tWHBwb0RKcyJ9.sbLtKJOsWN_CRdM1NJlc0C69xheU1yVEcTI65N6URWk, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@645272e4, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, authcode -> ySgHgIi6QTILKeZvOUQuoKd1dMg, callbacks -> {"tokenId":"LCF4WUXvCIJK5pX8MltqaCR4a5k.*AAJTSQACMDIAAlNLABxsMGVwNVhKY1NvcHFJbnBOMVVNTWJxVE5LV0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737109688993), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=LCF4WUXvCIJK5pX8MltqaCR4a5k.*AAJTSQACMDIAAlNLABxsMGVwNVhKY1NvcHFJbnBOMVVNTWJxVE5LV0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737109688993))), user_uuid -> a9c3ebb9-e2ef-4c3f-bc2a-07a645ae4cae, password -> Pa_ssw0rd, challenge -> wG4YDYN8KxQh0l0fwMyCiPsBTt238P1dUCTFoifq6Wc, gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, fake-ip -> 42.42.42.42, verifier -> ODA4MzU3NjE0MDU1NjkxNDc1NA, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@47c94214, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@66ac9452, tokenId -> LCF4WUXvCIJK5pX8MltqaCR4a5k.*AAJTSQACMDIAAlNLABxsMGVwNVhKY1NvcHFJbnBOMVVNTWJxVE5LV0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a499c69a0e0@17362f82,io.netty.channel.epoll.EpollEventLoop@650eab8) 2025-01-17 10:28:35,099 INFO ========================= 2025-01-17 10:28:35,099 INFO HTTP request: 2025-01-17 10:28:35,099 INFO GET https://openam-perf-200m.forgeblocks.com/openidm/info/features?_queryFilter=true 2025-01-17 10:28:35,099 INFO headers: 2025-01-17 10:28:35,099 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-17 10:28:35,099 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-17 10:28:35,099 INFO Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhOWMzZWJiOS1lMmVmLTRjM2YtYmMyYS0wN2E2NDVhZTRjYWUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiODJjY2M2ZDItMDhmMS00N2VmLTlmMjMtOTZkOTA3ZGZlMmRlLTgzMTc0Mjg4Iiwic3VibmFtZSI6ImE5YzNlYmI5LWUyZWYtNGMzZi1iYzJhLTA3YTY0NWFlNGNhZSIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJfekJlWTRNNWQwa25uYWJOZFItakNjRFRNODAiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDk2ODksImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDk2ODgsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTEzMjg5LCJpYXQiOjE3MzcxMDk2ODksImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IldwU29SY1JyVks2NTRZcHVoQS0tWHBwb0RKcyJ9.sbLtKJOsWN_CRdM1NJlc0C69xheU1yVEcTI65N6URWk 2025-01-17 10:28:35,099 INFO Accept-Api-Version: 2025-01-17 10:28:35,100 INFO accept: */* 2025-01-17 10:28:35,100 INFO cookie: amlbcookie=01; 15892ffd844ef80=LCF4WUXvCIJK5pX8MltqaCR4a5k.*AAJTSQACMDIAAlNLABxsMGVwNVhKY1NvcHFJbnBOMVVNTWJxVE5LV0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-17 10:28:35,100 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 10:28:35,100 INFO cookies: 2025-01-17 10:28:35,100 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 10:28:35,100 INFO 15892ffd844ef80=LCF4WUXvCIJK5pX8MltqaCR4a5k.*AAJTSQACMDIAAlNLABxsMGVwNVhKY1NvcHFJbnBOMVVNTWJxVE5LV0E9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 10:28:35,100 INFO ========================= 2025-01-17 10:28:35,100 INFO HTTP response: 2025-01-17 10:28:35,100 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 10:28:35,100 INFO 10:28:09.583 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 609577: j.i.IOException: Premature close 2025-01-17 10:28:35,100 INFO 10:28:09.583 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 10:28:35,100 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 10:28:35,100 INFO Request: 2025-01-17 10:28:35,100 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 10:28:35,100 INFO ========================= 2025-01-17 10:28:35,100 INFO Session: 2025-01-17 10:28:35,100 INFO Session(idc.benchmark.Mix2024,609577,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.43842215, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@12d6882f, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1, password -> Pa_ssw0rd, fake-ip -> 143.227.230.149, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@40b4fda0),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a499c69a0e0@17362f82,io.netty.channel.epoll.EpollEventLoop@5b7ea70d) 2025-01-17 10:28:35,100 INFO ========================= 2025-01-17 10:28:35,100 INFO HTTP request: 2025-01-17 10:28:35,100 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login 2025-01-17 10:28:35,100 INFO headers: 2025-01-17 10:28:35,100 INFO accept: application/json 2025-01-17 10:28:35,100 INFO content-type: application/json 2025-01-17 10:28:35,100 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1 2025-01-17 10:28:35,100 INFO X-Forwarded-For: 143.227.230.149 2025-01-17 10:28:35,100 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 10:28:35,100 INFO content-length: 0 2025-01-17 10:28:35,100 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 10:28:35,100 INFO ========================= 2025-01-17 10:28:35,100 INFO HTTP response: 2025-01-17 10:28:35,100 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 10:28:35,100 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 10:28:35,100 INFO [INFO] BUILD SUCCESS 2025-01-17 10:28:35,100 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 10:28:35,100 INFO [INFO] Total time: 01:00 h 2025-01-17 10:28:35,100 INFO [INFO] Finished at: 2025-01-17T10:28:09Z 2025-01-17 10:28:35,100 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 10:28:35,100 INFO 2025-01-17 10:28:09,695 INFO Gatling simulation run ended successfully 2025-01-17 10:28:35,100 INFO 2025-01-17 10:28:09,695 DEBUG No archive name provided. No archive will be created 2025-01-17 10:28:35,100 INFO ________________________________________________________________________________ [2025-01-17 10:28:35] benchmark-170 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-17 10:28:35,100 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-170/stderr.txt is small (0 lines), printing all lines: 2025-01-17 10:28:35,100 DEBUG ----- output ----- 2025-01-17 10:28:35,100 DEBUG 2025-01-17 10:28:35,100 INFO ________________________________________________________________________________ [2025-01-17 10:28:35] benchmark-170 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-17 10:28:35] benchmark-170 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-17 10:28:35] benchmark-170 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped