--Task-- name: benchmark-150 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-120'] preceding_task: benchmark-120 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 150} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-17 08:27:01] benchmark-150 pre : N/A ________________________________________________________________________________ 2025-01-17 08:27:01,650 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-17 08:27:01 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-17 08:27:01 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-150/stdout.txt Pod log : /results/orders/benchmark-150 2025-01-17 08:27:01,650 INFO 2025-01-17 08:27:01,650 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:27:01,650 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:27:01,927 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:27:01,927 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:01,927 DEBUG --- stdout --- 2025-01-17 08:27:01,928 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:27:01,928 DEBUG --- stderr --- 2025-01-17 08:27:01,928 DEBUG ________________________________________________________________________________ [2025-01-17 08:27:01] benchmark-150 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-17 08:27:01,928 INFO 2025-01-17 08:27:01,928 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:27:01,928 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:27:02,203 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:27:02,204 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:02,204 DEBUG --- stdout --- 2025-01-17 08:27:02,204 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:27:02,204 DEBUG --- stderr --- 2025-01-17 08:27:02,204 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-150" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-17 08:27:02] benchmark-150 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-17 08:27:02,204 INFO 2025-01-17 08:27:02,204 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:27:02,204 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:27:02,482 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:27:02,482 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:02,482 DEBUG --- stdout --- 2025-01-17 08:27:02,482 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:27:02,482 DEBUG --- stderr --- 2025-01-17 08:27:02,482 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/order.json { "name": "benchmark-150", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-150\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-150" } ________________________________________________________________________________ [2025-01-17 08:27:02] benchmark-150 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-17 08:27:02,486 INFO 2025-01-17 08:27:02,486 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-17 08:27:02,486 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 08:27:02,703 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 08:27:02,703 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:02,703 DEBUG --- stdout --- 2025-01-17 08:27:02,703 DEBUG WAITING 2025-01-17 08:27:02,703 DEBUG --- stderr --- 2025-01-17 08:27:02,703 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-01-17 08:27:02] benchmark-150 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-17 08:27:02,704 INFO 2025-01-17 08:27:02,704 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:27:02,704 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:27:02,983 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:27:02,983 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:02,983 DEBUG --- stdout --- 2025-01-17 08:27:02,983 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:27:02,983 DEBUG --- stderr --- 2025-01-17 08:27:02,983 DEBUG 2025-01-17 08:27:02,983 INFO 2025-01-17 08:27:02,983 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-17 08:27:02,983 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 08:27:04,352 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:04,352 DEBUG --- stdout --- 2025-01-17 08:27:04,352 DEBUG 2025-01-17 08:27:04,352 DEBUG --- stderr --- 2025-01-17 08:27:04,352 DEBUG Order has been successfully forwarded to overseer 2025-01-17 08:27:04 - INFO: Check if Gatling simulation started successfully 2025-01-17 08:27:04,352 INFO 2025-01-17 08:27:04,352 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 08:27:04,352 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 08:27:04,630 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 08:27:04,630 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:04,630 DEBUG --- stdout --- 2025-01-17 08:27:04,630 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 08:27:04,630 DEBUG --- stderr --- 2025-01-17 08:27:04,630 DEBUG 2025-01-17 08:27:04,631 INFO 2025-01-17 08:27:04,631 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-150/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-17 08:27:04,631 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 08:27:05,363 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 08:27:11,094 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 08:27:16,835 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 08:27:22,569 INFO [loop_until]: Function succeeded after 17s (rc=0) - expected pattern found 2025-01-17 08:27:22,569 INFO [loop_until]: OK (rc = 0) 2025-01-17 08:27:22,569 DEBUG --- stdout --- 2025-01-17 08:27:22,569 DEBUG 2025-01-17 08:27:05,091 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp50p6upg7 2025-01-17 08:27:05,094 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-150" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmp50p6upg7/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmp50p6upg7/target/test-classes ... [INFO] compile in 11.2 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 08:27:22,569 DEBUG --- stderr --- 2025-01-17 08:27:22,569 DEBUG ________________________________________________________________________________ [2025-01-17 08:27:22] benchmark-150 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 07s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-17 09:27:31] benchmark-150 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-17 09:27:31,360 INFO 2025-01-17 09:27:31,360 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:31,360 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:31,665 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:31,665 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:31,665 DEBUG --- stdout --- 2025-01-17 09:27:31,665 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:31,665 DEBUG --- stderr --- 2025-01-17 09:27:31,665 DEBUG 2025-01-17 09:27:31,666 INFO 2025-01-17 09:27:31,666 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-17 09:27:31,666 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 09:27:32,462 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:32,463 DEBUG --- stdout --- 2025-01-17 09:27:32,463 DEBUG 2025-01-17 09:27:32,463 DEBUG --- stderr --- 2025-01-17 09:27:32,463 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-17 09:27:32] benchmark-150 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-17 09:27:32 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/order.json 2025-01-17 09:27:32,463 INFO 2025-01-17 09:27:32,463 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:32,463 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:32,741 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:32,741 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:32,741 DEBUG --- stdout --- 2025-01-17 09:27:32,741 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:32,741 DEBUG --- stderr --- 2025-01-17 09:27:32,741 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 09:27:32,741 INFO 2025-01-17 09:27:32,741 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:32,741 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:33,018 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:33,018 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:33,018 DEBUG --- stdout --- 2025-01-17 09:27:33,018 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:33,018 DEBUG --- stderr --- 2025-01-17 09:27:33,018 DEBUG 2025-01-17 09:27:33,019 INFO 2025-01-17 09:27:33,019 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-150/rc.txt" ]; then echo "/results/orders/benchmark-150/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-150/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-150/rc.txt file found" 2025-01-17 09:27:33,019 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 09:27:33,820 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 09:27:33,820 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:33,820 DEBUG --- stdout --- 2025-01-17 09:27:33,820 DEBUG /results/orders/benchmark-150/rc.txt file found 2025-01-17 09:27:33,820 DEBUG --- stderr --- 2025-01-17 09:27:33,820 DEBUG 2025-01-17 09:27:33,820 INFO 2025-01-17 09:27:33,820 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:33,820 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:34,097 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:34,097 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:34,097 DEBUG --- stdout --- 2025-01-17 09:27:34,097 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:34,097 DEBUG --- stderr --- 2025-01-17 09:27:34,097 DEBUG 2025-01-17 09:27:34,097 INFO 2025-01-17 09:27:34,097 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-150/rc.txt 2025-01-17 09:27:34,901 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 09:27:34,901 DEBUG --- stdout --- 2025-01-17 09:27:34,901 DEBUG 4 /results/orders/benchmark-150/rc.txt 2025-01-17 09:27:34,901 DEBUG --- stderr --- 2025-01-17 09:27:34,902 DEBUG 2025-01-17 09:27:34,902 INFO - Download file (size 4k) 2025-01-17 09:27:34,902 INFO 2025-01-17 09:27:34,902 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:34,902 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:35,182 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:35,182 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:35,182 DEBUG --- stdout --- 2025-01-17 09:27:35,183 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:35,183 DEBUG --- stderr --- 2025-01-17 09:27:35,183 DEBUG source : /results/orders/benchmark-150/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/rc.txt 2025-01-17 09:27:35,183 INFO 2025-01-17 09:27:35,183 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:35,183 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:35,481 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:35,481 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:35,481 DEBUG --- stdout --- 2025-01-17 09:27:35,481 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:35,481 DEBUG --- stderr --- 2025-01-17 09:27:35,481 DEBUG 2025-01-17 09:27:35,481 INFO 2025-01-17 09:27:35,481 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-150/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/rc.txt 2025-01-17 09:27:35,482 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 09:27:36,209 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:36,209 DEBUG --- stdout --- 2025-01-17 09:27:36,209 DEBUG tar: Removing leading `/' from member names 2025-01-17 09:27:36,209 DEBUG --- stderr --- 2025-01-17 09:27:36,209 DEBUG 2025-01-17 09:27:36,210 INFO 2025-01-17 09:27:36,210 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:36,210 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:36,487 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:36,487 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:36,487 DEBUG --- stdout --- 2025-01-17 09:27:36,487 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:36,487 DEBUG --- stderr --- 2025-01-17 09:27:36,487 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 09:27:36,487 INFO 2025-01-17 09:27:36,487 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:36,487 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:36,765 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:36,765 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:36,765 DEBUG --- stdout --- 2025-01-17 09:27:36,765 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:36,765 DEBUG --- stderr --- 2025-01-17 09:27:36,765 DEBUG 2025-01-17 09:27:36,766 INFO 2025-01-17 09:27:36,766 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-150/stderr.txt" ]; then echo "/results/orders/benchmark-150/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-150/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-150/stderr.txt file found" 2025-01-17 09:27:36,766 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 09:27:37,568 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 09:27:37,568 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:37,568 DEBUG --- stdout --- 2025-01-17 09:27:37,568 DEBUG /results/orders/benchmark-150/stderr.txt file found 2025-01-17 09:27:37,568 DEBUG --- stderr --- 2025-01-17 09:27:37,568 DEBUG 2025-01-17 09:27:37,568 INFO 2025-01-17 09:27:37,569 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:37,569 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:37,846 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:37,846 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:37,846 DEBUG --- stdout --- 2025-01-17 09:27:37,846 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:37,846 DEBUG --- stderr --- 2025-01-17 09:27:37,846 DEBUG 2025-01-17 09:27:37,846 INFO 2025-01-17 09:27:37,846 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-150/stderr.txt 2025-01-17 09:27:38,648 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 09:27:38,648 DEBUG --- stdout --- 2025-01-17 09:27:38,648 DEBUG 0 /results/orders/benchmark-150/stderr.txt 2025-01-17 09:27:38,648 DEBUG --- stderr --- 2025-01-17 09:27:38,648 DEBUG 2025-01-17 09:27:38,648 INFO - Download file (size 0k) 2025-01-17 09:27:38,648 INFO 2025-01-17 09:27:38,648 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:38,648 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:38,925 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:38,925 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:38,925 DEBUG --- stdout --- 2025-01-17 09:27:38,925 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:38,925 DEBUG --- stderr --- 2025-01-17 09:27:38,925 DEBUG source : /results/orders/benchmark-150/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stderr.txt 2025-01-17 09:27:38,926 INFO 2025-01-17 09:27:38,926 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:38,926 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:39,202 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:39,202 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:39,202 DEBUG --- stdout --- 2025-01-17 09:27:39,202 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:39,202 DEBUG --- stderr --- 2025-01-17 09:27:39,202 DEBUG 2025-01-17 09:27:39,203 INFO 2025-01-17 09:27:39,203 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-150/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stderr.txt 2025-01-17 09:27:39,203 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 09:27:39,992 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:39,992 DEBUG --- stdout --- 2025-01-17 09:27:39,992 DEBUG tar: Removing leading `/' from member names 2025-01-17 09:27:39,992 DEBUG --- stderr --- 2025-01-17 09:27:39,992 DEBUG 2025-01-17 09:27:39,992 INFO 2025-01-17 09:27:39,992 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:39,992 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:40,276 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:40,276 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:40,276 DEBUG --- stdout --- 2025-01-17 09:27:40,276 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:40,276 DEBUG --- stderr --- 2025-01-17 09:27:40,276 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 09:27:40,277 INFO 2025-01-17 09:27:40,277 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:40,277 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:40,553 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:40,554 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:40,554 DEBUG --- stdout --- 2025-01-17 09:27:40,554 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:40,554 DEBUG --- stderr --- 2025-01-17 09:27:40,554 DEBUG 2025-01-17 09:27:40,554 INFO 2025-01-17 09:27:40,554 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-150/stdout.txt" ]; then echo "/results/orders/benchmark-150/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-150/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-150/stdout.txt file found" 2025-01-17 09:27:40,554 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 09:27:41,399 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 09:27:41,399 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:41,399 DEBUG --- stdout --- 2025-01-17 09:27:41,399 DEBUG /results/orders/benchmark-150/stdout.txt file found 2025-01-17 09:27:41,399 DEBUG --- stderr --- 2025-01-17 09:27:41,399 DEBUG 2025-01-17 09:27:41,399 INFO 2025-01-17 09:27:41,399 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:41,399 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:41,677 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:41,677 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:41,677 DEBUG --- stdout --- 2025-01-17 09:27:41,677 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:41,677 DEBUG --- stderr --- 2025-01-17 09:27:41,677 DEBUG 2025-01-17 09:27:41,677 INFO 2025-01-17 09:27:41,678 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-150/stdout.txt 2025-01-17 09:27:42,486 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 09:27:42,486 DEBUG --- stdout --- 2025-01-17 09:27:42,486 DEBUG 5204 /results/orders/benchmark-150/stdout.txt 2025-01-17 09:27:42,486 DEBUG --- stderr --- 2025-01-17 09:27:42,486 DEBUG 2025-01-17 09:27:42,486 INFO - Download file (size 5204k) 2025-01-17 09:27:42,486 INFO 2025-01-17 09:27:42,486 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:42,486 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:42,765 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:42,765 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:42,765 DEBUG --- stdout --- 2025-01-17 09:27:42,765 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:42,765 DEBUG --- stderr --- 2025-01-17 09:27:42,765 DEBUG source : /results/orders/benchmark-150/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stdout.txt 2025-01-17 09:27:42,765 INFO 2025-01-17 09:27:42,765 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:42,765 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:43,041 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:43,041 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:43,041 DEBUG --- stdout --- 2025-01-17 09:27:43,041 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:43,041 DEBUG --- stderr --- 2025-01-17 09:27:43,042 DEBUG 2025-01-17 09:27:43,042 INFO 2025-01-17 09:27:43,042 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-150/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stdout.txt 2025-01-17 09:27:43,042 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 09:27:44,310 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:44,310 DEBUG --- stdout --- 2025-01-17 09:27:44,310 DEBUG tar: Removing leading `/' from member names 2025-01-17 09:27:44,310 DEBUG --- stderr --- 2025-01-17 09:27:44,310 DEBUG ________________________________________________________________________________ [2025-01-17 09:27:44] benchmark-150 show_cmd : Display order command ________________________________________________________________________________ 2025-01-17 09:27:44,311 INFO 2025-01-17 09:27:44,311 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:44,311 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:44,588 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:44,588 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:44,588 DEBUG --- stdout --- 2025-01-17 09:27:44,588 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:44,588 DEBUG --- stderr --- 2025-01-17 09:27:44,588 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 09:27:44,589 INFO 2025-01-17 09:27:44,589 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:44,589 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:44,866 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:44,866 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:44,866 DEBUG --- stdout --- 2025-01-17 09:27:44,866 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:44,866 DEBUG --- stderr --- 2025-01-17 09:27:44,866 DEBUG 2025-01-17 09:27:44,867 INFO 2025-01-17 09:27:44,867 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-150/cmd.txt" ]; then echo "/results/orders/benchmark-150/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-150/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-150/cmd.txt file found" 2025-01-17 09:27:44,867 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 09:27:45,676 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 09:27:45,676 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:45,676 DEBUG --- stdout --- 2025-01-17 09:27:45,676 DEBUG /results/orders/benchmark-150/cmd.txt file found 2025-01-17 09:27:45,676 DEBUG --- stderr --- 2025-01-17 09:27:45,676 DEBUG 2025-01-17 09:27:45,676 INFO 2025-01-17 09:27:45,676 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:45,676 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:45,957 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:45,957 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:45,957 DEBUG --- stdout --- 2025-01-17 09:27:45,957 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:45,957 DEBUG --- stderr --- 2025-01-17 09:27:45,957 DEBUG 2025-01-17 09:27:45,957 INFO 2025-01-17 09:27:45,957 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-150/cmd.txt 2025-01-17 09:27:46,759 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 09:27:46,759 DEBUG --- stdout --- 2025-01-17 09:27:46,759 DEBUG 4 /results/orders/benchmark-150/cmd.txt 2025-01-17 09:27:46,759 DEBUG --- stderr --- 2025-01-17 09:27:46,759 DEBUG 2025-01-17 09:27:46,759 INFO - Download file (size 4k) 2025-01-17 09:27:46,759 INFO 2025-01-17 09:27:46,759 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:46,759 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:47,036 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:47,036 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:47,036 DEBUG --- stdout --- 2025-01-17 09:27:47,036 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:47,036 DEBUG --- stderr --- 2025-01-17 09:27:47,036 DEBUG source : /results/orders/benchmark-150/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/cmd.txt 2025-01-17 09:27:47,036 INFO 2025-01-17 09:27:47,036 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 09:27:47,036 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 09:27:47,313 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 09:27:47,313 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:47,313 DEBUG --- stdout --- 2025-01-17 09:27:47,313 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 09:27:47,313 DEBUG --- stderr --- 2025-01-17 09:27:47,313 DEBUG 2025-01-17 09:27:47,314 INFO 2025-01-17 09:27:47,314 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-150/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/cmd.txt 2025-01-17 09:27:47,314 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 09:27:48,034 INFO [loop_until]: OK (rc = 0) 2025-01-17 09:27:48,035 DEBUG --- stdout --- 2025-01-17 09:27:48,035 DEBUG tar: Removing leading `/' from member names 2025-01-17 09:27:48,035 DEBUG --- stderr --- 2025-01-17 09:27:48,035 DEBUG 2025-01-17 09:27:48,035 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/cmd.txt is small (1 lines), printing all lines: 2025-01-17 09:27:48,035 DEBUG ----- output ----- 2025-01-17 09:27:48,035 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-150" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=Pa_ssw0rd" 2025-01-17 09:27:48,035 INFO ________________________________________________________________________________ [2025-01-17 09:27:48] benchmark-150 show_rc : Display rc order ________________________________________________________________________________ 2025-01-17 09:27:48,035 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/rc.txt is small (1 lines), printing all lines: 2025-01-17 09:27:48,035 DEBUG ----- output ----- 2025-01-17 09:27:48,035 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-17 09:27:48,035 INFO ________________________________________________________________________________ [2025-01-17 09:27:48] benchmark-150 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-17 09:27:48,042 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stdout.txt is 65096 lines): 2025-01-17 09:27:48,042 DEBUG ----- output ----- 2025-01-17 09:27:48,042 INFO 2025-01-17 08:27:05,091 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp50p6upg7 2025-01-17 09:27:48,042 INFO 2025-01-17 08:27:05,094 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-150" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=**** 2025-01-17 09:27:48,042 INFO [INFO] Scanning for projects... 2025-01-17 09:27:48,042 INFO [INFO] 2025-01-17 09:27:48,042 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-17 09:27:48,042 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-17 09:27:48,042 INFO [INFO] from pom.xml 2025-01-17 09:27:48,042 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-17 09:27:48,042 INFO [INFO] 2025-01-17 09:27:48,042 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-17 09:27:48,042 INFO [INFO] 2025-01-17 09:27:48,042 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-17 09:27:48,042 INFO [INFO] skip non existing resourceDirectory /tmp/tmp50p6upg7/src/main/resources 2025-01-17 09:27:48,042 INFO [INFO] 2025-01-17 09:27:48,043 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-17 09:27:48,043 INFO [INFO] No sources to compile 2025-01-17 09:27:48,043 INFO [INFO] 2025-01-17 09:27:48,043 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-17 09:27:48,043 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-17 09:27:48,043 INFO [INFO] 2025-01-17 09:27:48,043 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-17 09:27:48,043 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-17 09:27:48,043 INFO [INFO] 2025-01-17 09:27:48,043 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-17 09:27:48,043 INFO [INFO] compiling 38 Scala sources to /tmp/tmp50p6upg7/target/test-classes ... 2025-01-17 09:27:48,043 INFO [INFO] compile in 11.2 s 2025-01-17 09:27:48,043 INFO [INFO] 2025-01-17 09:27:48,043 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-17 09:27:48,043 INFO [INFO] 2025-01-17 09:27:48,043 INFO [INFO] 2025-01-17 09:27:48,043 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-17 09:27:48,043 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-17 09:27:48,043 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-17 09:27:48,043 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-17 09:27:48,043 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 09:27:48,043 INFO 2025-01-17 09:27:48,043 INFO ================================================================================ 2025-01-17 09:27:48,043 INFO 2025-01-17 08:27:26 GMT 5s elapsed 2025-01-17 09:27:48,043 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 09:27:48,043 INFO > Global (OK=685 KO=0 ) 2025-01-17 09:27:48,043 INFO > restLoginInitiate (OK=57 KO=0 ) 2025-01-17 09:27:48,043 INFO > restLoginUsernamePasswordCallback (OK=55 KO=0 ) 2025-01-17 09:27:48,043 INFO > Skip 2FA (OK=36 KO=0 ) 2025-01-17 09:27:48,043 INFO > User Authorize PKCE stage (OK=64 KO=0 ) 2025-01-17 09:27:48,043 INFO > User AccessToken PKCE stage (OK=63 KO=0 ) 2025-01-17 09:27:48,043 INFO > loginTreeWorkflow_restLoginInitiate (OK=4 KO=0 ) 2025-01-17 09:27:48,043 INFO > GetUUid (OK=28 KO=0 ) 2025-01-17 09:27:48,043 INFO > GetOpenidConfig (OK=28 KO=0 ) 2025-01-17 09:27:48,043 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=4 KO=0 ) 2025-01-17 09:27:48,043 INFO > CreatePolicy (OK=26 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI-Post-Login - stage 1 (OK=13 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=13 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI AM idFromSession (OK=12 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI AM validateGoto (OK=12 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI-Post-Login - stage 2 (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI Enduser appAuthHelper1 (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI Enduser appAuthHelper2 (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > RootUserinfo (OK=17 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI-Post-Login - stage 3 (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI Enduser sessioncheck (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM uiconfig (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM version (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM privilege (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM login (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM features (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM dashboard (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM user (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM managed user schema (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI IDM oidcToken (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > userinfo (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI-Logout (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI-Logout Redirect 1 (OK=11 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI AM endsession (OK=10 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI AM revoke1 (OK=10 KO=0 ) 2025-01-17 09:27:48,043 INFO > UI AM revoke2 (OK=10 KO=0 ) 2025-01-17 09:27:48,043 INFO > getIdToken (OK=2 KO=0 ) 2025-01-17 09:27:48,044 INFO > getIdToken Redirect 1 (OK=2 KO=0 ) 2025-01-17 09:27:48,044 INFO > tokenUserinfo (OK=5 KO=0 ) 2025-01-17 09:27:48,044 INFO > createOrganization (OK=2 KO=0 ) 2025-01-17 09:27:48,044 INFO > queryOrganization (OK=2 KO=0 ) 2025-01-17 09:27:48,044 INFO > deleteOrganization (OK=1 KO=0 ) 2025-01-17 09:27:48,044 INFO 2025-01-17 09:27:48,044 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 09:27:48,044 INFO [- ] 0% 2025-01-17 09:27:48,044 INFO waiting: 540646 / active: 42 / done: 20 2025-01-17 09:27:48,044 INFO ================================================================================ 2025-01-17 09:27:48,044 INFO 2025-01-17 09:27:48,044 INFO 2025-01-17 09:27:48,044 INFO ================================================================================ 2025-01-17 09:27:48,044 INFO 2025-01-17 08:27:31 GMT 10s elapsed 2025-01-17 09:27:48,044 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 09:27:48,044 INFO > Global (OK=2875 KO=0 ) 2025-01-17 09:27:48,044 INFO > restLoginInitiate (OK=238 KO=0 ) 2025-01-17 09:27:48,044 INFO > restLoginUsernamePasswordCallback (OK=234 KO=0 ) 2025-01-17 09:27:48,044 INFO > Skip 2FA (OK=133 KO=0 ) 2025-01-17 09:27:48,044 INFO > User Authorize PKCE stage (OK=274 KO=0 ) 2025-01-17 09:27:48,044 INFO > User AccessToken PKCE stage (OK=271 KO=0 ) 2025-01-17 09:27:48,044 INFO > loginTreeWorkflow_restLoginInitiate (OK=9 KO=0 ) 2025-01-17 09:27:48,044 INFO [...] 2025-01-17 09:27:48,053 INFO 09:27:21.808 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 536327: j.n.c.ClosedChannelException 2025-01-17 09:27:48,053 INFO 09:27:21.808 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 09:27:48,053 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 09:27:48,053 INFO Request: 2025-01-17 09:27:48,053 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 09:27:48,053 INFO ========================= 2025-01-17 09:27:48,053 INFO Session: 2025-01-17 09:27:48,053 INFO Session(idc.benchmark.Mix2024,536322,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.36989916, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@25d4b15, fake-user-agent -> Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 103.203.93.15, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@479075af),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x0000793c6c69a2e8@7b12a8af,io.netty.channel.epoll.EpollEventLoop@14f5da2c) 2025-01-17 09:27:48,053 INFO ========================= 2025-01-17 09:27:48,053 INFO HTTP request: 2025-01-17 09:27:48,053 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-17 09:27:48,054 INFO headers: 2025-01-17 09:27:48,054 INFO accept: application/json 2025-01-17 09:27:48,054 INFO content-type: application/json 2025-01-17 09:27:48,054 INFO user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36 2025-01-17 09:27:48,054 INFO X-Forwarded-For: 103.203.93.15 2025-01-17 09:27:48,054 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 09:27:48,054 INFO content-length: 0 2025-01-17 09:27:48,054 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 09:27:48,054 INFO ========================= 2025-01-17 09:27:48,054 INFO HTTP response: 2025-01-17 09:27:48,054 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 09:27:48,054 INFO 09:27:21.808 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 536323: j.i.IOException: Premature close 2025-01-17 09:27:48,054 INFO 09:27:21.808 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 09:27:48,054 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 09:27:48,054 INFO Request: 2025-01-17 09:27:48,054 INFO restLoginInitiate: KO j.n.c.ClosedChannelException 2025-01-17 09:27:48,054 INFO ========================= 2025-01-17 09:27:48,054 INFO Session: 2025-01-17 09:27:48,054 INFO Session(idc.benchmark.Mix2024,536327,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.11749810, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@74f1af7d, fake-user-agent -> Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 30.144.42.175, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@5d37c71b),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x0000793c6c69a2e8@7b12a8af,io.netty.channel.epoll.EpollEventLoop@1eb6749b) 2025-01-17 09:27:48,054 INFO ========================= 2025-01-17 09:27:48,054 INFO HTTP request: 2025-01-17 09:27:48,054 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-17 09:27:48,054 INFO headers: 2025-01-17 09:27:48,054 INFO accept: application/json 2025-01-17 09:27:48,054 INFO content-type: application/json 2025-01-17 09:27:48,054 INFO user-agent: Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 2025-01-17 09:27:48,054 INFO X-Forwarded-For: 30.144.42.175 2025-01-17 09:27:48,054 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 09:27:48,054 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 09:27:48,054 INFO ========================= 2025-01-17 09:27:48,054 INFO HTTP response: 2025-01-17 09:27:48,054 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 09:27:48,054 INFO 09:27:21.808 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-163' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 09:27:48,054 INFO 09:27:21.809 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 09:27:48,054 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 09:27:48,054 INFO Request: 2025-01-17 09:27:48,054 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-17 09:27:48,054 INFO ========================= 2025-01-17 09:27:48,054 INFO Session: 2025-01-17 09:27:48,054 INFO Session(idc.benchmark.Mix2024,536323,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.38626551, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@48673275, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3, password -> Pa_ssw0rd, fake-ip -> 144.56.17.38, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@1ad5b1b2),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x0000793c6c69a2e8@7b12a8af,io.netty.channel.epoll.EpollEventLoop@12dae582) 2025-01-17 09:27:48,054 INFO ========================= 2025-01-17 09:27:48,054 INFO HTTP request: 2025-01-17 09:27:48,054 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2025-01-17 09:27:48,054 INFO headers: 2025-01-17 09:27:48,054 INFO accept: application/json 2025-01-17 09:27:48,054 INFO content-type: application/json 2025-01-17 09:27:48,054 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3 2025-01-17 09:27:48,054 INFO X-Forwarded-For: 144.56.17.38 2025-01-17 09:27:48,054 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 09:27:48,054 INFO content-length: 0 2025-01-17 09:27:48,054 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-17 09:27:48,054 INFO ========================= 2025-01-17 09:27:48,054 INFO HTTP response: 2025-01-17 09:27:48,054 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 09:27:48,054 INFO 09:27:21.809 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-163' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 09:27:48,054 INFO 09:27:21.809 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-17 09:27:48,054 INFO 09:27:21.810 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM features' failed for user 536235: j.i.IOException: Premature close 2025-01-17 09:27:48,054 INFO 09:27:21.810 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-17 09:27:48,054 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-17 09:27:48,054 INFO Request: 2025-01-17 09:27:48,054 INFO UI IDM features: KO j.i.IOException: Premature close 2025-01-17 09:27:48,054 INFO ========================= 2025-01-17 09:27:48,054 INFO Session: 2025-01-17 09:27:48,055 INFO Session(idc.benchmark.Mix2024,536235,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiMDE1M2I2OC0wZmI2LTRmYjEtOWRhOS00MGUyMTU2ZjFjZmMiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiOWM3YWQ3ZTctYTk1Zi00NDIyLWE3YjItYzA1ZDcwNTA2ZjdjLTU4MjI1MjcyIiwic3VibmFtZSI6ImIwMTUzYjY4LTBmYjYtNGZiMS05ZGE5LTQwZTIxNTZmMWNmYyIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJlMjNhTlN4X09uMkZUNzhIT2JpTmRXSW5mQU0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDYwNDEsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDYwNDEsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA5NjQxLCJpYXQiOjE3MzcxMDYwNDEsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IlliYzd5QmlBREd0M3ZQbU91ejBfeGF4V3p0ZyJ9.cE9CBLzAMSykWr9lCLeUMsTzoI0HCS-c14neYIgf7N8, username -> user.10182208, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiMDE1M2I2OC0wZmI2LTRmYjEtOWRhOS00MGUyMTU2ZjFjZmMiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiOGE3YTUwNzAtM2JlYy00MWVhLTgxNjQtYzYyMWVkZTQ1ZmZmLTU4MTE1NDUzIiwic3VibmFtZSI6ImIwMTUzYjY4LTBmYjYtNGZiMS05ZGE5LTQwZTIxNTZmMWNmYyIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJuSW4xa2gwa0o3YjR4LVJ5SzRjTGpjejZxZk0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDYwNDEsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDYwNDEsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA5NjQxLCJpYXQiOjE3MzcxMDYwNDEsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6Ik5vZ0d4NHJ2RVB4dHJaNXZQY3Z6TGpfRU9NcyJ9.zbda7bbf_QayHDoe8eDVmgZkH-VuB5IxT3QrrC_6CaY, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@86877e6, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, authcode -> Xi3uB-yR0pmUJkJ2tWOb5Be4tJ4, callbacks -> {"tokenId":"NmS9fHKWDTbXNh1eQk8is5xaans.*AAJTSQACMDIAAlNLABxTcGZhWWlxbDlLcWRLNjZ4SktpV3A0cGJyQnc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737106041243), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=NmS9fHKWDTbXNh1eQk8is5xaans.*AAJTSQACMDIAAlNLABxTcGZhWWlxbDlLcWRLNjZ4SktpV3A0cGJyQnc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737106041243))), user_uuid -> b0153b68-0fb6-4fb1-9da9-40e2156f1cfc, password -> Pa_ssw0rd, challenge -> TbHCAn0LmH40wpcwyaptqYT4GdHJzUYIKkC1aDPp0Gc, gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, fake-ip -> 87.131.135.23, verifier -> NzUxOTg0Mzk3MjA0MTI3OTMyMQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@19728edc, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@1c6e2052, tokenId -> NmS9fHKWDTbXNh1eQk8is5xaans.*AAJTSQACMDIAAlNLABxTcGZhWWlxbDlLcWRLNjZ4SktpV3A0cGJyQnc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Linux; Android 8.0.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x0000793c6c69a2e8@7b12a8af,io.netty.channel.epoll.EpollEventLoop@650eab8) 2025-01-17 09:27:48,055 INFO ========================= 2025-01-17 09:27:48,055 INFO HTTP request: 2025-01-17 09:27:48,055 INFO GET https://openam-perf-200m.forgeblocks.com/openidm/info/features?_queryFilter=true 2025-01-17 09:27:48,055 INFO headers: 2025-01-17 09:27:48,055 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-17 09:27:48,055 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-17 09:27:48,055 INFO Authorization: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJiMDE1M2I2OC0wZmI2LTRmYjEtOWRhOS00MGUyMTU2ZjFjZmMiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiOGE3YTUwNzAtM2JlYy00MWVhLTgxNjQtYzYyMWVkZTQ1ZmZmLTU4MTE1NDUzIiwic3VibmFtZSI6ImIwMTUzYjY4LTBmYjYtNGZiMS05ZGE5LTQwZTIxNTZmMWNmYyIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJuSW4xa2gwa0o3YjR4LVJ5SzRjTGpjejZxZk0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcxMDYwNDEsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcxMDYwNDEsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MTA5NjQxLCJpYXQiOjE3MzcxMDYwNDEsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6Ik5vZ0d4NHJ2RVB4dHJaNXZQY3Z6TGpfRU9NcyJ9.zbda7bbf_QayHDoe8eDVmgZkH-VuB5IxT3QrrC_6CaY 2025-01-17 09:27:48,055 INFO Accept-Api-Version: 2025-01-17 09:27:48,055 INFO accept: */* 2025-01-17 09:27:48,055 INFO cookie: amlbcookie=01; 15892ffd844ef80=NmS9fHKWDTbXNh1eQk8is5xaans.*AAJTSQACMDIAAlNLABxTcGZhWWlxbDlLcWRLNjZ4SktpV3A0cGJyQnc9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-17 09:27:48,055 INFO host: openam-perf-200m.forgeblocks.com 2025-01-17 09:27:48,055 INFO cookies: 2025-01-17 09:27:48,055 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 09:27:48,055 INFO 15892ffd844ef80=NmS9fHKWDTbXNh1eQk8is5xaans.*AAJTSQACMDIAAlNLABxTcGZhWWlxbDlLcWRLNjZ4SktpV3A0cGJyQnc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-17 09:27:48,055 INFO ========================= 2025-01-17 09:27:48,055 INFO HTTP response: 2025-01-17 09:27:48,055 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-17 09:27:48,055 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 09:27:48,055 INFO [INFO] BUILD SUCCESS 2025-01-17 09:27:48,055 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 09:27:48,055 INFO [INFO] Total time: 01:00 h 2025-01-17 09:27:48,055 INFO [INFO] Finished at: 2025-01-17T09:27:21Z 2025-01-17 09:27:48,055 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 09:27:48,055 INFO 2025-01-17 09:27:21,926 INFO Gatling simulation run ended successfully 2025-01-17 09:27:48,055 INFO 2025-01-17 09:27:21,927 DEBUG No archive name provided. No archive will be created 2025-01-17 09:27:48,055 INFO ________________________________________________________________________________ [2025-01-17 09:27:48] benchmark-150 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-17 09:27:48,055 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stderr.txt is small (0 lines), printing all lines: 2025-01-17 09:27:48,055 DEBUG ----- output ----- 2025-01-17 09:27:48,055 DEBUG 2025-01-17 09:27:48,055 INFO ________________________________________________________________________________ [2025-01-17 09:27:48] benchmark-150 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-17 09:27:48] benchmark-150 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-17 09:27:48] benchmark-150 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped