--Task-- name: benchmark-10 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 10} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-17 04:23:49] benchmark-10 pre : N/A ________________________________________________________________________________ 2025-01-17 04:23:49,631 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-17 04:23:49 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-17 04:23:49 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-10/stdout.txt Pod log : /results/orders/benchmark-10 2025-01-17 04:23:50,185 INFO 2025-01-17 04:23:50,185 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 04:23:50,185 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 04:23:50,462 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 04:23:50,462 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:23:50,462 DEBUG --- stdout --- 2025-01-17 04:23:50,462 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 04:23:50,462 DEBUG --- stderr --- 2025-01-17 04:23:50,462 DEBUG 2025-01-17 04:23:50 - INFO: Get overseer pod resources requests memory 2025-01-17 04:23:50,462 INFO 2025-01-17 04:23:50,462 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-5865b977f-pk2tz --output jsonpath={.spec.containers[].resources.requests.memory} 2025-01-17 04:23:50,462 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 04:23:50,761 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:23:50,761 DEBUG --- stdout --- 2025-01-17 04:23:50,761 DEBUG 4Gi 2025-01-17 04:23:50,761 DEBUG --- stderr --- 2025-01-17 04:23:50,761 DEBUG ________________________________________________________________________________ [2025-01-17 04:23:50] benchmark-10 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-17 04:23:50,761 INFO 2025-01-17 04:23:50,761 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 04:23:50,761 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 04:23:51,039 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 04:23:51,039 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:23:51,039 DEBUG --- stdout --- 2025-01-17 04:23:51,039 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 04:23:51,039 DEBUG --- stderr --- 2025-01-17 04:23:51,039 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-17 04:23:51] benchmark-10 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-17 04:23:51,039 INFO 2025-01-17 04:23:51,040 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 04:23:51,040 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 04:23:51,317 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 04:23:51,317 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:23:51,317 DEBUG --- stdout --- 2025-01-17 04:23:51,317 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 04:23:51,317 DEBUG --- stderr --- 2025-01-17 04:23:51,317 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json { "name": "benchmark-10", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-10\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-10" } ________________________________________________________________________________ [2025-01-17 04:23:51] benchmark-10 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-17 04:23:51,320 INFO 2025-01-17 04:23:51,320 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-17 04:23:51,320 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 04:23:51,642 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 04:23:51,643 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:23:51,643 DEBUG --- stdout --- 2025-01-17 04:23:51,643 DEBUG WAITING 2025-01-17 04:23:51,643 DEBUG --- stderr --- 2025-01-17 04:23:51,643 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 22 0 --:--:-- --:--:-- --:--:-- 22 ________________________________________________________________________________ [2025-01-17 04:23:51] benchmark-10 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-17 04:23:51,643 INFO 2025-01-17 04:23:51,643 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 04:23:51,643 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 04:23:51,920 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 04:23:51,920 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:23:51,920 DEBUG --- stdout --- 2025-01-17 04:23:51,920 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 04:23:51,920 DEBUG --- stderr --- 2025-01-17 04:23:51,920 DEBUG 2025-01-17 04:23:51,921 INFO 2025-01-17 04:23:51,921 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-17 04:23:51,921 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 04:23:53,315 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:23:53,315 DEBUG --- stdout --- 2025-01-17 04:23:53,315 DEBUG 2025-01-17 04:23:53,315 DEBUG --- stderr --- 2025-01-17 04:23:53,315 DEBUG Order has been successfully forwarded to overseer 2025-01-17 04:23:53 - INFO: Check if Gatling simulation started successfully 2025-01-17 04:23:53,315 INFO 2025-01-17 04:23:53,315 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 04:23:53,315 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 04:23:53,594 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 04:23:53,594 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:23:53,594 DEBUG --- stdout --- 2025-01-17 04:23:53,594 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 04:23:53,594 DEBUG --- stderr --- 2025-01-17 04:23:53,594 DEBUG 2025-01-17 04:23:53,594 INFO 2025-01-17 04:23:53,594 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-10/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-17 04:23:53,594 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-17 04:23:54,331 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 04:24:00,064 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 04:24:05,806 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-17 04:24:11,537 INFO [loop_until]: Function succeeded after 17s (rc=0) - expected pattern found 2025-01-17 04:24:11,537 INFO [loop_until]: OK (rc = 0) 2025-01-17 04:24:11,537 DEBUG --- stdout --- 2025-01-17 04:24:11,537 DEBUG 2025-01-17 04:23:54,365 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpwb1k49lh 2025-01-17 04:23:54,368 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpwb1k49lh/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmpwb1k49lh/target/test-classes ... [INFO] compile in 10.9 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 04:24:11,537 DEBUG --- stderr --- 2025-01-17 04:24:11,537 DEBUG ________________________________________________________________________________ [2025-01-17 04:24:11] benchmark-10 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 04s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 05s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 06s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 07s, retry Order is running since 46m 07s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 08s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 09s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-17 05:24:21] benchmark-10 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-17 05:24:21,005 INFO 2025-01-17 05:24:21,005 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:21,005 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:21,314 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:21,314 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:21,314 DEBUG --- stdout --- 2025-01-17 05:24:21,314 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:21,314 DEBUG --- stderr --- 2025-01-17 05:24:21,314 DEBUG 2025-01-17 05:24:21,315 INFO 2025-01-17 05:24:21,315 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-17 05:24:21,315 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 05:24:22,105 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:22,105 DEBUG --- stdout --- 2025-01-17 05:24:22,105 DEBUG 2025-01-17 05:24:22,105 DEBUG --- stderr --- 2025-01-17 05:24:22,105 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-17 05:24:22] benchmark-10 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-17 05:24:22 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json 2025-01-17 05:24:22,106 INFO 2025-01-17 05:24:22,106 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:22,106 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:22,384 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:22,384 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:22,384 DEBUG --- stdout --- 2025-01-17 05:24:22,384 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:22,385 DEBUG --- stderr --- 2025-01-17 05:24:22,385 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 05:24:22,385 INFO 2025-01-17 05:24:22,385 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:22,385 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:22,663 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:22,663 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:22,663 DEBUG --- stdout --- 2025-01-17 05:24:22,663 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:22,663 DEBUG --- stderr --- 2025-01-17 05:24:22,663 DEBUG 2025-01-17 05:24:22,664 INFO 2025-01-17 05:24:22,664 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/rc.txt" ]; then echo "/results/orders/benchmark-10/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-10/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/rc.txt file found" 2025-01-17 05:24:22,664 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 05:24:23,471 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 05:24:23,472 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:23,472 DEBUG --- stdout --- 2025-01-17 05:24:23,472 DEBUG /results/orders/benchmark-10/rc.txt file found 2025-01-17 05:24:23,472 DEBUG --- stderr --- 2025-01-17 05:24:23,472 DEBUG 2025-01-17 05:24:23,472 INFO 2025-01-17 05:24:23,472 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:23,472 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:23,749 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:23,749 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:23,749 DEBUG --- stdout --- 2025-01-17 05:24:23,749 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:23,749 DEBUG --- stderr --- 2025-01-17 05:24:23,749 DEBUG 2025-01-17 05:24:23,749 INFO 2025-01-17 05:24:23,750 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-10/rc.txt 2025-01-17 05:24:24,554 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 05:24:24,554 DEBUG --- stdout --- 2025-01-17 05:24:24,554 DEBUG 4 /results/orders/benchmark-10/rc.txt 2025-01-17 05:24:24,554 DEBUG --- stderr --- 2025-01-17 05:24:24,554 DEBUG 2025-01-17 05:24:24,554 INFO - Download file (size 4k) 2025-01-17 05:24:24,554 INFO 2025-01-17 05:24:24,554 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:24,554 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:24,847 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:24,847 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:24,847 DEBUG --- stdout --- 2025-01-17 05:24:24,847 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:24,847 DEBUG --- stderr --- 2025-01-17 05:24:24,847 DEBUG source : /results/orders/benchmark-10/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2025-01-17 05:24:24,847 INFO 2025-01-17 05:24:24,847 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:24,847 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:25,128 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:25,128 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:25,128 DEBUG --- stdout --- 2025-01-17 05:24:25,128 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:25,128 DEBUG --- stderr --- 2025-01-17 05:24:25,128 DEBUG 2025-01-17 05:24:25,129 INFO 2025-01-17 05:24:25,129 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-10/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2025-01-17 05:24:25,129 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 05:24:25,894 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:25,894 DEBUG --- stdout --- 2025-01-17 05:24:25,894 DEBUG tar: Removing leading `/' from member names 2025-01-17 05:24:25,894 DEBUG --- stderr --- 2025-01-17 05:24:25,894 DEBUG 2025-01-17 05:24:25,895 INFO 2025-01-17 05:24:25,895 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:25,895 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:26,174 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:26,174 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:26,175 DEBUG --- stdout --- 2025-01-17 05:24:26,175 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:26,175 DEBUG --- stderr --- 2025-01-17 05:24:26,175 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 05:24:26,175 INFO 2025-01-17 05:24:26,175 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:26,176 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:26,454 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:26,454 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:26,454 DEBUG --- stdout --- 2025-01-17 05:24:26,454 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:26,454 DEBUG --- stderr --- 2025-01-17 05:24:26,454 DEBUG 2025-01-17 05:24:26,454 INFO 2025-01-17 05:24:26,455 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/stderr.txt" ]; then echo "/results/orders/benchmark-10/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stderr.txt file found" 2025-01-17 05:24:26,455 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 05:24:27,255 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 05:24:27,255 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:27,255 DEBUG --- stdout --- 2025-01-17 05:24:27,255 DEBUG /results/orders/benchmark-10/stderr.txt file found 2025-01-17 05:24:27,255 DEBUG --- stderr --- 2025-01-17 05:24:27,255 DEBUG 2025-01-17 05:24:27,256 INFO 2025-01-17 05:24:27,256 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:27,256 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:27,533 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:27,533 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:27,533 DEBUG --- stdout --- 2025-01-17 05:24:27,533 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:27,533 DEBUG --- stderr --- 2025-01-17 05:24:27,533 DEBUG 2025-01-17 05:24:27,533 INFO 2025-01-17 05:24:27,534 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-10/stderr.txt 2025-01-17 05:24:28,334 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 05:24:28,334 DEBUG --- stdout --- 2025-01-17 05:24:28,334 DEBUG 0 /results/orders/benchmark-10/stderr.txt 2025-01-17 05:24:28,334 DEBUG --- stderr --- 2025-01-17 05:24:28,334 DEBUG 2025-01-17 05:24:28,334 INFO - Download file (size 0k) 2025-01-17 05:24:28,335 INFO 2025-01-17 05:24:28,335 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:28,335 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:28,614 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:28,614 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:28,614 DEBUG --- stdout --- 2025-01-17 05:24:28,614 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:28,614 DEBUG --- stderr --- 2025-01-17 05:24:28,614 DEBUG source : /results/orders/benchmark-10/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2025-01-17 05:24:28,614 INFO 2025-01-17 05:24:28,614 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:28,614 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:28,894 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:28,894 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:28,894 DEBUG --- stdout --- 2025-01-17 05:24:28,894 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:28,894 DEBUG --- stderr --- 2025-01-17 05:24:28,894 DEBUG 2025-01-17 05:24:28,895 INFO 2025-01-17 05:24:28,895 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-10/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2025-01-17 05:24:28,895 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 05:24:29,658 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:29,658 DEBUG --- stdout --- 2025-01-17 05:24:29,658 DEBUG tar: Removing leading `/' from member names 2025-01-17 05:24:29,658 DEBUG --- stderr --- 2025-01-17 05:24:29,658 DEBUG 2025-01-17 05:24:29,659 INFO 2025-01-17 05:24:29,659 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:29,659 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:29,937 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:29,937 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:29,937 DEBUG --- stdout --- 2025-01-17 05:24:29,937 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:29,937 DEBUG --- stderr --- 2025-01-17 05:24:29,937 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 05:24:29,937 INFO 2025-01-17 05:24:29,937 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:29,938 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:30,215 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:30,215 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:30,215 DEBUG --- stdout --- 2025-01-17 05:24:30,216 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:30,216 DEBUG --- stderr --- 2025-01-17 05:24:30,216 DEBUG 2025-01-17 05:24:30,216 INFO 2025-01-17 05:24:30,216 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/stdout.txt" ]; then echo "/results/orders/benchmark-10/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stdout.txt file found" 2025-01-17 05:24:30,216 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 05:24:31,023 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 05:24:31,024 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:31,024 DEBUG --- stdout --- 2025-01-17 05:24:31,024 DEBUG /results/orders/benchmark-10/stdout.txt file found 2025-01-17 05:24:31,024 DEBUG --- stderr --- 2025-01-17 05:24:31,024 DEBUG 2025-01-17 05:24:31,024 INFO 2025-01-17 05:24:31,024 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:31,024 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:31,369 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:31,369 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:31,369 DEBUG --- stdout --- 2025-01-17 05:24:31,369 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:31,369 DEBUG --- stderr --- 2025-01-17 05:24:31,369 DEBUG 2025-01-17 05:24:31,369 INFO 2025-01-17 05:24:31,370 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-10/stdout.txt 2025-01-17 05:24:32,208 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 05:24:32,209 DEBUG --- stdout --- 2025-01-17 05:24:32,209 DEBUG 3320 /results/orders/benchmark-10/stdout.txt 2025-01-17 05:24:32,209 DEBUG --- stderr --- 2025-01-17 05:24:32,209 DEBUG 2025-01-17 05:24:32,209 INFO - Download file (size 3320k) 2025-01-17 05:24:32,209 INFO 2025-01-17 05:24:32,209 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:32,209 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:32,487 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:32,487 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:32,487 DEBUG --- stdout --- 2025-01-17 05:24:32,487 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:32,487 DEBUG --- stderr --- 2025-01-17 05:24:32,487 DEBUG source : /results/orders/benchmark-10/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2025-01-17 05:24:32,488 INFO 2025-01-17 05:24:32,488 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:32,488 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:32,764 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:32,764 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:32,764 DEBUG --- stdout --- 2025-01-17 05:24:32,764 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:32,764 DEBUG --- stderr --- 2025-01-17 05:24:32,765 DEBUG 2025-01-17 05:24:32,765 INFO 2025-01-17 05:24:32,765 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-10/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2025-01-17 05:24:32,765 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 05:24:33,993 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:33,994 DEBUG --- stdout --- 2025-01-17 05:24:33,994 DEBUG tar: Removing leading `/' from member names 2025-01-17 05:24:33,994 DEBUG --- stderr --- 2025-01-17 05:24:33,994 DEBUG ________________________________________________________________________________ [2025-01-17 05:24:33] benchmark-10 show_cmd : Display order command ________________________________________________________________________________ 2025-01-17 05:24:33,994 INFO 2025-01-17 05:24:33,994 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:33,994 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:34,271 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:34,271 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:34,271 DEBUG --- stdout --- 2025-01-17 05:24:34,271 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:34,271 DEBUG --- stderr --- 2025-01-17 05:24:34,271 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-17 05:24:34,272 INFO 2025-01-17 05:24:34,272 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:34,272 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:34,554 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:34,554 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:34,554 DEBUG --- stdout --- 2025-01-17 05:24:34,554 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:34,554 DEBUG --- stderr --- 2025-01-17 05:24:34,554 DEBUG 2025-01-17 05:24:34,555 INFO 2025-01-17 05:24:34,555 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/cmd.txt" ]; then echo "/results/orders/benchmark-10/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-10/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/cmd.txt file found" 2025-01-17 05:24:34,555 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-17 05:24:35,356 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-17 05:24:35,356 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:35,356 DEBUG --- stdout --- 2025-01-17 05:24:35,356 DEBUG /results/orders/benchmark-10/cmd.txt file found 2025-01-17 05:24:35,356 DEBUG --- stderr --- 2025-01-17 05:24:35,356 DEBUG 2025-01-17 05:24:35,356 INFO 2025-01-17 05:24:35,356 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:35,356 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:35,636 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:35,636 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:35,636 DEBUG --- stdout --- 2025-01-17 05:24:35,636 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:35,636 DEBUG --- stderr --- 2025-01-17 05:24:35,636 DEBUG 2025-01-17 05:24:35,636 INFO 2025-01-17 05:24:35,637 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-10/cmd.txt 2025-01-17 05:24:36,442 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-17 05:24:36,442 DEBUG --- stdout --- 2025-01-17 05:24:36,442 DEBUG 4 /results/orders/benchmark-10/cmd.txt 2025-01-17 05:24:36,442 DEBUG --- stderr --- 2025-01-17 05:24:36,442 DEBUG 2025-01-17 05:24:36,442 INFO - Download file (size 4k) 2025-01-17 05:24:36,443 INFO 2025-01-17 05:24:36,443 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:36,443 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:36,721 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:36,721 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:36,721 DEBUG --- stdout --- 2025-01-17 05:24:36,721 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:36,721 DEBUG --- stderr --- 2025-01-17 05:24:36,721 DEBUG source : /results/orders/benchmark-10/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2025-01-17 05:24:36,722 INFO 2025-01-17 05:24:36,722 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-17 05:24:36,722 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-17 05:24:37,001 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-17 05:24:37,001 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:37,001 DEBUG --- stdout --- 2025-01-17 05:24:37,001 DEBUG overseer-0-5865b977f-pk2tz 2025-01-17 05:24:37,001 DEBUG --- stderr --- 2025-01-17 05:24:37,001 DEBUG 2025-01-17 05:24:37,002 INFO 2025-01-17 05:24:37,002 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-10/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2025-01-17 05:24:37,002 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-17 05:24:37,729 INFO [loop_until]: OK (rc = 0) 2025-01-17 05:24:37,729 DEBUG --- stdout --- 2025-01-17 05:24:37,729 DEBUG tar: Removing leading `/' from member names 2025-01-17 05:24:37,729 DEBUG --- stderr --- 2025-01-17 05:24:37,729 DEBUG 2025-01-17 05:24:37,729 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt is small (1 lines), printing all lines: 2025-01-17 05:24:37,729 DEBUG ----- output ----- 2025-01-17 05:24:37,729 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" 2025-01-17 05:24:37,729 INFO ________________________________________________________________________________ [2025-01-17 05:24:37] benchmark-10 show_rc : Display rc order ________________________________________________________________________________ 2025-01-17 05:24:37,729 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt is small (1 lines), printing all lines: 2025-01-17 05:24:37,729 DEBUG ----- output ----- 2025-01-17 05:24:37,729 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-17 05:24:37,729 INFO ________________________________________________________________________________ [2025-01-17 05:24:37] benchmark-10 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-17 05:24:37,734 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt is 44127 lines): 2025-01-17 05:24:37,734 DEBUG ----- output ----- 2025-01-17 05:24:37,734 INFO 2025-01-17 04:23:54,365 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpwb1k49lh 2025-01-17 05:24:37,734 INFO 2025-01-17 04:23:54,368 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=**** 2025-01-17 05:24:37,734 INFO [INFO] Scanning for projects... 2025-01-17 05:24:37,734 INFO [INFO] 2025-01-17 05:24:37,734 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-17 05:24:37,734 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-17 05:24:37,734 INFO [INFO] from pom.xml 2025-01-17 05:24:37,734 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-17 05:24:37,734 INFO [INFO] 2025-01-17 05:24:37,734 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-17 05:24:37,734 INFO [INFO] 2025-01-17 05:24:37,734 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-17 05:24:37,734 INFO [INFO] skip non existing resourceDirectory /tmp/tmpwb1k49lh/src/main/resources 2025-01-17 05:24:37,735 INFO [INFO] 2025-01-17 05:24:37,735 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-17 05:24:37,735 INFO [INFO] No sources to compile 2025-01-17 05:24:37,735 INFO [INFO] 2025-01-17 05:24:37,735 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-17 05:24:37,735 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-17 05:24:37,735 INFO [INFO] 2025-01-17 05:24:37,735 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-17 05:24:37,735 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-17 05:24:37,735 INFO [INFO] 2025-01-17 05:24:37,735 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-17 05:24:37,735 INFO [INFO] compiling 38 Scala sources to /tmp/tmpwb1k49lh/target/test-classes ... 2025-01-17 05:24:37,735 INFO [INFO] compile in 10.9 s 2025-01-17 05:24:37,735 INFO [INFO] 2025-01-17 05:24:37,735 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-17 05:24:37,735 INFO [INFO] 2025-01-17 05:24:37,735 INFO [INFO] 2025-01-17 05:24:37,735 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-17 05:24:37,735 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-17 05:24:37,735 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-17 05:24:37,735 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-17 05:24:37,735 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-17 05:24:37,735 INFO 2025-01-17 05:24:37,735 INFO ================================================================================ 2025-01-17 05:24:37,735 INFO 2025-01-17 04:24:15 GMT 4s elapsed 2025-01-17 05:24:37,735 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 05:24:37,735 INFO > Global (OK=49 KO=0 ) 2025-01-17 05:24:37,735 INFO > restLoginInitiate (OK=3 KO=0 ) 2025-01-17 05:24:37,735 INFO > restLoginUsernamePasswordCallback (OK=3 KO=0 ) 2025-01-17 05:24:37,735 INFO > Skip 2FA (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > User Authorize PKCE stage (OK=4 KO=0 ) 2025-01-17 05:24:37,735 INFO > User AccessToken PKCE stage (OK=4 KO=0 ) 2025-01-17 05:24:37,735 INFO > getIdToken (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > getIdToken Redirect 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > createOrganization (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI-Post-Login - stage 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI AM validateGoto (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI AM idFromSession (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > queryOrganization (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > deleteOrganization (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI-Post-Login - stage 2 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI Enduser appAuthHelper1 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI Enduser appAuthHelper2 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI-Post-Login - stage 3 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI Enduser sessioncheck (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM uiconfig (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM version (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM features (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM login (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM privilege (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM dashboard (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM managed user schema (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM user (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > tokenUserinfo (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI IDM oidcToken (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > loginTreeWorkflow_restLoginInitiate (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > userinfo (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > UI-Logout (OK=1 KO=0 ) 2025-01-17 05:24:37,735 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO > UI-Logout Redirect 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO > UI AM revoke2 (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO > UI AM revoke1 (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO > UI AM endsession (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO 2025-01-17 05:24:37,736 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 05:24:37,736 INFO [ ] 0% 2025-01-17 05:24:37,736 INFO waiting: 36010 / active: 0 / done: 4 2025-01-17 05:24:37,736 INFO ================================================================================ 2025-01-17 05:24:37,736 INFO 2025-01-17 05:24:37,736 INFO 2025-01-17 05:24:37,736 INFO ================================================================================ 2025-01-17 05:24:37,736 INFO 2025-01-17 04:24:20 GMT 9s elapsed 2025-01-17 05:24:37,736 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 05:24:37,736 INFO > Global (OK=123 KO=0 ) 2025-01-17 05:24:37,736 INFO > restLoginInitiate (OK=15 KO=0 ) 2025-01-17 05:24:37,736 INFO > restLoginUsernamePasswordCallback (OK=15 KO=0 ) 2025-01-17 05:24:37,736 INFO > Skip 2FA (OK=7 KO=0 ) 2025-01-17 05:24:37,736 INFO > User Authorize PKCE stage (OK=15 KO=0 ) 2025-01-17 05:24:37,736 INFO > User AccessToken PKCE stage (OK=15 KO=0 ) 2025-01-17 05:24:37,736 INFO > getIdToken (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO > getIdToken Redirect 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO > createOrganization (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO > UI-Post-Login - stage 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=1 KO=0 ) 2025-01-17 05:24:37,736 INFO [...] 2025-01-17 05:24:37,742 INFO > tokenUserinfo (OK=7682 KO=0 ) 2025-01-17 05:24:37,742 INFO > UI IDM oidcToken (OK=7549 KO=0 ) 2025-01-17 05:24:37,742 INFO > loginTreeWorkflow_restLoginInitiate (OK=1284 KO=0 ) 2025-01-17 05:24:37,742 INFO > userinfo (OK=7548 KO=0 ) 2025-01-17 05:24:37,742 INFO > UI-Logout (OK=7549 KO=0 ) 2025-01-17 05:24:37,742 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1284 KO=0 ) 2025-01-17 05:24:37,742 INFO > UI-Logout Redirect 1 (OK=7548 KO=0 ) 2025-01-17 05:24:37,742 INFO > UI AM revoke2 (OK=7546 KO=2 ) 2025-01-17 05:24:37,742 INFO > UI AM revoke1 (OK=7547 KO=0 ) 2025-01-17 05:24:37,742 INFO > UI AM endsession (OK=7548 KO=0 ) 2025-01-17 05:24:37,742 INFO > RootUserinfo (OK=25321 KO=0 ) 2025-01-17 05:24:37,742 INFO > GetUUid (OK=11532 KO=0 ) 2025-01-17 05:24:37,742 INFO > GetOpenidConfig (OK=34555 KO=0 ) 2025-01-17 05:24:37,742 INFO > CreatePolicy (OK=11532 KO=0 ) 2025-01-17 05:24:37,742 INFO > ReadPolicy (OK=11520 KO=0 ) 2025-01-17 05:24:37,742 INFO > DeletePolicy (OK=11502 KO=0 ) 2025-01-17 05:24:37,742 INFO ---- Errors -------------------------------------------------------------------- 2025-01-17 05:24:37,742 INFO > status.find.in([200, 209], 304), found 503 4 (36.36%) 2025-01-17 05:24:37,742 INFO > status.find.is(302), but actually found 502 2 (18.18%) 2025-01-17 05:24:37,742 INFO > status.find.is(200), but actually found 502 2 (18.18%) 2025-01-17 05:24:37,742 INFO > status.find.in([200, 209], 304), found 502 1 ( 9.09%) 2025-01-17 05:24:37,742 INFO > userinfo: No attribute named 'access_token' is defined 1 ( 9.09%) 2025-01-17 05:24:37,742 INFO > UI AM revoke1: No attribute named 'access_token' is defined 1 ( 9.09%) 2025-01-17 05:24:37,742 INFO 2025-01-17 05:24:37,743 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 05:24:37,743 INFO [#########################################################################-] 98% 2025-01-17 05:24:37,743 INFO waiting: 317 / active: 46 / done: 35651 2025-01-17 05:24:37,743 INFO ================================================================================ 2025-01-17 05:24:37,743 INFO 2025-01-17 05:24:37,743 INFO 2025-01-17 05:24:37,743 INFO ================================================================================ 2025-01-17 05:24:37,743 INFO 2025-01-17 05:24:10 GMT 3600s elapsed 2025-01-17 05:24:37,743 INFO ---- Requests ------------------------------------------------------------------ 2025-01-17 05:24:37,743 INFO > Global (OK=497269 KO=9 ) 2025-01-17 05:24:37,743 INFO > restLoginInitiate (OK=34412 KO=1 ) 2025-01-17 05:24:37,743 INFO > restLoginUsernamePasswordCallback (OK=34411 KO=1 ) 2025-01-17 05:24:37,743 INFO > Skip 2FA (OK=19180 KO=0 ) 2025-01-17 05:24:37,743 INFO > User Authorize PKCE stage (OK=41958 KO=2 ) 2025-01-17 05:24:37,743 INFO > User AccessToken PKCE stage (OK=41958 KO=0 ) 2025-01-17 05:24:37,743 INFO > getIdToken (OK=2575 KO=0 ) 2025-01-17 05:24:37,743 INFO > getIdToken Redirect 1 (OK=2575 KO=0 ) 2025-01-17 05:24:37,743 INFO > createOrganization (OK=2575 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI-Post-Login - stage 1 (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI AM validateGoto (OK=7548 KO=1 ) 2025-01-17 05:24:37,743 INFO > UI AM idFromSession (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > queryOrganization (OK=2575 KO=0 ) 2025-01-17 05:24:37,743 INFO > deleteOrganization (OK=2575 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI-Post-Login - stage 2 (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI Enduser appAuthHelper1 (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI Enduser appAuthHelper2 (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI-Post-Login - stage 3 (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI Enduser sessioncheck (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI IDM uiconfig (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI IDM version (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI IDM features (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI IDM login (OK=7547 KO=2 ) 2025-01-17 05:24:37,743 INFO > UI IDM privilege (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI IDM dashboard (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI IDM managed user schema (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI IDM user (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > tokenUserinfo (OK=7682 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI IDM oidcToken (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > loginTreeWorkflow_restLoginInitiate (OK=1284 KO=0 ) 2025-01-17 05:24:37,743 INFO > userinfo (OK=7548 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI-Logout (OK=7549 KO=0 ) 2025-01-17 05:24:37,743 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1284 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI-Logout Redirect 1 (OK=7548 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI AM revoke2 (OK=7546 KO=2 ) 2025-01-17 05:24:37,743 INFO > UI AM revoke1 (OK=7547 KO=0 ) 2025-01-17 05:24:37,743 INFO > UI AM endsession (OK=7548 KO=0 ) 2025-01-17 05:24:37,743 INFO > RootUserinfo (OK=25321 KO=0 ) 2025-01-17 05:24:37,743 INFO > GetUUid (OK=11532 KO=0 ) 2025-01-17 05:24:37,743 INFO > GetOpenidConfig (OK=34555 KO=0 ) 2025-01-17 05:24:37,743 INFO > CreatePolicy (OK=11532 KO=0 ) 2025-01-17 05:24:37,743 INFO > ReadPolicy (OK=11520 KO=0 ) 2025-01-17 05:24:37,743 INFO > DeletePolicy (OK=11502 KO=0 ) 2025-01-17 05:24:37,743 INFO ---- Errors -------------------------------------------------------------------- 2025-01-17 05:24:37,743 INFO > status.find.in([200, 209], 304), found 503 4 (36.36%) 2025-01-17 05:24:37,743 INFO > status.find.is(302), but actually found 502 2 (18.18%) 2025-01-17 05:24:37,743 INFO > status.find.is(200), but actually found 502 2 (18.18%) 2025-01-17 05:24:37,743 INFO > status.find.in([200, 209], 304), found 502 1 ( 9.09%) 2025-01-17 05:24:37,743 INFO > userinfo: No attribute named 'access_token' is defined 1 ( 9.09%) 2025-01-17 05:24:37,743 INFO > UI AM revoke1: No attribute named 'access_token' is defined 1 ( 9.09%) 2025-01-17 05:24:37,743 INFO 2025-01-17 05:24:37,744 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-17 05:24:37,744 INFO [#########################################################################-] 98% 2025-01-17 05:24:37,744 INFO waiting: 317 / active: 46 / done: 35651 2025-01-17 05:24:37,744 INFO ================================================================================ 2025-01-17 05:24:37,744 INFO 2025-01-17 05:24:37,744 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 05:24:37,744 INFO [INFO] BUILD SUCCESS 2025-01-17 05:24:37,744 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 05:24:37,744 INFO [INFO] Total time: 01:00 h 2025-01-17 05:24:37,744 INFO [INFO] Finished at: 2025-01-17T05:24:10Z 2025-01-17 05:24:37,744 INFO [INFO] ------------------------------------------------------------------------ 2025-01-17 05:24:37,744 INFO 2025-01-17 05:24:10,980 INFO Gatling simulation run ended successfully 2025-01-17 05:24:37,744 INFO 2025-01-17 05:24:10,980 DEBUG No archive name provided. No archive will be created 2025-01-17 05:24:37,744 INFO ________________________________________________________________________________ [2025-01-17 05:24:37] benchmark-10 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-17 05:24:37,744 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt is small (0 lines), printing all lines: 2025-01-17 05:24:37,744 DEBUG ----- output ----- 2025-01-17 05:24:37,744 DEBUG 2025-01-17 05:24:37,744 INFO ________________________________________________________________________________ [2025-01-17 05:24:37] benchmark-10 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-17 05:24:37] benchmark-10 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-17 05:24:37] benchmark-10 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped