--Task-- name: benchmark-5 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 5} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-11-21 18:11:19] benchmark-5 pre : N/A ________________________________________________________________________________ 2024-11-21 18:11:19 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2024-11-21 18:11:19 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-5/stdout.txt Pod log : /results/orders/benchmark-5 2024-11-21 18:11:19,955 INFO 2024-11-21 18:11:19,955 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 18:11:19,955 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 18:11:20,228 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 18:11:20,228 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:20,228 DEBUG --- stdout --- 2024-11-21 18:11:20,228 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 18:11:20,228 DEBUG --- stderr --- 2024-11-21 18:11:20,228 DEBUG 2024-11-21 18:11:20 - INFO: Get overseer pod resources requests memory 2024-11-21 18:11:20,228 INFO 2024-11-21 18:11:20,228 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-6644bb6697-rchxr --output jsonpath={.spec.containers[].resources.requests.memory} 2024-11-21 18:11:20,228 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-21 18:11:20,521 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:20,521 DEBUG --- stdout --- 2024-11-21 18:11:20,521 DEBUG 4Gi 2024-11-21 18:11:20,521 DEBUG --- stderr --- 2024-11-21 18:11:20,521 DEBUG ________________________________________________________________________________ [2024-11-21 18:11:20] benchmark-5 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-11-21 18:11:20,522 INFO 2024-11-21 18:11:20,522 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 18:11:20,522 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 18:11:20,795 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 18:11:20,795 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:20,795 DEBUG --- stdout --- 2024-11-21 18:11:20,795 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 18:11:20,795 DEBUG --- stderr --- 2024-11-21 18:11:20,795 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-5" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=5 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2024-11-21 18:11:20] benchmark-5 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-11-21 18:11:20,796 INFO 2024-11-21 18:11:20,796 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 18:11:20,796 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 18:11:21,068 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 18:11:21,068 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:21,068 DEBUG --- stdout --- 2024-11-21 18:11:21,069 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 18:11:21,069 DEBUG --- stderr --- 2024-11-21 18:11:21,069 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/order.json { "name": "benchmark-5", "command": " /lodestar/lodestar.py run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-benchmark\" --results-folder=\"/results/gatling/benchmark-5\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=5 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-5" } ________________________________________________________________________________ [2024-11-21 18:11:21] benchmark-5 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-11-21 18:11:21,073 INFO 2024-11-21 18:11:21,073 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-11-21 18:11:21,073 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-21 18:11:21,336 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-21 18:11:21,336 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:21,336 DEBUG --- stdout --- 2024-11-21 18:11:21,336 DEBUG WAITING 2024-11-21 18:11:21,336 DEBUG --- stderr --- 2024-11-21 18:11:21,336 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 27 0 --:--:-- --:--:-- --:--:-- 27 ________________________________________________________________________________ [2024-11-21 18:11:21] benchmark-5 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-11-21 18:11:21,336 INFO 2024-11-21 18:11:21,337 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 18:11:21,337 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 18:11:21,610 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 18:11:21,610 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:21,611 DEBUG --- stdout --- 2024-11-21 18:11:21,611 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 18:11:21,611 DEBUG --- stderr --- 2024-11-21 18:11:21,611 DEBUG 2024-11-21 18:11:21,611 INFO 2024-11-21 18:11:21,611 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/order.json overseer-0-6644bb6697-rchxr:/results/orders/order.json 2024-11-21 18:11:21,611 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-21 18:11:22,964 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:22,964 DEBUG --- stdout --- 2024-11-21 18:11:22,964 DEBUG 2024-11-21 18:11:22,964 DEBUG --- stderr --- 2024-11-21 18:11:22,964 DEBUG Order has been successfully forwarded to overseer 2024-11-21 18:11:22 - INFO: Check if Gatling simulation started successfully 2024-11-21 18:11:22,965 INFO 2024-11-21 18:11:22,965 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 18:11:22,965 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 18:11:23,237 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 18:11:23,237 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:23,237 DEBUG --- stdout --- 2024-11-21 18:11:23,237 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 18:11:23,237 DEBUG --- stderr --- 2024-11-21 18:11:23,237 DEBUG 2024-11-21 18:11:23,238 INFO 2024-11-21 18:11:23,238 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- head --lines 5000 /results/orders/benchmark-5/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2024-11-21 18:11:23,238 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-21 18:11:24,051 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-21 18:11:29,775 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-21 18:11:35,491 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-11-21 18:11:35,491 INFO [loop_until]: OK (rc = 0) 2024-11-21 18:11:35,491 DEBUG --- stdout --- 2024-11-21 18:11:35,491 DEBUG 2024-11-21 18:11:23,947 DEBUG Creating results folder /results/gatling/benchmark-5 2024-11-21 18:11:23,955 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpmw1_27yt 2024-11-21 18:11:23,957 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-5" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=5 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpmw1_27yt/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmpmw1_27yt/target/test-classes ... [INFO] compile in 6.9 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2024-11-21 18:11:35,492 DEBUG --- stderr --- 2024-11-21 18:11:35,492 DEBUG ________________________________________________________________________________ [2024-11-21 18:11:35] benchmark-5 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2024-11-21 19:11:44] benchmark-5 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-11-21 19:11:44,516 INFO 2024-11-21 19:11:44,516 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:44,516 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:44,808 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:44,808 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:44,808 DEBUG --- stdout --- 2024-11-21 19:11:44,808 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:44,808 DEBUG --- stderr --- 2024-11-21 19:11:44,808 DEBUG 2024-11-21 19:11:44,808 INFO 2024-11-21 19:11:44,808 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- rm -f /results/orders/order.json 2024-11-21 19:11:44,808 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-21 19:11:45,572 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:45,572 DEBUG --- stdout --- 2024-11-21 19:11:45,572 DEBUG 2024-11-21 19:11:45,572 DEBUG --- stderr --- 2024-11-21 19:11:45,572 DEBUG Order ran during 1h ________________________________________________________________________________ [2024-11-21 19:11:45] benchmark-5 download_logs : Download individual order files ________________________________________________________________________________ 2024-11-21 19:11:45 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/order.json 2024-11-21 19:11:45,573 INFO 2024-11-21 19:11:45,573 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:45,573 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:45,845 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:45,845 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:45,845 DEBUG --- stdout --- 2024-11-21 19:11:45,845 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:45,845 DEBUG --- stderr --- 2024-11-21 19:11:45,845 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-21 19:11:45,846 INFO 2024-11-21 19:11:45,846 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:45,846 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:46,120 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:46,120 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:46,120 DEBUG --- stdout --- 2024-11-21 19:11:46,120 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:46,120 DEBUG --- stderr --- 2024-11-21 19:11:46,120 DEBUG 2024-11-21 19:11:46,120 INFO 2024-11-21 19:11:46,121 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-5/rc.txt" ]; then echo "/results/orders/benchmark-5/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-5/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-5/rc.txt file found" 2024-11-21 19:11:46,121 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-21 19:11:46,901 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-21 19:11:46,901 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:46,901 DEBUG --- stdout --- 2024-11-21 19:11:46,901 DEBUG /results/orders/benchmark-5/rc.txt file found 2024-11-21 19:11:46,901 DEBUG --- stderr --- 2024-11-21 19:11:46,901 DEBUG 2024-11-21 19:11:46,901 INFO 2024-11-21 19:11:46,901 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:46,902 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:47,195 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:47,195 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:47,195 DEBUG --- stdout --- 2024-11-21 19:11:47,195 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:47,195 DEBUG --- stderr --- 2024-11-21 19:11:47,195 DEBUG 2024-11-21 19:11:47,195 INFO 2024-11-21 19:11:47,196 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-5/rc.txt 2024-11-21 19:11:47,974 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-21 19:11:47,974 DEBUG --- stdout --- 2024-11-21 19:11:47,974 DEBUG 4 /results/orders/benchmark-5/rc.txt 2024-11-21 19:11:47,974 DEBUG --- stderr --- 2024-11-21 19:11:47,974 DEBUG 2024-11-21 19:11:47,974 INFO - Download file (size 4k) 2024-11-21 19:11:47,974 INFO 2024-11-21 19:11:47,974 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:47,974 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:48,247 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:48,247 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:48,247 DEBUG --- stdout --- 2024-11-21 19:11:48,248 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:48,248 DEBUG --- stderr --- 2024-11-21 19:11:48,248 DEBUG source : /results/orders/benchmark-5/rc.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/rc.txt 2024-11-21 19:11:48,248 INFO 2024-11-21 19:11:48,248 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:48,248 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:48,522 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:48,522 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:48,522 DEBUG --- stdout --- 2024-11-21 19:11:48,522 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:48,522 DEBUG --- stderr --- 2024-11-21 19:11:48,522 DEBUG 2024-11-21 19:11:48,522 INFO 2024-11-21 19:11:48,522 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-5/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/rc.txt 2024-11-21 19:11:48,522 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-21 19:11:49,265 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:49,265 DEBUG --- stdout --- 2024-11-21 19:11:49,265 DEBUG tar: Removing leading `/' from member names 2024-11-21 19:11:49,265 DEBUG --- stderr --- 2024-11-21 19:11:49,265 DEBUG 2024-11-21 19:11:49,265 INFO 2024-11-21 19:11:49,265 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:49,265 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:49,540 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:49,540 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:49,540 DEBUG --- stdout --- 2024-11-21 19:11:49,540 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:49,540 DEBUG --- stderr --- 2024-11-21 19:11:49,540 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-21 19:11:49,541 INFO 2024-11-21 19:11:49,541 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:49,541 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:49,815 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:49,815 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:49,815 DEBUG --- stdout --- 2024-11-21 19:11:49,815 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:49,815 DEBUG --- stderr --- 2024-11-21 19:11:49,815 DEBUG 2024-11-21 19:11:49,816 INFO 2024-11-21 19:11:49,816 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-5/stderr.txt" ]; then echo "/results/orders/benchmark-5/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-5/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-5/stderr.txt file found" 2024-11-21 19:11:49,816 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-21 19:11:50,595 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-21 19:11:50,595 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:50,595 DEBUG --- stdout --- 2024-11-21 19:11:50,595 DEBUG /results/orders/benchmark-5/stderr.txt file found 2024-11-21 19:11:50,595 DEBUG --- stderr --- 2024-11-21 19:11:50,595 DEBUG 2024-11-21 19:11:50,595 INFO 2024-11-21 19:11:50,595 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:50,595 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:50,867 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:50,867 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:50,867 DEBUG --- stdout --- 2024-11-21 19:11:50,867 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:50,867 DEBUG --- stderr --- 2024-11-21 19:11:50,867 DEBUG 2024-11-21 19:11:50,867 INFO 2024-11-21 19:11:50,868 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-5/stderr.txt 2024-11-21 19:11:51,649 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-21 19:11:51,649 DEBUG --- stdout --- 2024-11-21 19:11:51,649 DEBUG 0 /results/orders/benchmark-5/stderr.txt 2024-11-21 19:11:51,649 DEBUG --- stderr --- 2024-11-21 19:11:51,649 DEBUG 2024-11-21 19:11:51,649 INFO - Download file (size 0k) 2024-11-21 19:11:51,649 INFO 2024-11-21 19:11:51,649 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:51,649 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:51,921 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:51,922 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:51,922 DEBUG --- stdout --- 2024-11-21 19:11:51,922 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:51,922 DEBUG --- stderr --- 2024-11-21 19:11:51,922 DEBUG source : /results/orders/benchmark-5/stderr.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/stderr.txt 2024-11-21 19:11:51,922 INFO 2024-11-21 19:11:51,922 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:51,922 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:52,195 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:52,195 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:52,195 DEBUG --- stdout --- 2024-11-21 19:11:52,195 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:52,195 DEBUG --- stderr --- 2024-11-21 19:11:52,195 DEBUG 2024-11-21 19:11:52,196 INFO 2024-11-21 19:11:52,196 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-5/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/stderr.txt 2024-11-21 19:11:52,196 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-21 19:11:52,940 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:52,940 DEBUG --- stdout --- 2024-11-21 19:11:52,940 DEBUG tar: Removing leading `/' from member names 2024-11-21 19:11:52,940 DEBUG --- stderr --- 2024-11-21 19:11:52,940 DEBUG 2024-11-21 19:11:52,940 INFO 2024-11-21 19:11:52,940 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:52,940 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:53,214 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:53,214 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:53,214 DEBUG --- stdout --- 2024-11-21 19:11:53,214 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:53,214 DEBUG --- stderr --- 2024-11-21 19:11:53,214 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-21 19:11:53,214 INFO 2024-11-21 19:11:53,214 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:53,214 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:53,489 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:53,489 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:53,489 DEBUG --- stdout --- 2024-11-21 19:11:53,489 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:53,489 DEBUG --- stderr --- 2024-11-21 19:11:53,489 DEBUG 2024-11-21 19:11:53,491 INFO 2024-11-21 19:11:53,491 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-5/stdout.txt" ]; then echo "/results/orders/benchmark-5/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-5/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-5/stdout.txt file found" 2024-11-21 19:11:53,491 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-21 19:11:54,309 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-21 19:11:54,309 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:54,309 DEBUG --- stdout --- 2024-11-21 19:11:54,309 DEBUG /results/orders/benchmark-5/stdout.txt file found 2024-11-21 19:11:54,309 DEBUG --- stderr --- 2024-11-21 19:11:54,309 DEBUG 2024-11-21 19:11:54,310 INFO 2024-11-21 19:11:54,310 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:54,310 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:54,583 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:54,583 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:54,583 DEBUG --- stdout --- 2024-11-21 19:11:54,583 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:54,583 DEBUG --- stderr --- 2024-11-21 19:11:54,583 DEBUG 2024-11-21 19:11:54,583 INFO 2024-11-21 19:11:54,583 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-5/stdout.txt 2024-11-21 19:11:55,411 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-21 19:11:55,411 DEBUG --- stdout --- 2024-11-21 19:11:55,411 DEBUG 3124 /results/orders/benchmark-5/stdout.txt 2024-11-21 19:11:55,411 DEBUG --- stderr --- 2024-11-21 19:11:55,411 DEBUG 2024-11-21 19:11:55,411 INFO - Download file (size 3124k) 2024-11-21 19:11:55,411 INFO 2024-11-21 19:11:55,411 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:55,411 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:55,685 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:55,685 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:55,685 DEBUG --- stdout --- 2024-11-21 19:11:55,685 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:55,685 DEBUG --- stderr --- 2024-11-21 19:11:55,685 DEBUG source : /results/orders/benchmark-5/stdout.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/stdout.txt 2024-11-21 19:11:55,685 INFO 2024-11-21 19:11:55,685 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:55,685 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:55,959 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:55,959 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:55,959 DEBUG --- stdout --- 2024-11-21 19:11:55,959 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:55,959 DEBUG --- stderr --- 2024-11-21 19:11:55,959 DEBUG 2024-11-21 19:11:55,960 INFO 2024-11-21 19:11:55,960 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-5/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/stdout.txt 2024-11-21 19:11:55,960 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-21 19:11:57,140 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:57,140 DEBUG --- stdout --- 2024-11-21 19:11:57,140 DEBUG tar: Removing leading `/' from member names 2024-11-21 19:11:57,140 DEBUG --- stderr --- 2024-11-21 19:11:57,140 DEBUG ________________________________________________________________________________ [2024-11-21 19:11:57] benchmark-5 show_cmd : Display order command ________________________________________________________________________________ 2024-11-21 19:11:57,140 INFO 2024-11-21 19:11:57,140 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:57,140 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:57,418 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:57,418 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:57,418 DEBUG --- stdout --- 2024-11-21 19:11:57,418 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:57,418 DEBUG --- stderr --- 2024-11-21 19:11:57,418 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-21 19:11:57,419 INFO 2024-11-21 19:11:57,419 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:57,419 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:57,754 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:57,754 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:57,754 DEBUG --- stdout --- 2024-11-21 19:11:57,754 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:57,754 DEBUG --- stderr --- 2024-11-21 19:11:57,754 DEBUG 2024-11-21 19:11:57,755 INFO 2024-11-21 19:11:57,755 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-5/cmd.txt" ]; then echo "/results/orders/benchmark-5/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-5/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-5/cmd.txt file found" 2024-11-21 19:11:57,755 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-21 19:11:58,578 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-21 19:11:58,578 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:58,578 DEBUG --- stdout --- 2024-11-21 19:11:58,579 DEBUG /results/orders/benchmark-5/cmd.txt file found 2024-11-21 19:11:58,579 DEBUG --- stderr --- 2024-11-21 19:11:58,579 DEBUG 2024-11-21 19:11:58,579 INFO 2024-11-21 19:11:58,579 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:58,579 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:58,850 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:58,850 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:58,850 DEBUG --- stdout --- 2024-11-21 19:11:58,850 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:58,850 DEBUG --- stderr --- 2024-11-21 19:11:58,850 DEBUG 2024-11-21 19:11:58,850 INFO 2024-11-21 19:11:58,850 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-5/cmd.txt 2024-11-21 19:11:59,630 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-21 19:11:59,630 DEBUG --- stdout --- 2024-11-21 19:11:59,630 DEBUG 4 /results/orders/benchmark-5/cmd.txt 2024-11-21 19:11:59,630 DEBUG --- stderr --- 2024-11-21 19:11:59,630 DEBUG 2024-11-21 19:11:59,630 INFO - Download file (size 4k) 2024-11-21 19:11:59,630 INFO 2024-11-21 19:11:59,630 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:59,631 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:11:59,905 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:11:59,905 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:11:59,905 DEBUG --- stdout --- 2024-11-21 19:11:59,905 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:11:59,905 DEBUG --- stderr --- 2024-11-21 19:11:59,905 DEBUG source : /results/orders/benchmark-5/cmd.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/cmd.txt 2024-11-21 19:11:59,905 INFO 2024-11-21 19:11:59,905 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 19:11:59,905 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 19:12:00,176 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 19:12:00,176 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:12:00,176 DEBUG --- stdout --- 2024-11-21 19:12:00,176 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 19:12:00,176 DEBUG --- stderr --- 2024-11-21 19:12:00,176 DEBUG 2024-11-21 19:12:00,177 INFO 2024-11-21 19:12:00,177 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-5/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/cmd.txt 2024-11-21 19:12:00,177 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-21 19:12:00,921 INFO [loop_until]: OK (rc = 0) 2024-11-21 19:12:00,921 DEBUG --- stdout --- 2024-11-21 19:12:00,922 DEBUG tar: Removing leading `/' from member names 2024-11-21 19:12:00,922 DEBUG --- stderr --- 2024-11-21 19:12:00,922 DEBUG 2024-11-21 19:12:00,922 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/cmd.txt is small (1 lines), printing all lines: 2024-11-21 19:12:00,922 DEBUG ----- output ----- 2024-11-21 19:12:00,922 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-5" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=5 -Duser_password=Pa_ssw0rd" 2024-11-21 19:12:00,922 INFO ________________________________________________________________________________ [2024-11-21 19:12:00] benchmark-5 show_rc : Display rc order ________________________________________________________________________________ 2024-11-21 19:12:00,922 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/rc.txt is small (1 lines), printing all lines: 2024-11-21 19:12:00,922 DEBUG ----- output ----- 2024-11-21 19:12:00,922 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-11-21 19:12:00,922 INFO ________________________________________________________________________________ [2024-11-21 19:12:00] benchmark-5 show_stdout : Display stdout order ________________________________________________________________________________ 2024-11-21 19:12:00,926 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/stdout.txt is 41825 lines): 2024-11-21 19:12:00,926 DEBUG ----- output ----- 2024-11-21 19:12:00,927 INFO 2024-11-21 18:11:23,947 DEBUG Creating results folder /results/gatling/benchmark-5 2024-11-21 19:12:00,927 INFO 2024-11-21 18:11:23,955 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpmw1_27yt 2024-11-21 19:12:00,927 INFO 2024-11-21 18:11:23,957 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-5" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=5 -Duser_password=**** 2024-11-21 19:12:00,927 INFO [INFO] Scanning for projects... 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2024-11-21 19:12:00,927 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2024-11-21 19:12:00,927 INFO [INFO] from pom.xml 2024-11-21 19:12:00,927 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2024-11-21 19:12:00,927 INFO [INFO] skip non existing resourceDirectory /tmp/tmpmw1_27yt/src/main/resources 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2024-11-21 19:12:00,927 INFO [INFO] No sources to compile 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2024-11-21 19:12:00,927 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2024-11-21 19:12:00,927 INFO [INFO] Nothing to compile - all classes are up to date. 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2024-11-21 19:12:00,927 INFO [INFO] compiling 38 Scala sources to /tmp/tmpmw1_27yt/target/test-classes ... 2024-11-21 19:12:00,927 INFO [INFO] compile in 6.9 s 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] 2024-11-21 19:12:00,927 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2024-11-21 19:12:00,927 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2024-11-21 19:12:00,927 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2024-11-21 19:12:00,927 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2024-11-21 19:12:00,927 INFO Simulation com.forgerock.pyrock.Loadtest started... 2024-11-21 19:12:00,927 INFO 2024-11-21 19:12:00,927 INFO ================================================================================ 2024-11-21 19:12:00,927 INFO 2024-11-21 18:11:39 GMT 5s elapsed 2024-11-21 19:12:00,927 INFO ---- Requests ------------------------------------------------------------------ 2024-11-21 19:12:00,927 INFO > Global (OK=1 KO=0 ) 2024-11-21 19:12:00,927 INFO > restLoginInitiate (OK=1 KO=0 ) 2024-11-21 19:12:00,927 INFO 2024-11-21 19:12:00,927 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-21 19:12:00,927 INFO [- ] 0% 2024-11-21 19:12:00,927 INFO waiting: 18202 / active: 2 / done: 0 2024-11-21 19:12:00,927 INFO ================================================================================ 2024-11-21 19:12:00,927 INFO 2024-11-21 19:12:00,927 INFO 2024-11-21 19:12:00,927 INFO ================================================================================ 2024-11-21 19:12:00,927 INFO 2024-11-21 18:11:44 GMT 10s elapsed 2024-11-21 19:12:00,927 INFO ---- Requests ------------------------------------------------------------------ 2024-11-21 19:12:00,927 INFO > Global (OK=109 KO=0 ) 2024-11-21 19:12:00,927 INFO > restLoginInitiate (OK=8 KO=0 ) 2024-11-21 19:12:00,927 INFO > restLoginUsernamePasswordCallback (OK=8 KO=0 ) 2024-11-21 19:12:00,927 INFO > Skip 2FA (OK=4 KO=0 ) 2024-11-21 19:12:00,927 INFO > User Authorize PKCE stage (OK=9 KO=0 ) 2024-11-21 19:12:00,927 INFO > User AccessToken PKCE stage (OK=9 KO=0 ) 2024-11-21 19:12:00,927 INFO > GetUUid (OK=2 KO=0 ) 2024-11-21 19:12:00,927 INFO > GetOpenidConfig (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI-Post-Login - stage 1 (OK=3 KO=0 ) 2024-11-21 19:12:00,928 INFO > CreatePolicy (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=3 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI AM idFromSession (OK=3 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI AM validateGoto (OK=3 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI-Post-Login - stage 2 (OK=3 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=3 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI Enduser appAuthHelper2 (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI Enduser appAuthHelper1 (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > RootUserinfo (OK=7 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI-Post-Login - stage 3 (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI Enduser sessioncheck (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM uiconfig (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM version (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM features (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM login (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM privilege (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM dashboard (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM managed user schema (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM user (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI IDM oidcToken (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > userinfo (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI-Logout (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI-Logout Redirect 1 (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI AM endsession (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI AM revoke1 (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO > UI AM revoke2 (OK=2 KO=0 ) 2024-11-21 19:12:00,928 INFO 2024-11-21 19:12:00,928 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-21 19:12:00,928 INFO [- ] 0% 2024-11-21 19:12:00,928 INFO waiting: 18196 / active: 6 / done: 2 2024-11-21 19:12:00,928 INFO ================================================================================ 2024-11-21 19:12:00,928 INFO 2024-11-21 19:12:00,928 INFO 2024-11-21 19:12:00,928 INFO ================================================================================ 2024-11-21 19:12:00,928 INFO 2024-11-21 18:11:49 GMT 15s elapsed 2024-11-21 19:12:00,928 INFO ---- Requests ------------------------------------------------------------------ 2024-11-21 19:12:00,928 INFO > Global (OK=206 KO=0 ) 2024-11-21 19:12:00,928 INFO > restLoginInitiate (OK=17 KO=0 ) 2024-11-21 19:12:00,928 INFO [...] 2024-11-21 19:12:00,934 INFO ---- Errors -------------------------------------------------------------------- 2024-11-21 19:12:00,934 INFO > tokenUserinfo: No attribute named 'access_token' is defined 1 (50.00%) 2024-11-21 19:12:00,934 INFO > status.find.is(302), but actually found 502 1 (50.00%) 2024-11-21 19:12:00,934 INFO 2024-11-21 19:12:00,934 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-21 19:12:00,934 INFO [#########################################################################-] 99% 2024-11-21 19:12:00,934 INFO waiting: 140 / active: 32 / done: 18032 2024-11-21 19:12:00,934 INFO ================================================================================ 2024-11-21 19:12:00,934 INFO 2024-11-21 19:12:00,934 INFO 2024-11-21 19:12:00,934 INFO ================================================================================ 2024-11-21 19:12:00,934 INFO 2024-11-21 19:11:34 GMT 3600s elapsed 2024-11-21 19:12:00,934 INFO ---- Requests ------------------------------------------------------------------ 2024-11-21 19:12:00,934 INFO > Global (OK=254922 KO=1 ) 2024-11-21 19:12:00,934 INFO > restLoginInitiate (OK=17411 KO=0 ) 2024-11-21 19:12:00,934 INFO > restLoginUsernamePasswordCallback (OK=17411 KO=0 ) 2024-11-21 19:12:00,934 INFO > Skip 2FA (OK=9669 KO=0 ) 2024-11-21 19:12:00,934 INFO > User Authorize PKCE stage (OK=21357 KO=1 ) 2024-11-21 19:12:00,934 INFO > User AccessToken PKCE stage (OK=21356 KO=0 ) 2024-11-21 19:12:00,934 INFO > GetUUid (OK=5846 KO=0 ) 2024-11-21 19:12:00,934 INFO > GetOpenidConfig (OK=17498 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI-Post-Login - stage 1 (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > CreatePolicy (OK=5846 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI AM idFromSession (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI AM validateGoto (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI-Post-Login - stage 2 (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI Enduser appAuthHelper2 (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI Enduser appAuthHelper1 (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > RootUserinfo (OK=12756 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI-Post-Login - stage 3 (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI Enduser sessioncheck (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI IDM uiconfig (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI IDM version (OK=3949 KO=0 ) 2024-11-21 19:12:00,934 INFO > UI IDM features (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI IDM login (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI IDM privilege (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI IDM dashboard (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI IDM managed user schema (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI IDM user (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI IDM oidcToken (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > userinfo (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI-Logout (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI-Logout Redirect 1 (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI AM endsession (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI AM revoke1 (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > UI AM revoke2 (OK=3949 KO=0 ) 2024-11-21 19:12:00,935 INFO > tokenUserinfo (OK=3790 KO=0 ) 2024-11-21 19:12:00,935 INFO > ReadPolicy (OK=5831 KO=0 ) 2024-11-21 19:12:00,935 INFO > loginTreeWorkflow_restLoginInitiate (OK=652 KO=0 ) 2024-11-21 19:12:00,935 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=652 KO=0 ) 2024-11-21 19:12:00,935 INFO > DeletePolicy (OK=5821 KO=0 ) 2024-11-21 19:12:00,935 INFO > getIdToken (OK=1270 KO=0 ) 2024-11-21 19:12:00,935 INFO > getIdToken Redirect 1 (OK=1270 KO=0 ) 2024-11-21 19:12:00,935 INFO > createOrganization (OK=1270 KO=0 ) 2024-11-21 19:12:00,935 INFO > queryOrganization (OK=1270 KO=0 ) 2024-11-21 19:12:00,935 INFO > deleteOrganization (OK=1270 KO=0 ) 2024-11-21 19:12:00,935 INFO > restloginProgressiveProfileCallback (OK=2 KO=0 ) 2024-11-21 19:12:00,935 INFO ---- Errors -------------------------------------------------------------------- 2024-11-21 19:12:00,935 INFO > tokenUserinfo: No attribute named 'access_token' is defined 1 (50.00%) 2024-11-21 19:12:00,935 INFO > status.find.is(302), but actually found 502 1 (50.00%) 2024-11-21 19:12:00,935 INFO 2024-11-21 19:12:00,935 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-21 19:12:00,935 INFO [#########################################################################-] 99% 2024-11-21 19:12:00,935 INFO waiting: 140 / active: 32 / done: 18032 2024-11-21 19:12:00,935 INFO ================================================================================ 2024-11-21 19:12:00,935 INFO 2024-11-21 19:12:00,935 INFO 19:11:34.927 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 18064: j.i.IOException: Premature close 2024-11-21 19:12:00,935 INFO 19:11:34.928 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-21 19:12:00,935 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-21 19:12:00,935 INFO Request: 2024-11-21 19:12:00,935 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-21 19:12:00,935 INFO ========================= 2024-11-21 19:12:00,935 INFO Session: 2024-11-21 19:12:00,935 INFO Session(idc.benchmark.Mix2024,18064,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.86210, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@19d97df0, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9, password -> Pa_ssw0rd, fake-ip -> 93.52.125.63, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@5c1e3bce),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x0000781ba869a0e0@3f7b5e18,io.netty.channel.epoll.EpollEventLoop@636e8cc) 2024-11-21 19:12:00,935 INFO ========================= 2024-11-21 19:12:00,935 INFO HTTP request: 2024-11-21 19:12:00,935 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/authenticate 2024-11-21 19:12:00,935 INFO headers: 2024-11-21 19:12:00,935 INFO accept: application/json 2024-11-21 19:12:00,935 INFO content-type: application/json 2024-11-21 19:12:00,935 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9 2024-11-21 19:12:00,935 INFO X-Forwarded-For: 93.52.125.63 2024-11-21 19:12:00,935 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-21 19:12:00,935 INFO content-length: 0 2024-11-21 19:12:00,935 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-21 19:12:00,935 INFO ========================= 2024-11-21 19:12:00,935 INFO HTTP response: 2024-11-21 19:12:00,935 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-21 19:12:00,935 INFO 19:11:34.928 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-133' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-21 19:12:00,935 INFO [INFO] ------------------------------------------------------------------------ 2024-11-21 19:12:00,935 INFO [INFO] BUILD SUCCESS 2024-11-21 19:12:00,935 INFO [INFO] ------------------------------------------------------------------------ 2024-11-21 19:12:00,935 INFO [INFO] Total time: 01:00 h 2024-11-21 19:12:00,935 INFO [INFO] Finished at: 2024-11-21T19:11:34Z 2024-11-21 19:12:00,935 INFO [INFO] ------------------------------------------------------------------------ 2024-11-21 19:12:00,936 INFO 2024-11-21 19:11:35,012 INFO Gatling simulation run ended successfully 2024-11-21 19:12:00,936 INFO 2024-11-21 19:11:35,012 DEBUG No archive name provided. No archive will be created 2024-11-21 19:12:00,936 INFO ________________________________________________________________________________ [2024-11-21 19:12:00] benchmark-5 show_stderr : Display stderr order ________________________________________________________________________________ 2024-11-21 19:12:00,936 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-5/stderr.txt is small (0 lines), printing all lines: 2024-11-21 19:12:00,936 DEBUG ----- output ----- 2024-11-21 19:12:00,936 DEBUG 2024-11-21 19:12:00,936 INFO ________________________________________________________________________________ [2024-11-21 19:12:00] benchmark-5 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-11-21 19:12:00] benchmark-5 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-11-21 19:12:00] benchmark-5 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped