--Task-- name: benchmark-40 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-10'] preceding_task: benchmark-10 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=selfr40-', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 40} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-11-20 20:08:58] benchmark-40 pre : N/A ________________________________________________________________________________ 2024-11-20 20:08:58 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2024-11-20 20:08:58 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-40/stdout.txt Pod log : /results/orders/benchmark-40 2024-11-20 20:08:58,410 INFO 2024-11-20 20:08:58,410 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:58,410 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:58,688 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:58,688 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:58,688 DEBUG --- stdout --- 2024-11-20 20:08:58,688 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:58,688 DEBUG --- stderr --- 2024-11-20 20:08:58,688 DEBUG ________________________________________________________________________________ [2024-11-20 20:08:58] benchmark-40 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-11-20 20:08:58,688 INFO 2024-11-20 20:08:58,688 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:58,688 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:58,963 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:58,964 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:58,964 DEBUG --- stdout --- 2024-11-20 20:08:58,964 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:58,964 DEBUG --- stderr --- 2024-11-20 20:08:58,964 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-40" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=selfr40- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2024-11-20 20:08:58] benchmark-40 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-11-20 20:08:58,964 INFO 2024-11-20 20:08:58,964 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:58,964 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:59,238 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:59,238 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:59,238 DEBUG --- stdout --- 2024-11-20 20:08:59,238 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:59,238 DEBUG --- stderr --- 2024-11-20 20:08:59,238 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/order.json { "name": "benchmark-40", "command": " /lodestar/lodestar.py run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-benchmark\" --results-folder=\"/results/gatling/benchmark-40\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=selfr40- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-40" } ________________________________________________________________________________ [2024-11-20 20:08:59] benchmark-40 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-11-20 20:08:59,241 INFO 2024-11-20 20:08:59,241 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-11-20 20:08:59,241 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-20 20:08:59,454 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 20:08:59,454 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:59,455 DEBUG --- stdout --- 2024-11-20 20:08:59,455 DEBUG WAITING 2024-11-20 20:08:59,455 DEBUG --- stderr --- 2024-11-20 20:08:59,455 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 34 0 --:--:-- --:--:-- --:--:-- 34 ________________________________________________________________________________ [2024-11-20 20:08:59] benchmark-40 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-11-20 20:08:59,456 INFO 2024-11-20 20:08:59,456 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:59,456 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:59,727 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:59,727 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:59,727 DEBUG --- stdout --- 2024-11-20 20:08:59,727 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:59,727 DEBUG --- stderr --- 2024-11-20 20:08:59,727 DEBUG 2024-11-20 20:08:59,728 INFO 2024-11-20 20:08:59,728 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/order.json overseer-0-6644bb6697-rchxr:/results/orders/order.json 2024-11-20 20:08:59,728 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 20:09:01,083 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:09:01,083 DEBUG --- stdout --- 2024-11-20 20:09:01,083 DEBUG 2024-11-20 20:09:01,083 DEBUG --- stderr --- 2024-11-20 20:09:01,083 DEBUG Order has been successfully forwarded to overseer 2024-11-20 20:09:01 - INFO: Check if Gatling simulation started successfully 2024-11-20 20:09:01,084 INFO 2024-11-20 20:09:01,084 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:09:01,084 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:09:01,357 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:09:01,357 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:09:01,357 DEBUG --- stdout --- 2024-11-20 20:09:01,357 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:09:01,357 DEBUG --- stderr --- 2024-11-20 20:09:01,357 DEBUG 2024-11-20 20:09:01,358 INFO 2024-11-20 20:09:01,358 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- head --lines 5000 /results/orders/benchmark-40/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2024-11-20 20:09:01,358 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-20 20:09:02,079 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-20 20:09:07,802 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-20 20:09:13,520 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-11-20 20:09:13,520 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:09:13,520 DEBUG --- stdout --- 2024-11-20 20:09:13,520 DEBUG 2024-11-20 20:09:01,958 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmph98afutm 2024-11-20 20:09:01,960 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-40" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=selfr40- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmph98afutm/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmph98afutm/target/test-classes ... [INFO] compile in 6.8 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2024-11-20 20:09:13,520 DEBUG --- stderr --- 2024-11-20 20:09:13,520 DEBUG ________________________________________________________________________________ [2024-11-20 20:09:13] benchmark-40 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 07s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2024-11-20 21:09:22] benchmark-40 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-11-20 21:09:22,259 INFO 2024-11-20 21:09:22,260 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:22,260 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:22,555 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:22,555 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:22,555 DEBUG --- stdout --- 2024-11-20 21:09:22,555 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:22,555 DEBUG --- stderr --- 2024-11-20 21:09:22,555 DEBUG 2024-11-20 21:09:22,555 INFO 2024-11-20 21:09:22,555 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- rm -f /results/orders/order.json 2024-11-20 21:09:22,555 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 21:09:23,321 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:23,321 DEBUG --- stdout --- 2024-11-20 21:09:23,321 DEBUG 2024-11-20 21:09:23,321 DEBUG --- stderr --- 2024-11-20 21:09:23,321 DEBUG Order ran during 1h ________________________________________________________________________________ [2024-11-20 21:09:23] benchmark-40 download_logs : Download individual order files ________________________________________________________________________________ 2024-11-20 21:09:23 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/order.json 2024-11-20 21:09:23,323 INFO 2024-11-20 21:09:23,323 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:23,323 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:23,594 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:23,594 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:23,594 DEBUG --- stdout --- 2024-11-20 21:09:23,594 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:23,594 DEBUG --- stderr --- 2024-11-20 21:09:23,594 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-20 21:09:23,594 INFO 2024-11-20 21:09:23,594 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:23,594 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:23,870 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:23,870 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:23,870 DEBUG --- stdout --- 2024-11-20 21:09:23,870 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:23,870 DEBUG --- stderr --- 2024-11-20 21:09:23,870 DEBUG 2024-11-20 21:09:23,871 INFO 2024-11-20 21:09:23,871 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-40/rc.txt" ]; then echo "/results/orders/benchmark-40/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-40/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-40/rc.txt file found" 2024-11-20 21:09:23,871 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 21:09:24,650 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 21:09:24,650 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:24,650 DEBUG --- stdout --- 2024-11-20 21:09:24,650 DEBUG /results/orders/benchmark-40/rc.txt file found 2024-11-20 21:09:24,650 DEBUG --- stderr --- 2024-11-20 21:09:24,650 DEBUG 2024-11-20 21:09:24,650 INFO 2024-11-20 21:09:24,650 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:24,650 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:24,920 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:24,920 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:24,920 DEBUG --- stdout --- 2024-11-20 21:09:24,920 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:24,920 DEBUG --- stderr --- 2024-11-20 21:09:24,920 DEBUG 2024-11-20 21:09:24,920 INFO 2024-11-20 21:09:24,920 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-40/rc.txt 2024-11-20 21:09:25,702 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-20 21:09:25,702 DEBUG --- stdout --- 2024-11-20 21:09:25,702 DEBUG 4 /results/orders/benchmark-40/rc.txt 2024-11-20 21:09:25,702 DEBUG --- stderr --- 2024-11-20 21:09:25,702 DEBUG 2024-11-20 21:09:25,702 INFO - Download file (size 4k) 2024-11-20 21:09:25,703 INFO 2024-11-20 21:09:25,703 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:25,703 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:25,972 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:25,972 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:25,972 DEBUG --- stdout --- 2024-11-20 21:09:25,972 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:25,972 DEBUG --- stderr --- 2024-11-20 21:09:25,972 DEBUG source : /results/orders/benchmark-40/rc.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/rc.txt 2024-11-20 21:09:25,973 INFO 2024-11-20 21:09:25,973 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:25,973 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:26,242 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:26,242 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:26,242 DEBUG --- stdout --- 2024-11-20 21:09:26,242 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:26,242 DEBUG --- stderr --- 2024-11-20 21:09:26,242 DEBUG 2024-11-20 21:09:26,243 INFO 2024-11-20 21:09:26,243 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-40/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/rc.txt 2024-11-20 21:09:26,243 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-20 21:09:26,986 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:26,986 DEBUG --- stdout --- 2024-11-20 21:09:26,986 DEBUG tar: Removing leading `/' from member names 2024-11-20 21:09:26,986 DEBUG --- stderr --- 2024-11-20 21:09:26,986 DEBUG 2024-11-20 21:09:26,986 INFO 2024-11-20 21:09:26,986 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:26,986 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:27,258 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:27,258 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:27,259 DEBUG --- stdout --- 2024-11-20 21:09:27,259 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:27,259 DEBUG --- stderr --- 2024-11-20 21:09:27,259 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-20 21:09:27,259 INFO 2024-11-20 21:09:27,259 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:27,259 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:27,531 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:27,531 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:27,531 DEBUG --- stdout --- 2024-11-20 21:09:27,531 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:27,531 DEBUG --- stderr --- 2024-11-20 21:09:27,531 DEBUG 2024-11-20 21:09:27,531 INFO 2024-11-20 21:09:27,532 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-40/stderr.txt" ]; then echo "/results/orders/benchmark-40/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-40/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-40/stderr.txt file found" 2024-11-20 21:09:27,532 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 21:09:28,308 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 21:09:28,308 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:28,308 DEBUG --- stdout --- 2024-11-20 21:09:28,308 DEBUG /results/orders/benchmark-40/stderr.txt file found 2024-11-20 21:09:28,308 DEBUG --- stderr --- 2024-11-20 21:09:28,308 DEBUG 2024-11-20 21:09:28,308 INFO 2024-11-20 21:09:28,308 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:28,308 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:28,580 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:28,580 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:28,580 DEBUG --- stdout --- 2024-11-20 21:09:28,580 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:28,580 DEBUG --- stderr --- 2024-11-20 21:09:28,580 DEBUG 2024-11-20 21:09:28,580 INFO 2024-11-20 21:09:28,581 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-40/stderr.txt 2024-11-20 21:09:29,366 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-20 21:09:29,366 DEBUG --- stdout --- 2024-11-20 21:09:29,366 DEBUG 0 /results/orders/benchmark-40/stderr.txt 2024-11-20 21:09:29,366 DEBUG --- stderr --- 2024-11-20 21:09:29,366 DEBUG 2024-11-20 21:09:29,366 INFO - Download file (size 0k) 2024-11-20 21:09:29,367 INFO 2024-11-20 21:09:29,367 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:29,367 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:29,638 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:29,638 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:29,638 DEBUG --- stdout --- 2024-11-20 21:09:29,638 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:29,638 DEBUG --- stderr --- 2024-11-20 21:09:29,638 DEBUG source : /results/orders/benchmark-40/stderr.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/stderr.txt 2024-11-20 21:09:29,639 INFO 2024-11-20 21:09:29,639 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:29,639 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:29,911 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:29,911 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:29,911 DEBUG --- stdout --- 2024-11-20 21:09:29,911 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:29,911 DEBUG --- stderr --- 2024-11-20 21:09:29,911 DEBUG 2024-11-20 21:09:29,912 INFO 2024-11-20 21:09:29,912 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-40/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/stderr.txt 2024-11-20 21:09:29,912 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-20 21:09:30,651 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:30,651 DEBUG --- stdout --- 2024-11-20 21:09:30,651 DEBUG tar: Removing leading `/' from member names 2024-11-20 21:09:30,651 DEBUG --- stderr --- 2024-11-20 21:09:30,651 DEBUG 2024-11-20 21:09:30,652 INFO 2024-11-20 21:09:30,652 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:30,652 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:30,961 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:30,961 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:30,961 DEBUG --- stdout --- 2024-11-20 21:09:30,961 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:30,961 DEBUG --- stderr --- 2024-11-20 21:09:30,961 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-20 21:09:30,961 INFO 2024-11-20 21:09:30,961 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:30,961 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:31,233 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:31,233 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:31,233 DEBUG --- stdout --- 2024-11-20 21:09:31,233 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:31,233 DEBUG --- stderr --- 2024-11-20 21:09:31,233 DEBUG 2024-11-20 21:09:31,234 INFO 2024-11-20 21:09:31,234 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-40/stdout.txt" ]; then echo "/results/orders/benchmark-40/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-40/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-40/stdout.txt file found" 2024-11-20 21:09:31,234 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 21:09:32,011 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 21:09:32,011 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:32,011 DEBUG --- stdout --- 2024-11-20 21:09:32,011 DEBUG /results/orders/benchmark-40/stdout.txt file found 2024-11-20 21:09:32,011 DEBUG --- stderr --- 2024-11-20 21:09:32,011 DEBUG 2024-11-20 21:09:32,012 INFO 2024-11-20 21:09:32,012 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:32,012 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:32,283 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:32,283 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:32,283 DEBUG --- stdout --- 2024-11-20 21:09:32,283 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:32,283 DEBUG --- stderr --- 2024-11-20 21:09:32,283 DEBUG 2024-11-20 21:09:32,283 INFO 2024-11-20 21:09:32,283 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-40/stdout.txt 2024-11-20 21:09:33,063 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-20 21:09:33,063 DEBUG --- stdout --- 2024-11-20 21:09:33,063 DEBUG 4028 /results/orders/benchmark-40/stdout.txt 2024-11-20 21:09:33,063 DEBUG --- stderr --- 2024-11-20 21:09:33,063 DEBUG 2024-11-20 21:09:33,063 INFO - Download file (size 4028k) 2024-11-20 21:09:33,064 INFO 2024-11-20 21:09:33,064 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:33,064 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:33,333 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:33,333 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:33,333 DEBUG --- stdout --- 2024-11-20 21:09:33,333 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:33,333 DEBUG --- stderr --- 2024-11-20 21:09:33,333 DEBUG source : /results/orders/benchmark-40/stdout.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/stdout.txt 2024-11-20 21:09:33,334 INFO 2024-11-20 21:09:33,334 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:33,334 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:33,606 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:33,606 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:33,606 DEBUG --- stdout --- 2024-11-20 21:09:33,606 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:33,606 DEBUG --- stderr --- 2024-11-20 21:09:33,606 DEBUG 2024-11-20 21:09:33,607 INFO 2024-11-20 21:09:33,607 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-40/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/stdout.txt 2024-11-20 21:09:33,607 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-20 21:09:34,833 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:34,833 DEBUG --- stdout --- 2024-11-20 21:09:34,833 DEBUG tar: Removing leading `/' from member names 2024-11-20 21:09:34,833 DEBUG --- stderr --- 2024-11-20 21:09:34,833 DEBUG ________________________________________________________________________________ [2024-11-20 21:09:34] benchmark-40 show_cmd : Display order command ________________________________________________________________________________ 2024-11-20 21:09:34,834 INFO 2024-11-20 21:09:34,834 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:34,834 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:35,105 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:35,106 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:35,106 DEBUG --- stdout --- 2024-11-20 21:09:35,106 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:35,106 DEBUG --- stderr --- 2024-11-20 21:09:35,106 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-20 21:09:35,106 INFO 2024-11-20 21:09:35,106 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:35,106 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:35,377 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:35,377 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:35,377 DEBUG --- stdout --- 2024-11-20 21:09:35,377 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:35,377 DEBUG --- stderr --- 2024-11-20 21:09:35,377 DEBUG 2024-11-20 21:09:35,378 INFO 2024-11-20 21:09:35,378 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-40/cmd.txt" ]; then echo "/results/orders/benchmark-40/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-40/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-40/cmd.txt file found" 2024-11-20 21:09:35,378 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 21:09:36,159 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 21:09:36,159 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:36,159 DEBUG --- stdout --- 2024-11-20 21:09:36,159 DEBUG /results/orders/benchmark-40/cmd.txt file found 2024-11-20 21:09:36,159 DEBUG --- stderr --- 2024-11-20 21:09:36,159 DEBUG 2024-11-20 21:09:36,159 INFO 2024-11-20 21:09:36,159 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:36,159 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:36,431 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:36,431 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:36,431 DEBUG --- stdout --- 2024-11-20 21:09:36,431 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:36,431 DEBUG --- stderr --- 2024-11-20 21:09:36,431 DEBUG 2024-11-20 21:09:36,431 INFO 2024-11-20 21:09:36,431 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-40/cmd.txt 2024-11-20 21:09:37,213 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-20 21:09:37,213 DEBUG --- stdout --- 2024-11-20 21:09:37,213 DEBUG 4 /results/orders/benchmark-40/cmd.txt 2024-11-20 21:09:37,213 DEBUG --- stderr --- 2024-11-20 21:09:37,213 DEBUG 2024-11-20 21:09:37,213 INFO - Download file (size 4k) 2024-11-20 21:09:37,213 INFO 2024-11-20 21:09:37,213 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:37,213 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:37,513 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:37,514 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:37,514 DEBUG --- stdout --- 2024-11-20 21:09:37,514 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:37,514 DEBUG --- stderr --- 2024-11-20 21:09:37,514 DEBUG source : /results/orders/benchmark-40/cmd.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/cmd.txt 2024-11-20 21:09:37,514 INFO 2024-11-20 21:09:37,514 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 21:09:37,514 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 21:09:37,789 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 21:09:37,789 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:37,789 DEBUG --- stdout --- 2024-11-20 21:09:37,789 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 21:09:37,789 DEBUG --- stderr --- 2024-11-20 21:09:37,789 DEBUG 2024-11-20 21:09:37,789 INFO 2024-11-20 21:09:37,789 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-40/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/cmd.txt 2024-11-20 21:09:37,789 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-20 21:09:38,529 INFO [loop_until]: OK (rc = 0) 2024-11-20 21:09:38,529 DEBUG --- stdout --- 2024-11-20 21:09:38,529 DEBUG tar: Removing leading `/' from member names 2024-11-20 21:09:38,529 DEBUG --- stderr --- 2024-11-20 21:09:38,529 DEBUG 2024-11-20 21:09:38,529 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/cmd.txt is small (1 lines), printing all lines: 2024-11-20 21:09:38,529 DEBUG ----- output ----- 2024-11-20 21:09:38,529 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-40" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=selfr40- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=Pa_ssw0rd" 2024-11-20 21:09:38,529 INFO ________________________________________________________________________________ [2024-11-20 21:09:38] benchmark-40 show_rc : Display rc order ________________________________________________________________________________ 2024-11-20 21:09:38,529 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/rc.txt is small (1 lines), printing all lines: 2024-11-20 21:09:38,530 DEBUG ----- output ----- 2024-11-20 21:09:38,530 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-11-20 21:09:38,530 INFO ________________________________________________________________________________ [2024-11-20 21:09:38] benchmark-40 show_stdout : Display stdout order ________________________________________________________________________________ 2024-11-20 21:09:38,535 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/stdout.txt is 54431 lines): 2024-11-20 21:09:38,535 DEBUG ----- output ----- 2024-11-20 21:09:38,535 INFO 2024-11-20 20:09:01,958 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmph98afutm 2024-11-20 21:09:38,535 INFO 2024-11-20 20:09:01,960 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-40" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=selfr40- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=**** 2024-11-20 21:09:38,535 INFO [INFO] Scanning for projects... 2024-11-20 21:09:38,535 INFO [INFO] 2024-11-20 21:09:38,535 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2024-11-20 21:09:38,535 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2024-11-20 21:09:38,535 INFO [INFO] from pom.xml 2024-11-20 21:09:38,535 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2024-11-20 21:09:38,536 INFO [INFO] skip non existing resourceDirectory /tmp/tmph98afutm/src/main/resources 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2024-11-20 21:09:38,536 INFO [INFO] No sources to compile 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2024-11-20 21:09:38,536 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2024-11-20 21:09:38,536 INFO [INFO] Nothing to compile - all classes are up to date. 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2024-11-20 21:09:38,536 INFO [INFO] compiling 38 Scala sources to /tmp/tmph98afutm/target/test-classes ... 2024-11-20 21:09:38,536 INFO [INFO] compile in 6.8 s 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] 2024-11-20 21:09:38,536 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2024-11-20 21:09:38,536 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2024-11-20 21:09:38,536 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2024-11-20 21:09:38,536 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2024-11-20 21:09:38,536 INFO Simulation com.forgerock.pyrock.Loadtest started... 2024-11-20 21:09:38,536 INFO 2024-11-20 21:09:38,536 INFO ================================================================================ 2024-11-20 21:09:38,536 INFO 2024-11-20 20:09:17 GMT 5s elapsed 2024-11-20 21:09:38,536 INFO ---- Requests ------------------------------------------------------------------ 2024-11-20 21:09:38,536 INFO > Global (OK=151 KO=0 ) 2024-11-20 21:09:38,536 INFO > restLoginInitiate (OK=15 KO=0 ) 2024-11-20 21:09:38,536 INFO > restLoginUsernamePasswordCallback (OK=15 KO=0 ) 2024-11-20 21:09:38,536 INFO > Skip 2FA (OK=6 KO=0 ) 2024-11-20 21:09:38,536 INFO > User Authorize PKCE stage (OK=16 KO=0 ) 2024-11-20 21:09:38,536 INFO > User AccessToken PKCE stage (OK=16 KO=0 ) 2024-11-20 21:09:38,536 INFO > GetUUid (OK=3 KO=0 ) 2024-11-20 21:09:38,536 INFO > GetOpenidConfig (OK=3 KO=0 ) 2024-11-20 21:09:38,536 INFO > CreatePolicy (OK=3 KO=0 ) 2024-11-20 21:09:38,536 INFO > tokenUserinfo (OK=5 KO=0 ) 2024-11-20 21:09:38,536 INFO > getIdToken (OK=3 KO=0 ) 2024-11-20 21:09:38,536 INFO > getIdToken Redirect 1 (OK=3 KO=0 ) 2024-11-20 21:09:38,536 INFO > loginTreeWorkflow_restLoginInitiate (OK=1 KO=0 ) 2024-11-20 21:09:38,536 INFO > createOrganization (OK=3 KO=0 ) 2024-11-20 21:09:38,536 INFO > queryOrganization (OK=3 KO=0 ) 2024-11-20 21:09:38,536 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2024-11-20 21:09:38,536 INFO > deleteOrganization (OK=3 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI-Post-Login - stage 1 (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI AM idFromSession (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI AM validateGoto (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI-Post-Login - stage 2 (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI Enduser appAuthHelper1 (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI Enduser appAuthHelper2 (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI-Post-Login - stage 3 (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI IDM uiconfig (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI Enduser sessioncheck (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI IDM version (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI IDM login (OK=2 KO=0 ) 2024-11-20 21:09:38,536 INFO > UI IDM privilege (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI IDM features (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI IDM dashboard (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI IDM managed user schema (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI IDM user (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI IDM oidcToken (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > userinfo (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI-Logout (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI-Logout Redirect 1 (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI AM revoke1 (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI AM endsession (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO > UI AM revoke2 (OK=2 KO=0 ) 2024-11-20 21:09:38,537 INFO 2024-11-20 21:09:38,537 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-20 21:09:38,537 INFO [- ] 0% 2024-11-20 21:09:38,537 INFO waiting: 144709 / active: 5 / done: 11 2024-11-20 21:09:38,537 INFO ================================================================================ 2024-11-20 21:09:38,537 INFO 2024-11-20 21:09:38,537 INFO 2024-11-20 21:09:38,537 INFO ================================================================================ 2024-11-20 21:09:38,537 INFO 2024-11-20 20:09:22 GMT 10s elapsed 2024-11-20 21:09:38,537 INFO ---- Requests ------------------------------------------------------------------ 2024-11-20 21:09:38,537 INFO > Global (OK=771 KO=0 ) 2024-11-20 21:09:38,537 INFO > restLoginInitiate (OK=64 KO=0 ) 2024-11-20 21:09:38,537 INFO > restLoginUsernamePasswordCallback (OK=63 KO=0 ) 2024-11-20 21:09:38,537 INFO > Skip 2FA (OK=32 KO=0 ) 2024-11-20 21:09:38,537 INFO > User Authorize PKCE stage (OK=74 KO=0 ) 2024-11-20 21:09:38,537 INFO > User AccessToken PKCE stage (OK=73 KO=0 ) 2024-11-20 21:09:38,537 INFO > GetUUid (OK=14 KO=0 ) 2024-11-20 21:09:38,537 INFO > GetOpenidConfig (OK=17 KO=0 ) 2024-11-20 21:09:38,537 INFO [...] 2024-11-20 21:09:38,545 INFO > UI IDM version (OK=30750 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI IDM login (OK=30750 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI IDM privilege (OK=30750 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI IDM features (OK=30750 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI IDM dashboard (OK=30746 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI IDM managed user schema (OK=30746 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI IDM user (OK=30746 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI IDM oidcToken (OK=30747 KO=1 ) 2024-11-20 21:09:38,545 INFO > userinfo (OK=30746 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI-Logout (OK=30747 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI-Logout Redirect 1 (OK=30747 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI AM revoke1 (OK=30746 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI AM endsession (OK=30746 KO=0 ) 2024-11-20 21:09:38,545 INFO > UI AM revoke2 (OK=30745 KO=0 ) 2024-11-20 21:09:38,545 INFO > RootUserinfo (OK=103248 KO=0 ) 2024-11-20 21:09:38,545 INFO > ReadPolicy (OK=45861 KO=3 ) 2024-11-20 21:09:38,545 INFO > DeletePolicy (OK=45799 KO=8 ) 2024-11-20 21:09:38,545 INFO > restloginProgressiveProfileCallback (OK=822 KO=0 ) 2024-11-20 21:09:38,545 INFO > loginTreeWorkflow_restloginProgressiveProfileCallback (OK=127 KO=0 ) 2024-11-20 21:09:38,545 INFO ---- Errors -------------------------------------------------------------------- 2024-11-20 21:09:38,545 INFO > tokenUserinfo: No attribute named 'access_token' is defined 806 (95.27%) 2024-11-20 21:09:38,545 INFO > status.find.in([200, 209], 304), found 404 11 ( 1.30%) 2024-11-20 21:09:38,545 INFO > status.find.in([200, 209], 304), found 409 8 ( 0.95%) 2024-11-20 21:09:38,545 INFO > status.find.is(200), but actually found 502 4 ( 0.47%) 2024-11-20 21:09:38,545 INFO > status.find.is(302), but actually found 502 3 ( 0.35%) 2024-11-20 21:09:38,545 INFO > status.find.in([200, 209], 304), found 502 3 ( 0.35%) 2024-11-20 21:09:38,545 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 2 ( 0.24%) 2024-11-20 21:09:38,545 INFO 2024-11-20 21:09:38,545 INFO > status.find.in([200, 209], 304), found 400 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO > createOrganization: No attribute named 'access_token' is defin 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO ed 2024-11-20 21:09:38,545 INFO > queryOrganization: No attribute named 'organization_id' is def 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO ined 2024-11-20 21:09:38,545 INFO > deleteOrganization: No attribute named 'organization_id' is de 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO fined 2024-11-20 21:09:38,545 INFO > status.find.in([200, 209], 304), found 401 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO > headerRegex((location,#id_token=(.*))).find.exists, found noth 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO ing 2024-11-20 21:09:38,545 INFO > userinfo: No attribute named 'access_token' is defined 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO > UI AM revoke1: No attribute named 'access_token' is defined 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO > UI AM endsession: No attribute named 'id_token_2' is defined 1 ( 0.12%) 2024-11-20 21:09:38,545 INFO 2024-11-20 21:09:38,545 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-20 21:09:38,545 INFO [#########################################################################-] 99% 2024-11-20 21:09:38,545 INFO waiting: 1203 / active: 189 / done: 143333 2024-11-20 21:09:38,545 INFO ================================================================================ 2024-11-20 21:09:38,545 INFO 2024-11-20 21:09:38,545 INFO 21:09:12.723 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 143522: j.i.IOException: Premature close 2024-11-20 21:09:38,545 INFO 21:09:12.723 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 143521: j.i.IOException: Premature close 2024-11-20 21:09:38,545 INFO 21:09:12.723 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-20 21:09:38,546 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-20 21:09:38,546 INFO Request: 2024-11-20 21:09:38,546 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-20 21:09:38,546 INFO ========================= 2024-11-20 21:09:38,546 INFO Session: 2024-11-20 21:09:38,546 INFO Session(idc.benchmark.Mix2024,143522,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.144496, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2e3c92dd, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1, password -> Pa_ssw0rd, fake-ip -> 67.101.221.10, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@54f732ea),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a6b10699970@3b51a992,io.netty.channel.epoll.EpollEventLoop@14f5da2c) 2024-11-20 21:09:38,546 INFO ========================= 2024-11-20 21:09:38,546 INFO HTTP request: 2024-11-20 21:09:38,546 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login 2024-11-20 21:09:38,546 INFO headers: 2024-11-20 21:09:38,546 INFO accept: application/json 2024-11-20 21:09:38,546 INFO content-type: application/json 2024-11-20 21:09:38,546 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1 2024-11-20 21:09:38,546 INFO X-Forwarded-For: 67.101.221.10 2024-11-20 21:09:38,546 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-20 21:09:38,546 INFO content-length: 0 2024-11-20 21:09:38,546 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-20 21:09:38,546 INFO ========================= 2024-11-20 21:09:38,546 INFO HTTP response: 2024-11-20 21:09:38,546 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-20 21:09:38,546 INFO 21:09:12.723 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-20 21:09:38,546 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-20 21:09:38,546 INFO Request: 2024-11-20 21:09:38,546 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-20 21:09:38,546 INFO ========================= 2024-11-20 21:09:38,546 INFO Session: 2024-11-20 21:09:38,546 INFO Session(idc.benchmark.Mix2024,143521,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.81595, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@97cc728, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1, password -> Pa_ssw0rd, fake-ip -> 96.12.42.120, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@258d2819),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a6b10699970@3b51a992,io.netty.channel.epoll.EpollEventLoop@f79a760) 2024-11-20 21:09:38,546 INFO ========================= 2024-11-20 21:09:38,546 INFO HTTP request: 2024-11-20 21:09:38,546 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/authenticate 2024-11-20 21:09:38,546 INFO headers: 2024-11-20 21:09:38,546 INFO accept: application/json 2024-11-20 21:09:38,546 INFO content-type: application/json 2024-11-20 21:09:38,546 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 13_2_3 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.3 Mobile/15E148 Safari/604.1 2024-11-20 21:09:38,546 INFO X-Forwarded-For: 96.12.42.120 2024-11-20 21:09:38,546 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-20 21:09:38,546 INFO content-length: 0 2024-11-20 21:09:38,546 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-20 21:09:38,546 INFO ========================= 2024-11-20 21:09:38,546 INFO HTTP response: 2024-11-20 21:09:38,546 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-20 21:09:38,546 INFO 21:09:12.723 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-133' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-20 21:09:38,546 INFO [INFO] ------------------------------------------------------------------------ 2024-11-20 21:09:38,546 INFO [INFO] BUILD SUCCESS 2024-11-20 21:09:38,546 INFO [INFO] ------------------------------------------------------------------------ 2024-11-20 21:09:38,546 INFO [INFO] Total time: 01:00 h 2024-11-20 21:09:38,546 INFO [INFO] Finished at: 2024-11-20T21:09:12Z 2024-11-20 21:09:38,546 INFO [INFO] ------------------------------------------------------------------------ 2024-11-20 21:09:38,546 INFO 2024-11-20 21:09:12,817 INFO Gatling simulation run ended successfully 2024-11-20 21:09:38,546 INFO 2024-11-20 21:09:12,817 DEBUG No archive name provided. No archive will be created 2024-11-20 21:09:38,546 INFO ________________________________________________________________________________ [2024-11-20 21:09:38] benchmark-40 show_stderr : Display stderr order ________________________________________________________________________________ 2024-11-20 21:09:38,547 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-40/stderr.txt is small (0 lines), printing all lines: 2024-11-20 21:09:38,547 DEBUG ----- output ----- 2024-11-20 21:09:38,547 DEBUG 2024-11-20 21:09:38,547 INFO ________________________________________________________________________________ [2024-11-20 21:09:38] benchmark-40 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-11-20 21:09:38] benchmark-40 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-11-20 21:09:38] benchmark-40 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped