--Task-- name: benchmark-30 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-10'] preceding_task: benchmark-10 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self30-', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 30} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-11-13 06:35:20] benchmark-30 pre : N/A ________________________________________________________________________________ 2024-11-13 06:35:20 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2024-11-13 06:35:20 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-30/stdout.txt Pod log : /results/orders/benchmark-30 2024-11-13 06:35:20,715 INFO 2024-11-13 06:35:20,715 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 06:35:20,715 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 06:35:21,001 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 06:35:21,001 INFO [loop_until]: OK (rc = 0) 2024-11-13 06:35:21,001 DEBUG --- stdout --- 2024-11-13 06:35:21,001 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 06:35:21,001 DEBUG --- stderr --- 2024-11-13 06:35:21,001 DEBUG ________________________________________________________________________________ [2024-11-13 06:35:21] benchmark-30 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-11-13 06:35:21,001 INFO 2024-11-13 06:35:21,001 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 06:35:21,001 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 06:35:21,287 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 06:35:21,287 INFO [loop_until]: OK (rc = 0) 2024-11-13 06:35:21,287 DEBUG --- stdout --- 2024-11-13 06:35:21,287 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 06:35:21,287 DEBUG --- stderr --- 2024-11-13 06:35:21,287 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-30" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self30- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=30 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2024-11-13 06:35:21] benchmark-30 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-11-13 06:35:21,288 INFO 2024-11-13 06:35:21,288 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 06:35:21,288 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 06:35:21,617 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 06:35:21,617 INFO [loop_until]: OK (rc = 0) 2024-11-13 06:35:21,617 DEBUG --- stdout --- 2024-11-13 06:35:21,617 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 06:35:21,617 DEBUG --- stderr --- 2024-11-13 06:35:21,618 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/order.json { "name": "benchmark-30", "command": " /lodestar/lodestar.py run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-benchmark\" --results-folder=\"/results/gatling/benchmark-30\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self30- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=30 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-30" } ________________________________________________________________________________ [2024-11-13 06:35:21] benchmark-30 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-11-13 06:35:21,620 INFO 2024-11-13 06:35:21,621 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-11-13 06:35:21,621 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-13 06:35:21,848 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 06:35:21,848 INFO [loop_until]: OK (rc = 0) 2024-11-13 06:35:21,848 DEBUG --- stdout --- 2024-11-13 06:35:21,848 DEBUG WAITING 2024-11-13 06:35:21,848 DEBUG --- stderr --- 2024-11-13 06:35:21,848 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 31 0 --:--:-- --:--:-- --:--:-- 31 ________________________________________________________________________________ [2024-11-13 06:35:21] benchmark-30 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-11-13 06:35:21,849 INFO 2024-11-13 06:35:21,849 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 06:35:21,849 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 06:35:22,133 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 06:35:22,133 INFO [loop_until]: OK (rc = 0) 2024-11-13 06:35:22,133 DEBUG --- stdout --- 2024-11-13 06:35:22,133 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 06:35:22,133 DEBUG --- stderr --- 2024-11-13 06:35:22,133 DEBUG 2024-11-13 06:35:22,133 INFO 2024-11-13 06:35:22,133 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/order.json overseer-0-6644bb6697-rchxr:/results/orders/order.json 2024-11-13 06:35:22,133 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 06:35:23,574 INFO [loop_until]: OK (rc = 0) 2024-11-13 06:35:23,574 DEBUG --- stdout --- 2024-11-13 06:35:23,574 DEBUG 2024-11-13 06:35:23,574 DEBUG --- stderr --- 2024-11-13 06:35:23,574 DEBUG Order has been successfully forwarded to overseer 2024-11-13 06:35:23 - INFO: Check if Gatling simulation started successfully 2024-11-13 06:35:23,574 INFO 2024-11-13 06:35:23,574 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 06:35:23,574 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 06:35:23,872 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 06:35:23,872 INFO [loop_until]: OK (rc = 0) 2024-11-13 06:35:23,872 DEBUG --- stdout --- 2024-11-13 06:35:23,872 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 06:35:23,872 DEBUG --- stderr --- 2024-11-13 06:35:23,872 DEBUG 2024-11-13 06:35:23,872 INFO 2024-11-13 06:35:23,872 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- head --lines 5000 /results/orders/benchmark-30/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2024-11-13 06:35:23,872 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-13 06:35:24,634 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-13 06:35:30,395 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-13 06:35:36,141 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-11-13 06:35:36,141 INFO [loop_until]: OK (rc = 0) 2024-11-13 06:35:36,141 DEBUG --- stdout --- 2024-11-13 06:35:36,141 DEBUG 2024-11-13 06:35:24,262 DEBUG Creating results folder /results/gatling/benchmark-30 2024-11-13 06:35:24,269 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp7zgb7p_7 2024-11-13 06:35:24,271 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-30" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self30- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=30 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmp7zgb7p_7/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmp7zgb7p_7/target/test-classes ... [INFO] compile in 6.8 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2024-11-13 06:35:36,141 DEBUG --- stderr --- 2024-11-13 06:35:36,141 DEBUG ________________________________________________________________________________ [2024-11-13 06:35:36] benchmark-30 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2024-11-13 07:35:45] benchmark-30 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-11-13 07:35:45,100 INFO 2024-11-13 07:35:45,100 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:45,100 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:45,405 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:45,405 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:45,406 DEBUG --- stdout --- 2024-11-13 07:35:45,406 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:45,406 DEBUG --- stderr --- 2024-11-13 07:35:45,406 DEBUG 2024-11-13 07:35:45,406 INFO 2024-11-13 07:35:45,406 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- rm -f /results/orders/order.json 2024-11-13 07:35:45,406 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 07:35:46,214 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:46,214 DEBUG --- stdout --- 2024-11-13 07:35:46,214 DEBUG 2024-11-13 07:35:46,214 DEBUG --- stderr --- 2024-11-13 07:35:46,214 DEBUG Order ran during 1h ________________________________________________________________________________ [2024-11-13 07:35:46] benchmark-30 download_logs : Download individual order files ________________________________________________________________________________ 2024-11-13 07:35:46 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/order.json 2024-11-13 07:35:46,214 INFO 2024-11-13 07:35:46,214 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:46,214 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:46,498 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:46,498 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:46,498 DEBUG --- stdout --- 2024-11-13 07:35:46,499 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:46,499 DEBUG --- stderr --- 2024-11-13 07:35:46,499 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-13 07:35:46,499 INFO 2024-11-13 07:35:46,499 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:46,499 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:46,784 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:46,784 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:46,784 DEBUG --- stdout --- 2024-11-13 07:35:46,784 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:46,784 DEBUG --- stderr --- 2024-11-13 07:35:46,784 DEBUG 2024-11-13 07:35:46,784 INFO 2024-11-13 07:35:46,785 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-30/rc.txt" ]; then echo "/results/orders/benchmark-30/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-30/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-30/rc.txt file found" 2024-11-13 07:35:46,785 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 07:35:47,622 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 07:35:47,622 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:47,623 DEBUG --- stdout --- 2024-11-13 07:35:47,623 DEBUG /results/orders/benchmark-30/rc.txt file found 2024-11-13 07:35:47,623 DEBUG --- stderr --- 2024-11-13 07:35:47,623 DEBUG 2024-11-13 07:35:47,623 INFO 2024-11-13 07:35:47,623 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:47,623 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:47,908 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:47,908 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:47,908 DEBUG --- stdout --- 2024-11-13 07:35:47,908 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:47,908 DEBUG --- stderr --- 2024-11-13 07:35:47,908 DEBUG 2024-11-13 07:35:47,908 INFO 2024-11-13 07:35:47,909 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-30/rc.txt 2024-11-13 07:35:48,737 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-13 07:35:48,737 DEBUG --- stdout --- 2024-11-13 07:35:48,738 DEBUG 4 /results/orders/benchmark-30/rc.txt 2024-11-13 07:35:48,738 DEBUG --- stderr --- 2024-11-13 07:35:48,738 DEBUG 2024-11-13 07:35:48,738 INFO - Download file (size 4k) 2024-11-13 07:35:48,738 INFO 2024-11-13 07:35:48,738 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:48,738 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:49,023 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:49,023 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:49,023 DEBUG --- stdout --- 2024-11-13 07:35:49,023 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:49,023 DEBUG --- stderr --- 2024-11-13 07:35:49,023 DEBUG source : /results/orders/benchmark-30/rc.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/rc.txt 2024-11-13 07:35:49,023 INFO 2024-11-13 07:35:49,023 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:49,023 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:49,309 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:49,309 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:49,309 DEBUG --- stdout --- 2024-11-13 07:35:49,309 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:49,309 DEBUG --- stderr --- 2024-11-13 07:35:49,309 DEBUG 2024-11-13 07:35:49,310 INFO 2024-11-13 07:35:49,310 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-30/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/rc.txt 2024-11-13 07:35:49,310 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-13 07:35:50,097 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:50,097 DEBUG --- stdout --- 2024-11-13 07:35:50,097 DEBUG tar: Removing leading `/' from member names 2024-11-13 07:35:50,097 DEBUG --- stderr --- 2024-11-13 07:35:50,097 DEBUG 2024-11-13 07:35:50,098 INFO 2024-11-13 07:35:50,098 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:50,098 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:50,384 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:50,384 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:50,384 DEBUG --- stdout --- 2024-11-13 07:35:50,384 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:50,384 DEBUG --- stderr --- 2024-11-13 07:35:50,384 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-13 07:35:50,384 INFO 2024-11-13 07:35:50,384 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:50,384 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:50,689 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:50,690 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:50,690 DEBUG --- stdout --- 2024-11-13 07:35:50,690 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:50,690 DEBUG --- stderr --- 2024-11-13 07:35:50,690 DEBUG 2024-11-13 07:35:50,690 INFO 2024-11-13 07:35:50,690 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-30/stderr.txt" ]; then echo "/results/orders/benchmark-30/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-30/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-30/stderr.txt file found" 2024-11-13 07:35:50,690 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 07:35:51,519 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 07:35:51,519 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:51,519 DEBUG --- stdout --- 2024-11-13 07:35:51,519 DEBUG /results/orders/benchmark-30/stderr.txt file found 2024-11-13 07:35:51,519 DEBUG --- stderr --- 2024-11-13 07:35:51,519 DEBUG 2024-11-13 07:35:51,519 INFO 2024-11-13 07:35:51,520 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:51,520 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:51,807 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:51,807 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:51,807 DEBUG --- stdout --- 2024-11-13 07:35:51,807 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:51,807 DEBUG --- stderr --- 2024-11-13 07:35:51,807 DEBUG 2024-11-13 07:35:51,807 INFO 2024-11-13 07:35:51,808 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-30/stderr.txt 2024-11-13 07:35:52,638 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-13 07:35:52,638 DEBUG --- stdout --- 2024-11-13 07:35:52,638 DEBUG 0 /results/orders/benchmark-30/stderr.txt 2024-11-13 07:35:52,638 DEBUG --- stderr --- 2024-11-13 07:35:52,638 DEBUG 2024-11-13 07:35:52,638 INFO - Download file (size 0k) 2024-11-13 07:35:52,638 INFO 2024-11-13 07:35:52,638 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:52,638 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:52,923 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:52,923 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:52,923 DEBUG --- stdout --- 2024-11-13 07:35:52,923 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:52,923 DEBUG --- stderr --- 2024-11-13 07:35:52,923 DEBUG source : /results/orders/benchmark-30/stderr.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/stderr.txt 2024-11-13 07:35:52,923 INFO 2024-11-13 07:35:52,923 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:52,923 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:53,209 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:53,209 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:53,209 DEBUG --- stdout --- 2024-11-13 07:35:53,209 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:53,209 DEBUG --- stderr --- 2024-11-13 07:35:53,209 DEBUG 2024-11-13 07:35:53,210 INFO 2024-11-13 07:35:53,210 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-30/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/stderr.txt 2024-11-13 07:35:53,210 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-13 07:35:54,028 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:54,028 DEBUG --- stdout --- 2024-11-13 07:35:54,028 DEBUG tar: Removing leading `/' from member names 2024-11-13 07:35:54,028 DEBUG --- stderr --- 2024-11-13 07:35:54,028 DEBUG 2024-11-13 07:35:54,028 INFO 2024-11-13 07:35:54,028 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:54,028 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:54,313 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:54,313 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:54,314 DEBUG --- stdout --- 2024-11-13 07:35:54,314 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:54,314 DEBUG --- stderr --- 2024-11-13 07:35:54,314 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-13 07:35:54,315 INFO 2024-11-13 07:35:54,315 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:54,315 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:54,599 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:54,599 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:54,599 DEBUG --- stdout --- 2024-11-13 07:35:54,599 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:54,599 DEBUG --- stderr --- 2024-11-13 07:35:54,599 DEBUG 2024-11-13 07:35:54,600 INFO 2024-11-13 07:35:54,600 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-30/stdout.txt" ]; then echo "/results/orders/benchmark-30/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-30/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-30/stdout.txt file found" 2024-11-13 07:35:54,600 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 07:35:55,427 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 07:35:55,427 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:55,427 DEBUG --- stdout --- 2024-11-13 07:35:55,427 DEBUG /results/orders/benchmark-30/stdout.txt file found 2024-11-13 07:35:55,427 DEBUG --- stderr --- 2024-11-13 07:35:55,427 DEBUG 2024-11-13 07:35:55,428 INFO 2024-11-13 07:35:55,428 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:55,428 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:55,717 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:55,717 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:55,717 DEBUG --- stdout --- 2024-11-13 07:35:55,717 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:55,717 DEBUG --- stderr --- 2024-11-13 07:35:55,717 DEBUG 2024-11-13 07:35:55,717 INFO 2024-11-13 07:35:55,718 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-30/stdout.txt 2024-11-13 07:35:56,540 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-13 07:35:56,540 DEBUG --- stdout --- 2024-11-13 07:35:56,540 DEBUG 4532 /results/orders/benchmark-30/stdout.txt 2024-11-13 07:35:56,540 DEBUG --- stderr --- 2024-11-13 07:35:56,540 DEBUG 2024-11-13 07:35:56,540 INFO - Download file (size 4532k) 2024-11-13 07:35:56,540 INFO 2024-11-13 07:35:56,540 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:56,540 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:56,825 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:56,825 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:56,825 DEBUG --- stdout --- 2024-11-13 07:35:56,825 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:56,825 DEBUG --- stderr --- 2024-11-13 07:35:56,825 DEBUG source : /results/orders/benchmark-30/stdout.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/stdout.txt 2024-11-13 07:35:56,825 INFO 2024-11-13 07:35:56,825 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:56,825 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:57,109 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:57,109 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:57,109 DEBUG --- stdout --- 2024-11-13 07:35:57,109 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:57,109 DEBUG --- stderr --- 2024-11-13 07:35:57,109 DEBUG 2024-11-13 07:35:57,110 INFO 2024-11-13 07:35:57,110 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-30/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/stdout.txt 2024-11-13 07:35:57,110 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-13 07:35:58,413 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:58,413 DEBUG --- stdout --- 2024-11-13 07:35:58,413 DEBUG tar: Removing leading `/' from member names 2024-11-13 07:35:58,413 DEBUG --- stderr --- 2024-11-13 07:35:58,413 DEBUG ________________________________________________________________________________ [2024-11-13 07:35:58] benchmark-30 show_cmd : Display order command ________________________________________________________________________________ 2024-11-13 07:35:58,413 INFO 2024-11-13 07:35:58,413 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:58,413 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:58,706 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:58,706 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:58,706 DEBUG --- stdout --- 2024-11-13 07:35:58,706 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:58,706 DEBUG --- stderr --- 2024-11-13 07:35:58,706 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-13 07:35:58,706 INFO 2024-11-13 07:35:58,706 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:58,706 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:35:58,990 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:35:58,990 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:58,990 DEBUG --- stdout --- 2024-11-13 07:35:58,990 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:35:58,990 DEBUG --- stderr --- 2024-11-13 07:35:58,990 DEBUG 2024-11-13 07:35:58,991 INFO 2024-11-13 07:35:58,991 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-30/cmd.txt" ]; then echo "/results/orders/benchmark-30/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-30/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-30/cmd.txt file found" 2024-11-13 07:35:58,991 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 07:35:59,815 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 07:35:59,815 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:35:59,815 DEBUG --- stdout --- 2024-11-13 07:35:59,815 DEBUG /results/orders/benchmark-30/cmd.txt file found 2024-11-13 07:35:59,815 DEBUG --- stderr --- 2024-11-13 07:35:59,815 DEBUG 2024-11-13 07:35:59,816 INFO 2024-11-13 07:35:59,816 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:35:59,816 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:36:00,101 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:36:00,101 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:36:00,101 DEBUG --- stdout --- 2024-11-13 07:36:00,101 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:36:00,101 DEBUG --- stderr --- 2024-11-13 07:36:00,101 DEBUG 2024-11-13 07:36:00,101 INFO 2024-11-13 07:36:00,101 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-30/cmd.txt 2024-11-13 07:36:00,927 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-13 07:36:00,927 DEBUG --- stdout --- 2024-11-13 07:36:00,927 DEBUG 4 /results/orders/benchmark-30/cmd.txt 2024-11-13 07:36:00,928 DEBUG --- stderr --- 2024-11-13 07:36:00,928 DEBUG 2024-11-13 07:36:00,928 INFO - Download file (size 4k) 2024-11-13 07:36:00,928 INFO 2024-11-13 07:36:00,928 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:36:00,928 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:36:01,211 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:36:01,211 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:36:01,211 DEBUG --- stdout --- 2024-11-13 07:36:01,211 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:36:01,211 DEBUG --- stderr --- 2024-11-13 07:36:01,211 DEBUG source : /results/orders/benchmark-30/cmd.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/cmd.txt 2024-11-13 07:36:01,212 INFO 2024-11-13 07:36:01,212 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 07:36:01,212 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 07:36:01,499 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 07:36:01,499 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:36:01,499 DEBUG --- stdout --- 2024-11-13 07:36:01,499 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 07:36:01,499 DEBUG --- stderr --- 2024-11-13 07:36:01,499 DEBUG 2024-11-13 07:36:01,500 INFO 2024-11-13 07:36:01,500 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-30/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/cmd.txt 2024-11-13 07:36:01,500 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-13 07:36:02,280 INFO [loop_until]: OK (rc = 0) 2024-11-13 07:36:02,280 DEBUG --- stdout --- 2024-11-13 07:36:02,280 DEBUG tar: Removing leading `/' from member names 2024-11-13 07:36:02,280 DEBUG --- stderr --- 2024-11-13 07:36:02,280 DEBUG 2024-11-13 07:36:02,280 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/cmd.txt is small (1 lines), printing all lines: 2024-11-13 07:36:02,280 DEBUG ----- output ----- 2024-11-13 07:36:02,280 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-30" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self30- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=30 -Duser_password=Pa_ssw0rd" 2024-11-13 07:36:02,280 INFO ________________________________________________________________________________ [2024-11-13 07:36:02] benchmark-30 show_rc : Display rc order ________________________________________________________________________________ 2024-11-13 07:36:02,281 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/rc.txt is small (1 lines), printing all lines: 2024-11-13 07:36:02,281 DEBUG ----- output ----- 2024-11-13 07:36:02,281 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-11-13 07:36:02,281 INFO ________________________________________________________________________________ [2024-11-13 07:36:02] benchmark-30 show_stdout : Display stdout order ________________________________________________________________________________ 2024-11-13 07:36:02,287 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/stdout.txt is 60332 lines): 2024-11-13 07:36:02,287 DEBUG ----- output ----- 2024-11-13 07:36:02,287 INFO 2024-11-13 06:35:24,262 DEBUG Creating results folder /results/gatling/benchmark-30 2024-11-13 07:36:02,287 INFO 2024-11-13 06:35:24,269 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp7zgb7p_7 2024-11-13 07:36:02,287 INFO 2024-11-13 06:35:24,271 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-30" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self30- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=30 -Duser_password=**** 2024-11-13 07:36:02,287 INFO [INFO] Scanning for projects... 2024-11-13 07:36:02,287 INFO [INFO] 2024-11-13 07:36:02,287 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2024-11-13 07:36:02,287 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2024-11-13 07:36:02,287 INFO [INFO] from pom.xml 2024-11-13 07:36:02,287 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2024-11-13 07:36:02,287 INFO [INFO] 2024-11-13 07:36:02,287 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2024-11-13 07:36:02,287 INFO [INFO] 2024-11-13 07:36:02,287 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2024-11-13 07:36:02,287 INFO [INFO] skip non existing resourceDirectory /tmp/tmp7zgb7p_7/src/main/resources 2024-11-13 07:36:02,287 INFO [INFO] 2024-11-13 07:36:02,287 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2024-11-13 07:36:02,288 INFO [INFO] No sources to compile 2024-11-13 07:36:02,288 INFO [INFO] 2024-11-13 07:36:02,288 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2024-11-13 07:36:02,288 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2024-11-13 07:36:02,288 INFO [INFO] 2024-11-13 07:36:02,288 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2024-11-13 07:36:02,288 INFO [INFO] Nothing to compile - all classes are up to date. 2024-11-13 07:36:02,288 INFO [INFO] 2024-11-13 07:36:02,288 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2024-11-13 07:36:02,288 INFO [INFO] compiling 38 Scala sources to /tmp/tmp7zgb7p_7/target/test-classes ... 2024-11-13 07:36:02,288 INFO [INFO] compile in 6.8 s 2024-11-13 07:36:02,288 INFO [INFO] 2024-11-13 07:36:02,288 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2024-11-13 07:36:02,288 INFO [INFO] 2024-11-13 07:36:02,288 INFO [INFO] 2024-11-13 07:36:02,288 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2024-11-13 07:36:02,288 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2024-11-13 07:36:02,288 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2024-11-13 07:36:02,288 INFO Simulation com.forgerock.pyrock.Loadtest started... 2024-11-13 07:36:02,288 INFO 2024-11-13 07:36:02,288 INFO ================================================================================ 2024-11-13 07:36:02,288 INFO 2024-11-13 06:35:40 GMT 5s elapsed 2024-11-13 07:36:02,288 INFO ---- Requests ------------------------------------------------------------------ 2024-11-13 07:36:02,288 INFO > Global (OK=179 KO=0 ) 2024-11-13 07:36:02,288 INFO > restLoginInitiate (OK=12 KO=0 ) 2024-11-13 07:36:02,288 INFO > restLoginUsernamePasswordCallback (OK=12 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI-Post-Login - stage 1 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI AM idFromSession (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI AM validateGoto (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > User Authorize PKCE stage (OK=15 KO=0 ) 2024-11-13 07:36:02,288 INFO > User AccessToken PKCE stage (OK=15 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI-Post-Login - stage 2 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI Enduser appAuthHelper1 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI Enduser appAuthHelper2 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI-Post-Login - stage 3 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI Enduser sessioncheck (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM uiconfig (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM version (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM features (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM login (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM privilege (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM dashboard (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM managed user schema (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM user (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI IDM oidcToken (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > userinfo (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI-Logout (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI-Logout Redirect 1 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI AM revoke1 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI AM revoke2 (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > UI AM endsession (OK=4 KO=0 ) 2024-11-13 07:36:02,288 INFO > Skip 2FA (OK=6 KO=0 ) 2024-11-13 07:36:02,288 INFO > GetUUid (OK=3 KO=0 ) 2024-11-13 07:36:02,288 INFO > GetOpenidConfig (OK=3 KO=0 ) 2024-11-13 07:36:02,288 INFO > CreatePolicy (OK=3 KO=0 ) 2024-11-13 07:36:02,288 INFO > RootUserinfo (OK=3 KO=0 ) 2024-11-13 07:36:02,288 INFO > tokenUserinfo (OK=1 KO=0 ) 2024-11-13 07:36:02,288 INFO > getIdToken (OK=1 KO=0 ) 2024-11-13 07:36:02,288 INFO > getIdToken Redirect 1 (OK=1 KO=0 ) 2024-11-13 07:36:02,288 INFO 2024-11-13 07:36:02,288 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-13 07:36:02,288 INFO [- ] 0% 2024-11-13 07:36:02,289 INFO waiting: 108413 / active: 7 / done: 5 2024-11-13 07:36:02,289 INFO ================================================================================ 2024-11-13 07:36:02,289 INFO 2024-11-13 07:36:02,289 INFO 06:35:44.733 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-13 07:36:02,289 INFO 2024-11-13 07:36:02,289 INFO ================================================================================ 2024-11-13 07:36:02,289 INFO 2024-11-13 06:35:45 GMT 10s elapsed 2024-11-13 07:36:02,289 INFO ---- Requests ------------------------------------------------------------------ 2024-11-13 07:36:02,289 INFO > Global (OK=607 KO=0 ) 2024-11-13 07:36:02,289 INFO > restLoginInitiate (OK=49 KO=0 ) 2024-11-13 07:36:02,289 INFO > restLoginUsernamePasswordCallback (OK=48 KO=0 ) 2024-11-13 07:36:02,289 INFO > UI-Post-Login - stage 1 (OK=11 KO=0 ) 2024-11-13 07:36:02,289 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=11 KO=0 ) 2024-11-13 07:36:02,289 INFO > UI AM idFromSession (OK=11 KO=0 ) 2024-11-13 07:36:02,289 INFO > UI AM validateGoto (OK=11 KO=0 ) 2024-11-13 07:36:02,289 INFO > User Authorize PKCE stage (OK=56 KO=0 ) 2024-11-13 07:36:02,289 INFO > User AccessToken PKCE stage (OK=55 KO=0 ) 2024-11-13 07:36:02,289 INFO > UI-Post-Login - stage 2 (OK=10 KO=0 ) 2024-11-13 07:36:02,289 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=10 KO=0 ) 2024-11-13 07:36:02,289 INFO [...] 2024-11-13 07:36:02,297 INFO > userinfo: No attribute named 'access_token' is defined 5 ( 0.32%) 2024-11-13 07:36:02,297 INFO > UI AM revoke1: No attribute named 'access_token' is defined 5 ( 0.32%) 2024-11-13 07:36:02,297 INFO > headerRegex((location,#id_token=(.*))).find.exists, found noth 3 ( 0.19%) 2024-11-13 07:36:02,297 INFO ing 2024-11-13 07:36:02,297 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 3 ( 0.19%) 2024-11-13 07:36:02,297 INFO 2024-11-13 07:36:02,297 INFO > UI AM endsession: No attribute named 'id_token_2' is defined 3 ( 0.19%) 2024-11-13 07:36:02,297 INFO > Request timeout to openam-perf-benchmark.forgeblocks.com/34.8. 2 ( 0.13%) 2024-11-13 07:36:02,297 INFO 9.233:443 after 60000 ms 2024-11-13 07:36:02,297 INFO > createOrganization: No attribute named 'access_token' is defin 2 ( 0.13%) 2024-11-13 07:36:02,297 INFO ed 2024-11-13 07:36:02,297 INFO > queryOrganization: No attribute named 'organization_id' is def 2 ( 0.13%) 2024-11-13 07:36:02,298 INFO ined 2024-11-13 07:36:02,298 INFO > deleteOrganization: No attribute named 'organization_id' is de 2 ( 0.13%) 2024-11-13 07:36:02,298 INFO fined 2024-11-13 07:36:02,298 INFO > CreatePolicy: No attribute named 'oauth2_uuId' is defined 2 ( 0.13%) 2024-11-13 07:36:02,298 INFO > status.find.is(302), but actually found 502 1 ( 0.06%) 2024-11-13 07:36:02,298 INFO 2024-11-13 07:36:02,298 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-13 07:36:02,298 INFO [#########################################################################-] 99% 2024-11-13 07:36:02,298 INFO waiting: 896 / active: 143 / done: 107386 2024-11-13 07:36:02,298 INFO ================================================================================ 2024-11-13 07:36:02,298 INFO 2024-11-13 07:36:02,298 INFO 07:35:35.056 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 107527: j.i.IOException: Premature close 2024-11-13 07:36:02,298 INFO 07:35:35.056 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-13 07:36:02,298 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-13 07:36:02,298 INFO Request: 2024-11-13 07:36:02,298 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-13 07:36:02,298 INFO ========================= 2024-11-13 07:36:02,298 INFO Session: 2024-11-13 07:36:02,298 INFO Session(idc.benchmark.Mix2024,107527,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.93007, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@20d1ba8e, fake-user-agent -> Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@609064c0),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a639469a0e0@4b0bc49f,io.netty.channel.epoll.EpollEventLoop@1eb6749b) 2024-11-13 07:36:02,298 INFO ========================= 2024-11-13 07:36:02,298 INFO HTTP request: 2024-11-13 07:36:02,298 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2024-11-13 07:36:02,298 INFO headers: 2024-11-13 07:36:02,298 INFO accept: application/json 2024-11-13 07:36:02,298 INFO content-type: application/json 2024-11-13 07:36:02,298 INFO user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36 2024-11-13 07:36:02,298 INFO X-Forwarded-For: 42.42.42.42 2024-11-13 07:36:02,298 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-13 07:36:02,298 INFO content-length: 0 2024-11-13 07:36:02,298 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-13 07:36:02,298 INFO ========================= 2024-11-13 07:36:02,298 INFO HTTP response: 2024-11-13 07:36:02,298 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-13 07:36:02,298 INFO 07:35:35.057 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-13 07:36:02,298 INFO 07:35:35.057 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 107529: j.i.IOException: Premature close 2024-11-13 07:36:02,298 INFO 07:35:35.057 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 107528: j.i.IOException: Premature close 2024-11-13 07:36:02,298 INFO 07:35:35.057 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-13 07:36:02,298 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-13 07:36:02,298 INFO Request: 2024-11-13 07:36:02,298 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-13 07:36:02,298 INFO ========================= 2024-11-13 07:36:02,298 INFO Session: 2024-11-13 07:36:02,298 INFO Session(idc.benchmark.Mix2024,107528,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.4280, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@6a710c98, fake-user-agent -> Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 225.80.129.226, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@3e62380d),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a639469a0e0@4b0bc49f,io.netty.channel.epoll.EpollEventLoop@652a7737) 2024-11-13 07:36:02,298 INFO ========================= 2024-11-13 07:36:02,298 INFO HTTP request: 2024-11-13 07:36:02,298 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2024-11-13 07:36:02,298 INFO headers: 2024-11-13 07:36:02,298 INFO accept: application/json 2024-11-13 07:36:02,298 INFO content-type: application/json 2024-11-13 07:36:02,298 INFO user-agent: Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 2024-11-13 07:36:02,298 INFO X-Forwarded-For: 225.80.129.226 2024-11-13 07:36:02,298 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-13 07:36:02,298 INFO content-length: 0 2024-11-13 07:36:02,298 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-13 07:36:02,298 INFO ========================= 2024-11-13 07:36:02,298 INFO HTTP response: 2024-11-13 07:36:02,298 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-13 07:36:02,298 INFO 07:35:35.057 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-13 07:36:02,298 INFO 07:35:35.057 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-13 07:36:02,298 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-13 07:36:02,298 INFO Request: 2024-11-13 07:36:02,298 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-13 07:36:02,299 INFO ========================= 2024-11-13 07:36:02,299 INFO Session: 2024-11-13 07:36:02,299 INFO Session(idc.benchmark.Mix2024,107529,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.125739, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@6751ee08, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1, password -> Pa_ssw0rd, fake-ip -> 251.124.119.49, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@4d4a96b8),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007a639469a0e0@4b0bc49f,io.netty.channel.epoll.EpollEventLoop@5b7ea70d) 2024-11-13 07:36:02,299 INFO ========================= 2024-11-13 07:36:02,299 INFO HTTP request: 2024-11-13 07:36:02,299 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2024-11-13 07:36:02,299 INFO headers: 2024-11-13 07:36:02,299 INFO accept: application/json 2024-11-13 07:36:02,299 INFO content-type: application/json 2024-11-13 07:36:02,299 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1 2024-11-13 07:36:02,299 INFO X-Forwarded-For: 251.124.119.49 2024-11-13 07:36:02,299 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-13 07:36:02,299 INFO content-length: 0 2024-11-13 07:36:02,299 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-13 07:36:02,299 INFO ========================= 2024-11-13 07:36:02,299 INFO HTTP response: 2024-11-13 07:36:02,299 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-13 07:36:02,299 INFO 07:35:35.057 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-13 07:36:02,299 INFO [INFO] ------------------------------------------------------------------------ 2024-11-13 07:36:02,299 INFO [INFO] BUILD SUCCESS 2024-11-13 07:36:02,299 INFO [INFO] ------------------------------------------------------------------------ 2024-11-13 07:36:02,299 INFO [INFO] Total time: 01:00 h 2024-11-13 07:36:02,299 INFO [INFO] Finished at: 2024-11-13T07:35:35Z 2024-11-13 07:36:02,299 INFO [INFO] ------------------------------------------------------------------------ 2024-11-13 07:36:02,299 INFO 2024-11-13 07:35:35,142 INFO Gatling simulation run ended successfully 2024-11-13 07:36:02,299 INFO 2024-11-13 07:35:35,142 DEBUG No archive name provided. No archive will be created 2024-11-13 07:36:02,299 INFO ________________________________________________________________________________ [2024-11-13 07:36:02] benchmark-30 show_stderr : Display stderr order ________________________________________________________________________________ 2024-11-13 07:36:02,299 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/02_benchmark-30/stderr.txt is small (0 lines), printing all lines: 2024-11-13 07:36:02,299 DEBUG ----- output ----- 2024-11-13 07:36:02,299 DEBUG 2024-11-13 07:36:02,299 INFO ________________________________________________________________________________ [2024-11-13 07:36:02] benchmark-30 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-11-13 07:36:02] benchmark-30 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-11-13 07:36:02] benchmark-30 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped