--Task-- name: benchmark-70 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-60'] preceding_task: benchmark-60 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self70-', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 70} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-11-13 09:37:28] benchmark-70 pre : N/A ________________________________________________________________________________ 2024-11-13 09:37:28 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2024-11-13 09:37:28 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-70/stdout.txt Pod log : /results/orders/benchmark-70 2024-11-13 09:37:28,399 INFO 2024-11-13 09:37:28,399 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 09:37:28,399 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 09:37:28,683 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 09:37:28,683 INFO [loop_until]: OK (rc = 0) 2024-11-13 09:37:28,683 DEBUG --- stdout --- 2024-11-13 09:37:28,683 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 09:37:28,683 DEBUG --- stderr --- 2024-11-13 09:37:28,683 DEBUG ________________________________________________________________________________ [2024-11-13 09:37:28] benchmark-70 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-11-13 09:37:28,683 INFO 2024-11-13 09:37:28,683 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 09:37:28,683 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 09:37:28,971 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 09:37:28,971 INFO [loop_until]: OK (rc = 0) 2024-11-13 09:37:28,971 DEBUG --- stdout --- 2024-11-13 09:37:28,972 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 09:37:28,972 DEBUG --- stderr --- 2024-11-13 09:37:28,972 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-70" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self70- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=70 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2024-11-13 09:37:28] benchmark-70 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-11-13 09:37:28,972 INFO 2024-11-13 09:37:28,972 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 09:37:28,972 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 09:37:29,258 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 09:37:29,258 INFO [loop_until]: OK (rc = 0) 2024-11-13 09:37:29,258 DEBUG --- stdout --- 2024-11-13 09:37:29,258 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 09:37:29,258 DEBUG --- stderr --- 2024-11-13 09:37:29,258 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/order.json { "name": "benchmark-70", "command": " /lodestar/lodestar.py run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-benchmark\" --results-folder=\"/results/gatling/benchmark-70\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self70- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=70 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-70" } ________________________________________________________________________________ [2024-11-13 09:37:29] benchmark-70 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-11-13 09:37:29,261 INFO 2024-11-13 09:37:29,261 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-11-13 09:37:29,261 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-13 09:37:29,488 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 09:37:29,488 INFO [loop_until]: OK (rc = 0) 2024-11-13 09:37:29,488 DEBUG --- stdout --- 2024-11-13 09:37:29,488 DEBUG WAITING 2024-11-13 09:37:29,488 DEBUG --- stderr --- 2024-11-13 09:37:29,488 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 32 0 --:--:-- --:--:-- --:--:-- 32 ________________________________________________________________________________ [2024-11-13 09:37:29] benchmark-70 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-11-13 09:37:29,489 INFO 2024-11-13 09:37:29,489 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 09:37:29,489 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 09:37:29,778 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 09:37:29,778 INFO [loop_until]: OK (rc = 0) 2024-11-13 09:37:29,778 DEBUG --- stdout --- 2024-11-13 09:37:29,778 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 09:37:29,778 DEBUG --- stderr --- 2024-11-13 09:37:29,778 DEBUG 2024-11-13 09:37:29,778 INFO 2024-11-13 09:37:29,778 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/order.json overseer-0-6644bb6697-rchxr:/results/orders/order.json 2024-11-13 09:37:29,778 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 09:37:31,201 INFO [loop_until]: OK (rc = 0) 2024-11-13 09:37:31,201 DEBUG --- stdout --- 2024-11-13 09:37:31,201 DEBUG 2024-11-13 09:37:31,201 DEBUG --- stderr --- 2024-11-13 09:37:31,201 DEBUG Order has been successfully forwarded to overseer 2024-11-13 09:37:31 - INFO: Check if Gatling simulation started successfully 2024-11-13 09:37:31,202 INFO 2024-11-13 09:37:31,202 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 09:37:31,202 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 09:37:31,489 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 09:37:31,489 INFO [loop_until]: OK (rc = 0) 2024-11-13 09:37:31,489 DEBUG --- stdout --- 2024-11-13 09:37:31,489 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 09:37:31,489 DEBUG --- stderr --- 2024-11-13 09:37:31,489 DEBUG 2024-11-13 09:37:31,489 INFO 2024-11-13 09:37:31,489 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- head --lines 5000 /results/orders/benchmark-70/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2024-11-13 09:37:31,489 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-13 09:37:32,248 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-13 09:37:38,007 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-13 09:37:43,753 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-11-13 09:37:43,753 INFO [loop_until]: OK (rc = 0) 2024-11-13 09:37:43,753 DEBUG --- stdout --- 2024-11-13 09:37:43,753 DEBUG 2024-11-13 09:37:31,732 DEBUG Creating results folder /results/gatling/benchmark-70 2024-11-13 09:37:31,740 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpo41ogj3f 2024-11-13 09:37:31,742 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-70" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self70- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=70 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpo41ogj3f/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmpo41ogj3f/target/test-classes ... [INFO] compile in 6.8 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2024-11-13 09:37:43,753 DEBUG --- stderr --- 2024-11-13 09:37:43,753 DEBUG ________________________________________________________________________________ [2024-11-13 09:37:43] benchmark-70 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 04s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 07s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2024-11-13 10:37:52] benchmark-70 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-11-13 10:37:52,941 INFO 2024-11-13 10:37:52,941 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:52,941 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:53,246 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:53,246 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:53,246 DEBUG --- stdout --- 2024-11-13 10:37:53,246 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:53,246 DEBUG --- stderr --- 2024-11-13 10:37:53,246 DEBUG 2024-11-13 10:37:53,247 INFO 2024-11-13 10:37:53,247 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- rm -f /results/orders/order.json 2024-11-13 10:37:53,247 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 10:37:54,063 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:54,063 DEBUG --- stdout --- 2024-11-13 10:37:54,063 DEBUG 2024-11-13 10:37:54,063 DEBUG --- stderr --- 2024-11-13 10:37:54,063 DEBUG Order ran during 1h ________________________________________________________________________________ [2024-11-13 10:37:54] benchmark-70 download_logs : Download individual order files ________________________________________________________________________________ 2024-11-13 10:37:54 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/order.json 2024-11-13 10:37:54,063 INFO 2024-11-13 10:37:54,063 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:54,064 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:54,349 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:54,349 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:54,349 DEBUG --- stdout --- 2024-11-13 10:37:54,349 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:54,349 DEBUG --- stderr --- 2024-11-13 10:37:54,349 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-13 10:37:54,350 INFO 2024-11-13 10:37:54,350 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:54,350 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:54,636 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:54,636 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:54,636 DEBUG --- stdout --- 2024-11-13 10:37:54,636 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:54,636 DEBUG --- stderr --- 2024-11-13 10:37:54,636 DEBUG 2024-11-13 10:37:54,636 INFO 2024-11-13 10:37:54,636 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-70/rc.txt" ]; then echo "/results/orders/benchmark-70/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-70/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-70/rc.txt file found" 2024-11-13 10:37:54,636 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 10:37:55,460 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 10:37:55,461 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:55,461 DEBUG --- stdout --- 2024-11-13 10:37:55,461 DEBUG /results/orders/benchmark-70/rc.txt file found 2024-11-13 10:37:55,461 DEBUG --- stderr --- 2024-11-13 10:37:55,461 DEBUG 2024-11-13 10:37:55,461 INFO 2024-11-13 10:37:55,461 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:55,461 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:55,744 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:55,744 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:55,744 DEBUG --- stdout --- 2024-11-13 10:37:55,745 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:55,745 DEBUG --- stderr --- 2024-11-13 10:37:55,745 DEBUG 2024-11-13 10:37:55,745 INFO 2024-11-13 10:37:55,745 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-70/rc.txt 2024-11-13 10:37:56,569 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-13 10:37:56,569 DEBUG --- stdout --- 2024-11-13 10:37:56,569 DEBUG 4 /results/orders/benchmark-70/rc.txt 2024-11-13 10:37:56,569 DEBUG --- stderr --- 2024-11-13 10:37:56,569 DEBUG 2024-11-13 10:37:56,569 INFO - Download file (size 4k) 2024-11-13 10:37:56,569 INFO 2024-11-13 10:37:56,569 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:56,569 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:56,854 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:56,854 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:56,854 DEBUG --- stdout --- 2024-11-13 10:37:56,854 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:56,854 DEBUG --- stderr --- 2024-11-13 10:37:56,854 DEBUG source : /results/orders/benchmark-70/rc.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/rc.txt 2024-11-13 10:37:56,855 INFO 2024-11-13 10:37:56,855 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:56,855 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:57,139 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:57,139 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:57,139 DEBUG --- stdout --- 2024-11-13 10:37:57,139 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:57,139 DEBUG --- stderr --- 2024-11-13 10:37:57,139 DEBUG 2024-11-13 10:37:57,140 INFO 2024-11-13 10:37:57,140 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-70/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/rc.txt 2024-11-13 10:37:57,140 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-13 10:37:57,926 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:57,927 DEBUG --- stdout --- 2024-11-13 10:37:57,927 DEBUG tar: Removing leading `/' from member names 2024-11-13 10:37:57,927 DEBUG --- stderr --- 2024-11-13 10:37:57,927 DEBUG 2024-11-13 10:37:57,927 INFO 2024-11-13 10:37:57,927 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:57,927 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:58,210 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:58,210 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:58,210 DEBUG --- stdout --- 2024-11-13 10:37:58,210 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:58,210 DEBUG --- stderr --- 2024-11-13 10:37:58,210 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-13 10:37:58,210 INFO 2024-11-13 10:37:58,210 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:58,210 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:58,493 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:58,493 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:58,493 DEBUG --- stdout --- 2024-11-13 10:37:58,493 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:58,494 DEBUG --- stderr --- 2024-11-13 10:37:58,494 DEBUG 2024-11-13 10:37:58,494 INFO 2024-11-13 10:37:58,494 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-70/stderr.txt" ]; then echo "/results/orders/benchmark-70/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-70/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-70/stderr.txt file found" 2024-11-13 10:37:58,494 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 10:37:59,313 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 10:37:59,313 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:59,313 DEBUG --- stdout --- 2024-11-13 10:37:59,313 DEBUG /results/orders/benchmark-70/stderr.txt file found 2024-11-13 10:37:59,313 DEBUG --- stderr --- 2024-11-13 10:37:59,313 DEBUG 2024-11-13 10:37:59,313 INFO 2024-11-13 10:37:59,314 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:37:59,314 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:37:59,596 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:37:59,596 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:37:59,596 DEBUG --- stdout --- 2024-11-13 10:37:59,596 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:37:59,596 DEBUG --- stderr --- 2024-11-13 10:37:59,596 DEBUG 2024-11-13 10:37:59,596 INFO 2024-11-13 10:37:59,596 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-70/stderr.txt 2024-11-13 10:38:00,416 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-13 10:38:00,417 DEBUG --- stdout --- 2024-11-13 10:38:00,417 DEBUG 0 /results/orders/benchmark-70/stderr.txt 2024-11-13 10:38:00,417 DEBUG --- stderr --- 2024-11-13 10:38:00,417 DEBUG 2024-11-13 10:38:00,417 INFO - Download file (size 0k) 2024-11-13 10:38:00,417 INFO 2024-11-13 10:38:00,417 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:00,417 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:00,700 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:00,700 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:00,700 DEBUG --- stdout --- 2024-11-13 10:38:00,701 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:00,701 DEBUG --- stderr --- 2024-11-13 10:38:00,701 DEBUG source : /results/orders/benchmark-70/stderr.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/stderr.txt 2024-11-13 10:38:00,701 INFO 2024-11-13 10:38:00,701 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:00,701 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:00,988 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:00,988 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:00,988 DEBUG --- stdout --- 2024-11-13 10:38:00,988 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:00,988 DEBUG --- stderr --- 2024-11-13 10:38:00,988 DEBUG 2024-11-13 10:38:00,988 INFO 2024-11-13 10:38:00,988 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-70/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/stderr.txt 2024-11-13 10:38:00,988 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-13 10:38:01,773 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:01,773 DEBUG --- stdout --- 2024-11-13 10:38:01,773 DEBUG tar: Removing leading `/' from member names 2024-11-13 10:38:01,773 DEBUG --- stderr --- 2024-11-13 10:38:01,773 DEBUG 2024-11-13 10:38:01,773 INFO 2024-11-13 10:38:01,773 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:01,773 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:02,060 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:02,060 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:02,060 DEBUG --- stdout --- 2024-11-13 10:38:02,060 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:02,060 DEBUG --- stderr --- 2024-11-13 10:38:02,060 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-13 10:38:02,061 INFO 2024-11-13 10:38:02,061 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:02,061 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:02,350 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:02,350 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:02,350 DEBUG --- stdout --- 2024-11-13 10:38:02,350 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:02,350 DEBUG --- stderr --- 2024-11-13 10:38:02,350 DEBUG 2024-11-13 10:38:02,351 INFO 2024-11-13 10:38:02,351 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-70/stdout.txt" ]; then echo "/results/orders/benchmark-70/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-70/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-70/stdout.txt file found" 2024-11-13 10:38:02,351 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 10:38:03,177 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 10:38:03,177 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:03,177 DEBUG --- stdout --- 2024-11-13 10:38:03,177 DEBUG /results/orders/benchmark-70/stdout.txt file found 2024-11-13 10:38:03,177 DEBUG --- stderr --- 2024-11-13 10:38:03,177 DEBUG 2024-11-13 10:38:03,177 INFO 2024-11-13 10:38:03,177 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:03,177 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:03,462 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:03,462 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:03,462 DEBUG --- stdout --- 2024-11-13 10:38:03,462 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:03,462 DEBUG --- stderr --- 2024-11-13 10:38:03,462 DEBUG 2024-11-13 10:38:03,462 INFO 2024-11-13 10:38:03,462 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-70/stdout.txt 2024-11-13 10:38:04,282 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-13 10:38:04,282 DEBUG --- stdout --- 2024-11-13 10:38:04,282 DEBUG 6068 /results/orders/benchmark-70/stdout.txt 2024-11-13 10:38:04,282 DEBUG --- stderr --- 2024-11-13 10:38:04,282 DEBUG 2024-11-13 10:38:04,282 INFO - Download file (size 6068k) 2024-11-13 10:38:04,282 INFO 2024-11-13 10:38:04,282 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:04,282 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:04,568 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:04,568 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:04,568 DEBUG --- stdout --- 2024-11-13 10:38:04,568 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:04,568 DEBUG --- stderr --- 2024-11-13 10:38:04,568 DEBUG source : /results/orders/benchmark-70/stdout.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/stdout.txt 2024-11-13 10:38:04,568 INFO 2024-11-13 10:38:04,568 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:04,568 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:04,855 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:04,855 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:04,855 DEBUG --- stdout --- 2024-11-13 10:38:04,855 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:04,855 DEBUG --- stderr --- 2024-11-13 10:38:04,855 DEBUG 2024-11-13 10:38:04,855 INFO 2024-11-13 10:38:04,855 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-70/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/stdout.txt 2024-11-13 10:38:04,855 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-13 10:38:06,208 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:06,208 DEBUG --- stdout --- 2024-11-13 10:38:06,208 DEBUG tar: Removing leading `/' from member names 2024-11-13 10:38:06,208 DEBUG --- stderr --- 2024-11-13 10:38:06,208 DEBUG ________________________________________________________________________________ [2024-11-13 10:38:06] benchmark-70 show_cmd : Display order command ________________________________________________________________________________ 2024-11-13 10:38:06,209 INFO 2024-11-13 10:38:06,209 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:06,209 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:06,495 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:06,495 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:06,495 DEBUG --- stdout --- 2024-11-13 10:38:06,495 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:06,495 DEBUG --- stderr --- 2024-11-13 10:38:06,495 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-13 10:38:06,495 INFO 2024-11-13 10:38:06,495 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:06,495 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:06,781 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:06,781 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:06,781 DEBUG --- stdout --- 2024-11-13 10:38:06,781 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:06,781 DEBUG --- stderr --- 2024-11-13 10:38:06,781 DEBUG 2024-11-13 10:38:06,782 INFO 2024-11-13 10:38:06,782 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-70/cmd.txt" ]; then echo "/results/orders/benchmark-70/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-70/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-70/cmd.txt file found" 2024-11-13 10:38:06,782 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-13 10:38:07,603 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-13 10:38:07,603 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:07,603 DEBUG --- stdout --- 2024-11-13 10:38:07,603 DEBUG /results/orders/benchmark-70/cmd.txt file found 2024-11-13 10:38:07,603 DEBUG --- stderr --- 2024-11-13 10:38:07,603 DEBUG 2024-11-13 10:38:07,603 INFO 2024-11-13 10:38:07,603 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:07,603 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:07,888 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:07,888 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:07,888 DEBUG --- stdout --- 2024-11-13 10:38:07,888 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:07,888 DEBUG --- stderr --- 2024-11-13 10:38:07,888 DEBUG 2024-11-13 10:38:07,888 INFO 2024-11-13 10:38:07,889 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-70/cmd.txt 2024-11-13 10:38:08,742 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-13 10:38:08,742 DEBUG --- stdout --- 2024-11-13 10:38:08,742 DEBUG 4 /results/orders/benchmark-70/cmd.txt 2024-11-13 10:38:08,742 DEBUG --- stderr --- 2024-11-13 10:38:08,742 DEBUG 2024-11-13 10:38:08,742 INFO - Download file (size 4k) 2024-11-13 10:38:08,742 INFO 2024-11-13 10:38:08,742 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:08,742 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:09,025 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:09,025 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:09,025 DEBUG --- stdout --- 2024-11-13 10:38:09,025 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:09,025 DEBUG --- stderr --- 2024-11-13 10:38:09,025 DEBUG source : /results/orders/benchmark-70/cmd.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/cmd.txt 2024-11-13 10:38:09,026 INFO 2024-11-13 10:38:09,026 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-13 10:38:09,026 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-13 10:38:09,312 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-13 10:38:09,313 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:09,313 DEBUG --- stdout --- 2024-11-13 10:38:09,313 DEBUG overseer-0-6644bb6697-rchxr 2024-11-13 10:38:09,313 DEBUG --- stderr --- 2024-11-13 10:38:09,314 DEBUG 2024-11-13 10:38:09,314 INFO 2024-11-13 10:38:09,314 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-70/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/cmd.txt 2024-11-13 10:38:09,314 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-13 10:38:10,100 INFO [loop_until]: OK (rc = 0) 2024-11-13 10:38:10,100 DEBUG --- stdout --- 2024-11-13 10:38:10,100 DEBUG tar: Removing leading `/' from member names 2024-11-13 10:38:10,100 DEBUG --- stderr --- 2024-11-13 10:38:10,101 DEBUG 2024-11-13 10:38:10,101 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/cmd.txt is small (1 lines), printing all lines: 2024-11-13 10:38:10,101 DEBUG ----- output ----- 2024-11-13 10:38:10,101 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-70" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self70- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=70 -Duser_password=Pa_ssw0rd" 2024-11-13 10:38:10,101 INFO ________________________________________________________________________________ [2024-11-13 10:38:10] benchmark-70 show_rc : Display rc order ________________________________________________________________________________ 2024-11-13 10:38:10,101 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/rc.txt is small (1 lines), printing all lines: 2024-11-13 10:38:10,101 DEBUG ----- output ----- 2024-11-13 10:38:10,101 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-11-13 10:38:10,101 INFO ________________________________________________________________________________ [2024-11-13 10:38:10] benchmark-70 show_stdout : Display stdout order ________________________________________________________________________________ 2024-11-13 10:38:10,109 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/stdout.txt is 68957 lines): 2024-11-13 10:38:10,109 DEBUG ----- output ----- 2024-11-13 10:38:10,109 INFO 2024-11-13 09:37:31,732 DEBUG Creating results folder /results/gatling/benchmark-70 2024-11-13 10:38:10,109 INFO 2024-11-13 09:37:31,740 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpo41ogj3f 2024-11-13 10:38:10,109 INFO 2024-11-13 09:37:31,742 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-70" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self70- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=70 -Duser_password=**** 2024-11-13 10:38:10,109 INFO [INFO] Scanning for projects... 2024-11-13 10:38:10,109 INFO [INFO] 2024-11-13 10:38:10,109 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2024-11-13 10:38:10,109 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2024-11-13 10:38:10,109 INFO [INFO] from pom.xml 2024-11-13 10:38:10,109 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2024-11-13 10:38:10,109 INFO [INFO] 2024-11-13 10:38:10,109 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2024-11-13 10:38:10,109 INFO [INFO] 2024-11-13 10:38:10,109 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2024-11-13 10:38:10,109 INFO [INFO] skip non existing resourceDirectory /tmp/tmpo41ogj3f/src/main/resources 2024-11-13 10:38:10,109 INFO [INFO] 2024-11-13 10:38:10,109 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2024-11-13 10:38:10,110 INFO [INFO] No sources to compile 2024-11-13 10:38:10,110 INFO [INFO] 2024-11-13 10:38:10,110 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2024-11-13 10:38:10,110 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2024-11-13 10:38:10,110 INFO [INFO] 2024-11-13 10:38:10,110 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2024-11-13 10:38:10,110 INFO [INFO] Nothing to compile - all classes are up to date. 2024-11-13 10:38:10,110 INFO [INFO] 2024-11-13 10:38:10,110 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2024-11-13 10:38:10,110 INFO [INFO] compiling 38 Scala sources to /tmp/tmpo41ogj3f/target/test-classes ... 2024-11-13 10:38:10,110 INFO [INFO] compile in 6.8 s 2024-11-13 10:38:10,110 INFO [INFO] 2024-11-13 10:38:10,110 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2024-11-13 10:38:10,110 INFO [INFO] 2024-11-13 10:38:10,110 INFO [INFO] 2024-11-13 10:38:10,110 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2024-11-13 10:38:10,110 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2024-11-13 10:38:10,110 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2024-11-13 10:38:10,110 INFO Simulation com.forgerock.pyrock.Loadtest started... 2024-11-13 10:38:10,110 INFO 09:37:46.451 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-13 10:38:10,110 INFO 09:37:47.525 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-13 10:38:10,110 INFO 2024-11-13 10:38:10,110 INFO ================================================================================ 2024-11-13 10:38:10,110 INFO 2024-11-13 09:37:47 GMT 5s elapsed 2024-11-13 10:38:10,110 INFO ---- Requests ------------------------------------------------------------------ 2024-11-13 10:38:10,110 INFO > Global (OK=341 KO=0 ) 2024-11-13 10:38:10,110 INFO > restLoginInitiate (OK=28 KO=0 ) 2024-11-13 10:38:10,110 INFO > restLoginUsernamePasswordCallback (OK=26 KO=0 ) 2024-11-13 10:38:10,110 INFO > User Authorize PKCE stage (OK=31 KO=0 ) 2024-11-13 10:38:10,110 INFO > User AccessToken PKCE stage (OK=30 KO=0 ) 2024-11-13 10:38:10,110 INFO > tokenUserinfo (OK=6 KO=0 ) 2024-11-13 10:38:10,110 INFO > Skip 2FA (OK=10 KO=0 ) 2024-11-13 10:38:10,110 INFO > GetUUid (OK=7 KO=0 ) 2024-11-13 10:38:10,110 INFO > GetOpenidConfig (OK=7 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI-Post-Login - stage 1 (OK=9 KO=0 ) 2024-11-13 10:38:10,110 INFO > CreatePolicy (OK=7 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=9 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI AM idFromSession (OK=9 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI AM validateGoto (OK=9 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI-Post-Login - stage 2 (OK=8 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=8 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI Enduser appAuthHelper2 (OK=8 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI Enduser appAuthHelper1 (OK=8 KO=0 ) 2024-11-13 10:38:10,110 INFO > restloginProgressiveProfileCallback (OK=3 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI-Post-Login - stage 3 (OK=7 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=6 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI Enduser sessioncheck (OK=6 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI IDM uiconfig (OK=6 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI IDM version (OK=6 KO=0 ) 2024-11-13 10:38:10,110 INFO > UI IDM login (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI IDM features (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI IDM privilege (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI IDM user (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI IDM dashboard (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI IDM managed user schema (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI IDM oidcToken (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > userinfo (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI-Logout (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI-Logout Redirect 1 (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI AM revoke2 (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI AM revoke1 (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > UI AM endsession (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > loginTreeWorkflow_restLoginInitiate (OK=1 KO=0 ) 2024-11-13 10:38:10,111 INFO > RootUserinfo (OK=6 KO=0 ) 2024-11-13 10:38:10,111 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2024-11-13 10:38:10,111 INFO > loginTreeWorkflow_restloginProgressiveProfileCallback (OK=1 KO=0 ) 2024-11-13 10:38:10,111 INFO ---- Errors -------------------------------------------------------------------- 2024-11-13 10:38:10,111 INFO > tokenUserinfo: No attribute named 'access_token' is defined 1 (100.0%) 2024-11-13 10:38:10,111 INFO 2024-11-13 10:38:10,111 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-13 10:38:10,111 INFO [- ] 0% 2024-11-13 10:38:10,111 INFO waiting: 253165 / active: 15 / done: 14 2024-11-13 10:38:10,111 INFO ================================================================================ 2024-11-13 10:38:10,111 INFO 2024-11-13 10:38:10,111 INFO 09:37:48.155 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-13 10:38:10,111 INFO 09:37:50.108 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-13 10:38:10,111 INFO 09:37:50.289 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-13 10:38:10,111 INFO 09:37:50.741 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-13 10:38:10,111 INFO 09:37:51.494 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-13 10:38:10,111 INFO 2024-11-13 10:38:10,111 INFO ================================================================================ 2024-11-13 10:38:10,111 INFO 2024-11-13 09:37:52 GMT 10s elapsed 2024-11-13 10:38:10,111 INFO ---- Requests ------------------------------------------------------------------ 2024-11-13 10:38:10,111 INFO > Global (OK=1355 KO=0 ) 2024-11-13 10:38:10,111 INFO [...] 2024-11-13 10:38:10,122 INFO > DeletePolicy (OK=80327 KO=19 ) 2024-11-13 10:38:10,122 INFO ---- Errors -------------------------------------------------------------------- 2024-11-13 10:38:10,122 INFO > tokenUserinfo: No attribute named 'access_token' is defined 14139 (99.23%) 2024-11-13 10:38:10,122 INFO > status.find.in([200, 209], 304), found 409 67 ( 0.47%) 2024-11-13 10:38:10,122 INFO > status.find.in([200, 209], 304), found 404 28 ( 0.20%) 2024-11-13 10:38:10,122 INFO > status.find.is(200), but actually found 502 3 ( 0.02%) 2024-11-13 10:38:10,122 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 2 ( 0.01%) 2024-11-13 10:38:10,122 INFO 2024-11-13 10:38:10,122 INFO > status.find.in([200, 209], 304), found 502 2 ( 0.01%) 2024-11-13 10:38:10,122 INFO > status.find.is(302), but actually found 502 1 ( 0.01%) 2024-11-13 10:38:10,122 INFO > status.find.in([200, 209], 304), found 400 1 ( 0.01%) 2024-11-13 10:38:10,122 INFO > status.find.in([200, 209], 304), found 401 1 ( 0.01%) 2024-11-13 10:38:10,122 INFO > headerRegex((location,#id_token=(.*))).find.exists, found noth 1 ( 0.01%) 2024-11-13 10:38:10,122 INFO ing 2024-11-13 10:38:10,122 INFO > userinfo: No attribute named 'access_token' is defined 1 ( 0.01%) 2024-11-13 10:38:10,122 INFO > UI AM revoke1: No attribute named 'access_token' is defined 1 ( 0.01%) 2024-11-13 10:38:10,122 INFO > UI AM endsession: No attribute named 'id_token_2' is defined 1 ( 0.01%) 2024-11-13 10:38:10,122 INFO 2024-11-13 10:38:10,122 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-13 10:38:10,122 INFO [#########################################################################-] 99% 2024-11-13 10:38:10,122 INFO waiting: 2079 / active: 334 / done: 250781 2024-11-13 10:38:10,122 INFO ================================================================================ 2024-11-13 10:38:10,122 INFO 2024-11-13 10:38:10,122 INFO 10:37:42.535 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 251114: j.i.IOException: Premature close 2024-11-13 10:38:10,122 INFO 10:37:42.535 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 251115: j.i.IOException: Premature close 2024-11-13 10:38:10,122 INFO 10:37:42.535 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 251113: j.i.IOException: Premature close 2024-11-13 10:38:10,122 INFO 10:37:42.535 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-13 10:38:10,122 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-13 10:38:10,122 INFO Request: 2024-11-13 10:38:10,122 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-13 10:38:10,122 INFO ========================= 2024-11-13 10:38:10,122 INFO Session: 2024-11-13 10:38:10,123 INFO Session(idc.benchmark.Mix2024,251114,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.130845, randomPolicyName -> testPolicy969914, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2361d2a8, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3, password -> Pa_ssw0rd, fake-ip -> 68.252.225.163, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@9788696),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x0000789dd869a0e0@4863e1f1,io.netty.channel.epoll.EpollEventLoop@2bef51f2) 2024-11-13 10:38:10,123 INFO ========================= 2024-11-13 10:38:10,123 INFO HTTP request: 2024-11-13 10:38:10,123 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/authenticate 2024-11-13 10:38:10,123 INFO headers: 2024-11-13 10:38:10,123 INFO accept: application/json 2024-11-13 10:38:10,123 INFO content-type: application/json 2024-11-13 10:38:10,123 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3 2024-11-13 10:38:10,123 INFO X-Forwarded-For: 68.252.225.163 2024-11-13 10:38:10,123 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-13 10:38:10,123 INFO content-length: 0 2024-11-13 10:38:10,123 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-13 10:38:10,123 INFO ========================= 2024-11-13 10:38:10,123 INFO HTTP response: 2024-11-13 10:38:10,123 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-13 10:38:10,123 INFO 10:37:42.535 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-13 10:38:10,123 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-13 10:38:10,123 INFO Request: 2024-11-13 10:38:10,123 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-13 10:38:10,123 INFO ========================= 2024-11-13 10:38:10,123 INFO Session: 2024-11-13 10:38:10,123 INFO Session(idc.benchmark.Mix2024,251115,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.70529, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@6c6e5cc1, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0, password -> Pa_ssw0rd, fake-ip -> 166.53.27.210, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@153ebc71),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x0000789dd869a0e0@4863e1f1,io.netty.channel.epoll.EpollEventLoop@650eab8) 2024-11-13 10:38:10,123 INFO ========================= 2024-11-13 10:38:10,123 INFO HTTP request: 2024-11-13 10:38:10,123 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/authenticate 2024-11-13 10:38:10,123 INFO headers: 2024-11-13 10:38:10,123 INFO accept: application/json 2024-11-13 10:38:10,123 INFO content-type: application/json 2024-11-13 10:38:10,123 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0 2024-11-13 10:38:10,123 INFO X-Forwarded-For: 166.53.27.210 2024-11-13 10:38:10,123 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-13 10:38:10,123 INFO content-length: 0 2024-11-13 10:38:10,123 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-13 10:38:10,123 INFO ========================= 2024-11-13 10:38:10,123 INFO HTTP response: 2024-11-13 10:38:10,123 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-13 10:38:10,123 INFO 10:37:42.535 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-13 10:38:10,123 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-13 10:38:10,123 INFO Request: 2024-11-13 10:38:10,123 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-13 10:38:10,123 INFO ========================= 2024-11-13 10:38:10,123 INFO Session: 2024-11-13 10:38:10,123 INFO Session(idc.benchmark.Mix2024,251113,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.76921, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@26b2b911, fake-user-agent -> Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@2a342b),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x0000789dd869a0e0@4863e1f1,io.netty.channel.epoll.EpollEventLoop@5b7ea70d) 2024-11-13 10:38:10,123 INFO ========================= 2024-11-13 10:38:10,123 INFO HTTP request: 2024-11-13 10:38:10,123 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/authenticate 2024-11-13 10:38:10,123 INFO headers: 2024-11-13 10:38:10,123 INFO accept: application/json 2024-11-13 10:38:10,123 INFO content-type: application/json 2024-11-13 10:38:10,123 INFO user-agent: Mozilla/5.0 (iPhone; CPU iPhone OS 10_3 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) CriOS/56.0.2924.75 Mobile/14E5239e Safari/602.1 2024-11-13 10:38:10,124 INFO X-Forwarded-For: 42.42.42.42 2024-11-13 10:38:10,124 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-13 10:38:10,124 INFO content-length: 0 2024-11-13 10:38:10,124 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-13 10:38:10,124 INFO ========================= 2024-11-13 10:38:10,124 INFO HTTP response: 2024-11-13 10:38:10,124 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-13 10:38:10,124 INFO 10:37:42.536 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-104' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-13 10:38:10,124 INFO 10:37:42.536 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-133' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-13 10:38:10,124 INFO 10:37:42.536 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-133' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-13 10:38:10,124 INFO [INFO] ------------------------------------------------------------------------ 2024-11-13 10:38:10,124 INFO [INFO] BUILD SUCCESS 2024-11-13 10:38:10,124 INFO [INFO] ------------------------------------------------------------------------ 2024-11-13 10:38:10,124 INFO [INFO] Total time: 01:00 h 2024-11-13 10:38:10,124 INFO [INFO] Finished at: 2024-11-13T10:37:42Z 2024-11-13 10:38:10,124 INFO [INFO] ------------------------------------------------------------------------ 2024-11-13 10:38:10,124 INFO 2024-11-13 10:37:42,633 INFO Gatling simulation run ended successfully 2024-11-13 10:38:10,124 INFO 2024-11-13 10:37:42,633 DEBUG No archive name provided. No archive will be created 2024-11-13 10:38:10,124 INFO ________________________________________________________________________________ [2024-11-13 10:38:10] benchmark-70 show_stderr : Display stderr order ________________________________________________________________________________ 2024-11-13 10:38:10,124 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-70/stderr.txt is small (0 lines), printing all lines: 2024-11-13 10:38:10,124 DEBUG ----- output ----- 2024-11-13 10:38:10,124 DEBUG 2024-11-13 10:38:10,124 INFO ________________________________________________________________________________ [2024-11-13 10:38:10] benchmark-70 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-11-13 10:38:10] benchmark-70 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-11-13 10:38:10] benchmark-70 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped