--Task-- name: benchmark-10 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10-', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 10} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-11-14 01:26:35] benchmark-10 pre : N/A ________________________________________________________________________________ 2024-11-14 01:26:35 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2024-11-14 01:26:35 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-10/stdout.txt Pod log : /results/orders/benchmark-10 2024-11-14 01:26:36,105 INFO 2024-11-14 01:26:36,105 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 01:26:36,105 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 01:26:36,381 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 01:26:36,382 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:36,382 DEBUG --- stdout --- 2024-11-14 01:26:36,382 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 01:26:36,382 DEBUG --- stderr --- 2024-11-14 01:26:36,382 DEBUG 2024-11-14 01:26:36 - INFO: Get overseer pod resources requests memory 2024-11-14 01:26:36,382 INFO 2024-11-14 01:26:36,382 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-6644bb6697-rchxr --output jsonpath={.spec.containers[].resources.requests.memory} 2024-11-14 01:26:36,382 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-14 01:26:36,681 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:36,681 DEBUG --- stdout --- 2024-11-14 01:26:36,681 DEBUG 4Gi 2024-11-14 01:26:36,681 DEBUG --- stderr --- 2024-11-14 01:26:36,681 DEBUG ________________________________________________________________________________ [2024-11-14 01:26:36] benchmark-10 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-11-14 01:26:36,681 INFO 2024-11-14 01:26:36,682 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 01:26:36,682 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 01:26:36,959 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 01:26:36,959 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:36,959 DEBUG --- stdout --- 2024-11-14 01:26:36,959 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 01:26:36,959 DEBUG --- stderr --- 2024-11-14 01:26:36,959 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2024-11-14 01:26:36] benchmark-10 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-11-14 01:26:36,960 INFO 2024-11-14 01:26:36,960 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 01:26:36,960 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 01:26:37,236 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 01:26:37,236 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:37,236 DEBUG --- stdout --- 2024-11-14 01:26:37,236 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 01:26:37,236 DEBUG --- stderr --- 2024-11-14 01:26:37,236 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json { "name": "benchmark-10", "command": " /lodestar/lodestar.py run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-benchmark\" --results-folder=\"/results/gatling/benchmark-10\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-10" } ________________________________________________________________________________ [2024-11-14 01:26:37] benchmark-10 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-11-14 01:26:37,239 INFO 2024-11-14 01:26:37,239 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-11-14 01:26:37,239 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-14 01:26:37,524 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-14 01:26:37,524 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:37,524 DEBUG --- stdout --- 2024-11-14 01:26:37,524 DEBUG WAITING 2024-11-14 01:26:37,524 DEBUG --- stderr --- 2024-11-14 01:26:37,524 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 25 0 --:--:-- --:--:-- --:--:-- 25 ________________________________________________________________________________ [2024-11-14 01:26:37] benchmark-10 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-11-14 01:26:37,525 INFO 2024-11-14 01:26:37,525 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 01:26:37,525 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 01:26:37,803 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 01:26:37,803 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:37,803 DEBUG --- stdout --- 2024-11-14 01:26:37,803 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 01:26:37,803 DEBUG --- stderr --- 2024-11-14 01:26:37,803 DEBUG 2024-11-14 01:26:37,803 INFO 2024-11-14 01:26:37,803 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json overseer-0-6644bb6697-rchxr:/results/orders/order.json 2024-11-14 01:26:37,803 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-14 01:26:39,191 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:39,191 DEBUG --- stdout --- 2024-11-14 01:26:39,191 DEBUG 2024-11-14 01:26:39,191 DEBUG --- stderr --- 2024-11-14 01:26:39,191 DEBUG Order has been successfully forwarded to overseer 2024-11-14 01:26:39 - INFO: Check if Gatling simulation started successfully 2024-11-14 01:26:39,192 INFO 2024-11-14 01:26:39,192 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 01:26:39,192 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 01:26:39,469 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 01:26:39,469 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:39,470 DEBUG --- stdout --- 2024-11-14 01:26:39,470 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 01:26:39,470 DEBUG --- stderr --- 2024-11-14 01:26:39,470 DEBUG 2024-11-14 01:26:39,470 INFO 2024-11-14 01:26:39,470 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- head --lines 5000 /results/orders/benchmark-10/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2024-11-14 01:26:39,470 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-14 01:26:40,209 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-14 01:26:45,940 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-14 01:26:51,662 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-11-14 01:26:51,662 INFO [loop_until]: OK (rc = 0) 2024-11-14 01:26:51,662 DEBUG --- stdout --- 2024-11-14 01:26:51,662 DEBUG 2024-11-14 01:26:39,921 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpz5b9sp3_ 2024-11-14 01:26:39,923 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpz5b9sp3_/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmpz5b9sp3_/target/test-classes ... [INFO] compile in 6.9 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2024-11-14 01:26:51,662 DEBUG --- stderr --- 2024-11-14 01:26:51,662 DEBUG ________________________________________________________________________________ [2024-11-14 01:26:51] benchmark-10 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 04s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 05s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 07s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2024-11-14 02:27:00] benchmark-10 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-11-14 02:27:00,743 INFO 2024-11-14 02:27:00,743 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:00,743 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:01,041 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:01,041 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:01,041 DEBUG --- stdout --- 2024-11-14 02:27:01,041 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:01,041 DEBUG --- stderr --- 2024-11-14 02:27:01,041 DEBUG 2024-11-14 02:27:01,041 INFO 2024-11-14 02:27:01,041 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- rm -f /results/orders/order.json 2024-11-14 02:27:01,041 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-14 02:27:01,819 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:01,819 DEBUG --- stdout --- 2024-11-14 02:27:01,819 DEBUG 2024-11-14 02:27:01,819 DEBUG --- stderr --- 2024-11-14 02:27:01,819 DEBUG Order ran during 1h ________________________________________________________________________________ [2024-11-14 02:27:01] benchmark-10 download_logs : Download individual order files ________________________________________________________________________________ 2024-11-14 02:27:01 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json 2024-11-14 02:27:01,819 INFO 2024-11-14 02:27:01,820 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:01,820 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:02,094 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:02,094 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:02,094 DEBUG --- stdout --- 2024-11-14 02:27:02,094 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:02,094 DEBUG --- stderr --- 2024-11-14 02:27:02,094 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-14 02:27:02,095 INFO 2024-11-14 02:27:02,095 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:02,095 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:02,370 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:02,370 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:02,370 DEBUG --- stdout --- 2024-11-14 02:27:02,370 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:02,371 DEBUG --- stderr --- 2024-11-14 02:27:02,371 DEBUG 2024-11-14 02:27:02,371 INFO 2024-11-14 02:27:02,371 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/rc.txt" ]; then echo "/results/orders/benchmark-10/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-10/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/rc.txt file found" 2024-11-14 02:27:02,371 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-14 02:27:03,168 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-14 02:27:03,168 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:03,168 DEBUG --- stdout --- 2024-11-14 02:27:03,168 DEBUG /results/orders/benchmark-10/rc.txt file found 2024-11-14 02:27:03,169 DEBUG --- stderr --- 2024-11-14 02:27:03,169 DEBUG 2024-11-14 02:27:03,169 INFO 2024-11-14 02:27:03,169 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:03,169 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:03,445 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:03,445 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:03,445 DEBUG --- stdout --- 2024-11-14 02:27:03,446 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:03,446 DEBUG --- stderr --- 2024-11-14 02:27:03,446 DEBUG 2024-11-14 02:27:03,446 INFO 2024-11-14 02:27:03,446 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-10/rc.txt 2024-11-14 02:27:04,241 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-14 02:27:04,241 DEBUG --- stdout --- 2024-11-14 02:27:04,241 DEBUG 4 /results/orders/benchmark-10/rc.txt 2024-11-14 02:27:04,241 DEBUG --- stderr --- 2024-11-14 02:27:04,241 DEBUG 2024-11-14 02:27:04,241 INFO - Download file (size 4k) 2024-11-14 02:27:04,241 INFO 2024-11-14 02:27:04,241 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:04,241 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:04,517 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:04,517 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:04,517 DEBUG --- stdout --- 2024-11-14 02:27:04,517 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:04,517 DEBUG --- stderr --- 2024-11-14 02:27:04,517 DEBUG source : /results/orders/benchmark-10/rc.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2024-11-14 02:27:04,518 INFO 2024-11-14 02:27:04,518 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:04,518 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:04,792 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:04,792 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:04,792 DEBUG --- stdout --- 2024-11-14 02:27:04,792 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:04,792 DEBUG --- stderr --- 2024-11-14 02:27:04,792 DEBUG 2024-11-14 02:27:04,792 INFO 2024-11-14 02:27:04,792 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-10/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2024-11-14 02:27:04,792 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-14 02:27:05,548 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:05,548 DEBUG --- stdout --- 2024-11-14 02:27:05,548 DEBUG tar: Removing leading `/' from member names 2024-11-14 02:27:05,548 DEBUG --- stderr --- 2024-11-14 02:27:05,548 DEBUG 2024-11-14 02:27:05,548 INFO 2024-11-14 02:27:05,548 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:05,549 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:05,824 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:05,825 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:05,825 DEBUG --- stdout --- 2024-11-14 02:27:05,825 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:05,825 DEBUG --- stderr --- 2024-11-14 02:27:05,825 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-14 02:27:05,825 INFO 2024-11-14 02:27:05,825 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:05,825 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:06,100 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:06,100 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:06,100 DEBUG --- stdout --- 2024-11-14 02:27:06,101 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:06,101 DEBUG --- stderr --- 2024-11-14 02:27:06,101 DEBUG 2024-11-14 02:27:06,101 INFO 2024-11-14 02:27:06,101 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/stderr.txt" ]; then echo "/results/orders/benchmark-10/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stderr.txt file found" 2024-11-14 02:27:06,101 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-14 02:27:06,904 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-14 02:27:06,904 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:06,904 DEBUG --- stdout --- 2024-11-14 02:27:06,904 DEBUG /results/orders/benchmark-10/stderr.txt file found 2024-11-14 02:27:06,904 DEBUG --- stderr --- 2024-11-14 02:27:06,904 DEBUG 2024-11-14 02:27:06,904 INFO 2024-11-14 02:27:06,904 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:06,904 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:07,183 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:07,183 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:07,183 DEBUG --- stdout --- 2024-11-14 02:27:07,183 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:07,183 DEBUG --- stderr --- 2024-11-14 02:27:07,183 DEBUG 2024-11-14 02:27:07,183 INFO 2024-11-14 02:27:07,183 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-10/stderr.txt 2024-11-14 02:27:07,972 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-14 02:27:07,972 DEBUG --- stdout --- 2024-11-14 02:27:07,972 DEBUG 0 /results/orders/benchmark-10/stderr.txt 2024-11-14 02:27:07,973 DEBUG --- stderr --- 2024-11-14 02:27:07,973 DEBUG 2024-11-14 02:27:07,973 INFO - Download file (size 0k) 2024-11-14 02:27:07,973 INFO 2024-11-14 02:27:07,973 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:07,973 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:08,251 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:08,252 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:08,253 DEBUG --- stdout --- 2024-11-14 02:27:08,253 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:08,253 DEBUG --- stderr --- 2024-11-14 02:27:08,253 DEBUG source : /results/orders/benchmark-10/stderr.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2024-11-14 02:27:08,253 INFO 2024-11-14 02:27:08,253 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:08,253 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:08,530 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:08,530 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:08,530 DEBUG --- stdout --- 2024-11-14 02:27:08,530 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:08,530 DEBUG --- stderr --- 2024-11-14 02:27:08,530 DEBUG 2024-11-14 02:27:08,530 INFO 2024-11-14 02:27:08,530 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-10/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2024-11-14 02:27:08,530 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-14 02:27:09,302 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:09,303 DEBUG --- stdout --- 2024-11-14 02:27:09,303 DEBUG tar: Removing leading `/' from member names 2024-11-14 02:27:09,303 DEBUG --- stderr --- 2024-11-14 02:27:09,303 DEBUG 2024-11-14 02:27:09,303 INFO 2024-11-14 02:27:09,303 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:09,303 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:09,580 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:09,580 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:09,580 DEBUG --- stdout --- 2024-11-14 02:27:09,580 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:09,580 DEBUG --- stderr --- 2024-11-14 02:27:09,580 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-14 02:27:09,580 INFO 2024-11-14 02:27:09,580 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:09,580 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:09,856 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:09,856 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:09,856 DEBUG --- stdout --- 2024-11-14 02:27:09,856 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:09,856 DEBUG --- stderr --- 2024-11-14 02:27:09,856 DEBUG 2024-11-14 02:27:09,857 INFO 2024-11-14 02:27:09,857 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/stdout.txt" ]; then echo "/results/orders/benchmark-10/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stdout.txt file found" 2024-11-14 02:27:09,857 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-14 02:27:10,657 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-14 02:27:10,657 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:10,657 DEBUG --- stdout --- 2024-11-14 02:27:10,657 DEBUG /results/orders/benchmark-10/stdout.txt file found 2024-11-14 02:27:10,657 DEBUG --- stderr --- 2024-11-14 02:27:10,657 DEBUG 2024-11-14 02:27:10,657 INFO 2024-11-14 02:27:10,657 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:10,657 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:10,932 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:10,932 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:10,932 DEBUG --- stdout --- 2024-11-14 02:27:10,932 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:10,932 DEBUG --- stderr --- 2024-11-14 02:27:10,932 DEBUG 2024-11-14 02:27:10,932 INFO 2024-11-14 02:27:10,932 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-10/stdout.txt 2024-11-14 02:27:11,734 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-14 02:27:11,734 DEBUG --- stdout --- 2024-11-14 02:27:11,734 DEBUG 3492 /results/orders/benchmark-10/stdout.txt 2024-11-14 02:27:11,734 DEBUG --- stderr --- 2024-11-14 02:27:11,734 DEBUG 2024-11-14 02:27:11,734 INFO - Download file (size 3492k) 2024-11-14 02:27:11,734 INFO 2024-11-14 02:27:11,734 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:11,734 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:12,011 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:12,011 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:12,011 DEBUG --- stdout --- 2024-11-14 02:27:12,011 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:12,011 DEBUG --- stderr --- 2024-11-14 02:27:12,011 DEBUG source : /results/orders/benchmark-10/stdout.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2024-11-14 02:27:12,011 INFO 2024-11-14 02:27:12,011 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:12,011 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:12,292 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:12,292 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:12,292 DEBUG --- stdout --- 2024-11-14 02:27:12,292 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:12,292 DEBUG --- stderr --- 2024-11-14 02:27:12,292 DEBUG 2024-11-14 02:27:12,293 INFO 2024-11-14 02:27:12,293 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-10/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2024-11-14 02:27:12,293 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-14 02:27:13,543 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:13,543 DEBUG --- stdout --- 2024-11-14 02:27:13,543 DEBUG tar: Removing leading `/' from member names 2024-11-14 02:27:13,543 DEBUG --- stderr --- 2024-11-14 02:27:13,543 DEBUG ________________________________________________________________________________ [2024-11-14 02:27:13] benchmark-10 show_cmd : Display order command ________________________________________________________________________________ 2024-11-14 02:27:13,543 INFO 2024-11-14 02:27:13,544 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:13,544 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:13,855 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:13,855 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:13,855 DEBUG --- stdout --- 2024-11-14 02:27:13,855 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:13,855 DEBUG --- stderr --- 2024-11-14 02:27:13,855 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-14 02:27:13,856 INFO 2024-11-14 02:27:13,856 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:13,856 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:14,132 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:14,133 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:14,133 DEBUG --- stdout --- 2024-11-14 02:27:14,133 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:14,133 DEBUG --- stderr --- 2024-11-14 02:27:14,133 DEBUG 2024-11-14 02:27:14,133 INFO 2024-11-14 02:27:14,133 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/cmd.txt" ]; then echo "/results/orders/benchmark-10/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-10/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/cmd.txt file found" 2024-11-14 02:27:14,133 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-14 02:27:14,923 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-14 02:27:14,923 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:14,923 DEBUG --- stdout --- 2024-11-14 02:27:14,923 DEBUG /results/orders/benchmark-10/cmd.txt file found 2024-11-14 02:27:14,923 DEBUG --- stderr --- 2024-11-14 02:27:14,923 DEBUG 2024-11-14 02:27:14,923 INFO 2024-11-14 02:27:14,923 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:14,923 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:15,199 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:15,199 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:15,199 DEBUG --- stdout --- 2024-11-14 02:27:15,199 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:15,199 DEBUG --- stderr --- 2024-11-14 02:27:15,199 DEBUG 2024-11-14 02:27:15,199 INFO 2024-11-14 02:27:15,199 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-10/cmd.txt 2024-11-14 02:27:15,998 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-14 02:27:15,998 DEBUG --- stdout --- 2024-11-14 02:27:15,998 DEBUG 4 /results/orders/benchmark-10/cmd.txt 2024-11-14 02:27:15,998 DEBUG --- stderr --- 2024-11-14 02:27:15,998 DEBUG 2024-11-14 02:27:15,998 INFO - Download file (size 4k) 2024-11-14 02:27:15,999 INFO 2024-11-14 02:27:15,999 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:15,999 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:16,275 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:16,275 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:16,275 DEBUG --- stdout --- 2024-11-14 02:27:16,275 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:16,275 DEBUG --- stderr --- 2024-11-14 02:27:16,275 DEBUG source : /results/orders/benchmark-10/cmd.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2024-11-14 02:27:16,275 INFO 2024-11-14 02:27:16,275 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-14 02:27:16,275 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-14 02:27:16,552 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-14 02:27:16,552 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:16,552 DEBUG --- stdout --- 2024-11-14 02:27:16,552 DEBUG overseer-0-6644bb6697-rchxr 2024-11-14 02:27:16,552 DEBUG --- stderr --- 2024-11-14 02:27:16,552 DEBUG 2024-11-14 02:27:16,553 INFO 2024-11-14 02:27:16,553 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-10/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2024-11-14 02:27:16,553 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-14 02:27:17,310 INFO [loop_until]: OK (rc = 0) 2024-11-14 02:27:17,310 DEBUG --- stdout --- 2024-11-14 02:27:17,310 DEBUG tar: Removing leading `/' from member names 2024-11-14 02:27:17,310 DEBUG --- stderr --- 2024-11-14 02:27:17,311 DEBUG 2024-11-14 02:27:17,311 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt is small (1 lines), printing all lines: 2024-11-14 02:27:17,311 DEBUG ----- output ----- 2024-11-14 02:27:17,311 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" 2024-11-14 02:27:17,311 INFO ________________________________________________________________________________ [2024-11-14 02:27:17] benchmark-10 show_rc : Display rc order ________________________________________________________________________________ 2024-11-14 02:27:17,311 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt is small (1 lines), printing all lines: 2024-11-14 02:27:17,311 DEBUG ----- output ----- 2024-11-14 02:27:17,311 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-11-14 02:27:17,311 INFO ________________________________________________________________________________ [2024-11-14 02:27:17] benchmark-10 show_stdout : Display stdout order ________________________________________________________________________________ 2024-11-14 02:27:17,316 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt is 46974 lines): 2024-11-14 02:27:17,316 DEBUG ----- output ----- 2024-11-14 02:27:17,316 INFO 2024-11-14 01:26:39,921 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpz5b9sp3_ 2024-11-14 02:27:17,316 INFO 2024-11-14 01:26:39,923 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=**** 2024-11-14 02:27:17,316 INFO [INFO] Scanning for projects... 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2024-11-14 02:27:17,316 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2024-11-14 02:27:17,316 INFO [INFO] from pom.xml 2024-11-14 02:27:17,316 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2024-11-14 02:27:17,316 INFO [INFO] skip non existing resourceDirectory /tmp/tmpz5b9sp3_/src/main/resources 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2024-11-14 02:27:17,316 INFO [INFO] No sources to compile 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2024-11-14 02:27:17,316 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2024-11-14 02:27:17,316 INFO [INFO] Nothing to compile - all classes are up to date. 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2024-11-14 02:27:17,316 INFO [INFO] compiling 38 Scala sources to /tmp/tmpz5b9sp3_/target/test-classes ... 2024-11-14 02:27:17,316 INFO [INFO] compile in 6.9 s 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] 2024-11-14 02:27:17,316 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2024-11-14 02:27:17,316 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2024-11-14 02:27:17,316 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2024-11-14 02:27:17,316 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2024-11-14 02:27:17,316 INFO Simulation com.forgerock.pyrock.Loadtest started... 2024-11-14 02:27:17,316 INFO 2024-11-14 02:27:17,316 INFO ================================================================================ 2024-11-14 02:27:17,316 INFO 2024-11-14 01:26:55 GMT 5s elapsed 2024-11-14 02:27:17,316 INFO ---- Requests ------------------------------------------------------------------ 2024-11-14 02:27:17,316 INFO > Global (OK=53 KO=0 ) 2024-11-14 02:27:17,316 INFO > restLoginInitiate (OK=4 KO=0 ) 2024-11-14 02:27:17,316 INFO > restLoginUsernamePasswordCallback (OK=4 KO=0 ) 2024-11-14 02:27:17,316 INFO > UI-Post-Login - stage 1 (OK=2 KO=0 ) 2024-11-14 02:27:17,316 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=2 KO=0 ) 2024-11-14 02:27:17,316 INFO > UI AM validateGoto (OK=2 KO=0 ) 2024-11-14 02:27:17,316 INFO > UI AM idFromSession (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > User Authorize PKCE stage (OK=5 KO=0 ) 2024-11-14 02:27:17,317 INFO > User AccessToken PKCE stage (OK=5 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 2 (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI Enduser appAuthHelper2 (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI Enduser appAuthHelper1 (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 3 (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI Enduser sessioncheck (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM uiconfig (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM version (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM login (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM features (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM privilege (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM dashboard (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM user (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM managed user schema (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM oidcToken (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > Skip 2FA (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > userinfo (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Logout (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Logout Redirect 1 (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI AM revoke2 (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI AM revoke1 (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI AM endsession (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO > RootUserinfo (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > tokenUserinfo (OK=1 KO=0 ) 2024-11-14 02:27:17,317 INFO 2024-11-14 02:27:17,317 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-14 02:27:17,317 INFO [- ] 0% 2024-11-14 02:27:17,317 INFO waiting: 35931 / active: 2 / done: 2 2024-11-14 02:27:17,317 INFO ================================================================================ 2024-11-14 02:27:17,317 INFO 2024-11-14 02:27:17,317 INFO 2024-11-14 02:27:17,317 INFO ================================================================================ 2024-11-14 02:27:17,317 INFO 2024-11-14 01:27:00 GMT 10s elapsed 2024-11-14 02:27:17,317 INFO ---- Requests ------------------------------------------------------------------ 2024-11-14 02:27:17,317 INFO > Global (OK=160 KO=0 ) 2024-11-14 02:27:17,317 INFO > restLoginInitiate (OK=16 KO=0 ) 2024-11-14 02:27:17,317 INFO > restLoginUsernamePasswordCallback (OK=16 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 1 (OK=3 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=3 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI AM validateGoto (OK=3 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI AM idFromSession (OK=3 KO=0 ) 2024-11-14 02:27:17,317 INFO > User Authorize PKCE stage (OK=17 KO=0 ) 2024-11-14 02:27:17,317 INFO > User AccessToken PKCE stage (OK=17 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 2 (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI Enduser appAuthHelper2 (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI Enduser appAuthHelper1 (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 3 (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI Enduser sessioncheck (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO > UI IDM uiconfig (OK=2 KO=0 ) 2024-11-14 02:27:17,317 INFO [...] 2024-11-14 02:27:17,324 INFO > UI IDM privilege (OK=7601 KO=0 ) 2024-11-14 02:27:17,324 INFO > UI IDM dashboard (OK=7601 KO=0 ) 2024-11-14 02:27:17,324 INFO > UI IDM user (OK=7601 KO=0 ) 2024-11-14 02:27:17,324 INFO > UI IDM managed user schema (OK=7601 KO=0 ) 2024-11-14 02:27:17,324 INFO > UI IDM oidcToken (OK=7602 KO=0 ) 2024-11-14 02:27:17,324 INFO > Skip 2FA (OK=19152 KO=0 ) 2024-11-14 02:27:17,324 INFO > userinfo (OK=7601 KO=0 ) 2024-11-14 02:27:17,324 INFO > UI-Logout (OK=7602 KO=0 ) 2024-11-14 02:27:17,324 INFO > UI-Logout Redirect 1 (OK=7602 KO=0 ) 2024-11-14 02:27:17,324 INFO > UI AM revoke2 (OK=7600 KO=1 ) 2024-11-14 02:27:17,324 INFO > UI AM revoke1 (OK=7601 KO=0 ) 2024-11-14 02:27:17,324 INFO > UI AM endsession (OK=7602 KO=0 ) 2024-11-14 02:27:17,324 INFO > RootUserinfo (OK=25040 KO=0 ) 2024-11-14 02:27:17,324 INFO > tokenUserinfo (OK=7564 KO=0 ) 2024-11-14 02:27:17,324 INFO > GetUUid (OK=11497 KO=0 ) 2024-11-14 02:27:17,324 INFO > GetOpenidConfig (OK=34428 KO=0 ) 2024-11-14 02:27:17,324 INFO > CreatePolicy (OK=11497 KO=0 ) 2024-11-14 02:27:17,324 INFO > getIdToken (OK=2643 KO=0 ) 2024-11-14 02:27:17,324 INFO > getIdToken Redirect 1 (OK=2643 KO=0 ) 2024-11-14 02:27:17,324 INFO > createOrganization (OK=2642 KO=1 ) 2024-11-14 02:27:17,324 INFO > queryOrganization (OK=2642 KO=0 ) 2024-11-14 02:27:17,324 INFO > deleteOrganization (OK=2642 KO=0 ) 2024-11-14 02:27:17,324 INFO > ReadPolicy (OK=11476 KO=0 ) 2024-11-14 02:27:17,324 INFO > loginTreeWorkflow_restLoginInitiate (OK=1277 KO=0 ) 2024-11-14 02:27:17,324 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1277 KO=0 ) 2024-11-14 02:27:17,324 INFO > DeletePolicy (OK=11455 KO=0 ) 2024-11-14 02:27:17,324 INFO > loginTreeWorkflow_restloginProgressiveProfileCallback (OK=3 KO=0 ) 2024-11-14 02:27:17,324 INFO > restloginProgressiveProfileCallback (OK=10 KO=0 ) 2024-11-14 02:27:17,324 INFO ---- Errors -------------------------------------------------------------------- 2024-11-14 02:27:17,324 INFO > tokenUserinfo: No attribute named 'access_token' is defined 8 (38.10%) 2024-11-14 02:27:17,324 INFO > status.find.in([200, 209], 304), found 502 4 (19.05%) 2024-11-14 02:27:17,324 INFO > status.find.is(200), but actually found 502 3 (14.29%) 2024-11-14 02:27:17,324 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 1 ( 4.76%) 2024-11-14 02:27:17,324 INFO 2024-11-14 02:27:17,324 INFO > userinfo: No attribute named 'access_token' is defined 1 ( 4.76%) 2024-11-14 02:27:17,324 INFO > UI AM revoke1: No attribute named 'access_token' is defined 1 ( 4.76%) 2024-11-14 02:27:17,324 INFO > status.find.is(302), but actually found 502 1 ( 4.76%) 2024-11-14 02:27:17,324 INFO > queryOrganization: No attribute named 'organization_id' is def 1 ( 4.76%) 2024-11-14 02:27:17,324 INFO ined 2024-11-14 02:27:17,324 INFO > deleteOrganization: No attribute named 'organization_id' is de 1 ( 4.76%) 2024-11-14 02:27:17,324 INFO fined 2024-11-14 02:27:17,324 INFO 2024-11-14 02:27:17,324 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-14 02:27:17,324 INFO [#########################################################################-] 98% 2024-11-14 02:27:17,324 INFO waiting: 325 / active: 53 / done: 35557 2024-11-14 02:27:17,324 INFO ================================================================================ 2024-11-14 02:27:17,324 INFO 2024-11-14 02:27:17,324 INFO 02:26:50.715 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 35609: j.i.IOException: Premature close 2024-11-14 02:27:17,324 INFO 02:26:50.715 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 35610: j.i.IOException: Premature close 2024-11-14 02:27:17,324 INFO 02:26:50.715 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-14 02:27:17,324 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-14 02:27:17,324 INFO Request: 2024-11-14 02:27:17,324 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-14 02:27:17,324 INFO ========================= 2024-11-14 02:27:17,325 INFO Session: 2024-11-14 02:27:17,325 INFO Session(idc.benchmark.Mix2024,35609,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.72225, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2cbadf11, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 63.106.180.72, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@7d627a81),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x000078076c699970@6c2215e9,io.netty.channel.epoll.EpollEventLoop@5b7ea70d) 2024-11-14 02:27:17,325 INFO ========================= 2024-11-14 02:27:17,325 INFO HTTP request: 2024-11-14 02:27:17,325 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login 2024-11-14 02:27:17,325 INFO headers: 2024-11-14 02:27:17,325 INFO accept: application/json 2024-11-14 02:27:17,325 INFO content-type: application/json 2024-11-14 02:27:17,325 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 2024-11-14 02:27:17,325 INFO X-Forwarded-For: 63.106.180.72 2024-11-14 02:27:17,325 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-14 02:27:17,325 INFO content-length: 0 2024-11-14 02:27:17,325 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-14 02:27:17,325 INFO ========================= 2024-11-14 02:27:17,325 INFO HTTP response: 2024-11-14 02:27:17,325 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-14 02:27:17,325 INFO 02:26:50.715 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-14 02:27:17,325 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-14 02:27:17,325 INFO Request: 2024-11-14 02:27:17,325 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-14 02:27:17,325 INFO ========================= 2024-11-14 02:27:17,325 INFO Session: 2024-11-14 02:27:17,325 INFO Session(idc.benchmark.Mix2024,35610,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.131055, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@71d58007, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.140 Safari/537.36 Edge/17.17134, password -> Pa_ssw0rd, fake-ip -> 190.23.188.6, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@6063d1b8),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x000078076c699970@6c2215e9,io.netty.channel.epoll.EpollEventLoop@2bef51f2) 2024-11-14 02:27:17,325 INFO ========================= 2024-11-14 02:27:17,325 INFO HTTP request: 2024-11-14 02:27:17,325 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2024-11-14 02:27:17,325 INFO headers: 2024-11-14 02:27:17,325 INFO accept: application/json 2024-11-14 02:27:17,325 INFO content-type: application/json 2024-11-14 02:27:17,325 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.140 Safari/537.36 Edge/17.17134 2024-11-14 02:27:17,325 INFO X-Forwarded-For: 190.23.188.6 2024-11-14 02:27:17,325 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-14 02:27:17,325 INFO content-length: 0 2024-11-14 02:27:17,325 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-14 02:27:17,325 INFO ========================= 2024-11-14 02:27:17,325 INFO HTTP response: 2024-11-14 02:27:17,325 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-14 02:27:17,325 INFO 02:26:50.716 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-14 02:27:17,325 INFO [INFO] ------------------------------------------------------------------------ 2024-11-14 02:27:17,325 INFO [INFO] BUILD SUCCESS 2024-11-14 02:27:17,325 INFO [INFO] ------------------------------------------------------------------------ 2024-11-14 02:27:17,325 INFO [INFO] Total time: 01:00 h 2024-11-14 02:27:17,325 INFO [INFO] Finished at: 2024-11-14T02:26:50Z 2024-11-14 02:27:17,325 INFO [INFO] ------------------------------------------------------------------------ 2024-11-14 02:27:17,325 INFO 2024-11-14 02:26:50,810 INFO Gatling simulation run ended successfully 2024-11-14 02:27:17,325 INFO 2024-11-14 02:26:50,810 DEBUG No archive name provided. No archive will be created 2024-11-14 02:27:17,325 INFO ________________________________________________________________________________ [2024-11-14 02:27:17] benchmark-10 show_stderr : Display stderr order ________________________________________________________________________________ 2024-11-14 02:27:17,325 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt is small (0 lines), printing all lines: 2024-11-14 02:27:17,325 DEBUG ----- output ----- 2024-11-14 02:27:17,325 DEBUG 2024-11-14 02:27:17,325 INFO ________________________________________________________________________________ [2024-11-14 02:27:17] benchmark-10 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-11-14 02:27:17] benchmark-10 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-11-14 02:27:17] benchmark-10 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped