--Task-- name: benchmark-10 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10-', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 10} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-11-20 19:08:15] benchmark-10 pre : N/A ________________________________________________________________________________ 2024-11-20 19:08:15 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2024-11-20 19:08:15 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-10/stdout.txt Pod log : /results/orders/benchmark-10 2024-11-20 19:08:16,457 INFO 2024-11-20 19:08:16,457 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 19:08:16,457 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 19:08:16,729 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 19:08:16,729 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:16,730 DEBUG --- stdout --- 2024-11-20 19:08:16,730 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 19:08:16,730 DEBUG --- stderr --- 2024-11-20 19:08:16,730 DEBUG 2024-11-20 19:08:16 - INFO: Get overseer pod resources requests memory 2024-11-20 19:08:16,730 INFO 2024-11-20 19:08:16,730 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-6644bb6697-rchxr --output jsonpath={.spec.containers[].resources.requests.memory} 2024-11-20 19:08:16,730 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 19:08:17,030 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:17,030 DEBUG --- stdout --- 2024-11-20 19:08:17,030 DEBUG 4Gi 2024-11-20 19:08:17,030 DEBUG --- stderr --- 2024-11-20 19:08:17,030 DEBUG ________________________________________________________________________________ [2024-11-20 19:08:17] benchmark-10 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-11-20 19:08:17,030 INFO 2024-11-20 19:08:17,030 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 19:08:17,030 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 19:08:17,302 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 19:08:17,302 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:17,302 DEBUG --- stdout --- 2024-11-20 19:08:17,302 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 19:08:17,302 DEBUG --- stderr --- 2024-11-20 19:08:17,302 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2024-11-20 19:08:17] benchmark-10 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-11-20 19:08:17,303 INFO 2024-11-20 19:08:17,303 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 19:08:17,303 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 19:08:17,575 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 19:08:17,575 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:17,575 DEBUG --- stdout --- 2024-11-20 19:08:17,575 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 19:08:17,575 DEBUG --- stderr --- 2024-11-20 19:08:17,575 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json { "name": "benchmark-10", "command": " /lodestar/lodestar.py run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-benchmark\" --results-folder=\"/results/gatling/benchmark-10\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-10" } ________________________________________________________________________________ [2024-11-20 19:08:17] benchmark-10 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-11-20 19:08:17,578 INFO 2024-11-20 19:08:17,578 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-11-20 19:08:17,578 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-20 19:08:17,926 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 19:08:17,926 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:17,926 DEBUG --- stdout --- 2024-11-20 19:08:17,926 DEBUG WAITING 2024-11-20 19:08:17,926 DEBUG --- stderr --- 2024-11-20 19:08:17,926 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 20 0 --:--:-- --:--:-- --:--:-- 20 ________________________________________________________________________________ [2024-11-20 19:08:17] benchmark-10 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-11-20 19:08:17,926 INFO 2024-11-20 19:08:17,926 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 19:08:17,926 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 19:08:18,203 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 19:08:18,203 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:18,203 DEBUG --- stdout --- 2024-11-20 19:08:18,203 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 19:08:18,203 DEBUG --- stderr --- 2024-11-20 19:08:18,203 DEBUG 2024-11-20 19:08:18,204 INFO 2024-11-20 19:08:18,204 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json overseer-0-6644bb6697-rchxr:/results/orders/order.json 2024-11-20 19:08:18,204 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 19:08:19,560 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:19,560 DEBUG --- stdout --- 2024-11-20 19:08:19,560 DEBUG 2024-11-20 19:08:19,560 DEBUG --- stderr --- 2024-11-20 19:08:19,560 DEBUG Order has been successfully forwarded to overseer 2024-11-20 19:08:19 - INFO: Check if Gatling simulation started successfully 2024-11-20 19:08:19,561 INFO 2024-11-20 19:08:19,561 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 19:08:19,561 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 19:08:19,834 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 19:08:19,834 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:19,834 DEBUG --- stdout --- 2024-11-20 19:08:19,834 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 19:08:19,834 DEBUG --- stderr --- 2024-11-20 19:08:19,834 DEBUG 2024-11-20 19:08:19,835 INFO 2024-11-20 19:08:19,835 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- head --lines 5000 /results/orders/benchmark-10/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2024-11-20 19:08:19,835 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-20 19:08:20,552 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-20 19:08:26,269 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-20 19:08:32,065 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-11-20 19:08:32,065 INFO [loop_until]: OK (rc = 0) 2024-11-20 19:08:32,065 DEBUG --- stdout --- 2024-11-20 19:08:32,065 DEBUG 2024-11-20 19:08:20,129 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmphqai0a64 2024-11-20 19:08:20,131 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmphqai0a64/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmphqai0a64/target/test-classes ... [INFO] compile in 6.9 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2024-11-20 19:08:32,065 DEBUG --- stderr --- 2024-11-20 19:08:32,065 DEBUG ________________________________________________________________________________ [2024-11-20 19:08:32] benchmark-10 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 04s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 07s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 08s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2024-11-20 20:08:41] benchmark-10 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-11-20 20:08:41,339 INFO 2024-11-20 20:08:41,339 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:41,339 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:41,665 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:41,665 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:41,665 DEBUG --- stdout --- 2024-11-20 20:08:41,665 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:41,665 DEBUG --- stderr --- 2024-11-20 20:08:41,665 DEBUG 2024-11-20 20:08:41,665 INFO 2024-11-20 20:08:41,665 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- rm -f /results/orders/order.json 2024-11-20 20:08:41,665 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 20:08:42,434 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:42,434 DEBUG --- stdout --- 2024-11-20 20:08:42,434 DEBUG 2024-11-20 20:08:42,434 DEBUG --- stderr --- 2024-11-20 20:08:42,434 DEBUG Order ran during 1h ________________________________________________________________________________ [2024-11-20 20:08:42] benchmark-10 download_logs : Download individual order files ________________________________________________________________________________ 2024-11-20 20:08:42 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/order.json 2024-11-20 20:08:42,434 INFO 2024-11-20 20:08:42,434 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:42,434 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:42,706 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:42,706 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:42,706 DEBUG --- stdout --- 2024-11-20 20:08:42,706 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:42,706 DEBUG --- stderr --- 2024-11-20 20:08:42,706 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-20 20:08:42,706 INFO 2024-11-20 20:08:42,706 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:42,706 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:42,977 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:42,977 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:42,977 DEBUG --- stdout --- 2024-11-20 20:08:42,977 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:42,977 DEBUG --- stderr --- 2024-11-20 20:08:42,977 DEBUG 2024-11-20 20:08:42,978 INFO 2024-11-20 20:08:42,978 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/rc.txt" ]; then echo "/results/orders/benchmark-10/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-10/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/rc.txt file found" 2024-11-20 20:08:42,978 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 20:08:43,766 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 20:08:43,766 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:43,767 DEBUG --- stdout --- 2024-11-20 20:08:43,767 DEBUG /results/orders/benchmark-10/rc.txt file found 2024-11-20 20:08:43,767 DEBUG --- stderr --- 2024-11-20 20:08:43,767 DEBUG 2024-11-20 20:08:43,767 INFO 2024-11-20 20:08:43,767 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:43,767 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:44,039 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:44,040 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:44,041 DEBUG --- stdout --- 2024-11-20 20:08:44,041 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:44,041 DEBUG --- stderr --- 2024-11-20 20:08:44,041 DEBUG 2024-11-20 20:08:44,041 INFO 2024-11-20 20:08:44,041 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-10/rc.txt 2024-11-20 20:08:44,816 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-20 20:08:44,817 DEBUG --- stdout --- 2024-11-20 20:08:44,817 DEBUG 4 /results/orders/benchmark-10/rc.txt 2024-11-20 20:08:44,817 DEBUG --- stderr --- 2024-11-20 20:08:44,817 DEBUG 2024-11-20 20:08:44,817 INFO - Download file (size 4k) 2024-11-20 20:08:44,817 INFO 2024-11-20 20:08:44,817 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:44,817 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:45,087 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:45,087 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:45,087 DEBUG --- stdout --- 2024-11-20 20:08:45,087 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:45,087 DEBUG --- stderr --- 2024-11-20 20:08:45,087 DEBUG source : /results/orders/benchmark-10/rc.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2024-11-20 20:08:45,088 INFO 2024-11-20 20:08:45,088 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:45,088 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:45,362 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:45,362 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:45,362 DEBUG --- stdout --- 2024-11-20 20:08:45,362 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:45,362 DEBUG --- stderr --- 2024-11-20 20:08:45,362 DEBUG 2024-11-20 20:08:45,363 INFO 2024-11-20 20:08:45,363 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-10/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt 2024-11-20 20:08:45,363 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-20 20:08:46,123 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:46,123 DEBUG --- stdout --- 2024-11-20 20:08:46,123 DEBUG tar: Removing leading `/' from member names 2024-11-20 20:08:46,123 DEBUG --- stderr --- 2024-11-20 20:08:46,123 DEBUG 2024-11-20 20:08:46,123 INFO 2024-11-20 20:08:46,123 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:46,124 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:46,395 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:46,395 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:46,395 DEBUG --- stdout --- 2024-11-20 20:08:46,395 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:46,395 DEBUG --- stderr --- 2024-11-20 20:08:46,395 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-20 20:08:46,395 INFO 2024-11-20 20:08:46,395 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:46,395 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:46,666 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:46,667 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:46,667 DEBUG --- stdout --- 2024-11-20 20:08:46,667 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:46,667 DEBUG --- stderr --- 2024-11-20 20:08:46,667 DEBUG 2024-11-20 20:08:46,667 INFO 2024-11-20 20:08:46,667 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/stderr.txt" ]; then echo "/results/orders/benchmark-10/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stderr.txt file found" 2024-11-20 20:08:46,667 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 20:08:47,442 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 20:08:47,442 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:47,442 DEBUG --- stdout --- 2024-11-20 20:08:47,442 DEBUG /results/orders/benchmark-10/stderr.txt file found 2024-11-20 20:08:47,442 DEBUG --- stderr --- 2024-11-20 20:08:47,442 DEBUG 2024-11-20 20:08:47,442 INFO 2024-11-20 20:08:47,442 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:47,442 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:47,713 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:47,713 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:47,713 DEBUG --- stdout --- 2024-11-20 20:08:47,713 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:47,713 DEBUG --- stderr --- 2024-11-20 20:08:47,713 DEBUG 2024-11-20 20:08:47,713 INFO 2024-11-20 20:08:47,713 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-10/stderr.txt 2024-11-20 20:08:48,501 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-20 20:08:48,501 DEBUG --- stdout --- 2024-11-20 20:08:48,502 DEBUG 0 /results/orders/benchmark-10/stderr.txt 2024-11-20 20:08:48,502 DEBUG --- stderr --- 2024-11-20 20:08:48,502 DEBUG 2024-11-20 20:08:48,502 INFO - Download file (size 0k) 2024-11-20 20:08:48,502 INFO 2024-11-20 20:08:48,502 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:48,502 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:48,772 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:48,772 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:48,772 DEBUG --- stdout --- 2024-11-20 20:08:48,773 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:48,773 DEBUG --- stderr --- 2024-11-20 20:08:48,773 DEBUG source : /results/orders/benchmark-10/stderr.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2024-11-20 20:08:48,773 INFO 2024-11-20 20:08:48,773 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:48,773 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:49,044 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:49,044 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:49,044 DEBUG --- stdout --- 2024-11-20 20:08:49,045 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:49,045 DEBUG --- stderr --- 2024-11-20 20:08:49,045 DEBUG 2024-11-20 20:08:49,045 INFO 2024-11-20 20:08:49,045 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-10/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt 2024-11-20 20:08:49,046 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-20 20:08:49,753 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:49,753 DEBUG --- stdout --- 2024-11-20 20:08:49,753 DEBUG tar: Removing leading `/' from member names 2024-11-20 20:08:49,753 DEBUG --- stderr --- 2024-11-20 20:08:49,753 DEBUG 2024-11-20 20:08:49,753 INFO 2024-11-20 20:08:49,753 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:49,753 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:50,023 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:50,023 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:50,023 DEBUG --- stdout --- 2024-11-20 20:08:50,023 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:50,023 DEBUG --- stderr --- 2024-11-20 20:08:50,023 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-20 20:08:50,024 INFO 2024-11-20 20:08:50,024 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:50,024 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:50,294 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:50,294 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:50,294 DEBUG --- stdout --- 2024-11-20 20:08:50,294 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:50,294 DEBUG --- stderr --- 2024-11-20 20:08:50,294 DEBUG 2024-11-20 20:08:50,295 INFO 2024-11-20 20:08:50,295 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/stdout.txt" ]; then echo "/results/orders/benchmark-10/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-10/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/stdout.txt file found" 2024-11-20 20:08:50,295 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 20:08:51,075 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 20:08:51,075 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:51,075 DEBUG --- stdout --- 2024-11-20 20:08:51,075 DEBUG /results/orders/benchmark-10/stdout.txt file found 2024-11-20 20:08:51,075 DEBUG --- stderr --- 2024-11-20 20:08:51,075 DEBUG 2024-11-20 20:08:51,076 INFO 2024-11-20 20:08:51,076 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:51,076 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:51,347 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:51,348 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:51,348 DEBUG --- stdout --- 2024-11-20 20:08:51,348 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:51,348 DEBUG --- stderr --- 2024-11-20 20:08:51,348 DEBUG 2024-11-20 20:08:51,348 INFO 2024-11-20 20:08:51,348 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-10/stdout.txt 2024-11-20 20:08:52,123 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-20 20:08:52,123 DEBUG --- stdout --- 2024-11-20 20:08:52,123 DEBUG 3564 /results/orders/benchmark-10/stdout.txt 2024-11-20 20:08:52,123 DEBUG --- stderr --- 2024-11-20 20:08:52,123 DEBUG 2024-11-20 20:08:52,123 INFO - Download file (size 3564k) 2024-11-20 20:08:52,123 INFO 2024-11-20 20:08:52,123 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:52,123 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:52,400 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:52,400 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:52,400 DEBUG --- stdout --- 2024-11-20 20:08:52,400 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:52,400 DEBUG --- stderr --- 2024-11-20 20:08:52,400 DEBUG source : /results/orders/benchmark-10/stdout.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2024-11-20 20:08:52,401 INFO 2024-11-20 20:08:52,401 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:52,401 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:52,675 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:52,675 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:52,675 DEBUG --- stdout --- 2024-11-20 20:08:52,675 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:52,675 DEBUG --- stderr --- 2024-11-20 20:08:52,675 DEBUG 2024-11-20 20:08:52,675 INFO 2024-11-20 20:08:52,675 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-10/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt 2024-11-20 20:08:52,675 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-20 20:08:53,871 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:53,871 DEBUG --- stdout --- 2024-11-20 20:08:53,871 DEBUG tar: Removing leading `/' from member names 2024-11-20 20:08:53,871 DEBUG --- stderr --- 2024-11-20 20:08:53,871 DEBUG ________________________________________________________________________________ [2024-11-20 20:08:53] benchmark-10 show_cmd : Display order command ________________________________________________________________________________ 2024-11-20 20:08:53,871 INFO 2024-11-20 20:08:53,871 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:53,871 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:54,142 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:54,142 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:54,142 DEBUG --- stdout --- 2024-11-20 20:08:54,142 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:54,142 DEBUG --- stderr --- 2024-11-20 20:08:54,142 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-20 20:08:54,142 INFO 2024-11-20 20:08:54,142 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:54,142 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:54,414 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:54,414 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:54,414 DEBUG --- stdout --- 2024-11-20 20:08:54,414 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:54,414 DEBUG --- stderr --- 2024-11-20 20:08:54,414 DEBUG 2024-11-20 20:08:54,415 INFO 2024-11-20 20:08:54,415 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-10/cmd.txt" ]; then echo "/results/orders/benchmark-10/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-10/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-10/cmd.txt file found" 2024-11-20 20:08:54,415 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-20 20:08:55,224 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-20 20:08:55,224 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:55,224 DEBUG --- stdout --- 2024-11-20 20:08:55,224 DEBUG /results/orders/benchmark-10/cmd.txt file found 2024-11-20 20:08:55,224 DEBUG --- stderr --- 2024-11-20 20:08:55,224 DEBUG 2024-11-20 20:08:55,224 INFO 2024-11-20 20:08:55,224 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:55,225 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:55,512 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:55,512 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:55,512 DEBUG --- stdout --- 2024-11-20 20:08:55,512 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:55,512 DEBUG --- stderr --- 2024-11-20 20:08:55,512 DEBUG 2024-11-20 20:08:55,512 INFO 2024-11-20 20:08:55,513 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-10/cmd.txt 2024-11-20 20:08:56,294 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-20 20:08:56,294 DEBUG --- stdout --- 2024-11-20 20:08:56,294 DEBUG 4 /results/orders/benchmark-10/cmd.txt 2024-11-20 20:08:56,294 DEBUG --- stderr --- 2024-11-20 20:08:56,294 DEBUG 2024-11-20 20:08:56,294 INFO - Download file (size 4k) 2024-11-20 20:08:56,294 INFO 2024-11-20 20:08:56,294 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:56,294 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:56,566 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:56,566 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:56,566 DEBUG --- stdout --- 2024-11-20 20:08:56,566 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:56,566 DEBUG --- stderr --- 2024-11-20 20:08:56,566 DEBUG source : /results/orders/benchmark-10/cmd.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2024-11-20 20:08:56,567 INFO 2024-11-20 20:08:56,567 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-20 20:08:56,567 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-20 20:08:56,839 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-20 20:08:56,839 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:56,839 DEBUG --- stdout --- 2024-11-20 20:08:56,839 DEBUG overseer-0-6644bb6697-rchxr 2024-11-20 20:08:56,839 DEBUG --- stderr --- 2024-11-20 20:08:56,839 DEBUG 2024-11-20 20:08:56,839 INFO 2024-11-20 20:08:56,839 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-10/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt 2024-11-20 20:08:56,839 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-20 20:08:57,579 INFO [loop_until]: OK (rc = 0) 2024-11-20 20:08:57,579 DEBUG --- stdout --- 2024-11-20 20:08:57,579 DEBUG tar: Removing leading `/' from member names 2024-11-20 20:08:57,579 DEBUG --- stderr --- 2024-11-20 20:08:57,579 DEBUG 2024-11-20 20:08:57,579 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/cmd.txt is small (1 lines), printing all lines: 2024-11-20 20:08:57,579 DEBUG ----- output ----- 2024-11-20 20:08:57,579 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-10" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=Pa_ssw0rd" 2024-11-20 20:08:57,579 INFO ________________________________________________________________________________ [2024-11-20 20:08:57] benchmark-10 show_rc : Display rc order ________________________________________________________________________________ 2024-11-20 20:08:57,579 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/rc.txt is small (1 lines), printing all lines: 2024-11-20 20:08:57,579 DEBUG ----- output ----- 2024-11-20 20:08:57,579 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-11-20 20:08:57,579 INFO ________________________________________________________________________________ [2024-11-20 20:08:57] benchmark-10 show_stdout : Display stdout order ________________________________________________________________________________ 2024-11-20 20:08:57,584 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stdout.txt is 47487 lines): 2024-11-20 20:08:57,584 DEBUG ----- output ----- 2024-11-20 20:08:57,584 INFO 2024-11-20 19:08:20,129 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmphqai0a64 2024-11-20 20:08:57,584 INFO 2024-11-20 19:08:20,131 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-10" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Dprefix=self10- -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=10 -Duser_password=**** 2024-11-20 20:08:57,584 INFO [INFO] Scanning for projects... 2024-11-20 20:08:57,584 INFO [INFO] 2024-11-20 20:08:57,584 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2024-11-20 20:08:57,584 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2024-11-20 20:08:57,584 INFO [INFO] from pom.xml 2024-11-20 20:08:57,585 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2024-11-20 20:08:57,585 INFO [INFO] skip non existing resourceDirectory /tmp/tmphqai0a64/src/main/resources 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2024-11-20 20:08:57,585 INFO [INFO] No sources to compile 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2024-11-20 20:08:57,585 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2024-11-20 20:08:57,585 INFO [INFO] Nothing to compile - all classes are up to date. 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2024-11-20 20:08:57,585 INFO [INFO] compiling 38 Scala sources to /tmp/tmphqai0a64/target/test-classes ... 2024-11-20 20:08:57,585 INFO [INFO] compile in 6.9 s 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] 2024-11-20 20:08:57,585 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2024-11-20 20:08:57,585 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2024-11-20 20:08:57,585 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2024-11-20 20:08:57,585 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2024-11-20 20:08:57,585 INFO Simulation com.forgerock.pyrock.Loadtest started... 2024-11-20 20:08:57,585 INFO 2024-11-20 20:08:57,585 INFO ================================================================================ 2024-11-20 20:08:57,585 INFO 2024-11-20 19:08:36 GMT 5s elapsed 2024-11-20 20:08:57,585 INFO ---- Requests ------------------------------------------------------------------ 2024-11-20 20:08:57,585 INFO > Global (OK=6 KO=0 ) 2024-11-20 20:08:57,585 INFO > restLoginInitiate (OK=2 KO=0 ) 2024-11-20 20:08:57,585 INFO > restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2024-11-20 20:08:57,585 INFO > UI-Post-Login - stage 1 (OK=1 KO=0 ) 2024-11-20 20:08:57,585 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=1 KO=0 ) 2024-11-20 20:08:57,585 INFO > UI AM idFromSession (OK=1 KO=0 ) 2024-11-20 20:08:57,585 INFO 2024-11-20 20:08:57,585 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-20 20:08:57,585 INFO [- ] 0% 2024-11-20 20:08:57,585 INFO waiting: 36314 / active: 4 / done: 0 2024-11-20 20:08:57,585 INFO ================================================================================ 2024-11-20 20:08:57,585 INFO 2024-11-20 20:08:57,585 INFO 19:08:37.147 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'CreatePolicy' failed for user 4: status.find.in([200, 209], 304), found 500 2024-11-20 20:08:57,585 INFO 19:08:37.154 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-20 20:08:57,585 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-20 20:08:57,585 INFO Request: 2024-11-20 20:08:57,585 INFO CreatePolicy: KO status.find.in([200, 209], 304), found 500 2024-11-20 20:08:57,585 INFO ========================= 2024-11-20 20:08:57,585 INFO Session: 2024-11-20 20:08:57,585 INFO Session(idc.benchmark.Mix2024,4,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJraWQiOiJyNFl0WW1RcVZXeGcwVkt2aWNzcllTMWd5NFE9IiwiYWxnIjoiUlMyNTYifQ.eyJzdWIiOiI2MGE2M2NhYS1lOTBlLTQzYWMtODJkNi1lZjk2N2U3OGUzYmUiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYzEyNzFjNjctOTY3ZS00ODMyLWE1YjEtY2E0NmU2ZmE3MjI3LTQzNTAiLCJzdWJuYW1lIjoiNjBhNjNjYWEtZTkwZS00M2FjLTgyZDYtZWY5NjdlNzhlM2JlIiwiaXNzIjoiaHR0cHM6Ly9vcGVuYW0tcGVyZi1iZW5jaG1hcmsuZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJ6WWYyZjFjZG0tZVVJMGlUYkRJQWh6UjAySTQiLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJpZG1BZG1pbkNsaWVudCIsImF1ZCI6ImlkbUFkbWluQ2xpZW50IiwibmJmIjoxNzMyMTI5NzE2LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsiZnI6aWRtOioiLCJvcGVuaWQiXSwiYXV0aF90aW1lIjoxNzMyMTI5NzE2LCJyZWFsbSI6Ii8iLCJleHAiOjE3MzIxMzMzMTYsImlhdCI6MTczMjEyOTcxNiwiZXhwaXJlc19pbiI6MzYwMCwianRpIjoiTm0temFNaE5BbDNKcjg3SF96XzRrQmtkVEJJIn0.EiUZU5u2ROfzk1JmSMA_GVwG2XbEOnKFAE-vhu9lm3tL8pjHIfZloI-JjyqCp8Z9Sg-8Av-ThTVE0kypFAH4vXOVdSImzVTefvSPHwBMqZ2WFidxfb9Up0N7oK-eCGUQNb1pQeVCR2nGD1MlEndsH2Q6fo6UKrIzYf5I1ep_WsqRMEqUcgN1JjFPod8zfmkokMwFg9Qytb6OBA6_LtORIxmaxeLCa3Z9dFyzICV2WQZVl5ObNgP8FU4J-tBcUzO8u2wOjSGeOcEYADsWOB8W22xOWkAfdLS24N11NA_v_Kfmq0dkRmEFrGgq_huCcp-ZSXA1-HhCGskL-ana4TmrMw, username -> user.194628, tokenIdCookieName -> 9b75a55744995d0, randomPolicyName -> testPolicy626589, oauth2_uuId -> d60b7a71-1dc6-44a5-8e48-e4b9d92dee8b, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@16c92c7a, authcode -> h3guq7d_HR3LJxVnUwWtnb0qWB4, useAdminRealm -> true, callbacks -> {"tokenId":"AKaAz5-INaynV_ItgkytWHfv8JU.*AAJTSQACMDIAAlNLABxXdHIrLzBqZlgvajB4amsxUEtCU1FzTStMc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/platform","realm":"/"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-benchmark.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-benchmark.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1732129716664), CookieKey(9b75a55744995d0,openam-perf-benchmark.forgeblocks.com,/) -> StoredCookie(9b75a55744995d0=AKaAz5-INaynV_ItgkytWHfv8JU.*AAJTSQACMDIAAlNLABxXdHIrLzBqZlgvajB4amsxUEtCU1FzTStMc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-benchmark.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1732129716664))), password -> Pa_ssw0rd, challenge -> dzJtUk7KnWZImYFbQhwApgfK1_4ijLqagxqkjO2nvl4, gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, fake-ip -> 42.42.42.42, verifier -> LTQxNTQyMDU3NTE3MzcwMzUxNDM, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@47baab69, tokenId -> AKaAz5-INaynV_ItgkytWHfv8JU.*AAJTSQACMDIAAlNLABxXdHIrLzBqZlgvajB4amsxUEtCU1FzTStMc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007c330469a0e0@27913862,io.netty.channel.epoll.EpollEventLoop@239b0f9d) 2024-11-20 20:08:57,585 INFO ========================= 2024-11-20 20:08:57,585 INFO HTTP request: 2024-11-20 20:08:57,585 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/policies/?_action=create 2024-11-20 20:08:57,585 INFO headers: 2024-11-20 20:08:57,585 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2024-11-20 20:08:57,585 INFO accept-api-version: protocol=1.0,resource=2.0 2024-11-20 20:08:57,585 INFO content-type: application/json 2024-11-20 20:08:57,585 INFO x-requested-with: XMLHttpRequest 2024-11-20 20:08:57,585 INFO accept: */* 2024-11-20 20:08:57,585 INFO cookie: amlbcookie=01; 9b75a55744995d0=AKaAz5-INaynV_ItgkytWHfv8JU.*AAJTSQACMDIAAlNLABxXdHIrLzBqZlgvajB4amsxUEtCU1FzTStMc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2024-11-20 20:08:57,586 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-20 20:08:57,586 INFO content-length: 194 2024-11-20 20:08:57,586 INFO cookies: 2024-11-20 20:08:57,586 INFO amlbcookie=01, domain=openam-perf-benchmark.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2024-11-20 20:08:57,586 INFO 9b75a55744995d0=AKaAz5-INaynV_ItgkytWHfv8JU.*AAJTSQACMDIAAlNLABxXdHIrLzBqZlgvajB4amsxUEtCU1FzTStMc2c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-benchmark.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2024-11-20 20:08:57,586 INFO body:StringChunksRequestBody{charset=UTF-8, content={"name":"testPolicy626589","description":"","resources":["http://localhost:80/am?q"],"actionValues":{},"applicationName":"oauth2Scopes","resourceTypeUuid":"d60b7a71-1dc6-44a5-8e48-e4b9d92dee8b"}} 2024-11-20 20:08:57,586 INFO ========================= 2024-11-20 20:08:57,586 INFO HTTP response: 2024-11-20 20:08:57,586 INFO version: 2024-11-20 20:08:57,586 INFO HTTP/1.1 2024-11-20 20:08:57,586 INFO status: 2024-11-20 20:08:57,586 INFO 500 Internal Server Error 2024-11-20 20:08:57,586 INFO headers: 2024-11-20 20:08:57,586 INFO x-frame-options: SAMEORIGIN 2024-11-20 20:08:57,586 INFO content-security-policy-report-only: frame-ancestors 'self'; script-src 'self' 'unsafe-eval' 'unsafe-inline' 2024-11-20 20:08:57,586 INFO x-content-type-options: nosniff 2024-11-20 20:08:57,586 INFO cache-control: private 2024-11-20 20:08:57,586 INFO content-api-version: resource=2.1 2024-11-20 20:08:57,586 INFO content-security-policy: default-src 'none';frame-ancestors 'none';sandbox 2024-11-20 20:08:57,586 INFO cross-origin-opener-policy: same-origin 2024-11-20 20:08:57,586 INFO cross-origin-resource-policy: same-origin 2024-11-20 20:08:57,586 INFO expires: 0 2024-11-20 20:08:57,586 INFO pragma: no-cache 2024-11-20 20:08:57,586 INFO content-type: application/json;charset=UTF-8 2024-11-20 20:08:57,586 INFO Content-Length: 95 2024-11-20 20:08:57,586 INFO date: Wed, 20 Nov 2024 19:08:37 GMT 2024-11-20 20:08:57,586 INFO x-forgerock-transactionid: fc9ebae5-cd42-4ede-82e7-a2149f873c83 2024-11-20 20:08:57,586 INFO strict-transport-security: max-age=31536000; includeSubDomains; preload; 2024-11-20 20:08:57,586 INFO x-robots-tag: none 2024-11-20 20:08:57,586 INFO Via: 1.1 google 2024-11-20 20:08:57,586 INFO Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 2024-11-20 20:08:57,586 INFO [...] 2024-11-20 20:08:57,593 INFO > status.find.is(200), but actually found 502 2 ( 5.71%) 2024-11-20 20:08:57,593 INFO > status.find.in([200, 209], 304), found 502 2 ( 5.71%) 2024-11-20 20:08:57,593 INFO > status.find.in([200, 209], 304), found 500 1 ( 2.86%) 2024-11-20 20:08:57,593 INFO > headerRegex((location,#id_token=(.*))).find.exists, found noth 1 ( 2.86%) 2024-11-20 20:08:57,593 INFO ing 2024-11-20 20:08:57,593 INFO > userinfo: No attribute named 'access_token' is defined 1 ( 2.86%) 2024-11-20 20:08:57,593 INFO > UI AM revoke1: No attribute named 'access_token' is defined 1 ( 2.86%) 2024-11-20 20:08:57,593 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 1 ( 2.86%) 2024-11-20 20:08:57,593 INFO 2024-11-20 20:08:57,593 INFO > UI AM endsession: No attribute named 'id_token_2' is defined 1 ( 2.86%) 2024-11-20 20:08:57,593 INFO > CreatePolicy: No attribute named 'oauth2_uuId' is defined 1 ( 2.86%) 2024-11-20 20:08:57,593 INFO 2024-11-20 20:08:57,593 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-20 20:08:57,593 INFO [#########################################################################-] 98% 2024-11-20 20:08:57,593 INFO waiting: 356 / active: 40 / done: 35922 2024-11-20 20:08:57,593 INFO ================================================================================ 2024-11-20 20:08:57,593 INFO 2024-11-20 20:08:57,593 INFO 2024-11-20 20:08:57,593 INFO ================================================================================ 2024-11-20 20:08:57,593 INFO 2024-11-20 20:08:31 GMT 3600s elapsed 2024-11-20 20:08:57,593 INFO ---- Requests ------------------------------------------------------------------ 2024-11-20 20:08:57,593 INFO > Global (OK=505090 KO=18 ) 2024-11-20 20:08:57,593 INFO > restLoginInitiate (OK=34730 KO=1 ) 2024-11-20 20:08:57,593 INFO > restLoginUsernamePasswordCallback (OK=34729 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI-Post-Login - stage 1 (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI AM idFromSession (OK=7742 KO=1 ) 2024-11-20 20:08:57,593 INFO > UI AM validateGoto (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > User Authorize PKCE stage (OK=42461 KO=2 ) 2024-11-20 20:08:57,593 INFO > User AccessToken PKCE stage (OK=42461 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI-Post-Login - stage 2 (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI Enduser appAuthHelper1 (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI Enduser appAuthHelper2 (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI-Post-Login - stage 3 (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > Skip 2FA (OK=19374 KO=1 ) 2024-11-20 20:08:57,593 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI Enduser sessioncheck (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM uiconfig (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM version (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM features (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM privilege (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM managed user schema (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM login (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM dashboard (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM user (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI IDM oidcToken (OK=7742 KO=1 ) 2024-11-20 20:08:57,593 INFO > userinfo (OK=7742 KO=0 ) 2024-11-20 20:08:57,593 INFO > GetUUid (OK=11555 KO=1 ) 2024-11-20 20:08:57,593 INFO > UI-Logout (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > getIdToken (OK=2658 KO=0 ) 2024-11-20 20:08:57,593 INFO > GetOpenidConfig (OK=34624 KO=0 ) 2024-11-20 20:08:57,593 INFO > UI-Logout Redirect 1 (OK=7743 KO=0 ) 2024-11-20 20:08:57,593 INFO > getIdToken Redirect 1 (OK=2658 KO=0 ) 2024-11-20 20:08:57,594 INFO > UI AM revoke1 (OK=7742 KO=0 ) 2024-11-20 20:08:57,594 INFO > UI AM endsession (OK=7742 KO=0 ) 2024-11-20 20:08:57,594 INFO > UI AM revoke2 (OK=7742 KO=0 ) 2024-11-20 20:08:57,594 INFO > CreatePolicy (OK=11552 KO=3 ) 2024-11-20 20:08:57,594 INFO > createOrganization (OK=2658 KO=0 ) 2024-11-20 20:08:57,594 INFO > queryOrganization (OK=2658 KO=0 ) 2024-11-20 20:08:57,594 INFO > deleteOrganization (OK=2658 KO=0 ) 2024-11-20 20:08:57,594 INFO > RootUserinfo (OK=25784 KO=0 ) 2024-11-20 20:08:57,594 INFO > tokenUserinfo (OK=7605 KO=0 ) 2024-11-20 20:08:57,594 INFO > ReadPolicy (OK=11537 KO=4 ) 2024-11-20 20:08:57,594 INFO > loginTreeWorkflow_restLoginInitiate (OK=1278 KO=0 ) 2024-11-20 20:08:57,594 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=1278 KO=0 ) 2024-11-20 20:08:57,594 INFO > DeletePolicy (OK=11523 KO=4 ) 2024-11-20 20:08:57,594 INFO > restloginProgressiveProfileCallback (OK=6 KO=0 ) 2024-11-20 20:08:57,594 INFO > loginTreeWorkflow_restloginProgressiveProfileCallback (OK=2 KO=0 ) 2024-11-20 20:08:57,594 INFO ---- Errors -------------------------------------------------------------------- 2024-11-20 20:08:57,594 INFO > tokenUserinfo: No attribute named 'access_token' is defined 7 (20.00%) 2024-11-20 20:08:57,594 INFO > status.find.in([200, 209], 304), found 404 6 (17.14%) 2024-11-20 20:08:57,594 INFO > RootUserinfo: No attribute named 'access_token' is defined 5 (14.29%) 2024-11-20 20:08:57,594 INFO > status.find.in([200, 209], 304), found 401 4 (11.43%) 2024-11-20 20:08:57,594 INFO > status.find.is(302), but actually found 502 2 ( 5.71%) 2024-11-20 20:08:57,594 INFO > status.find.is(200), but actually found 502 2 ( 5.71%) 2024-11-20 20:08:57,594 INFO > status.find.in([200, 209], 304), found 502 2 ( 5.71%) 2024-11-20 20:08:57,594 INFO > status.find.in([200, 209], 304), found 500 1 ( 2.86%) 2024-11-20 20:08:57,594 INFO > headerRegex((location,#id_token=(.*))).find.exists, found noth 1 ( 2.86%) 2024-11-20 20:08:57,594 INFO ing 2024-11-20 20:08:57,594 INFO > userinfo: No attribute named 'access_token' is defined 1 ( 2.86%) 2024-11-20 20:08:57,594 INFO > UI AM revoke1: No attribute named 'access_token' is defined 1 ( 2.86%) 2024-11-20 20:08:57,594 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 1 ( 2.86%) 2024-11-20 20:08:57,594 INFO 2024-11-20 20:08:57,594 INFO > UI AM endsession: No attribute named 'id_token_2' is defined 1 ( 2.86%) 2024-11-20 20:08:57,594 INFO > CreatePolicy: No attribute named 'oauth2_uuId' is defined 1 ( 2.86%) 2024-11-20 20:08:57,594 INFO 2024-11-20 20:08:57,594 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-20 20:08:57,594 INFO [#########################################################################-] 99% 2024-11-20 20:08:57,594 INFO waiting: 309 / active: 36 / done: 35973 2024-11-20 20:08:57,594 INFO ================================================================================ 2024-11-20 20:08:57,594 INFO 2024-11-20 20:08:57,594 INFO [INFO] ------------------------------------------------------------------------ 2024-11-20 20:08:57,594 INFO [INFO] BUILD SUCCESS 2024-11-20 20:08:57,594 INFO [INFO] ------------------------------------------------------------------------ 2024-11-20 20:08:57,594 INFO [INFO] Total time: 01:00 h 2024-11-20 20:08:57,594 INFO [INFO] Finished at: 2024-11-20T20:08:31Z 2024-11-20 20:08:57,594 INFO [INFO] ------------------------------------------------------------------------ 2024-11-20 20:08:57,594 INFO 2024-11-20 20:08:31,218 INFO Gatling simulation run ended successfully 2024-11-20 20:08:57,594 INFO 2024-11-20 20:08:31,218 DEBUG No archive name provided. No archive will be created 2024-11-20 20:08:57,594 INFO ________________________________________________________________________________ [2024-11-20 20:08:57] benchmark-10 show_stderr : Display stderr order ________________________________________________________________________________ 2024-11-20 20:08:57,594 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/01_benchmark-10/stderr.txt is small (0 lines), printing all lines: 2024-11-20 20:08:57,594 DEBUG ----- output ----- 2024-11-20 20:08:57,594 DEBUG 2024-11-20 20:08:57,594 INFO ________________________________________________________________________________ [2024-11-20 20:08:57] benchmark-10 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-11-20 20:08:57] benchmark-10 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-11-20 20:08:57] benchmark-10 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped