--Task-- name: benchmark-40 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-35'] preceding_task: benchmark-35 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 40} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-11-21 23:14:45] benchmark-40 pre : N/A ________________________________________________________________________________ 2024-11-21 23:14:45 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2024-11-21 23:14:45 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-40/stdout.txt Pod log : /results/orders/benchmark-40 2024-11-21 23:14:45,219 INFO 2024-11-21 23:14:45,219 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 23:14:45,219 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 23:14:45,495 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 23:14:45,495 INFO [loop_until]: OK (rc = 0) 2024-11-21 23:14:45,495 DEBUG --- stdout --- 2024-11-21 23:14:45,495 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 23:14:45,495 DEBUG --- stderr --- 2024-11-21 23:14:45,495 DEBUG ________________________________________________________________________________ [2024-11-21 23:14:45] benchmark-40 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-11-21 23:14:45,495 INFO 2024-11-21 23:14:45,495 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 23:14:45,495 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 23:14:45,767 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 23:14:45,767 INFO [loop_until]: OK (rc = 0) 2024-11-21 23:14:45,767 DEBUG --- stdout --- 2024-11-21 23:14:45,767 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 23:14:45,767 DEBUG --- stderr --- 2024-11-21 23:14:45,767 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-40" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2024-11-21 23:14:45] benchmark-40 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-11-21 23:14:45,768 INFO 2024-11-21 23:14:45,768 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 23:14:45,768 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 23:14:46,039 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 23:14:46,039 INFO [loop_until]: OK (rc = 0) 2024-11-21 23:14:46,039 DEBUG --- stdout --- 2024-11-21 23:14:46,039 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 23:14:46,039 DEBUG --- stderr --- 2024-11-21 23:14:46,039 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/order.json { "name": "benchmark-40", "command": " /lodestar/lodestar.py run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-benchmark\" --results-folder=\"/results/gatling/benchmark-40\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-40" } ________________________________________________________________________________ [2024-11-21 23:14:46] benchmark-40 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-11-21 23:14:46,042 INFO 2024-11-21 23:14:46,042 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-11-21 23:14:46,043 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-21 23:14:46,256 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-21 23:14:46,256 INFO [loop_until]: OK (rc = 0) 2024-11-21 23:14:46,256 DEBUG --- stdout --- 2024-11-21 23:14:46,256 DEBUG WAITING 2024-11-21 23:14:46,256 DEBUG --- stderr --- 2024-11-21 23:14:46,256 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 34 0 --:--:-- --:--:-- --:--:-- 34 ________________________________________________________________________________ [2024-11-21 23:14:46] benchmark-40 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-11-21 23:14:46,257 INFO 2024-11-21 23:14:46,257 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 23:14:46,257 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 23:14:46,529 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 23:14:46,529 INFO [loop_until]: OK (rc = 0) 2024-11-21 23:14:46,529 DEBUG --- stdout --- 2024-11-21 23:14:46,529 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 23:14:46,529 DEBUG --- stderr --- 2024-11-21 23:14:46,529 DEBUG 2024-11-21 23:14:46,530 INFO 2024-11-21 23:14:46,530 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/order.json overseer-0-6644bb6697-rchxr:/results/orders/order.json 2024-11-21 23:14:46,530 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-21 23:14:47,868 INFO [loop_until]: OK (rc = 0) 2024-11-21 23:14:47,868 DEBUG --- stdout --- 2024-11-21 23:14:47,868 DEBUG 2024-11-21 23:14:47,868 DEBUG --- stderr --- 2024-11-21 23:14:47,868 DEBUG Order has been successfully forwarded to overseer 2024-11-21 23:14:47 - INFO: Check if Gatling simulation started successfully 2024-11-21 23:14:47,868 INFO 2024-11-21 23:14:47,868 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-21 23:14:47,868 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-21 23:14:48,140 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-21 23:14:48,140 INFO [loop_until]: OK (rc = 0) 2024-11-21 23:14:48,140 DEBUG --- stdout --- 2024-11-21 23:14:48,140 DEBUG overseer-0-6644bb6697-rchxr 2024-11-21 23:14:48,140 DEBUG --- stderr --- 2024-11-21 23:14:48,140 DEBUG 2024-11-21 23:14:48,140 INFO 2024-11-21 23:14:48,140 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- head --lines 5000 /results/orders/benchmark-40/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2024-11-21 23:14:48,140 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-11-21 23:14:48,857 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-21 23:14:54,596 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2024-11-21 23:15:00,313 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-11-21 23:15:00,313 INFO [loop_until]: OK (rc = 0) 2024-11-21 23:15:00,314 DEBUG --- stdout --- 2024-11-21 23:15:00,314 DEBUG 2024-11-21 23:14:48,624 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpm5iiew3t 2024-11-21 23:14:48,626 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-40" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpm5iiew3t/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmpm5iiew3t/target/test-classes ... [INFO] compile in 6.9 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2024-11-21 23:15:00,314 DEBUG --- stderr --- 2024-11-21 23:15:00,314 DEBUG ________________________________________________________________________________ [2024-11-21 23:15:00] benchmark-40 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 06s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 07s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2024-11-22 00:15:08] benchmark-40 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-11-22 00:15:08,969 INFO 2024-11-22 00:15:08,969 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:08,969 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:09,262 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:09,262 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:09,262 DEBUG --- stdout --- 2024-11-22 00:15:09,262 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:09,262 DEBUG --- stderr --- 2024-11-22 00:15:09,262 DEBUG 2024-11-22 00:15:09,262 INFO 2024-11-22 00:15:09,262 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr -- rm -f /results/orders/order.json 2024-11-22 00:15:09,262 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-22 00:15:10,027 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:10,028 DEBUG --- stdout --- 2024-11-22 00:15:10,028 DEBUG 2024-11-22 00:15:10,028 DEBUG --- stderr --- 2024-11-22 00:15:10,028 DEBUG Order ran during 1h ________________________________________________________________________________ [2024-11-22 00:15:10] benchmark-40 download_logs : Download individual order files ________________________________________________________________________________ 2024-11-22 00:15:10 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/order.json 2024-11-22 00:15:10,028 INFO 2024-11-22 00:15:10,028 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:10,028 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:10,300 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:10,300 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:10,300 DEBUG --- stdout --- 2024-11-22 00:15:10,300 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:10,300 DEBUG --- stderr --- 2024-11-22 00:15:10,300 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-22 00:15:10,300 INFO 2024-11-22 00:15:10,300 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:10,300 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:10,574 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:10,574 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:10,574 DEBUG --- stdout --- 2024-11-22 00:15:10,574 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:10,574 DEBUG --- stderr --- 2024-11-22 00:15:10,574 DEBUG 2024-11-22 00:15:10,575 INFO 2024-11-22 00:15:10,575 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-40/rc.txt" ]; then echo "/results/orders/benchmark-40/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-40/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-40/rc.txt file found" 2024-11-22 00:15:10,575 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-22 00:15:11,356 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-22 00:15:11,356 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:11,356 DEBUG --- stdout --- 2024-11-22 00:15:11,356 DEBUG /results/orders/benchmark-40/rc.txt file found 2024-11-22 00:15:11,356 DEBUG --- stderr --- 2024-11-22 00:15:11,356 DEBUG 2024-11-22 00:15:11,356 INFO 2024-11-22 00:15:11,356 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:11,356 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:11,629 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:11,629 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:11,629 DEBUG --- stdout --- 2024-11-22 00:15:11,629 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:11,629 DEBUG --- stderr --- 2024-11-22 00:15:11,629 DEBUG 2024-11-22 00:15:11,629 INFO 2024-11-22 00:15:11,630 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-40/rc.txt 2024-11-22 00:15:12,411 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-22 00:15:12,411 DEBUG --- stdout --- 2024-11-22 00:15:12,411 DEBUG 4 /results/orders/benchmark-40/rc.txt 2024-11-22 00:15:12,411 DEBUG --- stderr --- 2024-11-22 00:15:12,412 DEBUG 2024-11-22 00:15:12,412 INFO - Download file (size 4k) 2024-11-22 00:15:12,412 INFO 2024-11-22 00:15:12,412 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:12,412 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:12,684 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:12,684 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:12,684 DEBUG --- stdout --- 2024-11-22 00:15:12,684 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:12,684 DEBUG --- stderr --- 2024-11-22 00:15:12,684 DEBUG source : /results/orders/benchmark-40/rc.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/rc.txt 2024-11-22 00:15:12,685 INFO 2024-11-22 00:15:12,685 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:12,685 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:12,957 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:12,957 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:12,957 DEBUG --- stdout --- 2024-11-22 00:15:12,957 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:12,957 DEBUG --- stderr --- 2024-11-22 00:15:12,957 DEBUG 2024-11-22 00:15:12,958 INFO 2024-11-22 00:15:12,958 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-40/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/rc.txt 2024-11-22 00:15:12,958 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-22 00:15:13,729 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:13,729 DEBUG --- stdout --- 2024-11-22 00:15:13,729 DEBUG tar: Removing leading `/' from member names 2024-11-22 00:15:13,729 DEBUG --- stderr --- 2024-11-22 00:15:13,729 DEBUG 2024-11-22 00:15:13,729 INFO 2024-11-22 00:15:13,729 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:13,729 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:14,003 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:14,003 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:14,003 DEBUG --- stdout --- 2024-11-22 00:15:14,003 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:14,003 DEBUG --- stderr --- 2024-11-22 00:15:14,003 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-22 00:15:14,004 INFO 2024-11-22 00:15:14,004 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:14,004 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:14,278 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:14,278 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:14,278 DEBUG --- stdout --- 2024-11-22 00:15:14,278 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:14,278 DEBUG --- stderr --- 2024-11-22 00:15:14,278 DEBUG 2024-11-22 00:15:14,279 INFO 2024-11-22 00:15:14,279 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-40/stderr.txt" ]; then echo "/results/orders/benchmark-40/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-40/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-40/stderr.txt file found" 2024-11-22 00:15:14,279 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-22 00:15:15,067 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-22 00:15:15,067 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:15,067 DEBUG --- stdout --- 2024-11-22 00:15:15,067 DEBUG /results/orders/benchmark-40/stderr.txt file found 2024-11-22 00:15:15,067 DEBUG --- stderr --- 2024-11-22 00:15:15,067 DEBUG 2024-11-22 00:15:15,067 INFO 2024-11-22 00:15:15,067 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:15,067 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:15,342 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:15,342 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:15,342 DEBUG --- stdout --- 2024-11-22 00:15:15,342 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:15,342 DEBUG --- stderr --- 2024-11-22 00:15:15,342 DEBUG 2024-11-22 00:15:15,342 INFO 2024-11-22 00:15:15,342 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-40/stderr.txt 2024-11-22 00:15:16,128 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-22 00:15:16,128 DEBUG --- stdout --- 2024-11-22 00:15:16,128 DEBUG 0 /results/orders/benchmark-40/stderr.txt 2024-11-22 00:15:16,128 DEBUG --- stderr --- 2024-11-22 00:15:16,128 DEBUG 2024-11-22 00:15:16,128 INFO - Download file (size 0k) 2024-11-22 00:15:16,128 INFO 2024-11-22 00:15:16,128 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:16,128 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:16,401 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:16,401 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:16,401 DEBUG --- stdout --- 2024-11-22 00:15:16,401 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:16,401 DEBUG --- stderr --- 2024-11-22 00:15:16,401 DEBUG source : /results/orders/benchmark-40/stderr.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/stderr.txt 2024-11-22 00:15:16,402 INFO 2024-11-22 00:15:16,402 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:16,402 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:16,674 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:16,674 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:16,674 DEBUG --- stdout --- 2024-11-22 00:15:16,674 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:16,674 DEBUG --- stderr --- 2024-11-22 00:15:16,674 DEBUG 2024-11-22 00:15:16,675 INFO 2024-11-22 00:15:16,675 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-40/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/stderr.txt 2024-11-22 00:15:16,675 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-22 00:15:17,383 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:17,383 DEBUG --- stdout --- 2024-11-22 00:15:17,383 DEBUG tar: Removing leading `/' from member names 2024-11-22 00:15:17,383 DEBUG --- stderr --- 2024-11-22 00:15:17,383 DEBUG 2024-11-22 00:15:17,383 INFO 2024-11-22 00:15:17,383 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:17,383 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:17,657 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:17,657 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:17,657 DEBUG --- stdout --- 2024-11-22 00:15:17,657 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:17,657 DEBUG --- stderr --- 2024-11-22 00:15:17,657 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-22 00:15:17,657 INFO 2024-11-22 00:15:17,657 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:17,657 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:17,928 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:17,928 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:17,928 DEBUG --- stdout --- 2024-11-22 00:15:17,929 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:17,929 DEBUG --- stderr --- 2024-11-22 00:15:17,929 DEBUG 2024-11-22 00:15:17,929 INFO 2024-11-22 00:15:17,929 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-40/stdout.txt" ]; then echo "/results/orders/benchmark-40/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-40/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-40/stdout.txt file found" 2024-11-22 00:15:17,929 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-22 00:15:18,713 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-22 00:15:18,713 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:18,713 DEBUG --- stdout --- 2024-11-22 00:15:18,713 DEBUG /results/orders/benchmark-40/stdout.txt file found 2024-11-22 00:15:18,713 DEBUG --- stderr --- 2024-11-22 00:15:18,713 DEBUG 2024-11-22 00:15:18,713 INFO 2024-11-22 00:15:18,713 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:18,713 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:18,986 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:18,987 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:18,987 DEBUG --- stdout --- 2024-11-22 00:15:18,987 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:18,987 DEBUG --- stderr --- 2024-11-22 00:15:18,987 DEBUG 2024-11-22 00:15:18,987 INFO 2024-11-22 00:15:18,987 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-40/stdout.txt 2024-11-22 00:15:19,776 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-22 00:15:19,776 DEBUG --- stdout --- 2024-11-22 00:15:19,776 DEBUG 4972 /results/orders/benchmark-40/stdout.txt 2024-11-22 00:15:19,776 DEBUG --- stderr --- 2024-11-22 00:15:19,776 DEBUG 2024-11-22 00:15:19,776 INFO - Download file (size 4972k) 2024-11-22 00:15:19,777 INFO 2024-11-22 00:15:19,777 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:19,777 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:20,051 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:20,052 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:20,052 DEBUG --- stdout --- 2024-11-22 00:15:20,052 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:20,052 DEBUG --- stderr --- 2024-11-22 00:15:20,052 DEBUG source : /results/orders/benchmark-40/stdout.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/stdout.txt 2024-11-22 00:15:20,052 INFO 2024-11-22 00:15:20,052 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:20,052 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:20,324 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:20,324 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:20,324 DEBUG --- stdout --- 2024-11-22 00:15:20,324 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:20,324 DEBUG --- stderr --- 2024-11-22 00:15:20,324 DEBUG 2024-11-22 00:15:20,324 INFO 2024-11-22 00:15:20,324 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-40/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/stdout.txt 2024-11-22 00:15:20,324 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-22 00:15:21,550 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:21,550 DEBUG --- stdout --- 2024-11-22 00:15:21,550 DEBUG tar: Removing leading `/' from member names 2024-11-22 00:15:21,550 DEBUG --- stderr --- 2024-11-22 00:15:21,550 DEBUG ________________________________________________________________________________ [2024-11-22 00:15:21] benchmark-40 show_cmd : Display order command ________________________________________________________________________________ 2024-11-22 00:15:21,551 INFO 2024-11-22 00:15:21,551 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:21,551 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:21,823 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:21,823 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:21,823 DEBUG --- stdout --- 2024-11-22 00:15:21,823 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:21,823 DEBUG --- stderr --- 2024-11-22 00:15:21,823 DEBUG Checking pod: overseer-0-6644bb6697-rchxr for file exists, if not wait. 2024-11-22 00:15:21,823 INFO 2024-11-22 00:15:21,824 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:21,824 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:22,094 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:22,094 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:22,094 DEBUG --- stdout --- 2024-11-22 00:15:22,094 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:22,094 DEBUG --- stderr --- 2024-11-22 00:15:22,094 DEBUG 2024-11-22 00:15:22,095 INFO 2024-11-22 00:15:22,095 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- bash -c 'if [ -f "/results/orders/benchmark-40/cmd.txt" ]; then echo "/results/orders/benchmark-40/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-40/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-40/cmd.txt file found" 2024-11-22 00:15:22,095 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-11-22 00:15:22,880 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-11-22 00:15:22,880 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:22,880 DEBUG --- stdout --- 2024-11-22 00:15:22,880 DEBUG /results/orders/benchmark-40/cmd.txt file found 2024-11-22 00:15:22,880 DEBUG --- stderr --- 2024-11-22 00:15:22,880 DEBUG 2024-11-22 00:15:22,881 INFO 2024-11-22 00:15:22,882 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:22,882 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:23,157 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:23,157 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:23,157 DEBUG --- stdout --- 2024-11-22 00:15:23,157 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:23,157 DEBUG --- stderr --- 2024-11-22 00:15:23,157 DEBUG 2024-11-22 00:15:23,157 INFO 2024-11-22 00:15:23,157 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-6644bb6697-rchxr --stdin -- du -k /results/orders/benchmark-40/cmd.txt 2024-11-22 00:15:24,037 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-11-22 00:15:24,037 DEBUG --- stdout --- 2024-11-22 00:15:24,037 DEBUG 4 /results/orders/benchmark-40/cmd.txt 2024-11-22 00:15:24,037 DEBUG --- stderr --- 2024-11-22 00:15:24,037 DEBUG 2024-11-22 00:15:24,037 INFO - Download file (size 4k) 2024-11-22 00:15:24,038 INFO 2024-11-22 00:15:24,038 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:24,038 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:24,310 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:24,310 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:24,310 DEBUG --- stdout --- 2024-11-22 00:15:24,310 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:24,310 DEBUG --- stderr --- 2024-11-22 00:15:24,310 DEBUG source : /results/orders/benchmark-40/cmd.txt @ overseer-0-6644bb6697-rchxr destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/cmd.txt 2024-11-22 00:15:24,311 INFO 2024-11-22 00:15:24,311 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-11-22 00:15:24,311 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-11-22 00:15:24,584 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-11-22 00:15:24,584 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:24,584 DEBUG --- stdout --- 2024-11-22 00:15:24,584 DEBUG overseer-0-6644bb6697-rchxr 2024-11-22 00:15:24,584 DEBUG --- stderr --- 2024-11-22 00:15:24,584 DEBUG 2024-11-22 00:15:24,584 INFO 2024-11-22 00:15:24,584 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-6644bb6697-rchxr:/results/orders/benchmark-40/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/cmd.txt 2024-11-22 00:15:24,584 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-11-22 00:15:25,339 INFO [loop_until]: OK (rc = 0) 2024-11-22 00:15:25,339 DEBUG --- stdout --- 2024-11-22 00:15:25,339 DEBUG tar: Removing leading `/' from member names 2024-11-22 00:15:25,339 DEBUG --- stderr --- 2024-11-22 00:15:25,339 DEBUG 2024-11-22 00:15:25,339 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/cmd.txt is small (1 lines), printing all lines: 2024-11-22 00:15:25,339 DEBUG ----- output ----- 2024-11-22 00:15:25,339 DEBUG /lodestar/lodestar.py run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-benchmark" --results-folder="/results/gatling/benchmark-40" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=Pa_ssw0rd" 2024-11-22 00:15:25,339 INFO ________________________________________________________________________________ [2024-11-22 00:15:25] benchmark-40 show_rc : Display rc order ________________________________________________________________________________ 2024-11-22 00:15:25,339 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/rc.txt is small (1 lines), printing all lines: 2024-11-22 00:15:25,339 DEBUG ----- output ----- 2024-11-22 00:15:25,340 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-11-22 00:15:25,340 INFO ________________________________________________________________________________ [2024-11-22 00:15:25] benchmark-40 show_stdout : Display stdout order ________________________________________________________________________________ 2024-11-22 00:15:25,346 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/stdout.txt is 61963 lines): 2024-11-22 00:15:25,346 DEBUG ----- output ----- 2024-11-22 00:15:25,346 INFO 2024-11-21 23:14:48,624 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpm5iiew3t 2024-11-22 00:15:25,346 INFO 2024-11-21 23:14:48,626 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-40" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Dlogin_cookie=9b75a55744995d0 -Dnum_users=200000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=40 -Duser_password=**** 2024-11-22 00:15:25,346 INFO [INFO] Scanning for projects... 2024-11-22 00:15:25,346 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2024-11-22 00:15:25,347 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2024-11-22 00:15:25,347 INFO [INFO] from pom.xml 2024-11-22 00:15:25,347 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2024-11-22 00:15:25,347 INFO [INFO] skip non existing resourceDirectory /tmp/tmpm5iiew3t/src/main/resources 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2024-11-22 00:15:25,347 INFO [INFO] No sources to compile 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2024-11-22 00:15:25,347 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2024-11-22 00:15:25,347 INFO [INFO] Nothing to compile - all classes are up to date. 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2024-11-22 00:15:25,347 INFO [INFO] compiling 38 Scala sources to /tmp/tmpm5iiew3t/target/test-classes ... 2024-11-22 00:15:25,347 INFO [INFO] compile in 6.9 s 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] 2024-11-22 00:15:25,347 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2024-11-22 00:15:25,347 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2024-11-22 00:15:25,347 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2024-11-22 00:15:25,347 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2024-11-22 00:15:25,347 INFO Simulation com.forgerock.pyrock.Loadtest started... 2024-11-22 00:15:25,347 INFO 23:15:03.396 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-22 00:15:25,347 INFO 2024-11-22 00:15:25,347 INFO ================================================================================ 2024-11-22 00:15:25,347 INFO 2024-11-21 23:15:04 GMT 5s elapsed 2024-11-22 00:15:25,347 INFO ---- Requests ------------------------------------------------------------------ 2024-11-22 00:15:25,347 INFO > Global (OK=171 KO=0 ) 2024-11-22 00:15:25,347 INFO > restLoginInitiate (OK=16 KO=0 ) 2024-11-22 00:15:25,347 INFO > restLoginUsernamePasswordCallback (OK=15 KO=0 ) 2024-11-22 00:15:25,347 INFO > Skip 2FA (OK=6 KO=0 ) 2024-11-22 00:15:25,347 INFO > User Authorize PKCE stage (OK=16 KO=0 ) 2024-11-22 00:15:25,347 INFO > User AccessToken PKCE stage (OK=15 KO=0 ) 2024-11-22 00:15:25,347 INFO > RootUserinfo (OK=4 KO=0 ) 2024-11-22 00:15:25,347 INFO > GetUUid (OK=2 KO=0 ) 2024-11-22 00:15:25,347 INFO > GetOpenidConfig (OK=2 KO=0 ) 2024-11-22 00:15:25,347 INFO > CreatePolicy (OK=2 KO=0 ) 2024-11-22 00:15:25,347 INFO > tokenUserinfo (OK=4 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI-Post-Login - stage 1 (OK=4 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=4 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI AM idFromSession (OK=4 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI AM validateGoto (OK=4 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI-Post-Login - stage 2 (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > restloginProgressiveProfileCallback (OK=2 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI Enduser appAuthHelper2 (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI Enduser appAuthHelper1 (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI-Post-Login - stage 3 (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI IDM uiconfig (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI Enduser sessioncheck (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI IDM version (OK=3 KO=0 ) 2024-11-22 00:15:25,347 INFO > UI IDM features (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI IDM privilege (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI IDM login (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI IDM managed user schema (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI IDM dashboard (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI IDM user (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI IDM oidcToken (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > userinfo (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI-Logout (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI-Logout Redirect 1 (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI AM revoke2 (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI AM endsession (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > UI AM revoke1 (OK=3 KO=0 ) 2024-11-22 00:15:25,348 INFO > getIdToken (OK=1 KO=0 ) 2024-11-22 00:15:25,348 INFO > getIdToken Redirect 1 (OK=1 KO=0 ) 2024-11-22 00:15:25,348 INFO > createOrganization (OK=1 KO=0 ) 2024-11-22 00:15:25,348 INFO > queryOrganization (OK=1 KO=0 ) 2024-11-22 00:15:25,348 INFO > deleteOrganization (OK=1 KO=0 ) 2024-11-22 00:15:25,348 INFO ---- Errors -------------------------------------------------------------------- 2024-11-22 00:15:25,348 INFO > tokenUserinfo: No attribute named 'access_token' is defined 1 (100.0%) 2024-11-22 00:15:25,348 INFO 2024-11-22 00:15:25,348 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-22 00:15:25,348 INFO [- ] 0% 2024-11-22 00:15:25,348 INFO waiting: 143960 / active: 7 / done: 9 2024-11-22 00:15:25,348 INFO ================================================================================ 2024-11-22 00:15:25,348 INFO 2024-11-22 00:15:25,348 INFO 23:15:05.259 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-22 00:15:25,348 INFO 23:15:06.012 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-22 00:15:25,348 INFO 23:15:07.481 [ERROR] i.g.h.a.HttpRequestAction - Failed to build request tokenUserinfo: No attribute named 'access_token' is defined 2024-11-22 00:15:25,348 INFO 2024-11-22 00:15:25,348 INFO ================================================================================ 2024-11-22 00:15:25,348 INFO 2024-11-21 23:15:09 GMT 10s elapsed 2024-11-22 00:15:25,348 INFO ---- Requests ------------------------------------------------------------------ 2024-11-22 00:15:25,348 INFO > Global (OK=841 KO=0 ) 2024-11-22 00:15:25,348 INFO > restLoginInitiate (OK=64 KO=0 ) 2024-11-22 00:15:25,348 INFO [...] 2024-11-22 00:15:25,357 INFO > status.find.is(200), but actually found 502 6 ( 0.10%) 2024-11-22 00:15:25,357 INFO > status.find.in([200, 209], 304), found 401 3 ( 0.05%) 2024-11-22 00:15:25,357 INFO > userinfo: No attribute named 'access_token' is defined 2 ( 0.03%) 2024-11-22 00:15:25,357 INFO > UI AM revoke1: No attribute named 'access_token' is defined 2 ( 0.03%) 2024-11-22 00:15:25,357 INFO > createOrganization: No attribute named 'access_token' is defin 1 ( 0.02%) 2024-11-22 00:15:25,357 INFO ed 2024-11-22 00:15:25,357 INFO > queryOrganization: No attribute named 'organization_id' is def 1 ( 0.02%) 2024-11-22 00:15:25,357 INFO ined 2024-11-22 00:15:25,357 INFO > deleteOrganization: No attribute named 'organization_id' is de 1 ( 0.02%) 2024-11-22 00:15:25,357 INFO fined 2024-11-22 00:15:25,357 INFO > status.find.is(302), but actually found 502 1 ( 0.02%) 2024-11-22 00:15:25,357 INFO > status.find.in([200, 209], 304), found 400 1 ( 0.02%) 2024-11-22 00:15:25,357 INFO > UI AM revoke2: No attribute named 'access_token_2' is defined 1 ( 0.02%) 2024-11-22 00:15:25,357 INFO 2024-11-22 00:15:25,357 INFO > CreatePolicy: No attribute named 'oauth2_uuId' is defined 1 ( 0.02%) 2024-11-22 00:15:25,357 INFO 2024-11-22 00:15:25,357 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2024-11-22 00:15:25,357 INFO [#########################################################################-] 99% 2024-11-22 00:15:25,357 INFO waiting: 1154 / active: 209 / done: 142613 2024-11-22 00:15:25,357 INFO ================================================================================ 2024-11-22 00:15:25,357 INFO 2024-11-22 00:15:25,357 INFO 00:14:59.710 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 142822: j.i.IOException: Premature close 2024-11-22 00:15:25,357 INFO 00:14:59.710 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 142821: j.i.IOException: Premature close 2024-11-22 00:15:25,357 INFO 00:14:59.710 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI AM validateGoto' failed for user 142811: j.i.IOException: Premature close 2024-11-22 00:15:25,357 INFO 00:14:59.710 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-22 00:15:25,357 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-22 00:15:25,357 INFO Request: 2024-11-22 00:15:25,357 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-22 00:15:25,357 INFO ========================= 2024-11-22 00:15:25,357 INFO Session: 2024-11-22 00:15:25,357 INFO Session(idc.benchmark.Mix2024,142822,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.80319, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@6a04a43b, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3, password -> Pa_ssw0rd, fake-ip -> 186.144.208.160, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@47b6d21a),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007ae9c069a0e0@2c275268,io.netty.channel.epoll.EpollEventLoop@5b057c8c) 2024-11-22 00:15:25,358 INFO ========================= 2024-11-22 00:15:25,358 INFO HTTP request: 2024-11-22 00:15:25,358 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/authenticate 2024-11-22 00:15:25,358 INFO headers: 2024-11-22 00:15:25,358 INFO accept: application/json 2024-11-22 00:15:25,358 INFO content-type: application/json 2024-11-22 00:15:25,358 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3 2024-11-22 00:15:25,358 INFO X-Forwarded-For: 186.144.208.160 2024-11-22 00:15:25,358 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-22 00:15:25,358 INFO content-length: 0 2024-11-22 00:15:25,358 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-22 00:15:25,358 INFO ========================= 2024-11-22 00:15:25,358 INFO HTTP response: 2024-11-22 00:15:25,358 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-22 00:15:25,358 INFO 00:14:59.710 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-22 00:15:25,358 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-22 00:15:25,358 INFO Request: 2024-11-22 00:15:25,358 INFO restLoginInitiate: KO j.i.IOException: Premature close 2024-11-22 00:15:25,358 INFO ========================= 2024-11-22 00:15:25,358 INFO Session: 2024-11-22 00:15:25,358 INFO Session(idc.benchmark.Mix2024,142821,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.119285, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2e605e20, fake-user-agent -> Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 66.56.177.158, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@68f52b1f),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007ae9c069a0e0@2c275268,io.netty.channel.epoll.EpollEventLoop@619bfe29) 2024-11-22 00:15:25,358 INFO ========================= 2024-11-22 00:15:25,358 INFO HTTP request: 2024-11-22 00:15:25,358 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login 2024-11-22 00:15:25,358 INFO headers: 2024-11-22 00:15:25,358 INFO accept: application/json 2024-11-22 00:15:25,358 INFO content-type: application/json 2024-11-22 00:15:25,358 INFO user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/44.0.2403.157 Safari/537.36 2024-11-22 00:15:25,358 INFO X-Forwarded-For: 66.56.177.158 2024-11-22 00:15:25,358 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-22 00:15:25,358 INFO content-length: 0 2024-11-22 00:15:25,358 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2024-11-22 00:15:25,358 INFO ========================= 2024-11-22 00:15:25,358 INFO HTTP response: 2024-11-22 00:15:25,358 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-22 00:15:25,358 INFO 00:14:59.710 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2024-11-22 00:15:25,358 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2024-11-22 00:15:25,358 INFO Request: 2024-11-22 00:15:25,358 INFO UI AM validateGoto: KO j.i.IOException: Premature close 2024-11-22 00:15:25,358 INFO ========================= 2024-11-22 00:15:25,358 INFO Session: 2024-11-22 00:15:25,358 INFO Session(idc.benchmark.Mix2024,142811,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-benchmark.forgeblocks.com:443, username -> user.137159, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@68c0d806, gatling.http.referer -> https://openam-perf-benchmark.forgeblocks.com/am/, callbacks -> {"tokenId":"lyeWY1bJJwrH32CKaGzHAXhWSJk.*AAJTSQACMDIAAlNLABx5Unk1YkpOKzliODYxeWJTcERvRFdUMzNZN0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-benchmark.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-benchmark.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1732234499562), CookieKey(9b75a55744995d0,openam-perf-benchmark.forgeblocks.com,/) -> StoredCookie(9b75a55744995d0=lyeWY1bJJwrH32CKaGzHAXhWSJk.*AAJTSQACMDIAAlNLABx5Unk1YkpOKzliODYxeWJTcERvRFdUMzNZN0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-benchmark.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1732234499562))), password -> Pa_ssw0rd, fake-ip -> 89.120.102.183, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@28ed2cc0, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@6c7349a3, tokenId -> lyeWY1bJJwrH32CKaGzHAXhWSJk.*AAJTSQACMDIAAlNLABx5Unk1YkpOKzliODYxeWJTcERvRFdUMzNZN0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007ae9c069a0e0@2c275268,io.netty.channel.epoll.EpollEventLoop@650eab8) 2024-11-22 00:15:25,358 INFO ========================= 2024-11-22 00:15:25,358 INFO HTTP request: 2024-11-22 00:15:25,358 INFO POST https://openam-perf-benchmark.forgeblocks.com/am/json/realms/root/realms/alpha/users?_action=validateGoto 2024-11-22 00:15:25,358 INFO headers: 2024-11-22 00:15:25,358 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2024-11-22 00:15:25,358 INFO Accept-API-Version: resource=2.1, protocol=1.0 2024-11-22 00:15:25,358 INFO referer: https://openam-perf-benchmark.forgeblocks.com/am/ 2024-11-22 00:15:25,358 INFO accept: */* 2024-11-22 00:15:25,358 INFO cookie: amlbcookie=01; 9b75a55744995d0=lyeWY1bJJwrH32CKaGzHAXhWSJk.*AAJTSQACMDIAAlNLABx5Unk1YkpOKzliODYxeWJTcERvRFdUMzNZN0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2024-11-22 00:15:25,358 INFO origin: https://openam-perf-benchmark.forgeblocks.com 2024-11-22 00:15:25,358 INFO host: openam-perf-benchmark.forgeblocks.com 2024-11-22 00:15:25,358 INFO content-length: 0 2024-11-22 00:15:25,358 INFO cookies: 2024-11-22 00:15:25,358 INFO amlbcookie=01, domain=openam-perf-benchmark.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2024-11-22 00:15:25,358 INFO 9b75a55744995d0=lyeWY1bJJwrH32CKaGzHAXhWSJk.*AAJTSQACMDIAAlNLABx5Unk1YkpOKzliODYxeWJTcERvRFdUMzNZN0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-benchmark.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2024-11-22 00:15:25,358 INFO ========================= 2024-11-22 00:15:25,358 INFO HTTP response: 2024-11-22 00:15:25,359 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2024-11-22 00:15:25,359 INFO 00:14:59.710 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-133' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2024-11-22 00:15:25,359 INFO [INFO] ------------------------------------------------------------------------ 2024-11-22 00:15:25,359 INFO [INFO] BUILD SUCCESS 2024-11-22 00:15:25,359 INFO [INFO] ------------------------------------------------------------------------ 2024-11-22 00:15:25,359 INFO [INFO] Total time: 01:00 h 2024-11-22 00:15:25,359 INFO [INFO] Finished at: 2024-11-22T00:14:59Z 2024-11-22 00:15:25,359 INFO [INFO] ------------------------------------------------------------------------ 2024-11-22 00:15:25,359 INFO 2024-11-22 00:14:59,818 INFO Gatling simulation run ended successfully 2024-11-22 00:15:25,359 INFO 2024-11-22 00:14:59,818 DEBUG No archive name provided. No archive will be created 2024-11-22 00:15:25,359 INFO ________________________________________________________________________________ [2024-11-22 00:15:25] benchmark-40 show_stderr : Display stderr order ________________________________________________________________________________ 2024-11-22 00:15:25,359 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/06_benchmark-40/stderr.txt is small (0 lines), printing all lines: 2024-11-22 00:15:25,359 DEBUG ----- output ----- 2024-11-22 00:15:25,359 DEBUG 2024-11-22 00:15:25,359 INFO ________________________________________________________________________________ [2024-11-22 00:15:25] benchmark-40 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-11-22 00:15:25] benchmark-40 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-11-22 00:15:25] benchmark-40 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped