--Task-- name: benchmark-150 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: am target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['benchmark-120'] preceding_task: benchmark-120 options: {'duration': 3600, 'java-opts': '-Drealm=alpha -Duser_password=Pa_ssw0rd -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html', 'testCase': 'idc.benchmark.Mix2024', 'testMode': 'open', 'throughput': 150} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2025-01-16 22:39:00] benchmark-150 pre : N/A ________________________________________________________________________________ 2025-01-16 22:39:00,405 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-01-16 22:39:00 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-01-16 22:39:00 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/benchmark-150/stdout.txt Pod log : /results/orders/benchmark-150 2025-01-16 22:39:00,405 INFO 2025-01-16 22:39:00,405 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 22:39:00,405 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 22:39:00,679 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 22:39:00,679 INFO [loop_until]: OK (rc = 0) 2025-01-16 22:39:00,679 DEBUG --- stdout --- 2025-01-16 22:39:00,679 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 22:39:00,679 DEBUG --- stderr --- 2025-01-16 22:39:00,679 DEBUG ________________________________________________________________________________ [2025-01-16 22:39:00] benchmark-150 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-01-16 22:39:00,680 INFO 2025-01-16 22:39:00,680 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 22:39:00,680 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 22:39:00,955 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 22:39:00,955 INFO [loop_until]: OK (rc = 0) 2025-01-16 22:39:00,955 DEBUG --- stdout --- 2025-01-16 22:39:00,955 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 22:39:00,955 DEBUG --- stderr --- 2025-01-16 22:39:00,955 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-150" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=Pa_ssw0rd" ________________________________________________________________________________ [2025-01-16 22:39:00] benchmark-150 create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-01-16 22:39:00,956 INFO 2025-01-16 22:39:00,956 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 22:39:00,956 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 22:39:01,232 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 22:39:01,233 INFO [loop_until]: OK (rc = 0) 2025-01-16 22:39:01,233 DEBUG --- stdout --- 2025-01-16 22:39:01,233 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 22:39:01,233 DEBUG --- stderr --- 2025-01-16 22:39:01,233 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/order.json { "name": "benchmark-150", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idc.benchmark.Mix2024@perf-200m\" --results-folder=\"/results/gatling/benchmark-150\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx4G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=Pa_ssw0rd\"", "out-dir": "/results/orders/benchmark-150" } ________________________________________________________________________________ [2025-01-16 22:39:01] benchmark-150 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-01-16 22:39:01,236 INFO 2025-01-16 22:39:01,236 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-01-16 22:39:01,236 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-16 22:39:01,453 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 22:39:01,453 INFO [loop_until]: OK (rc = 0) 2025-01-16 22:39:01,453 DEBUG --- stdout --- 2025-01-16 22:39:01,454 DEBUG WAITING 2025-01-16 22:39:01,454 DEBUG --- stderr --- 2025-01-16 22:39:01,454 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-01-16 22:39:01] benchmark-150 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-01-16 22:39:01,454 INFO 2025-01-16 22:39:01,454 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 22:39:01,454 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 22:39:01,728 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 22:39:01,728 INFO [loop_until]: OK (rc = 0) 2025-01-16 22:39:01,728 DEBUG --- stdout --- 2025-01-16 22:39:01,728 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 22:39:01,728 DEBUG --- stderr --- 2025-01-16 22:39:01,728 DEBUG 2025-01-16 22:39:01,728 INFO 2025-01-16 22:39:01,728 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/order.json overseer-0-5865b977f-pk2tz:/results/orders/order.json 2025-01-16 22:39:01,728 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 22:39:03,089 INFO [loop_until]: OK (rc = 0) 2025-01-16 22:39:03,089 DEBUG --- stdout --- 2025-01-16 22:39:03,089 DEBUG 2025-01-16 22:39:03,089 DEBUG --- stderr --- 2025-01-16 22:39:03,089 DEBUG Order has been successfully forwarded to overseer 2025-01-16 22:39:03 - INFO: Check if Gatling simulation started successfully 2025-01-16 22:39:03,089 INFO 2025-01-16 22:39:03,089 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 22:39:03,089 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 22:39:03,364 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 22:39:03,364 INFO [loop_until]: OK (rc = 0) 2025-01-16 22:39:03,364 DEBUG --- stdout --- 2025-01-16 22:39:03,364 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 22:39:03,364 DEBUG --- stderr --- 2025-01-16 22:39:03,364 DEBUG 2025-01-16 22:39:03,365 INFO 2025-01-16 22:39:03,365 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- head --lines 5000 /results/orders/benchmark-150/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-01-16 22:39:03,365 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-01-16 22:39:04,101 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 22:39:09,883 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 22:39:15,619 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 22:39:21,362 INFO [loop_until]: Function succeeded after 17s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-01-16 22:39:27,100 INFO [loop_until]: Function succeeded after 23s (rc=0) - expected pattern found 2025-01-16 22:39:27,100 INFO [loop_until]: OK (rc = 0) 2025-01-16 22:39:27,100 DEBUG --- stdout --- 2025-01-16 22:39:27,100 DEBUG 2025-01-16 22:39:04,305 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpjkf07c1u 2025-01-16 22:39:04,307 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-150" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmpjkf07c1u/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmpjkf07c1u/target/test-classes ... [INFO] compile in 12.4 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.1 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Simulation com.forgerock.pyrock.Loadtest started... 2025-01-16 22:39:27,100 DEBUG --- stderr --- 2025-01-16 22:39:27,100 DEBUG ________________________________________________________________________________ [2025-01-16 22:39:27] benchmark-150 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 02s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 03s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 05s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 06s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 08s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-01-16 23:39:36] benchmark-150 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-01-16 23:39:36,136 INFO 2025-01-16 23:39:36,136 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:36,136 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:36,435 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:36,435 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:36,435 DEBUG --- stdout --- 2025-01-16 23:39:36,435 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:36,435 DEBUG --- stderr --- 2025-01-16 23:39:36,436 DEBUG 2025-01-16 23:39:36,436 INFO 2025-01-16 23:39:36,436 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz -- rm -f /results/orders/order.json 2025-01-16 23:39:36,436 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 23:39:37,289 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:37,289 DEBUG --- stdout --- 2025-01-16 23:39:37,289 DEBUG 2025-01-16 23:39:37,289 DEBUG --- stderr --- 2025-01-16 23:39:37,289 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-01-16 23:39:37] benchmark-150 download_logs : Download individual order files ________________________________________________________________________________ 2025-01-16 23:39:37 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/order.json 2025-01-16 23:39:37,290 INFO 2025-01-16 23:39:37,290 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:37,290 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:37,600 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:37,600 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:37,600 DEBUG --- stdout --- 2025-01-16 23:39:37,600 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:37,600 DEBUG --- stderr --- 2025-01-16 23:39:37,600 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 23:39:37,600 INFO 2025-01-16 23:39:37,600 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:37,600 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:37,876 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:37,876 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:37,876 DEBUG --- stdout --- 2025-01-16 23:39:37,876 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:37,876 DEBUG --- stderr --- 2025-01-16 23:39:37,876 DEBUG 2025-01-16 23:39:37,877 INFO 2025-01-16 23:39:37,877 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-150/rc.txt" ]; then echo "/results/orders/benchmark-150/rc.txt file found"; exit 0; else echo "/results/orders/benchmark-150/rc.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-150/rc.txt file found" 2025-01-16 23:39:37,877 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 23:39:38,707 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 23:39:38,707 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:38,707 DEBUG --- stdout --- 2025-01-16 23:39:38,707 DEBUG /results/orders/benchmark-150/rc.txt file found 2025-01-16 23:39:38,707 DEBUG --- stderr --- 2025-01-16 23:39:38,707 DEBUG 2025-01-16 23:39:38,707 INFO 2025-01-16 23:39:38,707 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:38,707 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:38,983 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:38,983 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:38,983 DEBUG --- stdout --- 2025-01-16 23:39:38,983 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:38,983 DEBUG --- stderr --- 2025-01-16 23:39:38,983 DEBUG 2025-01-16 23:39:38,984 INFO 2025-01-16 23:39:38,984 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-150/rc.txt 2025-01-16 23:39:39,799 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 23:39:39,799 DEBUG --- stdout --- 2025-01-16 23:39:39,800 DEBUG 4 /results/orders/benchmark-150/rc.txt 2025-01-16 23:39:39,800 DEBUG --- stderr --- 2025-01-16 23:39:39,800 DEBUG 2025-01-16 23:39:39,800 INFO - Download file (size 4k) 2025-01-16 23:39:39,800 INFO 2025-01-16 23:39:39,800 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:39,800 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:40,114 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:40,114 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:40,114 DEBUG --- stdout --- 2025-01-16 23:39:40,114 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:40,114 DEBUG --- stderr --- 2025-01-16 23:39:40,114 DEBUG source : /results/orders/benchmark-150/rc.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/rc.txt 2025-01-16 23:39:40,114 INFO 2025-01-16 23:39:40,114 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:40,114 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:40,397 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:40,397 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:40,397 DEBUG --- stdout --- 2025-01-16 23:39:40,397 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:40,397 DEBUG --- stderr --- 2025-01-16 23:39:40,397 DEBUG 2025-01-16 23:39:40,398 INFO 2025-01-16 23:39:40,398 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-150/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/rc.txt 2025-01-16 23:39:40,398 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 23:39:41,176 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:41,176 DEBUG --- stdout --- 2025-01-16 23:39:41,176 DEBUG tar: Removing leading `/' from member names 2025-01-16 23:39:41,176 DEBUG --- stderr --- 2025-01-16 23:39:41,176 DEBUG 2025-01-16 23:39:41,176 INFO 2025-01-16 23:39:41,176 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:41,176 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:41,454 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:41,455 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:41,455 DEBUG --- stdout --- 2025-01-16 23:39:41,455 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:41,455 DEBUG --- stderr --- 2025-01-16 23:39:41,455 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 23:39:41,455 INFO 2025-01-16 23:39:41,455 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:41,455 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:41,732 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:41,732 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:41,732 DEBUG --- stdout --- 2025-01-16 23:39:41,732 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:41,732 DEBUG --- stderr --- 2025-01-16 23:39:41,732 DEBUG 2025-01-16 23:39:41,733 INFO 2025-01-16 23:39:41,733 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-150/stderr.txt" ]; then echo "/results/orders/benchmark-150/stderr.txt file found"; exit 0; else echo "/results/orders/benchmark-150/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-150/stderr.txt file found" 2025-01-16 23:39:41,733 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 23:39:42,539 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 23:39:42,539 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:42,539 DEBUG --- stdout --- 2025-01-16 23:39:42,539 DEBUG /results/orders/benchmark-150/stderr.txt file found 2025-01-16 23:39:42,539 DEBUG --- stderr --- 2025-01-16 23:39:42,539 DEBUG 2025-01-16 23:39:42,540 INFO 2025-01-16 23:39:42,540 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:42,540 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:42,818 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:42,818 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:42,818 DEBUG --- stdout --- 2025-01-16 23:39:42,818 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:42,818 DEBUG --- stderr --- 2025-01-16 23:39:42,818 DEBUG 2025-01-16 23:39:42,818 INFO 2025-01-16 23:39:42,819 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-150/stderr.txt 2025-01-16 23:39:43,624 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 23:39:43,624 DEBUG --- stdout --- 2025-01-16 23:39:43,624 DEBUG 0 /results/orders/benchmark-150/stderr.txt 2025-01-16 23:39:43,624 DEBUG --- stderr --- 2025-01-16 23:39:43,624 DEBUG 2025-01-16 23:39:43,624 INFO - Download file (size 0k) 2025-01-16 23:39:43,624 INFO 2025-01-16 23:39:43,624 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:43,624 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:43,901 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:43,901 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:43,901 DEBUG --- stdout --- 2025-01-16 23:39:43,901 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:43,901 DEBUG --- stderr --- 2025-01-16 23:39:43,901 DEBUG source : /results/orders/benchmark-150/stderr.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stderr.txt 2025-01-16 23:39:43,902 INFO 2025-01-16 23:39:43,902 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:43,902 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:44,179 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:44,179 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:44,179 DEBUG --- stdout --- 2025-01-16 23:39:44,179 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:44,179 DEBUG --- stderr --- 2025-01-16 23:39:44,179 DEBUG 2025-01-16 23:39:44,180 INFO 2025-01-16 23:39:44,180 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-150/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stderr.txt 2025-01-16 23:39:44,180 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 23:39:44,911 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:44,911 DEBUG --- stdout --- 2025-01-16 23:39:44,911 DEBUG tar: Removing leading `/' from member names 2025-01-16 23:39:44,911 DEBUG --- stderr --- 2025-01-16 23:39:44,912 DEBUG 2025-01-16 23:39:44,912 INFO 2025-01-16 23:39:44,912 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:44,912 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:45,190 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:45,190 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:45,190 DEBUG --- stdout --- 2025-01-16 23:39:45,190 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:45,190 DEBUG --- stderr --- 2025-01-16 23:39:45,190 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 23:39:45,190 INFO 2025-01-16 23:39:45,190 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:45,190 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:45,467 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:45,467 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:45,467 DEBUG --- stdout --- 2025-01-16 23:39:45,467 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:45,467 DEBUG --- stderr --- 2025-01-16 23:39:45,467 DEBUG 2025-01-16 23:39:45,468 INFO 2025-01-16 23:39:45,468 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-150/stdout.txt" ]; then echo "/results/orders/benchmark-150/stdout.txt file found"; exit 0; else echo "/results/orders/benchmark-150/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-150/stdout.txt file found" 2025-01-16 23:39:45,468 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 23:39:46,274 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 23:39:46,274 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:46,274 DEBUG --- stdout --- 2025-01-16 23:39:46,274 DEBUG /results/orders/benchmark-150/stdout.txt file found 2025-01-16 23:39:46,274 DEBUG --- stderr --- 2025-01-16 23:39:46,274 DEBUG 2025-01-16 23:39:46,275 INFO 2025-01-16 23:39:46,275 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:46,275 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:46,553 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:46,553 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:46,553 DEBUG --- stdout --- 2025-01-16 23:39:46,553 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:46,553 DEBUG --- stderr --- 2025-01-16 23:39:46,553 DEBUG 2025-01-16 23:39:46,553 INFO 2025-01-16 23:39:46,553 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-150/stdout.txt 2025-01-16 23:39:47,361 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 23:39:47,361 DEBUG --- stdout --- 2025-01-16 23:39:47,361 DEBUG 9088 /results/orders/benchmark-150/stdout.txt 2025-01-16 23:39:47,361 DEBUG --- stderr --- 2025-01-16 23:39:47,361 DEBUG 2025-01-16 23:39:47,361 INFO - Download file (size 9088k) 2025-01-16 23:39:47,362 INFO 2025-01-16 23:39:47,362 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:47,362 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:47,644 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:47,644 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:47,644 DEBUG --- stdout --- 2025-01-16 23:39:47,644 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:47,644 DEBUG --- stderr --- 2025-01-16 23:39:47,644 DEBUG source : /results/orders/benchmark-150/stdout.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stdout.txt 2025-01-16 23:39:47,644 INFO 2025-01-16 23:39:47,644 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:47,644 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:47,922 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:47,922 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:47,922 DEBUG --- stdout --- 2025-01-16 23:39:47,922 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:47,922 DEBUG --- stderr --- 2025-01-16 23:39:47,922 DEBUG 2025-01-16 23:39:47,922 INFO 2025-01-16 23:39:47,922 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-150/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stdout.txt 2025-01-16 23:39:47,922 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 23:39:49,423 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:49,423 DEBUG --- stdout --- 2025-01-16 23:39:49,423 DEBUG tar: Removing leading `/' from member names 2025-01-16 23:39:49,423 DEBUG --- stderr --- 2025-01-16 23:39:49,423 DEBUG ________________________________________________________________________________ [2025-01-16 23:39:49] benchmark-150 show_cmd : Display order command ________________________________________________________________________________ 2025-01-16 23:39:49,423 INFO 2025-01-16 23:39:49,423 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:49,423 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:49,700 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:49,701 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:49,701 DEBUG --- stdout --- 2025-01-16 23:39:49,701 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:49,701 DEBUG --- stderr --- 2025-01-16 23:39:49,701 DEBUG Checking pod: overseer-0-5865b977f-pk2tz for file exists, if not wait. 2025-01-16 23:39:49,701 INFO 2025-01-16 23:39:49,701 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:49,701 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:49,995 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:49,995 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:49,995 DEBUG --- stdout --- 2025-01-16 23:39:49,995 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:49,995 DEBUG --- stderr --- 2025-01-16 23:39:49,995 DEBUG 2025-01-16 23:39:49,996 INFO 2025-01-16 23:39:49,996 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- bash -c 'if [ -f "/results/orders/benchmark-150/cmd.txt" ]; then echo "/results/orders/benchmark-150/cmd.txt file found"; exit 0; else echo "/results/orders/benchmark-150/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/benchmark-150/cmd.txt file found" 2025-01-16 23:39:49,996 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-01-16 23:39:50,804 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-01-16 23:39:50,804 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:50,804 DEBUG --- stdout --- 2025-01-16 23:39:50,805 DEBUG /results/orders/benchmark-150/cmd.txt file found 2025-01-16 23:39:50,805 DEBUG --- stderr --- 2025-01-16 23:39:50,805 DEBUG 2025-01-16 23:39:50,805 INFO 2025-01-16 23:39:50,805 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:50,805 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:51,082 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:51,082 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:51,082 DEBUG --- stdout --- 2025-01-16 23:39:51,082 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:51,082 DEBUG --- stderr --- 2025-01-16 23:39:51,082 DEBUG 2025-01-16 23:39:51,082 INFO 2025-01-16 23:39:51,083 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-pk2tz --stdin -- du -k /results/orders/benchmark-150/cmd.txt 2025-01-16 23:39:51,881 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-01-16 23:39:51,881 DEBUG --- stdout --- 2025-01-16 23:39:51,881 DEBUG 4 /results/orders/benchmark-150/cmd.txt 2025-01-16 23:39:51,881 DEBUG --- stderr --- 2025-01-16 23:39:51,881 DEBUG 2025-01-16 23:39:51,881 INFO - Download file (size 4k) 2025-01-16 23:39:51,881 INFO 2025-01-16 23:39:51,881 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:51,881 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:52,158 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:52,158 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:52,158 DEBUG --- stdout --- 2025-01-16 23:39:52,158 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:52,158 DEBUG --- stderr --- 2025-01-16 23:39:52,158 DEBUG source : /results/orders/benchmark-150/cmd.txt @ overseer-0-5865b977f-pk2tz destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/cmd.txt 2025-01-16 23:39:52,158 INFO 2025-01-16 23:39:52,159 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-01-16 23:39:52,159 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-01-16 23:39:52,435 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-01-16 23:39:52,435 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:52,435 DEBUG --- stdout --- 2025-01-16 23:39:52,435 DEBUG overseer-0-5865b977f-pk2tz 2025-01-16 23:39:52,435 DEBUG --- stderr --- 2025-01-16 23:39:52,435 DEBUG 2025-01-16 23:39:52,436 INFO 2025-01-16 23:39:52,436 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5865b977f-pk2tz:/results/orders/benchmark-150/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/cmd.txt 2025-01-16 23:39:52,436 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-01-16 23:39:53,164 INFO [loop_until]: OK (rc = 0) 2025-01-16 23:39:53,164 DEBUG --- stdout --- 2025-01-16 23:39:53,164 DEBUG tar: Removing leading `/' from member names 2025-01-16 23:39:53,164 DEBUG --- stderr --- 2025-01-16 23:39:53,164 DEBUG 2025-01-16 23:39:53,164 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/cmd.txt is small (1 lines), printing all lines: 2025-01-16 23:39:53,164 DEBUG ----- output ----- 2025-01-16 23:39:53,164 DEBUG /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idc.benchmark.Mix2024@perf-200m" --results-folder="/results/gatling/benchmark-150" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx4G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=Pa_ssw0rd" 2025-01-16 23:39:53,164 INFO ________________________________________________________________________________ [2025-01-16 23:39:53] benchmark-150 show_rc : Display rc order ________________________________________________________________________________ 2025-01-16 23:39:53,164 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/rc.txt is small (1 lines), printing all lines: 2025-01-16 23:39:53,164 DEBUG ----- output ----- 2025-01-16 23:39:53,164 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2025-01-16 23:39:53,164 INFO ________________________________________________________________________________ [2025-01-16 23:39:53] benchmark-150 show_stdout : Display stdout order ________________________________________________________________________________ 2025-01-16 23:39:53,177 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stdout.txt is 97414 lines): 2025-01-16 23:39:53,177 DEBUG ----- output ----- 2025-01-16 23:39:53,177 INFO 2025-01-16 22:39:04,305 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmpjkf07c1u 2025-01-16 23:39:53,177 INFO 2025-01-16 22:39:04,307 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/benchmark-150" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx4G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=200000000 -Doauth2_client_id=endUserUIClient -Doauth2_redirect_uri=/enduser/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idc.benchmark.Mix2024 -DtestMode=open -Dthroughput=150 -Duser_password=**** 2025-01-16 23:39:53,177 INFO [INFO] Scanning for projects... 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- 2025-01-16 23:39:53,177 INFO [INFO] Building pyrock-gatling-simulation 3.12.0 2025-01-16 23:39:53,177 INFO [INFO] from pom.xml 2025-01-16 23:39:53,177 INFO [INFO] --------------------------------[ jar ]--------------------------------- 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- 2025-01-16 23:39:53,177 INFO [INFO] skip non existing resourceDirectory /tmp/tmpjkf07c1u/src/main/resources 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- 2025-01-16 23:39:53,177 INFO [INFO] No sources to compile 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- 2025-01-16 23:39:53,177 INFO [INFO] Copying 2 resources from src/test/resources to target/test-classes 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- 2025-01-16 23:39:53,177 INFO [INFO] Nothing to compile - all classes are up to date. 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- 2025-01-16 23:39:53,177 INFO [INFO] compiling 38 Scala sources to /tmp/tmpjkf07c1u/target/test-classes ... 2025-01-16 23:39:53,177 INFO [INFO] compile in 12.4 s 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] 2025-01-16 23:39:53,177 INFO [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- 2025-01-16 23:39:53,177 INFO [INFO] Running simulation com.forgerock.pyrock.Loadtest. 2025-01-16 23:39:53,177 INFO Gatling 3.13.1 is available! (you're using 3.12.0) 2025-01-16 23:39:53,177 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2025-01-16 23:39:53,177 INFO Simulation com.forgerock.pyrock.Loadtest started... 2025-01-16 23:39:53,177 INFO 2025-01-16 23:39:53,177 INFO ================================================================================ 2025-01-16 23:39:53,177 INFO 2025-01-16 22:39:27 GMT 5s elapsed 2025-01-16 23:39:53,177 INFO ---- Requests ------------------------------------------------------------------ 2025-01-16 23:39:53,177 INFO > Global (OK=789 KO=0 ) 2025-01-16 23:39:53,177 INFO > restLoginInitiate (OK=59 KO=0 ) 2025-01-16 23:39:53,177 INFO > restLoginUsernamePasswordCallback (OK=57 KO=0 ) 2025-01-16 23:39:53,177 INFO > UI-Post-Login - stage 1 (OK=19 KO=0 ) 2025-01-16 23:39:53,177 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=19 KO=0 ) 2025-01-16 23:39:53,177 INFO > UI AM idFromSession (OK=19 KO=0 ) 2025-01-16 23:39:53,177 INFO > UI AM validateGoto (OK=19 KO=0 ) 2025-01-16 23:39:53,177 INFO > User Authorize PKCE stage (OK=70 KO=0 ) 2025-01-16 23:39:53,177 INFO > User AccessToken PKCE stage (OK=69 KO=0 ) 2025-01-16 23:39:53,177 INFO > UI-Post-Login - stage 2 (OK=18 KO=0 ) 2025-01-16 23:39:53,177 INFO > UI-Post-Login - stage 2 Redirect 1 (OK=17 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI Enduser appAuthHelper2 (OK=17 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI Enduser appAuthHelper1 (OK=17 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI-Post-Login - stage 3 (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI-Post-Login - stage 3 Redirect 1 (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > tokenUserinfo (OK=10 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI Enduser sessioncheck (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM uiconfig (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM version (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM login (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM features (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM privilege (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM managed user schema (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM dashboard (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM user (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI IDM oidcToken (OK=16 KO=0 ) 2025-01-16 23:39:53,178 INFO > userinfo (OK=15 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI-Logout (OK=14 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI-Logout Redirect 1 (OK=14 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI AM endsession (OK=14 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI AM revoke1 (OK=14 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI AM revoke2 (OK=14 KO=0 ) 2025-01-16 23:39:53,178 INFO > Skip 2FA (OK=26 KO=0 ) 2025-01-16 23:39:53,178 INFO > RootUserinfo (OK=17 KO=0 ) 2025-01-16 23:39:53,178 INFO > GetUUid (OK=15 KO=0 ) 2025-01-16 23:39:53,178 INFO > getIdToken (OK=2 KO=0 ) 2025-01-16 23:39:53,178 INFO > GetOpenidConfig (OK=15 KO=0 ) 2025-01-16 23:39:53,178 INFO > getIdToken Redirect 1 (OK=2 KO=0 ) 2025-01-16 23:39:53,178 INFO > CreatePolicy (OK=15 KO=0 ) 2025-01-16 23:39:53,178 INFO > createOrganization (OK=2 KO=0 ) 2025-01-16 23:39:53,178 INFO > queryOrganization (OK=2 KO=0 ) 2025-01-16 23:39:53,178 INFO > deleteOrganization (OK=2 KO=0 ) 2025-01-16 23:39:53,178 INFO > loginTreeWorkflow_restLoginInitiate (OK=2 KO=0 ) 2025-01-16 23:39:53,178 INFO > loginTreeWorkflow_restLoginUsernamePasswordCallback (OK=2 KO=0 ) 2025-01-16 23:39:53,178 INFO 2025-01-16 23:39:53,178 INFO ---- idc.benchmark.Mix2024 ----------------------------------------------------- 2025-01-16 23:39:53,178 INFO [- ] 0% 2025-01-16 23:39:53,178 INFO waiting: 541342 / active: 34 / done: 28 2025-01-16 23:39:53,178 INFO ================================================================================ 2025-01-16 23:39:53,178 INFO 2025-01-16 23:39:53,178 INFO 2025-01-16 23:39:53,178 INFO ================================================================================ 2025-01-16 23:39:53,178 INFO 2025-01-16 22:39:32 GMT 10s elapsed 2025-01-16 23:39:53,178 INFO ---- Requests ------------------------------------------------------------------ 2025-01-16 23:39:53,178 INFO > Global (OK=2962 KO=0 ) 2025-01-16 23:39:53,178 INFO > restLoginInitiate (OK=240 KO=0 ) 2025-01-16 23:39:53,178 INFO > restLoginUsernamePasswordCallback (OK=237 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI-Post-Login - stage 1 (OK=54 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI-Post-Login - stage 1 Redirect 1 (OK=53 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI AM idFromSession (OK=53 KO=0 ) 2025-01-16 23:39:53,178 INFO > UI AM validateGoto (OK=53 KO=0 ) 2025-01-16 23:39:53,178 INFO [...] 2025-01-16 23:39:53,194 INFO ========================= 2025-01-16 23:39:53,194 INFO HTTP response: 2025-01-16 23:39:53,194 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 23:39:53,194 INFO 23:39:22.914 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-16 23:39:53,194 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-16 23:39:53,194 INFO Request: 2025-01-16 23:39:53,194 INFO restLoginInitiate: KO j.i.IOException: Premature close 2025-01-16 23:39:53,194 INFO ========================= 2025-01-16 23:39:53,194 INFO Session: 2025-01-16 23:39:53,194 INFO Session(idc.benchmark.Mix2024,536797,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.134946939, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@6588a5e5, fake-user-agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3, password -> Pa_ssw0rd, fake-ip -> 42.42.42.42, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@7ad80927),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007fb13869a2e8@69fb5d8a,io.netty.channel.epoll.EpollEventLoop@1e1d3956) 2025-01-16 23:39:53,194 INFO ========================= 2025-01-16 23:39:53,194 INFO HTTP request: 2025-01-16 23:39:53,194 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/authenticate 2025-01-16 23:39:53,194 INFO headers: 2025-01-16 23:39:53,194 INFO accept: application/json 2025-01-16 23:39:53,194 INFO content-type: application/json 2025-01-16 23:39:53,194 INFO user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3 2025-01-16 23:39:53,194 INFO X-Forwarded-For: 42.42.42.42 2025-01-16 23:39:53,194 INFO host: openam-perf-200m.forgeblocks.com 2025-01-16 23:39:53,194 INFO content-length: 0 2025-01-16 23:39:53,194 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-16 23:39:53,194 INFO ========================= 2025-01-16 23:39:53,194 INFO HTTP response: 2025-01-16 23:39:53,194 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 23:39:53,194 INFO 23:39:22.915 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-133' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-16 23:39:53,194 INFO 23:39:22.916 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request ' UI IDM version' failed for user 536694: j.i.IOException: Premature close 2025-01-16 23:39:53,194 INFO 23:39:22.916 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-16 23:39:53,194 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-16 23:39:53,194 INFO Request: 2025-01-16 23:39:53,194 INFO UI IDM version: KO j.i.IOException: Premature close 2025-01-16 23:39:53,194 INFO ========================= 2025-01-16 23:39:53,194 INFO Session: 2025-01-16 23:39:53,194 INFO Session(idc.benchmark.Mix2024,536694,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhMWRjNDRkZS0zMzkxLTRlYTctYTQ0MS1mNmUwMzViMDE3YzYiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiZDU2YzQ3YzgtMjA2OC00YzQwLWIxZDktZTkxOTFlNGI4NDNmLTU4NDk5MzkyIiwic3VibmFtZSI6ImExZGM0NGRlLTMzOTEtNGVhNy1hNDQxLWY2ZTAzNWIwMTdjNiIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiI3aUd1NEtkZEo3dnZYSTBGTlp4N3hYdGNSRnciLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcwNzA3NjIsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJvcGVuaWQiLCJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcwNzA3NjIsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MDc0MzYyLCJpYXQiOjE3MzcwNzA3NjIsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6Ik5wU3lPUk94S0RFQWRJYVBVaWNHb0hiV0xfVSJ9.shvRN2f2ZDQkgFCeghXg5jZfRB_XBv_2cMcBVzVZB7s, username -> user.142450297, access_token_2 -> eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJhMWRjNDRkZS0zMzkxLTRlYTctYTQ0MS1mNmUwMzViMDE3YzYiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiZDU2YzQ3YzgtMjA2OC00YzQwLWIxZDktZTkxOTFlNGI4NDNmLTU4NTAwNjY3Iiwic3VibmFtZSI6ImExZGM0NGRlLTMzOTEtNGVhNy1hNDQxLWY2ZTAzNWIwMTdjNiIsImlzcyI6Imh0dHBzOi8vb3BlbmFtLXBlcmYtMjAwbS5mb3JnZWJsb2Nrcy5jb206NDQzL2FtL29hdXRoMi9yZWFsbXMvcm9vdC9yZWFsbXMvYWxwaGEiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiI5Mzg2TTdlSWVoZWc5UGNsTDlnYmttcEJhTWciLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJlbmRVc2VyVUlDbGllbnQiLCJhdWQiOiJlbmRVc2VyVUlDbGllbnQiLCJuYmYiOjE3MzcwNzA3NjIsImdyYW50X3R5cGUiOiJhdXRob3JpemF0aW9uX2NvZGUiLCJzY29wZSI6WyJmcjppZG06KiJdLCJhdXRoX3RpbWUiOjE3MzcwNzA3NjIsInJlYWxtIjoiL2FscGhhIiwiZXhwIjoxNzM3MDc0MzYyLCJpYXQiOjE3MzcwNzA3NjIsImV4cGlyZXNfaW4iOjM2MDAsImp0aSI6IjhPN3hzUHFvNkx6RGw4TktHUWRQdjczanZYcyJ9.M046g9AbfF-NRVAEEy69v-ZMu-BAh2mpoYX5I9wTaXQ, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@52ace3ea, gatling.http.referer -> https://openam-perf-200m.forgeblocks.com/am/, authcode -> fK6isPlvPwGgwg-4bU6q_85aT0Y, callbacks -> {"tokenId":"449foou8SnEIzcgmQevXsG9LFkc.*AAJTSQACMDIAAlNLABx6SmV5TkFxUEs0aTVCSmZBMDduQ0FZOHpOeDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*","successUrl":"/enduser/?realm=/alpha","realm":"/alpha"}, gatling.http.cookies -> CookieJar(Map(CookieKey(amlbcookie,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737070762334), CookieKey(15892ffd844ef80,openam-perf-200m.forgeblocks.com,/) -> StoredCookie(15892ffd844ef80=449foou8SnEIzcgmQevXsG9LFkc.*AAJTSQACMDIAAlNLABx6SmV5TkFxUEs0aTVCSmZBMDduQ0FZOHpOeDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None,false,false,1737070762334))), user_uuid -> a1dc44de-3391-4ea7-a441-f6e035b017c6, password -> Pa_ssw0rd, challenge -> i8xknZC7JnoGtSYr1jlYeeCr0PocHbpmGZahCnQC7P0, gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, fake-ip -> 29.59.179.249, verifier -> Mjk5MDg2ODQwNzkyNTMyMTAyMQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@60dd1801, gatling.http.cache.contentCache -> io.gatling.core.util.cache.Cache@33dbb99a, tokenId -> 449foou8SnEIzcgmQevXsG9LFkc.*AAJTSQACMDIAAlNLABx6SmV5TkFxUEs0aTVCSmZBMDduQ0FZOHpOeDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, fake-user-agent -> Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007fb13869a2e8@69fb5d8a,io.netty.channel.epoll.EpollEventLoop@5b057c8c) 2025-01-16 23:39:53,194 INFO ========================= 2025-01-16 23:39:53,194 INFO HTTP request: 2025-01-16 23:39:53,194 INFO GET https://openam-perf-200m.forgeblocks.com/openidm/info/version 2025-01-16 23:39:53,194 INFO headers: 2025-01-16 23:39:53,194 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 2025-01-16 23:39:53,194 INFO referer: https://openam-perf-200m.forgeblocks.com/am/ 2025-01-16 23:39:53,194 INFO Accept-Api-Version: 2025-01-16 23:39:53,194 INFO accept: */* 2025-01-16 23:39:53,194 INFO cookie: amlbcookie=01; 15892ffd844ef80=449foou8SnEIzcgmQevXsG9LFkc.*AAJTSQACMDIAAlNLABx6SmV5TkFxUEs0aTVCSmZBMDduQ0FZOHpOeDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..* 2025-01-16 23:39:53,195 INFO host: openam-perf-200m.forgeblocks.com 2025-01-16 23:39:53,195 INFO cookies: 2025-01-16 23:39:53,195 INFO amlbcookie=01, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-16 23:39:53,195 INFO 15892ffd844ef80=449foou8SnEIzcgmQevXsG9LFkc.*AAJTSQACMDIAAlNLABx6SmV5TkFxUEs0aTVCSmZBMDduQ0FZOHpOeDA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, domain=openam-perf-200m.forgeblocks.com, path=/, secure, HTTPOnly, SameSite=None 2025-01-16 23:39:53,195 INFO ========================= 2025-01-16 23:39:53,195 INFO HTTP response: 2025-01-16 23:39:53,195 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 23:39:53,195 INFO 23:39:22.916 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 535770: j.n.c.ClosedChannelException 2025-01-16 23:39:53,195 INFO 23:39:22.916 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'restLoginInitiate' failed for user 535300: j.n.c.ClosedChannelException 2025-01-16 23:39:53,195 INFO 23:39:22.916 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-16 23:39:53,195 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-16 23:39:53,195 INFO Request: 2025-01-16 23:39:53,195 INFO restLoginInitiate: KO j.n.c.ClosedChannelException 2025-01-16 23:39:53,195 INFO ========================= 2025-01-16 23:39:53,195 INFO Session: 2025-01-16 23:39:53,195 INFO Session(idc.benchmark.Mix2024,535770,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.175524066, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@2619f22c, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9, password -> Pa_ssw0rd, fake-ip -> 21.252.217.175, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@d9ef34a),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007fb13869a2e8@69fb5d8a,io.netty.channel.epoll.EpollEventLoop@2bef51f2) 2025-01-16 23:39:53,195 INFO ========================= 2025-01-16 23:39:53,195 INFO HTTP request: 2025-01-16 23:39:53,195 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate 2025-01-16 23:39:53,195 INFO headers: 2025-01-16 23:39:53,195 INFO accept: application/json 2025-01-16 23:39:53,195 INFO content-type: application/json 2025-01-16 23:39:53,195 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/601.3.9 (KHTML, like Gecko) Version/9.0.2 Safari/601.3.9 2025-01-16 23:39:53,195 INFO X-Forwarded-For: 21.252.217.175 2025-01-16 23:39:53,195 INFO host: openam-perf-200m.forgeblocks.com 2025-01-16 23:39:53,195 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-16 23:39:53,195 INFO ========================= 2025-01-16 23:39:53,195 INFO HTTP response: 2025-01-16 23:39:53,195 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 23:39:53,195 INFO 23:39:22.916 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - 2025-01-16 23:39:53,195 INFO >>>>>>>>>>>>>>>>>>>>>>>>>> 2025-01-16 23:39:53,195 INFO Request: 2025-01-16 23:39:53,195 INFO restLoginInitiate: KO j.n.c.ClosedChannelException 2025-01-16 23:39:53,195 INFO ========================= 2025-01-16 23:39:53,195 INFO Session: 2025-01-16 23:39:53,195 INFO Session(idc.benchmark.Mix2024,535300,HashMap(gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, username -> user.54575402, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@743705c2, fake-user-agent -> Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36, password -> Pa_ssw0rd, fake-ip -> 70.169.98.239, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@22d55066),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$823/0x00007fb13869a2e8@69fb5d8a,io.netty.channel.epoll.EpollEventLoop@239b0f9d) 2025-01-16 23:39:53,195 INFO ========================= 2025-01-16 23:39:53,195 INFO HTTP request: 2025-01-16 23:39:53,195 INFO POST https://openam-perf-200m.forgeblocks.com/am/json/realms/root/realms/alpha/authenticate?authIndexType=service&authIndexValue=Login 2025-01-16 23:39:53,195 INFO headers: 2025-01-16 23:39:53,195 INFO accept: application/json 2025-01-16 23:39:53,195 INFO content-type: application/json 2025-01-16 23:39:53,195 INFO user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 2025-01-16 23:39:53,195 INFO X-Forwarded-For: 70.169.98.239 2025-01-16 23:39:53,195 INFO host: openam-perf-200m.forgeblocks.com 2025-01-16 23:39:53,195 INFO body:StringChunksRequestBody{charset=UTF-8, content=} 2025-01-16 23:39:53,195 INFO ========================= 2025-01-16 23:39:53,195 INFO HTTP response: 2025-01-16 23:39:53,195 INFO <<<<<<<<<<<<<<<<<<<<<<<<< 2025-01-16 23:39:53,195 INFO 23:39:22.916 [ERROR] i.g.c.a.b.SessionHookBuilder$$anon$1 - 'hook-190' crashed with 'j.u.NoSuchElementException: No attribute named 'callbacks' is defined', forwarding to the next one 2025-01-16 23:39:53,195 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 23:39:53,195 INFO [INFO] BUILD SUCCESS 2025-01-16 23:39:53,195 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 23:39:53,195 INFO [INFO] Total time: 01:00 h 2025-01-16 23:39:53,195 INFO [INFO] Finished at: 2025-01-16T23:39:23Z 2025-01-16 23:39:53,195 INFO [INFO] ------------------------------------------------------------------------ 2025-01-16 23:39:53,195 INFO 2025-01-16 23:39:23,052 INFO Gatling simulation run ended successfully 2025-01-16 23:39:53,195 INFO 2025-01-16 23:39:23,052 DEBUG No archive name provided. No archive will be created 2025-01-16 23:39:53,195 INFO ________________________________________________________________________________ [2025-01-16 23:39:53] benchmark-150 show_stderr : Display stderr order ________________________________________________________________________________ 2025-01-16 23:39:53,196 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark/07_Scenario_benchmark/05_benchmark-150/stderr.txt is small (0 lines), printing all lines: 2025-01-16 23:39:53,196 DEBUG ----- output ----- 2025-01-16 23:39:53,196 DEBUG 2025-01-16 23:39:53,196 INFO ________________________________________________________________________________ [2025-01-16 23:39:53] benchmark-150 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-01-16 23:39:53] benchmark-150 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-01-16 23:39:53] benchmark-150 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped