--Task-- name: update-1600 enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: idm target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: ['update-1500'] preceding_task: update-1500 options: {'testMode': 'open', 'testCase': 'idm.ManagedUsersUpdate', 'duration': 3600, 'throughput': 1600, 'java-opts': '-Dcsvfile=/results/idm/user_feeder.csv -Drealm=alpha'} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock 2025-03-28 08:44:52,523 INFO 2025-03-28 08:44:52,523 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 08:44:52,523 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 08:44:52,800 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 08:44:52,800 INFO [loop_until]: OK (rc = 0) 2025-03-28 08:44:52,800 DEBUG --- stdout --- 2025-03-28 08:44:52,800 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 08:44:52,800 DEBUG --- stderr --- 2025-03-28 08:44:52,800 DEBUG 2025-03-28 08:44:52,800 INFO Lodestar assumed that full stack is deployed so will set all products host URLs in Gatling system properties 2025-03-28 08:44:52 - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) 2025-03-28 08:44:52 - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/update-1600/stdout.txt Pod log : /results/orders/update-1600 ________________________________________________________________________________ [2025-03-28 08:44:52] update-1600 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idm.ManagedUsersUpdate@perf-200m" --results-folder="/results/gatling/update-1600" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx8G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dcsvfile=/results/idm/user_feeder.csv -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idm.ManagedUsersUpdate -DtestMode=open -Dthroughput=1600 -Duser_password=**** ________________________________________________________________________________ [2025-03-28 08:44:52] update-1600 create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/order.json { "name": "update-1600", "command": " /lodestar/lodestar.py perf run-gatling --simulation-class=\"com.forgerock.pyrock.Loadtest\" --run-description=\"idm.ManagedUsersUpdate@perf-200m\" --results-folder=\"/results/gatling/update-1600\" --no-reports --simulation-jvm-args=\"-XX:+ExitOnOutOfMemoryError -Xmx8G\" --simulation-system-properties=\"-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dcsvfile=/results/idm/user_feeder.csv -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idm.ManagedUsersUpdate -DtestMode=open -Dthroughput=1600 -Duser_password=T35!tr0c-k123\"", "out-dir": "/results/orders/update-1600" } ________________________________________________________________________________ [2025-03-28 08:44:52] update-1600 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-03-28 08:44:52,808 INFO 2025-03-28 08:44:52,808 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-03-28 08:44:52,808 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-03-28 08:44:53,066 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-28 08:44:53,066 INFO [loop_until]: OK (rc = 0) 2025-03-28 08:44:53,066 DEBUG --- stdout --- 2025-03-28 08:44:53,066 DEBUG WAITING 2025-03-28 08:44:53,066 DEBUG --- stderr --- 2025-03-28 08:44:53,066 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2025-03-28 08:44:53] update-1600 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-03-28 08:44:53,066 INFO 2025-03-28 08:44:53,066 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 08:44:53,066 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 08:44:53,345 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 08:44:53,345 INFO [loop_until]: OK (rc = 0) 2025-03-28 08:44:53,345 DEBUG --- stdout --- 2025-03-28 08:44:53,345 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 08:44:53,345 DEBUG --- stderr --- 2025-03-28 08:44:53,345 DEBUG 2025-03-28 08:44:53,345 INFO 2025-03-28 08:44:53,345 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/order.json overseer-0-59c948f569-rgrkv:/results/orders/order.json 2025-03-28 08:44:53,345 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-28 08:44:54,706 INFO [loop_until]: OK (rc = 0) 2025-03-28 08:44:54,706 DEBUG --- stdout --- 2025-03-28 08:44:54,706 DEBUG 2025-03-28 08:44:54,706 DEBUG --- stderr --- 2025-03-28 08:44:54,706 DEBUG Order has been successfully forwarded to overseer 2025-03-28 08:44:54 - INFO: Check if Gatling simulation started successfully 2025-03-28 08:44:54,706 INFO 2025-03-28 08:44:54,706 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv -- head --lines 5000 /results/orders/update-1600/stdout.txt | grep "Simulation com.forgerock.pyrock.Loadtest started..." 2025-03-28 08:44:54,706 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-03-28 08:44:55,630 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-03-28 08:45:01,374 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-03-28 08:45:07,107 INFO [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: Simulation com.forgerock.pyrock.Loadtest started... - retry 2025-03-28 08:45:12,847 INFO [loop_until]: Function succeeded after 18s (rc=0) - expected pattern found 2025-03-28 08:45:12,847 INFO [loop_until]: OK (rc = 0) 2025-03-28 08:45:12,847 DEBUG --- stdout --- 2025-03-28 08:45:12,847 DEBUG 2025-03-28 08:44:55,765 DEBUG Creating results folder /results/gatling/update-1600 2025-03-28 08:44:55,771 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp62ad6jel 2025-03-28 08:44:55,773 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/update-1600" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx8G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dcsvfile=/results/idm/user_feeder.csv -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idm.ManagedUsersUpdate -DtestMode=open -Dthroughput=1600 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmp62ad6jel/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmp62ad6jel/target/test-classes ... [INFO] compile in 8.4 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.5 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Set idVarName to id Simulation com.forgerock.pyrock.Loadtest started... 2025-03-28 08:45:12,847 DEBUG --- stderr --- 2025-03-28 08:45:12,847 DEBUG ________________________________________________________________________________ [2025-03-28 08:45:12] update-1600 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m, retry Order is running since 8m 01s, retry Order is running since 10m 01s, retry Order is running since 12m 01s, retry Order is running since 14m 01s, retry Order is running since 16m 02s, retry Order is running since 18m 02s, retry Order is running since 20m 02s, retry Order is running since 22m 03s, retry Order is running since 24m 03s, retry Order is running since 26m 03s, retry Order is running since 28m 04s, retry Order is running since 30m 04s, retry Order is running since 32m 04s, retry Order is running since 34m 04s, retry Order is running since 36m 05s, retry Order is running since 38m 05s, retry Order is running since 40m 05s, retry Order is running since 42m 06s, retry Order is running since 44m 06s, retry Order is running since 46m 06s, retry Order is running since 48m 07s, retry Order is running since 50m 07s, retry Order is running since 52m 07s, retry Order is running since 54m 07s, retry Order is running since 56m 08s, retry Order is running since 58m 08s, retry PASS : Order stopped by itself after 1h and before timeout (1h 12m) ________________________________________________________________________________ [2025-03-28 09:45:21] update-1600 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-03-28 09:45:21,744 INFO 2025-03-28 09:45:21,744 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 09:45:21,744 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 09:45:22,053 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 09:45:22,053 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:22,053 DEBUG --- stdout --- 2025-03-28 09:45:22,053 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 09:45:22,053 DEBUG --- stderr --- 2025-03-28 09:45:22,053 DEBUG 2025-03-28 09:45:22,054 INFO 2025-03-28 09:45:22,054 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv -- rm -f /results/orders/order.json 2025-03-28 09:45:22,054 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-28 09:45:22,845 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:22,845 DEBUG --- stdout --- 2025-03-28 09:45:22,845 DEBUG 2025-03-28 09:45:22,845 DEBUG --- stderr --- 2025-03-28 09:45:22,845 DEBUG Order ran during 1h ________________________________________________________________________________ [2025-03-28 09:45:22] update-1600 download_logs : Download individual order files ________________________________________________________________________________ 2025-03-28 09:45:22 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/order.json 2025-03-28 09:45:22,846 INFO 2025-03-28 09:45:22,846 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 09:45:22,846 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 09:45:23,123 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 09:45:23,123 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:23,123 DEBUG --- stdout --- 2025-03-28 09:45:23,123 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 09:45:23,123 DEBUG --- stderr --- 2025-03-28 09:45:23,123 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-28 09:45:23,124 INFO 2025-03-28 09:45:23,124 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/update-1600/rc.txt" ]; then echo "/results/orders/update-1600/rc.txt file found"; exit 0; else echo "/results/orders/update-1600/rc.txt file not found"; exit 1; fi' | grep "/results/orders/update-1600/rc.txt file found" 2025-03-28 09:45:23,124 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-28 09:45:23,927 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-28 09:45:23,927 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:23,927 DEBUG --- stdout --- 2025-03-28 09:45:23,927 DEBUG /results/orders/update-1600/rc.txt file found 2025-03-28 09:45:23,927 DEBUG --- stderr --- 2025-03-28 09:45:23,927 DEBUG 2025-03-28 09:45:23,927 INFO 2025-03-28 09:45:23,928 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/update-1600/rc.txt 2025-03-28 09:45:24,723 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-28 09:45:24,723 DEBUG --- stdout --- 2025-03-28 09:45:24,723 DEBUG 4 /results/orders/update-1600/rc.txt 2025-03-28 09:45:24,723 DEBUG --- stderr --- 2025-03-28 09:45:24,723 DEBUG 2025-03-28 09:45:24,723 INFO - Download file (size 4k) source : /results/orders/update-1600/rc.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/rc.txt 2025-03-28 09:45:24,724 INFO 2025-03-28 09:45:24,724 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/update-1600/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/rc.txt 2025-03-28 09:45:24,724 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-28 09:45:25,626 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:25,626 DEBUG --- stdout --- 2025-03-28 09:45:25,626 DEBUG tar: Removing leading `/' from member names 2025-03-28 09:45:25,626 DEBUG --- stderr --- 2025-03-28 09:45:25,626 DEBUG 2025-03-28 09:45:25,626 INFO 2025-03-28 09:45:25,627 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 09:45:25,627 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 09:45:25,904 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 09:45:25,904 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:25,904 DEBUG --- stdout --- 2025-03-28 09:45:25,904 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 09:45:25,904 DEBUG --- stderr --- 2025-03-28 09:45:25,904 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-28 09:45:25,905 INFO 2025-03-28 09:45:25,905 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/update-1600/stderr.txt" ]; then echo "/results/orders/update-1600/stderr.txt file found"; exit 0; else echo "/results/orders/update-1600/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/update-1600/stderr.txt file found" 2025-03-28 09:45:25,905 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-28 09:45:26,702 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-28 09:45:26,702 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:26,702 DEBUG --- stdout --- 2025-03-28 09:45:26,702 DEBUG /results/orders/update-1600/stderr.txt file found 2025-03-28 09:45:26,702 DEBUG --- stderr --- 2025-03-28 09:45:26,702 DEBUG 2025-03-28 09:45:26,703 INFO 2025-03-28 09:45:26,703 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/update-1600/stderr.txt 2025-03-28 09:45:27,498 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-28 09:45:27,498 DEBUG --- stdout --- 2025-03-28 09:45:27,498 DEBUG 0 /results/orders/update-1600/stderr.txt 2025-03-28 09:45:27,498 DEBUG --- stderr --- 2025-03-28 09:45:27,498 DEBUG 2025-03-28 09:45:27,498 INFO - Download file (size 0k) source : /results/orders/update-1600/stderr.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/stderr.txt 2025-03-28 09:45:27,499 INFO 2025-03-28 09:45:27,499 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/update-1600/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/stderr.txt 2025-03-28 09:45:27,499 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-28 09:45:28,259 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:28,259 DEBUG --- stdout --- 2025-03-28 09:45:28,259 DEBUG tar: Removing leading `/' from member names 2025-03-28 09:45:28,259 DEBUG --- stderr --- 2025-03-28 09:45:28,259 DEBUG 2025-03-28 09:45:28,260 INFO 2025-03-28 09:45:28,260 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 09:45:28,260 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 09:45:28,539 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 09:45:28,539 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:28,539 DEBUG --- stdout --- 2025-03-28 09:45:28,539 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 09:45:28,539 DEBUG --- stderr --- 2025-03-28 09:45:28,539 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-28 09:45:28,540 INFO 2025-03-28 09:45:28,540 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/update-1600/stdout.txt" ]; then echo "/results/orders/update-1600/stdout.txt file found"; exit 0; else echo "/results/orders/update-1600/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/update-1600/stdout.txt file found" 2025-03-28 09:45:28,540 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-28 09:45:29,357 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-28 09:45:29,357 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:29,357 DEBUG --- stdout --- 2025-03-28 09:45:29,357 DEBUG /results/orders/update-1600/stdout.txt file found 2025-03-28 09:45:29,357 DEBUG --- stderr --- 2025-03-28 09:45:29,357 DEBUG 2025-03-28 09:45:29,357 INFO 2025-03-28 09:45:29,358 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/update-1600/stdout.txt 2025-03-28 09:45:30,154 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-28 09:45:30,154 DEBUG --- stdout --- 2025-03-28 09:45:30,154 DEBUG 2688 /results/orders/update-1600/stdout.txt 2025-03-28 09:45:30,154 DEBUG --- stderr --- 2025-03-28 09:45:30,154 DEBUG 2025-03-28 09:45:30,154 INFO - Download file (size 2688k) source : /results/orders/update-1600/stdout.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/stdout.txt 2025-03-28 09:45:30,155 INFO 2025-03-28 09:45:30,155 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/update-1600/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/stdout.txt 2025-03-28 09:45:30,155 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-28 09:45:31,349 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:31,349 DEBUG --- stdout --- 2025-03-28 09:45:31,349 DEBUG tar: Removing leading `/' from member names 2025-03-28 09:45:31,349 DEBUG --- stderr --- 2025-03-28 09:45:31,349 DEBUG ________________________________________________________________________________ [2025-03-28 09:45:31] update-1600 show_cmd : Display order command ________________________________________________________________________________ 2025-03-28 09:45:31,349 INFO 2025-03-28 09:45:31,349 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-03-28 09:45:31,349 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-03-28 09:45:31,629 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-03-28 09:45:31,629 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:31,629 DEBUG --- stdout --- 2025-03-28 09:45:31,629 DEBUG overseer-0-59c948f569-rgrkv 2025-03-28 09:45:31,629 DEBUG --- stderr --- 2025-03-28 09:45:31,629 DEBUG Checking pod: overseer-0-59c948f569-rgrkv for file exists, if not wait. 2025-03-28 09:45:31,630 INFO 2025-03-28 09:45:31,630 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- bash -c 'if [ -f "/results/orders/update-1600/cmd.txt" ]; then echo "/results/orders/update-1600/cmd.txt file found"; exit 0; else echo "/results/orders/update-1600/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/update-1600/cmd.txt file found" 2025-03-28 09:45:31,630 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-03-28 09:45:32,431 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-03-28 09:45:32,431 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:32,431 DEBUG --- stdout --- 2025-03-28 09:45:32,431 DEBUG /results/orders/update-1600/cmd.txt file found 2025-03-28 09:45:32,431 DEBUG --- stderr --- 2025-03-28 09:45:32,431 DEBUG 2025-03-28 09:45:32,431 INFO 2025-03-28 09:45:32,431 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-59c948f569-rgrkv --stdin -- du -k /results/orders/update-1600/cmd.txt 2025-03-28 09:45:33,232 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2025-03-28 09:45:33,232 DEBUG --- stdout --- 2025-03-28 09:45:33,232 DEBUG 4 /results/orders/update-1600/cmd.txt 2025-03-28 09:45:33,232 DEBUG --- stderr --- 2025-03-28 09:45:33,232 DEBUG 2025-03-28 09:45:33,232 INFO - Download file (size 4k) source : /results/orders/update-1600/cmd.txt @ overseer-0-59c948f569-rgrkv destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/cmd.txt 2025-03-28 09:45:33,232 INFO 2025-03-28 09:45:33,233 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-59c948f569-rgrkv:/results/orders/update-1600/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/cmd.txt 2025-03-28 09:45:33,233 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-03-28 09:45:33,996 INFO [loop_until]: OK (rc = 0) 2025-03-28 09:45:33,996 DEBUG --- stdout --- 2025-03-28 09:45:33,996 DEBUG tar: Removing leading `/' from member names 2025-03-28 09:45:33,996 DEBUG --- stderr --- 2025-03-28 09:45:33,996 DEBUG 2025-03-28 09:45:33,996 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/cmd.txt is small (1 lines), printing all lines: 2025-03-28 09:45:33,996 INFO ----- output ----- /lodestar/lodestar.py perf run-gatling --simulation-class="com.forgerock.pyrock.Loadtest" --run-description="idm.ManagedUsersUpdate@perf-200m" --results-folder="/results/gatling/update-1600" --no-reports --simulation-jvm-args="-XX:+ExitOnOutOfMemoryError -Xmx8G" --simulation-system-properties="-Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@pingidentity.com -Dcsvfile=/results/idm/user_feeder.csv -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idm.ManagedUsersUpdate -DtestMode=open -Dthroughput=1600 -Duser_password=T35!tr0c-k123" ________________________________________________________________________________ [2025-03-28 09:45:33] update-1600 show_rc : Display rc order ________________________________________________________________________________ 2025-03-28 09:45:33,996 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/rc.txt is small (1 lines), printing all lines: 2025-03-28 09:45:33,996 INFO ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2025-03-28 09:45:33] update-1600 show_stdout : Display stdout order ________________________________________________________________________________ 2025-03-28 09:45:34,000 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/stdout.txt is 29892 lines): 2025-03-28 09:45:34,004 INFO ----- output ----- 2025-03-28 08:44:55,765 DEBUG Creating results folder /results/gatling/update-1600 2025-03-28 08:44:55,771 INFO pom.xml and Gatling Scala files copied from /home/jenkins/lodestar/pyrock/shared/clients/gatling to temporary folder /tmp/tmp62ad6jel 2025-03-28 08:44:55,773 INFO Running Gatling simulation with command: mvn gatling:test --batch-mode -Dgatling.simulationClass="com.forgerock.pyrock.Loadtest" -Dgatling.runDescription="..." -Dgatling.resultsFolder="/results/gatling/update-1600" -Dgatling.noReports=true -Dgatling.jvmArgs="-XX:+ExitOnOutOfMemoryError,-Xmx8G" -Dgatling.propagateSystemProperties=true -Dam_host=openam-perf-200m.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dcsvfile=/results/idm/user_feeder.csv -Dduration=3600 -Didc=true -Didm_host=openam-perf-200m.forgeblocks.com -Dlogin_cookie=15892ffd844ef80 -Dnum_users=50000000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idm.ManagedUsersUpdate -DtestMode=open -Dthroughput=1600 -Duser_password=**** [INFO] Scanning for projects... [INFO] [INFO] -----------< com.forgerock.pyrock:pyrock-gatling-simulation >----------- [INFO] Building pyrock-gatling-simulation 3.12.0 [INFO] from pom.xml [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] >>> gatling:4.9.6:test (default-cli) > test-compile @ pyrock-gatling-simulation >>> [INFO] [INFO] --- resources:3.3.1:resources (default-resources) @ pyrock-gatling-simulation --- [INFO] skip non existing resourceDirectory /tmp/tmp62ad6jel/src/main/resources [INFO] [INFO] --- compiler:3.13.0:compile (default-compile) @ pyrock-gatling-simulation --- [INFO] No sources to compile [INFO] [INFO] --- resources:3.3.1:testResources (default-testResources) @ pyrock-gatling-simulation --- [INFO] Copying 2 resources from src/test/resources to target/test-classes [INFO] [INFO] --- compiler:3.13.0:testCompile (default-testCompile) @ pyrock-gatling-simulation --- [INFO] Nothing to compile - all classes are up to date. [INFO] [INFO] --- scala:4.9.2:testCompile (default) @ pyrock-gatling-simulation --- [INFO] compiling 38 Scala sources to /tmp/tmp62ad6jel/target/test-classes ... [INFO] compile in 8.4 s [INFO] [INFO] <<< gatling:4.9.6:test (default-cli) < test-compile @ pyrock-gatling-simulation <<< [INFO] [INFO] [INFO] --- gatling:4.9.6:test (default-cli) @ pyrock-gatling-simulation --- [INFO] Running simulation com.forgerock.pyrock.Loadtest. Gatling 3.13.5 is available! (you're using 3.12.0) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Set idVarName to id Simulation com.forgerock.pyrock.Loadtest started... ================================================================================ 2025-03-28 08:45:14 GMT 5s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=650 KO=0 ) > restLoginInitiate (OK=1 KO=0 ) > restLoginUsernamePasswordCallback (OK=1 KO=0 ) > Skip 2FA (OK=1 KO=0 ) > User Authorize PKCE stage (OK=1 KO=0 ) > User AccessToken PKCE stage (OK=1 KO=0 ) > UpdateManagedUser (OK=645 KO=0 ) ---- getToken ------------------------------------------------------------------ [--------------------------------------------------------------------------] 0% waiting: 0 / active: 1 / done: 0 ---- idm.ManagedUsersUpdate ---------------------------------------------------- [- ] 0% waiting: 5784870 / active: 20 / done: 645 ================================================================================ ================================================================================ 2025-03-28 08:45:19 GMT 10s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=2627 KO=0 ) > restLoginInitiate (OK=1 KO=0 ) > restLoginUsernamePasswordCallback (OK=1 KO=0 ) > Skip 2FA (OK=1 KO=0 ) > User Authorize PKCE stage (OK=1 KO=0 ) > User AccessToken PKCE stage (OK=1 KO=0 ) > UpdateManagedUser (OK=2622 KO=0 ) ---- getToken ------------------------------------------------------------------ [--------------------------------------------------------------------------] 0% waiting: 0 / active: 1 / done: 0 ---- idm.ManagedUsersUpdate ---------------------------------------------------- [- ] 0% waiting: 5782871 / active: 42 / done: 2622 ================================================================================ ================================================================================ 2025-03-28 08:45:24 GMT 15s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=5938 KO=0 ) > restLoginInitiate (OK=1 KO=0 ) > restLoginUsernamePasswordCallback (OK=1 KO=0 ) > Skip 2FA (OK=1 KO=0 ) > User Authorize PKCE stage (OK=1 KO=0 ) > User AccessToken PKCE stage (OK=1 KO=0 ) > UpdateManagedUser (OK=5933 KO=0 ) ---- getToken ------------------------------------------------------------------ [--------------------------------------------------------------------------] 0% waiting: 0 / active: 1 / done: 0 ---- idm.ManagedUsersUpdate ---------------------------------------------------- [- ] 0% waiting: 5779538 / active: 64 / done: 5933 ================================================================================ ================================================================================ 2025-03-28 08:45:29 GMT 20s elapsed [...] ========================= HTTP request: PUT https://openam-perf-200m.forgeblocks.com/openidm/managed/alpha_user/01c21af5-07e4-4b95-8be3-d8b00ee3aef8 headers: if-match: * Content-Type: application/json accept: application/json user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Authorization: Bearer eyJ0eXAiOiJKV1QiLCJraWQiOiJ1QVQ1a1VCbnhzUmZLblRwNUw4bDFpNkdyRkU9IiwiYWxnIjoiUlMyNTYifQ.eyJzdWIiOiJjNDI0ZjVmZC0zNjJlLTQzOTctYTg3NC0xYzIzMWU5M2UwZGMiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYjhmYTc4NjgtNjFiZi00NDY3LWE3ZjktMWU4YTIzYzZjN2FmLTY1MjMzOCIsInN1Ym5hbWUiOiJjNDI0ZjVmZC0zNjJlLTQzOTctYTg3NC0xYzIzMWU5M2UwZGMiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLTIwMG0uZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJKVzcwYU1hdVR4eGxMdFNjR1hLdjZueWo3UE0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJpZG1BZG1pbkNsaWVudCIsImF1ZCI6ImlkbUFkbWluQ2xpZW50IiwibmJmIjoxNzQzMTU1MDA5LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsib3BlbmlkIiwiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzQzMTU1MDA5LCJyZWFsbSI6Ii8iLCJleHAiOjE3NDMxNTg2MDksImlhdCI6MTc0MzE1NTAwOSwiZXhwaXJlc19pbiI6MzYwMCwianRpIjoiaDktMUFGN2NDUDZJQ0FMYjZwRFh3NDlEVGd3In0.PJuWT6s9WDgLHUyi6Z49AYF6rrlxmzCUO-iR951CKrvYaGozvB8iYLBF-mUKx1icvkvsLlR4gCMTP46bK0GRDdkoT9dmw-cu8M12YeMrPaGYZ2hK2aaDRqv0EbAUQSGUFTdXMwU9Ma65t4M_tvFU23NJ1HZf-_9QPZamgFJHKi1PE-4HVASSJ_kGpBobqtFBQvnCJ9AASle9ohllvsamSM9utiwinpU8AoxXaw-T-z4IapDR_hky6iFFBQqg6VNEhLc4SayhfI5LEakcRKxR6Fg79I9MuhgfYdQDs2FYpvUSZ95LTdw3YWHaRrjyfZ9YMMmjcq1jqH_QUObvwAyTqw host: openam-perf-200m.forgeblocks.com content-length: 264 body:StringChunksRequestBody{charset=UTF-8, content={ "_id" : "01c21af5-07e4-4b95-8be3-d8b00ee3aef8", "givenName" : "Rheta", "sn" : "Rahal", "mail" : "user.73639940@example.com", "telephoneNumber" : "626-117-393", "description" : "Updated Managed User", "userName" : "user.73639940" }} ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 09:45:09.057 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - Request 'UpdateManagedUser' failed for user 5737394: j.i.IOException: Premature close 09:45:09.057 [DEBUG] i.g.h.e.r.DefaultStatsProcessor - >>>>>>>>>>>>>>>>>>>>>>>>>> Request: UpdateManagedUser: KO j.i.IOException: Premature close ========================= Session: Session(idm.ManagedUsersUpdate,5737394,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJraWQiOiJ1QVQ1a1VCbnhzUmZLblRwNUw4bDFpNkdyRkU9IiwiYWxnIjoiUlMyNTYifQ.eyJzdWIiOiJjNDI0ZjVmZC0zNjJlLTQzOTctYTg3NC0xYzIzMWU5M2UwZGMiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYjhmYTc4NjgtNjFiZi00NDY3LWE3ZjktMWU4YTIzYzZjN2FmLTY1MjMzOCIsInN1Ym5hbWUiOiJjNDI0ZjVmZC0zNjJlLTQzOTctYTg3NC0xYzIzMWU5M2UwZGMiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLTIwMG0uZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJKVzcwYU1hdVR4eGxMdFNjR1hLdjZueWo3UE0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJpZG1BZG1pbkNsaWVudCIsImF1ZCI6ImlkbUFkbWluQ2xpZW50IiwibmJmIjoxNzQzMTU1MDA5LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsib3BlbmlkIiwiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzQzMTU1MDA5LCJyZWFsbSI6Ii8iLCJleHAiOjE3NDMxNTg2MDksImlhdCI6MTc0MzE1NTAwOSwiZXhwaXJlc19pbiI6MzYwMCwianRpIjoiaDktMUFGN2NDUDZJQ0FMYjZwRFh3NDlEVGd3In0.PJuWT6s9WDgLHUyi6Z49AYF6rrlxmzCUO-iR951CKrvYaGozvB8iYLBF-mUKx1icvkvsLlR4gCMTP46bK0GRDdkoT9dmw-cu8M12YeMrPaGYZ2hK2aaDRqv0EbAUQSGUFTdXMwU9Ma65t4M_tvFU23NJ1HZf-_9QPZamgFJHKi1PE-4HVASSJ_kGpBobqtFBQvnCJ9AASle9ohllvsamSM9utiwinpU8AoxXaw-T-z4IapDR_hky6iFFBQqg6VNEhLc4SayhfI5LEakcRKxR6Fg79I9MuhgfYdQDs2FYpvUSZ95LTdw3YWHaRrjyfZ9YMMmjcq1jqH_QUObvwAyTqw, username -> user.132884590, tokenIdCookieName -> 15892ffd844ef80, id -> 01c21bd4-c9a2-4d2c-89b7-020fa904471d, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@38bf460b, givenname -> Brian, tokenId -> srmlDRy95OXpgYPypLNedAKJlpg.*AAJTSQACMDIAAlNLABxtbUlxT0xlaW5Yd1lBM05vVXFqZTZLSnIzYzA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, familyname -> Porecha1299, telNum -> 793-918-8399, challenge -> V18p3pIyOFo49U8RuKqjcHQIGexslYVpOxAvtp2zAPY, gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, email -> user.132884590@example.com, verifier -> NDkwMjczMzE3NTc1ODUxOTA2MQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@27bb866f),KO,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d1c2069b068@39d97fe4,io.netty.channel.epoll.EpollEventLoop@14f5da2c) ========================= HTTP request: PUT https://openam-perf-200m.forgeblocks.com/openidm/managed/alpha_user/01c21bd4-c9a2-4d2c-89b7-020fa904471d headers: if-match: * Content-Type: application/json accept: application/json user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 12_5_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/105.0.0.0 Safari/537.36 Authorization: Bearer eyJ0eXAiOiJKV1QiLCJraWQiOiJ1QVQ1a1VCbnhzUmZLblRwNUw4bDFpNkdyRkU9IiwiYWxnIjoiUlMyNTYifQ.eyJzdWIiOiJjNDI0ZjVmZC0zNjJlLTQzOTctYTg3NC0xYzIzMWU5M2UwZGMiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYjhmYTc4NjgtNjFiZi00NDY3LWE3ZjktMWU4YTIzYzZjN2FmLTY1MjMzOCIsInN1Ym5hbWUiOiJjNDI0ZjVmZC0zNjJlLTQzOTctYTg3NC0xYzIzMWU5M2UwZGMiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLTIwMG0uZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJKVzcwYU1hdVR4eGxMdFNjR1hLdjZueWo3UE0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJpZG1BZG1pbkNsaWVudCIsImF1ZCI6ImlkbUFkbWluQ2xpZW50IiwibmJmIjoxNzQzMTU1MDA5LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsib3BlbmlkIiwiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzQzMTU1MDA5LCJyZWFsbSI6Ii8iLCJleHAiOjE3NDMxNTg2MDksImlhdCI6MTc0MzE1NTAwOSwiZXhwaXJlc19pbiI6MzYwMCwianRpIjoiaDktMUFGN2NDUDZJQ0FMYjZwRFh3NDlEVGd3In0.PJuWT6s9WDgLHUyi6Z49AYF6rrlxmzCUO-iR951CKrvYaGozvB8iYLBF-mUKx1icvkvsLlR4gCMTP46bK0GRDdkoT9dmw-cu8M12YeMrPaGYZ2hK2aaDRqv0EbAUQSGUFTdXMwU9Ma65t4M_tvFU23NJ1HZf-_9QPZamgFJHKi1PE-4HVASSJ_kGpBobqtFBQvnCJ9AASle9ohllvsamSM9utiwinpU8AoxXaw-T-z4IapDR_hky6iFFBQqg6VNEhLc4SayhfI5LEakcRKxR6Fg79I9MuhgfYdQDs2FYpvUSZ95LTdw3YWHaRrjyfZ9YMMmjcq1jqH_QUObvwAyTqw host: openam-perf-200m.forgeblocks.com content-length: 273 body:StringChunksRequestBody{charset=UTF-8, content={ "_id" : "01c21bd4-c9a2-4d2c-89b7-020fa904471d", "givenName" : "Brian", "sn" : "Porecha1299", "mail" : "user.132884590@example.com", "telephoneNumber" : "793-918-8399", "description" : "Updated Managed User", "userName" : "user.132884590" }} ========================= HTTP response: <<<<<<<<<<<<<<<<<<<<<<<<< 09:45:09.059 [ERROR] i.g.c.a.AtomicRunnableActorRef - Actor controller crashed java.util.concurrent.RejectedExecutionException: Task io.gatling.core.actor.AtomicRunnableActorRef@a2a48b1 rejected from java.util.concurrent.ThreadPoolExecutor@1fa02b4[Shutting down, pool size = 8, active threads = 1, queued tasks = 0, completed tasks = 38705157] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365) at scala.concurrent.impl.ExecutionContextImpl.execute(ExecutionContextImpl.scala:21) at io.gatling.core.actor.AtomicRunnableActorRef.async(ActorSystem.scala:95) at io.gatling.core.actor.AtomicRunnableActorRef.$bang(ActorSystem.scala:70) at io.gatling.core.action.FeedActor.io$gatling$core$action$FeedActor$$$anonfun$init$1(FeedActor.scala:109) at io.gatling.core.action.FeedActor$$anonfun$init$2.apply(FeedActor.scala:92) at io.gatling.core.action.FeedActor$$anonfun$init$2.apply(FeedActor.scala:92) at io.gatling.core.actor.AtomicRunnableActorRef.$anonfun$run$1(ActorSystem.scala:115) at io.netty.util.internal.shaded.org.jctools.queues.MessagePassingQueueUtil.drain(MessagePassingQueueUtil.java:39) at io.netty.util.internal.shaded.org.jctools.queues.BaseMpscLinkedArrayQueue.drain(BaseMpscLinkedArrayQueue.java:612) at io.netty.util.internal.shaded.org.jctools.queues.MpscUnboundedArrayQueue.drain(MpscUnboundedArrayQueue.java:23) at io.gatling.core.actor.AtomicRunnableActorRef.run(ActorSystem.scala:120) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) 09:45:09.060 [ERROR] i.g.c.a.AtomicRunnableActorRef - Actor csv(user_feeder.csv) crashed when processing message 'FeedMessage(Session(idm.ManagedUsersUpdate,5737559,HashMap(access_token -> eyJ0eXAiOiJKV1QiLCJraWQiOiJ1QVQ1a1VCbnhzUmZLblRwNUw4bDFpNkdyRkU9IiwiYWxnIjoiUlMyNTYifQ.eyJzdWIiOiJjNDI0ZjVmZC0zNjJlLTQzOTctYTg3NC0xYzIzMWU5M2UwZGMiLCJjdHMiOiJPQVVUSDJfU1RBVEVMRVNTX0dSQU5UIiwiYXV0aF9sZXZlbCI6MCwiYXVkaXRUcmFja2luZ0lkIjoiYjhmYTc4NjgtNjFiZi00NDY3LWE3ZjktMWU4YTIzYzZjN2FmLTY1MjMzOCIsInN1Ym5hbWUiOiJjNDI0ZjVmZC0zNjJlLTQzOTctYTg3NC0xYzIzMWU5M2UwZGMiLCJpc3MiOiJodHRwczovL29wZW5hbS1wZXJmLTIwMG0uZm9yZ2VibG9ja3MuY29tOjQ0My9hbS9vYXV0aDIiLCJ0b2tlbk5hbWUiOiJhY2Nlc3NfdG9rZW4iLCJ0b2tlbl90eXBlIjoiQmVhcmVyIiwiYXV0aEdyYW50SWQiOiJKVzcwYU1hdVR4eGxMdFNjR1hLdjZueWo3UE0iLCJub25jZSI6IjEyMzQiLCJjbGllbnRfaWQiOiJpZG1BZG1pbkNsaWVudCIsImF1ZCI6ImlkbUFkbWluQ2xpZW50IiwibmJmIjoxNzQzMTU1MDA5LCJncmFudF90eXBlIjoiYXV0aG9yaXphdGlvbl9jb2RlIiwic2NvcGUiOlsib3BlbmlkIiwiZnI6aWRtOioiXSwiYXV0aF90aW1lIjoxNzQzMTU1MDA5LCJyZWFsbSI6Ii8iLCJleHAiOjE3NDMxNTg2MDksImlhdCI6MTc0MzE1NTAwOSwiZXhwaXJlc19pbiI6MzYwMCwianRpIjoiaDktMUFGN2NDUDZJQ0FMYjZwRFh3NDlEVGd3In0.PJuWT6s9WDgLHUyi6Z49AYF6rrlxmzCUO-iR951CKrvYaGozvB8iYLBF-mUKx1icvkvsLlR4gCMTP46bK0GRDdkoT9dmw-cu8M12YeMrPaGYZ2hK2aaDRqv0EbAUQSGUFTdXMwU9Ma65t4M_tvFU23NJ1HZf-_9QPZamgFJHKi1PE-4HVASSJ_kGpBobqtFBQvnCJ9AASle9ohllvsamSM9utiwinpU8AoxXaw-T-z4IapDR_hky6iFFBQqg6VNEhLc4SayhfI5LEakcRKxR6Fg79I9MuhgfYdQDs2FYpvUSZ95LTdw3YWHaRrjyfZ9YMMmjcq1jqH_QUObvwAyTqw, tokenIdCookieName -> 15892ffd844ef80, gatling.http.ssl.sslContexts -> io.gatling.http.util.SslContexts@74b13e05, tokenId -> srmlDRy95OXpgYPypLNedAKJlpg.*AAJTSQACMDIAAlNLABxtbUlxT0xlaW5Yd1lBM05vVXFqZTZLSnIzYzA9AAR0eXBlAANDVFMAAlMxAAIwMQ..*, telNum -> 965-801-1535, challenge -> V18p3pIyOFo49U8RuKqjcHQIGexslYVpOxAvtp2zAPY, gatling.http.cache.baseUrl -> https://openam-perf-200m.forgeblocks.com:443, verifier -> NDkwMjczMzE3NTc1ODUxOTA2MQ, gatling.http.cache.dns -> io.gatling.http.resolver.ShufflingNameResolver@2c042c68),OK,List(),io.gatling.core.protocol.ProtocolComponentsRegistry$$Lambda$822/0x00007d1c2069b068@39d97fe4,io.netty.channel.epoll.EpollEventLoop@1eb6749b),None,httpRequest-41)' java.util.concurrent.RejectedExecutionException: Task io.gatling.core.actor.AtomicRunnableActorRef@a2a48b1 rejected from java.util.concurrent.ThreadPoolExecutor@1fa02b4[Shutting down, pool size = 8, active threads = 1, queued tasks = 0, completed tasks = 38705157] at java.base/java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2065) at java.base/java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:833) at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1365) at scala.concurrent.impl.ExecutionContextImpl.execute(ExecutionContextImpl.scala:21) at io.gatling.core.actor.AtomicRunnableActorRef.async(ActorSystem.scala:95) at io.gatling.core.actor.AtomicRunnableActorRef.$bang(ActorSystem.scala:70) at io.gatling.core.action.FeedActor.io$gatling$core$action$FeedActor$$$anonfun$init$1(FeedActor.scala:109) at io.gatling.core.action.FeedActor$$anonfun$init$2.apply(FeedActor.scala:92) at io.gatling.core.action.FeedActor$$anonfun$init$2.apply(FeedActor.scala:92) at io.gatling.core.actor.AtomicRunnableActorRef.$anonfun$run$1(ActorSystem.scala:115) at io.netty.util.internal.shaded.org.jctools.queues.MessagePassingQueueUtil.drain(MessagePassingQueueUtil.java:39) at io.netty.util.internal.shaded.org.jctools.queues.BaseMpscLinkedArrayQueue.drain(BaseMpscLinkedArrayQueue.java:612) at io.netty.util.internal.shaded.org.jctools.queues.MpscUnboundedArrayQueue.drain(MpscUnboundedArrayQueue.java:23) at io.gatling.core.actor.AtomicRunnableActorRef.run(ActorSystem.scala:120) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:840) [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:00 h [INFO] Finished at: 2025-03-28T09:45:09Z [INFO] ------------------------------------------------------------------------ 2025-03-28 09:45:09,148 INFO Gatling simulation run ended successfully 2025-03-28 09:45:09,148 DEBUG No archive name provided. No archive will be created ________________________________________________________________________________ [2025-03-28 09:45:34] update-1600 show_stderr : Display stderr order ________________________________________________________________________________ 2025-03-28 09:45:34,005 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_simple_managed_users/07_Scenario_scenario/04_update-1600/stderr.txt is small (0 lines), printing all lines: 2025-03-28 09:45:34,005 INFO ----- output ----- ________________________________________________________________________________ [2025-03-28 09:45:34] update-1600 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-03-28 09:45:34] update-1600 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-03-28 09:45:34] update-1600 post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped