--Task-- name: cleanup enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: idm target_namespace: >default< start: 0.0 stop: None timeout: 1h (3600 seconds) loop: False interval: None dependencies: ['dump-uid'] wait_for: ['Pre-check Num Users'] preceding_task: None options: {'check-before-preload': True, 'testCase': 'idm.ManagedUsersDelete', 'concurrency': 35, 'java-opts': '-Dcsvfile=/results/idm/user_feeder.csv -Drealm=alpha'} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-10-16 19:08:00] cleanup pre : N/A ________________________________________________________________________________ Pod log file : /results/orders/cleanup/stdout.txt Pod log : /results/orders/cleanup 2024-10-16 19:08:00,932 INFO 2024-10-16 19:08:00,932 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:08:00,932 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:08:01,222 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:08:01,222 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:01,222 DEBUG --- stdout --- 2024-10-16 19:08:01,222 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:08:01,222 DEBUG --- stderr --- 2024-10-16 19:08:01,222 DEBUG 2024-10-16 19:08:01 - INFO: Get overseer pod resources requests memory 2024-10-16 19:08:01,222 INFO 2024-10-16 19:08:01,222 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-68b86489-ztj5j --output jsonpath={.spec.containers[].resources.requests.memory} 2024-10-16 19:08:01,222 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-10-16 19:08:01,490 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:01,490 DEBUG --- stdout --- 2024-10-16 19:08:01,490 DEBUG 4Gi 2024-10-16 19:08:01,490 DEBUG --- stderr --- 2024-10-16 19:08:01,490 DEBUG ________________________________________________________________________________ [2024-10-16 19:08:01] cleanup print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2024-10-16 19:08:01,490 INFO 2024-10-16 19:08:01,490 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:08:01,490 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:08:01,761 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:08:01,761 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:01,762 DEBUG --- stdout --- 2024-10-16 19:08:01,762 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:08:01,762 DEBUG --- stderr --- 2024-10-16 19:08:01,762 DEBUG /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling/ --run-description "idm.ManagedUsersDelete@perf-benchmark" --results-folder /results/gatling/cleanup --extra-run-jvm-options "-Xmx4G" --no-reports ________________________________________________________________________________ [2024-10-16 19:08:01] cleanup create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2024-10-16 19:08:01,762 INFO 2024-10-16 19:08:01,762 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:08:01,762 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:08:02,032 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:08:02,032 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:02,032 DEBUG --- stdout --- 2024-10-16 19:08:02,032 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:08:02,032 DEBUG --- stderr --- 2024-10-16 19:08:02,032 DEBUG Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/order.json { "name": "cleanup", "command": " /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling/ --run-description \"idm.ManagedUsersDelete@perf-benchmark\" --results-folder /results/gatling/cleanup --extra-run-jvm-options \"-Xmx4G\" --no-reports", "out-dir": "/results/orders/cleanup", "environment": { "JAVA_OPTS": "-Dam_host=openam-perf-benchmark.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@pingidentity.com -Dcheck_before_preload=True -Dconcurrency=35 -Dcsvfile=/results/idm/user_feeder.csv -Didc=true -Didm_host=openam-perf-benchmark.forgeblocks.com -Dlogin_cookie=9b75a55744995d0 -Dnum_users=1000000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drealm=alpha -DtestCase=idm.ManagedUsersDelete -Duser_password=T35!tr0c-k123" } } ________________________________________________________________________________ [2024-10-16 19:08:02] cleanup loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-10-16 19:08:02,034 INFO 2024-10-16 19:08:02,034 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-10-16 19:08:02,034 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-10-16 19:08:02,298 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-10-16 19:08:02,298 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:02,298 DEBUG --- stdout --- 2024-10-16 19:08:02,298 DEBUG WAITING 2024-10-16 19:08:02,298 DEBUG --- stderr --- 2024-10-16 19:08:02,298 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 27 0 --:--:-- --:--:-- --:--:-- 27 ________________________________________________________________________________ [2024-10-16 19:08:02] cleanup start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-10-16 19:08:02,299 INFO 2024-10-16 19:08:02,299 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:08:02,299 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:08:02,569 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:08:02,569 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:02,569 DEBUG --- stdout --- 2024-10-16 19:08:02,569 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:08:02,569 DEBUG --- stderr --- 2024-10-16 19:08:02,569 DEBUG 2024-10-16 19:08:02,570 INFO 2024-10-16 19:08:02,570 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/order.json overseer-0-68b86489-ztj5j:/results/orders/order.json 2024-10-16 19:08:02,570 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-10-16 19:08:03,897 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:03,897 DEBUG --- stdout --- 2024-10-16 19:08:03,897 DEBUG 2024-10-16 19:08:03,897 DEBUG --- stderr --- 2024-10-16 19:08:03,897 DEBUG Order has been successfully forwarded to overseer 2024-10-16 19:08:03 - INFO: Check if Gatling simulation started successfully 2024-10-16 19:08:03,897 INFO 2024-10-16 19:08:03,897 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:08:03,897 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:08:04,169 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:08:04,169 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:04,169 DEBUG --- stdout --- 2024-10-16 19:08:04,169 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:08:04,169 DEBUG --- stderr --- 2024-10-16 19:08:04,169 DEBUG 2024-10-16 19:08:04,170 INFO 2024-10-16 19:08:04,170 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j -- head -n 25 /results/orders/cleanup/stdout.txt | grep "started..." 2024-10-16 19:08:04,170 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-10-16 19:08:04,959 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: started... - retry 2024-10-16 19:08:10,676 INFO [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: started... - retry 2024-10-16 19:08:16,386 INFO [loop_until]: Function succeeded after 12s (rc=0) - expected pattern found 2024-10-16 19:08:16,386 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:08:16,386 DEBUG --- stdout --- 2024-10-16 19:08:16,386 DEBUG GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling 20:08:05.900 [WARN ] i.g.c.ZincCompiler$ - -target is deprecated: Use -release instead to compile against the correct platform API. 20:08:10.226 [WARN ] i.g.c.ZincCompiler$ - /lodestar/pyrock/shared/clients/gatling/benchmark/Testcase.scala:176:35: method - in trait MapOps is deprecated (since 2.13.0): Use - or remove on an immutable Map crossSessionVariables.-("poliEvalTokenId"); ^ 20:08:10.227 [WARN ] i.g.c.ZincCompiler$ - /lodestar/pyrock/shared/clients/gatling/benchmark/Testcase.scala:279:35: method - in trait MapOps is deprecated (since 2.13.0): Use - or remove on an immutable Map crossSessionVariables.-("poliEvalTokenId"); ^ 20:08:11.952 [WARN ] i.g.c.ZincCompiler$ - three warnings found Gatling 3.12.0 is available! (you're using 3.9.5) System property think_time_multiplier not set. No think time emulation will be done in the simulation. Set idVarName to user_id Simulation com.forgerock.gatling.Loadtest started... 2024-10-16 19:08:16,386 DEBUG --- stderr --- 2024-10-16 19:08:16,386 DEBUG ________________________________________________________________________________ [2024-10-16 19:08:16] cleanup wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 5s, retry Order is running since 10s, retry Order is running since 15s, retry Order is running since 20s, retry Order is running since 26s, retry Order is running since 31s, retry Order is running since 36s, retry Order is running since 41s, retry Order is running since 46s, retry Order is running since 52s, retry Order is running since 57s, retry Order is running since 1m 02s, retry Order is running since 1m 07s, retry Order is running since 1m 13s, retry Order is running since 1m 18s, retry Order is running since 1m 23s, retry Order is running since 1m 28s, retry Order is running since 1m 33s, retry Order is running since 1m 39s, retry Order is running since 1m 44s, retry Order is running since 1m 49s, retry Order is running since 1m 54s, retry Order is running since 1m 59s, retry Order is running since 2m 05s, retry Order is running since 2m 10s, retry Order is running since 2m 15s, retry Order is running since 2m 20s, retry Order is running since 2m 26s, retry Order is running since 2m 31s, retry Order is running since 2m 36s, retry Order is running since 2m 41s, retry Order is running since 2m 46s, retry Order is running since 2m 52s, retry Order is running since 2m 57s, retry Order is running since 3m 02s, retry Order is running since 3m 07s, retry Order is running since 3m 12s, retry Order is running since 3m 18s, retry Order is running since 3m 23s, retry Order is running since 3m 28s, retry Order is running since 3m 33s, retry Order is running since 3m 39s, retry Order is running since 3m 44s, retry Order is running since 3m 49s, retry Order is running since 3m 54s, retry Order is running since 3m 59s, retry Order is running since 4m 05s, retry Order is running since 4m 10s, retry Order is running since 4m 15s, retry Order is running since 4m 20s, retry Order is running since 4m 25s, retry Order is running since 4m 31s, retry Order is running since 4m 36s, retry Order is running since 4m 41s, retry Order is running since 4m 46s, retry Order is running since 4m 52s, retry Order is running since 4m 57s, retry Order is running since 5m 02s, retry Order is running since 5m 07s, retry Order is running since 5m 12s, retry Order is running since 5m 18s, retry Order is running since 5m 23s, retry Order is running since 5m 28s, retry Order is running since 5m 33s, retry Order is running since 5m 39s, retry Order is running since 5m 44s, retry Order is running since 5m 49s, retry Order is running since 5m 54s, retry Order is running since 5m 59s, retry Order is running since 6m 05s, retry Order is running since 6m 10s, retry Order is running since 6m 15s, retry Order is running since 6m 20s, retry Order is running since 6m 25s, retry Order is running since 6m 31s, retry Order is running since 6m 36s, retry Order is running since 6m 41s, retry Order is running since 6m 46s, retry Order is running since 6m 52s, retry Order is running since 6m 57s, retry Order is running since 7m 02s, retry Order is running since 7m 07s, retry Order is running since 7m 12s, retry Order is running since 7m 18s, retry Order is running since 7m 23s, retry Order is running since 7m 28s, retry Order is running since 7m 33s, retry Order is running since 7m 38s, retry Order is running since 7m 44s, retry Order is running since 7m 49s, retry Order is running since 7m 54s, retry Order is running since 7m 59s, retry Order is running since 8m 05s, retry Order is running since 8m 10s, retry Order is running since 8m 15s, retry Order is running since 8m 20s, retry Order is running since 8m 25s, retry Order is running since 8m 31s, retry Order is running since 8m 36s, retry Order is running since 8m 41s, retry Order is running since 8m 46s, retry Order is running since 8m 51s, retry Order is running since 8m 57s, retry Order is running since 9m 02s, retry Order is running since 9m 07s, retry Order is running since 9m 12s, retry Order is running since 9m 18s, retry Order is running since 9m 23s, retry Order is running since 9m 28s, retry Order is running since 9m 33s, retry Order is running since 9m 38s, retry Order is running since 9m 44s, retry Order is running since 9m 49s, retry Order is running since 9m 54s, retry Order is running since 9m 59s, retry Order is running since 10m 05s, retry Order is running since 10m 10s, retry Order is running since 10m 15s, retry Order is running since 10m 20s, retry Order is running since 10m 25s, retry Order is running since 10m 31s, retry Order is running since 10m 36s, retry Order is running since 10m 41s, retry Order is running since 10m 46s, retry Order is running since 10m 51s, retry Order is running since 10m 57s, retry Order is running since 11m 02s, retry Order is running since 11m 07s, retry Order is running since 11m 12s, retry Order is running since 11m 18s, retry Order is running since 11m 23s, retry Order is running since 11m 28s, retry Order is running since 11m 33s, retry Order is running since 11m 38s, retry Order is running since 11m 44s, retry Order is running since 11m 49s, retry Order is running since 11m 54s, retry Order is running since 11m 59s, retry Order is running since 12m 04s, retry Order is running since 12m 10s, retry Order is running since 12m 15s, retry Order is running since 12m 20s, retry Order is running since 12m 25s, retry Order is running since 12m 31s, retry Order is running since 12m 36s, retry Order is running since 12m 41s, retry Order is running since 12m 46s, retry Order is running since 12m 51s, retry Order is running since 12m 57s, retry Order is running since 13m 02s, retry Order is running since 13m 07s, retry Order is running since 13m 12s, retry Order is running since 13m 17s, retry Order is running since 13m 23s, retry Order is running since 13m 28s, retry Order is running since 13m 33s, retry Order is running since 13m 38s, retry Order is running since 13m 44s, retry Order is running since 13m 49s, retry Order is running since 13m 54s, retry Order is running since 13m 59s, retry Order is running since 14m 04s, retry Order is running since 14m 10s, retry Order is running since 14m 15s, retry Order is running since 14m 20s, retry Order is running since 14m 25s, retry Order is running since 14m 30s, retry Order is running since 14m 36s, retry Order is running since 14m 41s, retry Order is running since 14m 46s, retry Order is running since 14m 51s, retry Order is running since 14m 57s, retry Order is running since 15m 02s, retry Order is running since 15m 07s, retry Order is running since 15m 12s, retry Order is running since 15m 17s, retry Order is running since 15m 23s, retry Order is running since 15m 28s, retry Order is running since 15m 33s, retry Order is running since 15m 38s, retry Order is running since 15m 44s, retry Order is running since 15m 49s, retry Order is running since 15m 54s, retry Order is running since 15m 59s, retry Order is running since 16m 04s, retry Order is running since 16m 10s, retry Order is running since 16m 15s, retry Order is running since 16m 20s, retry Order is running since 16m 25s, retry Order is running since 16m 30s, retry Order is running since 16m 36s, retry Order is running since 16m 41s, retry Order is running since 16m 46s, retry Order is running since 16m 51s, retry Order is running since 16m 57s, retry Order is running since 17m 02s, retry Order is running since 17m 07s, retry Order is running since 17m 12s, retry Order is running since 17m 17s, retry Order is running since 17m 23s, retry Order is running since 17m 28s, retry Order is running since 17m 33s, retry Order is running since 17m 38s, retry Order is running since 17m 44s, retry Order is running since 17m 49s, retry Order is running since 17m 54s, retry Order is running since 17m 59s, retry Order is running since 18m 04s, retry Order is running since 18m 10s, retry Order is running since 18m 15s, retry Order is running since 18m 20s, retry Order is running since 18m 25s, retry Order is running since 18m 30s, retry Order is running since 18m 36s, retry Order is running since 18m 41s, retry Order is running since 18m 46s, retry Order is running since 18m 51s, retry Order is running since 18m 57s, retry Order is running since 19m 02s, retry Order is running since 19m 07s, retry Order is running since 19m 12s, retry Order is running since 19m 17s, retry Order is running since 19m 23s, retry Order is running since 19m 28s, retry Order is running since 19m 33s, retry Order is running since 19m 38s, retry Order is running since 19m 43s, retry Order is running since 19m 49s, retry Order is running since 19m 54s, retry Order is running since 19m 59s, retry Order is running since 20m 04s, retry Order is running since 20m 10s, retry Order is running since 20m 15s, retry Order is running since 20m 20s, retry Order is running since 20m 25s, retry Order is running since 20m 30s, retry Order is running since 20m 36s, retry Order is running since 20m 41s, retry Order is running since 20m 46s, retry Order is running since 20m 51s, retry Order is running since 20m 57s, retry Order is running since 21m 02s, retry Order is running since 21m 07s, retry Order is running since 21m 12s, retry Order is running since 21m 17s, retry Order is running since 21m 23s, retry Order is running since 21m 28s, retry Order is running since 21m 33s, retry Order is running since 21m 38s, retry Order is running since 21m 44s, retry Order is running since 21m 49s, retry Order is running since 21m 54s, retry Order is running since 21m 59s, retry Order is running since 22m 04s, retry Order is running since 22m 10s, retry Order is running since 22m 15s, retry Order is running since 22m 20s, retry Order is running since 22m 25s, retry Order is running since 22m 30s, retry Order is running since 22m 36s, retry Order is running since 22m 41s, retry Order is running since 22m 46s, retry Order is running since 22m 51s, retry Order is running since 22m 57s, retry Order is running since 23m 02s, retry Order is running since 23m 07s, retry Order is running since 23m 12s, retry Order is running since 23m 17s, retry Order is running since 23m 23s, retry Order is running since 23m 28s, retry Order is running since 23m 33s, retry Order is running since 23m 38s, retry Order is running since 23m 44s, retry Order is running since 23m 49s, retry Order is running since 23m 54s, retry Order is running since 23m 59s, retry Order is running since 24m 04s, retry Order is running since 24m 10s, retry Order is running since 24m 15s, retry Order is running since 24m 20s, retry Order is running since 24m 25s, retry Order is running since 24m 30s, retry Order is running since 24m 36s, retry Order is running since 24m 41s, retry Order is running since 24m 46s, retry Order is running since 24m 51s, retry Order is running since 24m 57s, retry Order is running since 25m 02s, retry Order is running since 25m 07s, retry Order is running since 25m 12s, retry Order is running since 25m 17s, retry Order is running since 25m 23s, retry Order is running since 25m 28s, retry Order is running since 25m 33s, retry Order is running since 25m 38s, retry Order is running since 25m 43s, retry Order is running since 25m 49s, retry Order is running since 25m 54s, retry Order is running since 25m 59s, retry Order is running since 26m 04s, retry Order is running since 26m 10s, retry Order is running since 26m 15s, retry Order is running since 26m 20s, retry Order is running since 26m 25s, retry Order is running since 26m 30s, retry Order is running since 26m 36s, retry Order is running since 26m 41s, retry Order is running since 26m 46s, retry Order is running since 26m 51s, retry Order is running since 26m 56s, retry Order is running since 27m 02s, retry Order is running since 27m 07s, retry Order is running since 27m 12s, retry Order is running since 27m 17s, retry Order is running since 27m 23s, retry Order is running since 27m 28s, retry Order is running since 27m 33s, retry Order is running since 27m 38s, retry Order is running since 27m 43s, retry Order is running since 27m 49s, retry Order is running since 27m 54s, retry Order is running since 27m 59s, retry Order is running since 28m 04s, retry Order is running since 28m 10s, retry Order is running since 28m 15s, retry Order is running since 28m 20s, retry Order is running since 28m 25s, retry Order is running since 28m 30s, retry Order is running since 28m 36s, retry Order is running since 28m 41s, retry Order is running since 28m 46s, retry Order is running since 28m 51s, retry Order is running since 28m 57s, retry Order is running since 29m 02s, retry Order is running since 29m 07s, retry Order is running since 29m 12s, retry Order is running since 29m 17s, retry Order is running since 29m 23s, retry Order is running since 29m 28s, retry Order is running since 29m 33s, retry Order is running since 29m 38s, retry Order is running since 29m 43s, retry Order is running since 29m 49s, retry Order is running since 29m 54s, retry Order is running since 29m 59s, retry Order is running since 30m 04s, retry Order is running since 30m 10s, retry Order is running since 30m 15s, retry Order is running since 30m 20s, retry Order is running since 30m 25s, retry Order is running since 30m 30s, retry Order is running since 30m 36s, retry Order is running since 30m 41s, retry Order is running since 30m 46s, retry Order is running since 30m 51s, retry Order is running since 30m 56s, retry Order is running since 31m 02s, retry Order is running since 31m 07s, retry Order is running since 31m 12s, retry Order is running since 31m 17s, retry Order is running since 31m 22s, retry Order is running since 31m 28s, retry Order is running since 31m 33s, retry Order is running since 31m 38s, retry Order is running since 31m 43s, retry Order is running since 31m 49s, retry Order is running since 31m 54s, retry Order is running since 31m 59s, retry Order is running since 32m 04s, retry Order is running since 32m 09s, retry Order is running since 32m 15s, retry Order is running since 32m 20s, retry Order is running since 32m 25s, retry Order is running since 32m 30s, retry Order is running since 32m 35s, retry Order is running since 32m 41s, retry Order is running since 32m 46s, retry Order is running since 32m 51s, retry Order is running since 32m 56s, retry Order is running since 33m 02s, retry Order is running since 33m 07s, retry Order is running since 33m 12s, retry Order is running since 33m 17s, retry Order is running since 33m 22s, retry Order is running since 33m 28s, retry Order is running since 33m 33s, retry Order is running since 33m 38s, retry Order is running since 33m 43s, retry Order is running since 33m 49s, retry Order is running since 33m 54s, retry Order is running since 33m 59s, retry Order is running since 34m 04s, retry Order is running since 34m 09s, retry Order is running since 34m 15s, retry Order is running since 34m 20s, retry Order is running since 34m 25s, retry Order is running since 34m 30s, retry Order is running since 34m 35s, retry Order is running since 34m 41s, retry Order is running since 34m 46s, retry Order is running since 34m 51s, retry Order is running since 34m 56s, retry Order is running since 35m 02s, retry Order is running since 35m 07s, retry Order is running since 35m 12s, retry Order is running since 35m 17s, retry Order is running since 35m 22s, retry Order is running since 35m 28s, retry Order is running since 35m 33s, retry Order is running since 35m 38s, retry Order is running since 35m 43s, retry Order is running since 35m 48s, retry Order is running since 35m 54s, retry Order is running since 35m 59s, retry Order is running since 36m 04s, retry Order is running since 36m 09s, retry Order is running since 36m 15s, retry Order is running since 36m 20s, retry Order is running since 36m 25s, retry Order is running since 36m 30s, retry Order is running since 36m 35s, retry Order is running since 36m 41s, retry Order is running since 36m 46s, retry Order is running since 36m 51s, retry Order is running since 36m 56s, retry Order is running since 37m 02s, retry Order is running since 37m 07s, retry Order is running since 37m 12s, retry Order is running since 37m 17s, retry Order is running since 37m 22s, retry Order is running since 37m 28s, retry Order is running since 37m 33s, retry Order is running since 37m 38s, retry Order is running since 37m 43s, retry Order is running since 37m 48s, retry Order is running since 37m 54s, retry Order is running since 37m 59s, retry Order is running since 38m 04s, retry Order is running since 38m 09s, retry Order is running since 38m 14s, retry Order is running since 38m 20s, retry Order is running since 38m 25s, retry Order is running since 38m 30s, retry Order is running since 38m 35s, retry Order is running since 38m 41s, retry Order is running since 38m 46s, retry Order is running since 38m 51s, retry Order is running since 38m 56s, retry Order is running since 39m 01s, retry Order is running since 39m 07s, retry Order is running since 39m 12s, retry Order is running since 39m 17s, retry Order is running since 39m 22s, retry Order is running since 39m 27s, retry Order is running since 39m 33s, retry Order is running since 39m 38s, retry Order is running since 39m 43s, retry Order is running since 39m 48s, retry Order is running since 39m 54s, retry Order is running since 39m 59s, retry Order is running since 40m 04s, retry Order is running since 40m 09s, retry Order is running since 40m 14s, retry Order is running since 40m 20s, retry Order is running since 40m 25s, retry Order is running since 40m 30s, retry Order is running since 40m 35s, retry PASS : Order stopped by itself after 40m 41s and before timeout (1h) ________________________________________________________________________________ [2024-10-16 19:48:57] cleanup stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-10-16 19:48:57,408 INFO 2024-10-16 19:48:57,408 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:48:57,408 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:48:57,705 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:48:57,705 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:48:57,706 DEBUG --- stdout --- 2024-10-16 19:48:57,706 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:48:57,706 DEBUG --- stderr --- 2024-10-16 19:48:57,706 DEBUG 2024-10-16 19:48:57,706 INFO 2024-10-16 19:48:57,706 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j -- rm -f /results/orders/order.json 2024-10-16 19:48:57,706 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-10-16 19:48:58,469 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:48:58,469 DEBUG --- stdout --- 2024-10-16 19:48:58,469 DEBUG 2024-10-16 19:48:58,469 DEBUG --- stderr --- 2024-10-16 19:48:58,469 DEBUG Order ran during 40m 54s ________________________________________________________________________________ [2024-10-16 19:48:58] cleanup download_logs : Download individual order files ________________________________________________________________________________ 2024-10-16 19:48:58 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/order.json 2024-10-16 19:48:58,470 INFO 2024-10-16 19:48:58,470 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:48:58,470 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:48:58,741 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:48:58,741 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:48:58,741 DEBUG --- stdout --- 2024-10-16 19:48:58,741 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:48:58,741 DEBUG --- stderr --- 2024-10-16 19:48:58,741 DEBUG Checking pod: overseer-0-68b86489-ztj5j for file exists, if not wait. 2024-10-16 19:48:58,741 INFO 2024-10-16 19:48:58,741 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:48:58,741 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:48:59,011 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:48:59,011 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:48:59,011 DEBUG --- stdout --- 2024-10-16 19:48:59,011 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:48:59,011 DEBUG --- stderr --- 2024-10-16 19:48:59,011 DEBUG 2024-10-16 19:48:59,012 INFO 2024-10-16 19:48:59,012 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j --stdin -- bash -c 'if [ -f "/results/orders/cleanup/rc.txt" ]; then echo "/results/orders/cleanup/rc.txt file found"; exit 0; else echo "/results/orders/cleanup/rc.txt file not found"; exit 1; fi' | grep "/results/orders/cleanup/rc.txt file found" 2024-10-16 19:48:59,012 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-10-16 19:48:59,788 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-10-16 19:48:59,788 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:48:59,788 DEBUG --- stdout --- 2024-10-16 19:48:59,788 DEBUG /results/orders/cleanup/rc.txt file found 2024-10-16 19:48:59,788 DEBUG --- stderr --- 2024-10-16 19:48:59,788 DEBUG 2024-10-16 19:48:59,789 INFO 2024-10-16 19:48:59,789 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:48:59,789 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:00,059 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:00,059 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:00,059 DEBUG --- stdout --- 2024-10-16 19:49:00,059 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:00,059 DEBUG --- stderr --- 2024-10-16 19:49:00,059 DEBUG 2024-10-16 19:49:00,059 INFO 2024-10-16 19:49:00,060 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j --stdin -- du -k /results/orders/cleanup/rc.txt 2024-10-16 19:49:00,832 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-10-16 19:49:00,832 DEBUG --- stdout --- 2024-10-16 19:49:00,832 DEBUG 4 /results/orders/cleanup/rc.txt 2024-10-16 19:49:00,832 DEBUG --- stderr --- 2024-10-16 19:49:00,832 DEBUG 2024-10-16 19:49:00,832 INFO - Download file (size 4k) 2024-10-16 19:49:00,832 INFO 2024-10-16 19:49:00,832 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:00,832 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:01,102 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:01,102 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:01,102 DEBUG --- stdout --- 2024-10-16 19:49:01,102 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:01,102 DEBUG --- stderr --- 2024-10-16 19:49:01,102 DEBUG source : /results/orders/cleanup/rc.txt @ overseer-0-68b86489-ztj5j destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/rc.txt 2024-10-16 19:49:01,102 INFO 2024-10-16 19:49:01,102 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:01,102 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:01,372 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:01,372 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:01,372 DEBUG --- stdout --- 2024-10-16 19:49:01,372 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:01,372 DEBUG --- stderr --- 2024-10-16 19:49:01,372 DEBUG 2024-10-16 19:49:01,372 INFO 2024-10-16 19:49:01,372 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-68b86489-ztj5j:/results/orders/cleanup/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/rc.txt 2024-10-16 19:49:01,372 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-10-16 19:49:02,117 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:02,117 DEBUG --- stdout --- 2024-10-16 19:49:02,117 DEBUG tar: Removing leading `/' from member names 2024-10-16 19:49:02,117 DEBUG --- stderr --- 2024-10-16 19:49:02,117 DEBUG 2024-10-16 19:49:02,117 INFO 2024-10-16 19:49:02,117 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:02,117 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:02,388 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:02,388 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:02,388 DEBUG --- stdout --- 2024-10-16 19:49:02,388 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:02,388 DEBUG --- stderr --- 2024-10-16 19:49:02,388 DEBUG Checking pod: overseer-0-68b86489-ztj5j for file exists, if not wait. 2024-10-16 19:49:02,388 INFO 2024-10-16 19:49:02,388 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:02,388 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:02,660 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:02,660 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:02,660 DEBUG --- stdout --- 2024-10-16 19:49:02,660 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:02,660 DEBUG --- stderr --- 2024-10-16 19:49:02,660 DEBUG 2024-10-16 19:49:02,661 INFO 2024-10-16 19:49:02,661 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j --stdin -- bash -c 'if [ -f "/results/orders/cleanup/stderr.txt" ]; then echo "/results/orders/cleanup/stderr.txt file found"; exit 0; else echo "/results/orders/cleanup/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/cleanup/stderr.txt file found" 2024-10-16 19:49:02,661 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-10-16 19:49:03,434 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-10-16 19:49:03,434 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:03,434 DEBUG --- stdout --- 2024-10-16 19:49:03,434 DEBUG /results/orders/cleanup/stderr.txt file found 2024-10-16 19:49:03,434 DEBUG --- stderr --- 2024-10-16 19:49:03,434 DEBUG 2024-10-16 19:49:03,434 INFO 2024-10-16 19:49:03,434 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:03,434 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:03,704 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:03,704 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:03,704 DEBUG --- stdout --- 2024-10-16 19:49:03,704 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:03,704 DEBUG --- stderr --- 2024-10-16 19:49:03,704 DEBUG 2024-10-16 19:49:03,704 INFO 2024-10-16 19:49:03,705 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j --stdin -- du -k /results/orders/cleanup/stderr.txt 2024-10-16 19:49:04,543 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-10-16 19:49:04,543 DEBUG --- stdout --- 2024-10-16 19:49:04,543 DEBUG 0 /results/orders/cleanup/stderr.txt 2024-10-16 19:49:04,543 DEBUG --- stderr --- 2024-10-16 19:49:04,543 DEBUG 2024-10-16 19:49:04,543 INFO - Download file (size 0k) 2024-10-16 19:49:04,543 INFO 2024-10-16 19:49:04,543 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:04,543 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:04,816 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:04,816 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:04,816 DEBUG --- stdout --- 2024-10-16 19:49:04,816 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:04,816 DEBUG --- stderr --- 2024-10-16 19:49:04,816 DEBUG source : /results/orders/cleanup/stderr.txt @ overseer-0-68b86489-ztj5j destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/stderr.txt 2024-10-16 19:49:04,816 INFO 2024-10-16 19:49:04,817 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:04,817 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:05,085 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:05,085 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:05,085 DEBUG --- stdout --- 2024-10-16 19:49:05,085 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:05,085 DEBUG --- stderr --- 2024-10-16 19:49:05,085 DEBUG 2024-10-16 19:49:05,085 INFO 2024-10-16 19:49:05,085 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-68b86489-ztj5j:/results/orders/cleanup/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/stderr.txt 2024-10-16 19:49:05,086 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-10-16 19:49:05,830 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:05,830 DEBUG --- stdout --- 2024-10-16 19:49:05,830 DEBUG tar: Removing leading `/' from member names 2024-10-16 19:49:05,830 DEBUG --- stderr --- 2024-10-16 19:49:05,830 DEBUG 2024-10-16 19:49:05,831 INFO 2024-10-16 19:49:05,831 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:05,831 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:06,101 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:06,101 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:06,101 DEBUG --- stdout --- 2024-10-16 19:49:06,101 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:06,101 DEBUG --- stderr --- 2024-10-16 19:49:06,101 DEBUG Checking pod: overseer-0-68b86489-ztj5j for file exists, if not wait. 2024-10-16 19:49:06,102 INFO 2024-10-16 19:49:06,102 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:06,102 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:06,372 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:06,373 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:06,373 DEBUG --- stdout --- 2024-10-16 19:49:06,373 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:06,373 DEBUG --- stderr --- 2024-10-16 19:49:06,373 DEBUG 2024-10-16 19:49:06,373 INFO 2024-10-16 19:49:06,373 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j --stdin -- bash -c 'if [ -f "/results/orders/cleanup/stdout.txt" ]; then echo "/results/orders/cleanup/stdout.txt file found"; exit 0; else echo "/results/orders/cleanup/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/cleanup/stdout.txt file found" 2024-10-16 19:49:06,373 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-10-16 19:49:07,159 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-10-16 19:49:07,159 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:07,159 DEBUG --- stdout --- 2024-10-16 19:49:07,159 DEBUG /results/orders/cleanup/stdout.txt file found 2024-10-16 19:49:07,160 DEBUG --- stderr --- 2024-10-16 19:49:07,160 DEBUG 2024-10-16 19:49:07,160 INFO 2024-10-16 19:49:07,160 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:07,160 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:07,430 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:07,430 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:07,430 DEBUG --- stdout --- 2024-10-16 19:49:07,430 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:07,430 DEBUG --- stderr --- 2024-10-16 19:49:07,430 DEBUG 2024-10-16 19:49:07,430 INFO 2024-10-16 19:49:07,431 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j --stdin -- du -k /results/orders/cleanup/stdout.txt 2024-10-16 19:49:08,209 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-10-16 19:49:08,209 DEBUG --- stdout --- 2024-10-16 19:49:08,209 DEBUG 640 /results/orders/cleanup/stdout.txt 2024-10-16 19:49:08,209 DEBUG --- stderr --- 2024-10-16 19:49:08,209 DEBUG 2024-10-16 19:49:08,209 INFO - Download file (size 640k) 2024-10-16 19:49:08,209 INFO 2024-10-16 19:49:08,209 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:08,209 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:08,479 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:08,479 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:08,479 DEBUG --- stdout --- 2024-10-16 19:49:08,480 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:08,480 DEBUG --- stderr --- 2024-10-16 19:49:08,480 DEBUG source : /results/orders/cleanup/stdout.txt @ overseer-0-68b86489-ztj5j destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/stdout.txt 2024-10-16 19:49:08,480 INFO 2024-10-16 19:49:08,480 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:08,480 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:08,748 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:08,748 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:08,748 DEBUG --- stdout --- 2024-10-16 19:49:08,748 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:08,748 DEBUG --- stderr --- 2024-10-16 19:49:08,748 DEBUG 2024-10-16 19:49:08,749 INFO 2024-10-16 19:49:08,749 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-68b86489-ztj5j:/results/orders/cleanup/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/stdout.txt 2024-10-16 19:49:08,749 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-10-16 19:49:09,783 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:09,783 DEBUG --- stdout --- 2024-10-16 19:49:09,783 DEBUG tar: Removing leading `/' from member names 2024-10-16 19:49:09,783 DEBUG --- stderr --- 2024-10-16 19:49:09,783 DEBUG ________________________________________________________________________________ [2024-10-16 19:49:09] cleanup show_cmd : Display order command ________________________________________________________________________________ 2024-10-16 19:49:09,783 INFO 2024-10-16 19:49:09,783 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:09,783 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:10,056 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:10,056 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:10,056 DEBUG --- stdout --- 2024-10-16 19:49:10,056 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:10,056 DEBUG --- stderr --- 2024-10-16 19:49:10,056 DEBUG Checking pod: overseer-0-68b86489-ztj5j for file exists, if not wait. 2024-10-16 19:49:10,056 INFO 2024-10-16 19:49:10,057 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:10,057 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:10,328 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:10,328 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:10,328 DEBUG --- stdout --- 2024-10-16 19:49:10,328 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:10,328 DEBUG --- stderr --- 2024-10-16 19:49:10,328 DEBUG 2024-10-16 19:49:10,329 INFO 2024-10-16 19:49:10,329 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j --stdin -- bash -c 'if [ -f "/results/orders/cleanup/cmd.txt" ]; then echo "/results/orders/cleanup/cmd.txt file found"; exit 0; else echo "/results/orders/cleanup/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/cleanup/cmd.txt file found" 2024-10-16 19:49:10,329 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-10-16 19:49:11,107 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-10-16 19:49:11,107 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:11,107 DEBUG --- stdout --- 2024-10-16 19:49:11,107 DEBUG /results/orders/cleanup/cmd.txt file found 2024-10-16 19:49:11,108 DEBUG --- stderr --- 2024-10-16 19:49:11,108 DEBUG 2024-10-16 19:49:11,108 INFO 2024-10-16 19:49:11,108 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:11,108 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:11,380 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:11,380 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:11,380 DEBUG --- stdout --- 2024-10-16 19:49:11,380 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:11,380 DEBUG --- stderr --- 2024-10-16 19:49:11,380 DEBUG 2024-10-16 19:49:11,380 INFO 2024-10-16 19:49:11,380 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-68b86489-ztj5j --stdin -- du -k /results/orders/cleanup/cmd.txt 2024-10-16 19:49:12,162 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-10-16 19:49:12,162 DEBUG --- stdout --- 2024-10-16 19:49:12,162 DEBUG 4 /results/orders/cleanup/cmd.txt 2024-10-16 19:49:12,162 DEBUG --- stderr --- 2024-10-16 19:49:12,162 DEBUG 2024-10-16 19:49:12,162 INFO - Download file (size 4k) 2024-10-16 19:49:12,163 INFO 2024-10-16 19:49:12,163 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:12,163 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:12,432 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:12,432 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:12,432 DEBUG --- stdout --- 2024-10-16 19:49:12,432 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:12,432 DEBUG --- stderr --- 2024-10-16 19:49:12,432 DEBUG source : /results/orders/cleanup/cmd.txt @ overseer-0-68b86489-ztj5j destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/cmd.txt 2024-10-16 19:49:12,433 INFO 2024-10-16 19:49:12,433 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-10-16 19:49:12,433 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-10-16 19:49:12,702 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-10-16 19:49:12,702 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:12,702 DEBUG --- stdout --- 2024-10-16 19:49:12,702 DEBUG overseer-0-68b86489-ztj5j 2024-10-16 19:49:12,702 DEBUG --- stderr --- 2024-10-16 19:49:12,702 DEBUG 2024-10-16 19:49:12,703 INFO 2024-10-16 19:49:12,703 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-68b86489-ztj5j:/results/orders/cleanup/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/cmd.txt 2024-10-16 19:49:12,703 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-10-16 19:49:13,443 INFO [loop_until]: OK (rc = 0) 2024-10-16 19:49:13,443 DEBUG --- stdout --- 2024-10-16 19:49:13,443 DEBUG tar: Removing leading `/' from member names 2024-10-16 19:49:13,443 DEBUG --- stderr --- 2024-10-16 19:49:13,443 DEBUG 2024-10-16 19:49:13,443 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/cmd.txt is small (1 lines), printing all lines: 2024-10-16 19:49:13,443 DEBUG ----- output ----- 2024-10-16 19:49:13,443 DEBUG /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation com.forgerock.gatling.Loadtest --simulations-folder /lodestar/pyrock/shared/clients/gatling/ --run-description "idm.ManagedUsersDelete@perf-benchmark" --results-folder /results/gatling/cleanup --extra-run-jvm-options "-Xmx4G" --no-reports 2024-10-16 19:49:13,443 INFO ________________________________________________________________________________ [2024-10-16 19:49:13] cleanup show_rc : Display rc order ________________________________________________________________________________ 2024-10-16 19:49:13,444 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/rc.txt is small (1 lines), printing all lines: 2024-10-16 19:49:13,444 DEBUG ----- output ----- 2024-10-16 19:49:13,444 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-10-16 19:49:13,444 INFO ________________________________________________________________________________ [2024-10-16 19:49:13] cleanup show_stdout : Display stdout order ________________________________________________________________________________ 2024-10-16 19:49:13,445 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/stdout.txt is 9812 lines): 2024-10-16 19:49:13,445 DEBUG ----- output ----- 2024-10-16 19:49:13,445 INFO GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling 2024-10-16 19:49:13,445 INFO 20:08:05.900 [WARN ] i.g.c.ZincCompiler$ - -target is deprecated: Use -release instead to compile against the correct platform API. 2024-10-16 19:49:13,445 INFO 20:08:10.226 [WARN ] i.g.c.ZincCompiler$ - /lodestar/pyrock/shared/clients/gatling/benchmark/Testcase.scala:176:35: method - in trait MapOps is deprecated (since 2.13.0): Use - or remove on an immutable Map 2024-10-16 19:49:13,445 INFO crossSessionVariables.-("poliEvalTokenId"); 2024-10-16 19:49:13,445 INFO ^ 2024-10-16 19:49:13,445 INFO 20:08:10.227 [WARN ] i.g.c.ZincCompiler$ - /lodestar/pyrock/shared/clients/gatling/benchmark/Testcase.scala:279:35: method - in trait MapOps is deprecated (since 2.13.0): Use - or remove on an immutable Map 2024-10-16 19:49:13,445 INFO crossSessionVariables.-("poliEvalTokenId"); 2024-10-16 19:49:13,445 INFO ^ 2024-10-16 19:49:13,445 INFO 20:08:11.952 [WARN ] i.g.c.ZincCompiler$ - three warnings found 2024-10-16 19:49:13,445 INFO Gatling 3.12.0 is available! (you're using 3.9.5) 2024-10-16 19:49:13,445 INFO System property think_time_multiplier not set. No think time emulation will be done in the simulation. 2024-10-16 19:49:13,445 INFO Set idVarName to user_id 2024-10-16 19:49:13,446 INFO Simulation com.forgerock.gatling.Loadtest started... 2024-10-16 19:49:13,446 INFO 2024-10-16 19:49:13,446 INFO ================================================================================ 2024-10-16 19:49:13,446 INFO 2024-10-16 20:08:20 5s elapsed 2024-10-16 19:49:13,446 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,446 INFO > Global (OK=411 KO=0 ) 2024-10-16 19:49:13,446 INFO > restLoginInitiate (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > Skip 2FA (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > User Authorize PKCE stage (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > User AccessToken PKCE stage (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > DeleteManagedUser (OK=406 KO=0 ) 2024-10-16 19:49:13,446 INFO 2024-10-16 19:49:13,446 INFO ---- getToken ------------------------------------------------------------------ 2024-10-16 19:49:13,446 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,446 INFO waiting: 0 / active: 1 / done: 0 2024-10-16 19:49:13,446 INFO ---- idm.ManagedUsersDelete ---------------------------------------------------- 2024-10-16 19:49:13,446 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,446 INFO waiting: 0 / active: 35 / done: 0 2024-10-16 19:49:13,446 INFO ================================================================================ 2024-10-16 19:49:13,446 INFO 2024-10-16 19:49:13,446 INFO 2024-10-16 19:49:13,446 INFO ================================================================================ 2024-10-16 19:49:13,446 INFO 2024-10-16 20:08:25 10s elapsed 2024-10-16 19:49:13,446 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,446 INFO > Global (OK=1146 KO=0 ) 2024-10-16 19:49:13,446 INFO > restLoginInitiate (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > Skip 2FA (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > User Authorize PKCE stage (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > User AccessToken PKCE stage (OK=1 KO=0 ) 2024-10-16 19:49:13,446 INFO > DeleteManagedUser (OK=1141 KO=0 ) 2024-10-16 19:49:13,446 INFO 2024-10-16 19:49:13,446 INFO ---- getToken ------------------------------------------------------------------ 2024-10-16 19:49:13,446 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,446 INFO waiting: 0 / active: 1 / done: 0 2024-10-16 19:49:13,446 INFO ---- idm.ManagedUsersDelete ---------------------------------------------------- 2024-10-16 19:49:13,446 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,446 INFO waiting: 0 / active: 35 / done: 0 2024-10-16 19:49:13,446 INFO ================================================================================ 2024-10-16 19:49:13,446 INFO 2024-10-16 19:49:13,446 INFO 2024-10-16 19:49:13,446 INFO ================================================================================ 2024-10-16 19:49:13,446 INFO 2024-10-16 20:08:30 15s elapsed 2024-10-16 19:49:13,446 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,446 INFO > Global (OK=2035 KO=0 ) 2024-10-16 19:49:13,446 INFO > restLoginInitiate (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > Skip 2FA (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > User Authorize PKCE stage (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > User AccessToken PKCE stage (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > DeleteManagedUser (OK=2030 KO=0 ) 2024-10-16 19:49:13,447 INFO 2024-10-16 19:49:13,447 INFO ---- getToken ------------------------------------------------------------------ 2024-10-16 19:49:13,447 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,447 INFO waiting: 0 / active: 1 / done: 0 2024-10-16 19:49:13,447 INFO ---- idm.ManagedUsersDelete ---------------------------------------------------- 2024-10-16 19:49:13,447 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,447 INFO waiting: 0 / active: 35 / done: 0 2024-10-16 19:49:13,447 INFO ================================================================================ 2024-10-16 19:49:13,447 INFO 2024-10-16 19:49:13,447 INFO 2024-10-16 19:49:13,447 INFO ================================================================================ 2024-10-16 19:49:13,447 INFO 2024-10-16 20:08:35 20s elapsed 2024-10-16 19:49:13,447 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,447 INFO > Global (OK=2985 KO=0 ) 2024-10-16 19:49:13,447 INFO > restLoginInitiate (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > Skip 2FA (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > User Authorize PKCE stage (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > User AccessToken PKCE stage (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > DeleteManagedUser (OK=2980 KO=0 ) 2024-10-16 19:49:13,447 INFO 2024-10-16 19:49:13,447 INFO ---- getToken ------------------------------------------------------------------ 2024-10-16 19:49:13,447 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,447 INFO waiting: 0 / active: 1 / done: 0 2024-10-16 19:49:13,447 INFO ---- idm.ManagedUsersDelete ---------------------------------------------------- 2024-10-16 19:49:13,447 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,447 INFO waiting: 0 / active: 35 / done: 0 2024-10-16 19:49:13,447 INFO ================================================================================ 2024-10-16 19:49:13,447 INFO 2024-10-16 19:49:13,447 INFO 2024-10-16 19:49:13,447 INFO ================================================================================ 2024-10-16 19:49:13,447 INFO 2024-10-16 20:08:40 25s elapsed 2024-10-16 19:49:13,447 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,447 INFO > Global (OK=4015 KO=0 ) 2024-10-16 19:49:13,447 INFO > restLoginInitiate (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO > restLoginUsernamePasswordCallback (OK=1 KO=0 ) 2024-10-16 19:49:13,447 INFO [...] 2024-10-16 19:49:13,449 INFO 2024-10-16 19:49:13,449 INFO 2024-10-16 19:49:13,450 INFO ================================================================================ 2024-10-16 19:49:13,450 INFO 2024-10-16 20:48:45 2430s elapsed 2024-10-16 19:49:13,450 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,450 INFO > Global (OK=1009481 KO=0 ) 2024-10-16 19:49:13,450 INFO > restLoginInitiate (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > restLoginUsernamePasswordCallback (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > Skip 2FA (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > User Authorize PKCE stage (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > User AccessToken PKCE stage (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > DeleteManagedUser (OK=1009276 KO=0 ) 2024-10-16 19:49:13,450 INFO 2024-10-16 19:49:13,450 INFO ---- getToken ------------------------------------------------------------------ 2024-10-16 19:49:13,450 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,450 INFO waiting: 0 / active: 1 / done: 0 2024-10-16 19:49:13,450 INFO ---- idm.ManagedUsersDelete ---------------------------------------------------- 2024-10-16 19:49:13,450 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,450 INFO waiting: 0 / active: 35 / done: 0 2024-10-16 19:49:13,450 INFO ================================================================================ 2024-10-16 19:49:13,450 INFO 2024-10-16 19:49:13,450 INFO 2024-10-16 19:49:13,450 INFO ================================================================================ 2024-10-16 19:49:13,450 INFO 2024-10-16 20:48:50 2435s elapsed 2024-10-16 19:49:13,450 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,450 INFO > Global (OK=1010183 KO=0 ) 2024-10-16 19:49:13,450 INFO > restLoginInitiate (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > restLoginUsernamePasswordCallback (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > Skip 2FA (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > User Authorize PKCE stage (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > User AccessToken PKCE stage (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > DeleteManagedUser (OK=1009978 KO=0 ) 2024-10-16 19:49:13,450 INFO 2024-10-16 19:49:13,450 INFO ---- getToken ------------------------------------------------------------------ 2024-10-16 19:49:13,450 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,450 INFO waiting: 0 / active: 1 / done: 0 2024-10-16 19:49:13,450 INFO ---- idm.ManagedUsersDelete ---------------------------------------------------- 2024-10-16 19:49:13,450 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,450 INFO waiting: 0 / active: 35 / done: 0 2024-10-16 19:49:13,450 INFO ================================================================================ 2024-10-16 19:49:13,450 INFO 2024-10-16 19:49:13,450 INFO 2024-10-16 19:49:13,450 INFO ================================================================================ 2024-10-16 19:49:13,450 INFO 2024-10-16 20:48:55 2440s elapsed 2024-10-16 19:49:13,450 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,450 INFO > Global (OK=1011188 KO=0 ) 2024-10-16 19:49:13,450 INFO > restLoginInitiate (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > restLoginUsernamePasswordCallback (OK=41 KO=0 ) 2024-10-16 19:49:13,450 INFO > Skip 2FA (OK=41 KO=0 ) 2024-10-16 19:49:13,451 INFO > User Authorize PKCE stage (OK=41 KO=0 ) 2024-10-16 19:49:13,451 INFO > User AccessToken PKCE stage (OK=41 KO=0 ) 2024-10-16 19:49:13,451 INFO > DeleteManagedUser (OK=1010983 KO=0 ) 2024-10-16 19:49:13,451 INFO 2024-10-16 19:49:13,451 INFO ---- getToken ------------------------------------------------------------------ 2024-10-16 19:49:13,451 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,451 INFO waiting: 0 / active: 1 / done: 0 2024-10-16 19:49:13,451 INFO ---- idm.ManagedUsersDelete ---------------------------------------------------- 2024-10-16 19:49:13,451 INFO [--------------------------------------------------------------------------] 0% 2024-10-16 19:49:13,451 INFO waiting: 0 / active: 35 / done: 0 2024-10-16 19:49:13,451 INFO ================================================================================ 2024-10-16 19:49:13,451 INFO 2024-10-16 19:49:13,451 INFO 2024-10-16 19:49:13,451 INFO ================================================================================ 2024-10-16 19:49:13,451 INFO 2024-10-16 20:48:56 2441s elapsed 2024-10-16 19:49:13,451 INFO ---- Requests ------------------------------------------------------------------ 2024-10-16 19:49:13,451 INFO > Global (OK=1011723 KO=0 ) 2024-10-16 19:49:13,451 INFO > restLoginInitiate (OK=41 KO=0 ) 2024-10-16 19:49:13,451 INFO > restLoginUsernamePasswordCallback (OK=41 KO=0 ) 2024-10-16 19:49:13,451 INFO > Skip 2FA (OK=41 KO=0 ) 2024-10-16 19:49:13,451 INFO > User Authorize PKCE stage (OK=41 KO=0 ) 2024-10-16 19:49:13,451 INFO > User AccessToken PKCE stage (OK=41 KO=0 ) 2024-10-16 19:49:13,451 INFO > DeleteManagedUser (OK=1011518 KO=0 ) 2024-10-16 19:49:13,451 INFO 2024-10-16 19:49:13,451 INFO ---- getToken ------------------------------------------------------------------ 2024-10-16 19:49:13,451 INFO [##########################################################################]100% 2024-10-16 19:49:13,451 INFO waiting: 0 / active: 0 / done: 1 2024-10-16 19:49:13,451 INFO ---- idm.ManagedUsersDelete ---------------------------------------------------- 2024-10-16 19:49:13,451 INFO [##########################################################################]100% 2024-10-16 19:49:13,451 INFO waiting: 0 / active: 0 / done: 35 2024-10-16 19:49:13,451 INFO ================================================================================ 2024-10-16 19:49:13,451 INFO 2024-10-16 19:49:13,451 INFO Simulation com.forgerock.gatling.Loadtest completed in 2441 seconds 2024-10-16 19:49:13,451 INFO 2024-10-16 19:49:13,451 INFO ---------------------- 2024-10-16 19:49:13,451 INFO [16/Oct/2024 20:48:56] Create tar file cleanup.tar.gz 2024-10-16 19:49:13,451 INFO ---------------------- 2024-10-16 19:49:13,451 INFO RESULTS_FOLDER=/results/gatling/ 2024-10-16 19:49:13,451 INFO RESULT_FOLDER=cleanup 2024-10-16 19:49:13,451 INFO SIMULATION_PATH=cleanup/loadtest-20241016190814266 2024-10-16 19:49:13,451 INFO PWD=/results/gatling/cleanup/loadtest-20241016190814266 2024-10-16 19:49:13,451 INFO [cmd] tar -czvf /results/gatling//cleanup.tar.gz --exclude=simulation.log * 2024-10-16 19:49:13,451 INFO /results/gatling 2024-10-16 19:49:13,451 INFO 2024-10-16 19:49:13,451 INFO ---------------------- 2024-10-16 19:49:13,451 INFO [16/Oct/2024 20:48:56] Update /results/gatling//latest 2024-10-16 19:49:13,451 INFO ---------------------- 2024-10-16 19:49:13,451 INFO 2024-10-16 19:49:13,452 INFO ---------------------- 2024-10-16 19:49:13,452 INFO [16/Oct/2024 20:48:56] Update /results/gatling//latest.tar.gz 2024-10-16 19:49:13,452 INFO ---------------------- 2024-10-16 19:49:13,452 INFO ________________________________________________________________________________ [2024-10-16 19:49:13] cleanup show_stderr : Display stderr order ________________________________________________________________________________ 2024-10-16 19:49:13,452 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_benchmark_ch2023/05_Data_Init/02_cleanup/stderr.txt is small (0 lines), printing all lines: 2024-10-16 19:49:13,452 DEBUG ----- output ----- 2024-10-16 19:49:13,452 DEBUG 2024-10-16 19:49:13,452 INFO ________________________________________________________________________________ [2024-10-16 19:49:13] cleanup check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-10-16 19:49:13] cleanup print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-10-16 19:49:13] cleanup post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped