--Task-- name: cleanup enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: idm target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: ['dump-uid'] wait_for: ['Pre-check Num Users'] preceding_task: None options: {'check-before-preload': True, 'simulation': 'idm.simple_managed_users.ManagedUsersDelete', 'concurrency': 20, 'java-opts': '-Dcsvfile=/results/idm/user_feeder.csv -Drealm=alpha -Dduration=3600'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-03-06 20:14:29] cleanup pre : N/A ________________________________________________________________________________ [2024-03-06 20:14:29] - INFO: Timeout for this Task has changed to 1h 12m (4320 seconds) [2024-03-06 20:14:29] - INFO: timeout was calculated based on simulation duration parameter Pod log file : /results/orders/cleanup/stdout.txt Pod log : /results/orders/cleanup [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [2024-03-06 20:14:29] - INFO: Get overseer pod resources requests memory [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-7894b8d7df-xbkzc --output jsonpath={.spec.containers[].resources.requests.memory} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 4Gi --- stderr --- ________________________________________________________________________________ [2024-03-06 20:14:30] cleanup print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation idm.simple_managed_users.ManagedUsersDelete --simulations-folder /lodestar/pyrock/shared/clients/gatling/ --run-description "idm.simple_managed_users.ManagedUsersDelete@ema-wajih-iga" --results-folder /results/gatling/cleanup --extra-run-jvm-options "-Xmx4G" --no-reports ________________________________________________________________________________ [2024-03-06 20:14:30] cleanup create_order : Create order for overseer with the command to run ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/order.json { "name": "cleanup", "command": " /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation idm.simple_managed_users.ManagedUsersDelete --simulations-folder /lodestar/pyrock/shared/clients/gatling/ --run-description \"idm.simple_managed_users.ManagedUsersDelete@ema-wajih-iga\" --results-folder /results/gatling/cleanup --extra-run-jvm-options \"-Xmx4G\" --no-reports", "out-dir": "/results/orders/cleanup", "environment": { "JAVA_OPTS": "-Dam_host=openam-ema-wajih-iga.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=**** -DamadminUsername=xiaosong.lou@forgerock.com -Dcheck_before_preload=True -Dconcurrency=20 -Dcsvfile=/results/idm/user_feeder.csv -Dduration=3600 -Didc=true -Didm_host=openam-ema-wajih-iga.forgeblocks.com -Dlogin_cookie=68e10e4cfff3cbb -Dnum_users=450000 -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drealm=alpha -Duser_password=T35!tr0c-k123" } } ________________________________________________________________________________ [2024-03-06 20:14:30] cleanup loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=300, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 27 0 --:--:-- --:--:-- --:--:-- 27 ________________________________________________________________________________ [2024-03-06 20:14:31] cleanup start_order : Send the order to the overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/order.json overseer-0-7894b8d7df-xbkzc:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer [2024-03-06 20:14:32] - INFO: Check if Gatling simulation started successfully [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc -- head /results/orders/cleanup/stdout.txt | grep "started..." [loop_until]: (max_time=300, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 18s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling 20:14:35.827 [WARN ] i.g.c.ZincCompiler$ - -target is deprecated: Use -release instead to compile against the correct platform API. 20:14:45.514 [WARN ] i.g.c.ZincCompiler$ - one warning found Gatling 3.10.4 is available! (you're using 3.9.5) think time multiplier is 0x Simulation idm.simple_managed_users.ManagedUsersDelete started... --- stderr --- ________________________________________________________________________________ [2024-03-06 20:14:51] cleanup wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h 12m Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 2m, retry Order is running since 4m, retry Order is running since 6m 01s, retry Order is running since 8m 01s, retry PASS : Order stopped by itself after 10m 01s and before timeout (1h 12m) ________________________________________________________________________________ [2024-03-06 20:24:52] cleanup stop_order : Stop the order on overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc -- rm -f /results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order ran during 10m 21s ________________________________________________________________________________ [2024-03-06 20:24:53] cleanup download_logs : Download individual order files ________________________________________________________________________________ [2024-03-06 20:24:53] - PASS: file already downloaded /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/order.json [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- Checking pod: overseer-0-7894b8d7df-xbkzc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc --stdin -- bash -c 'if [ -f "/results/orders/cleanup/rc.txt" ]; then echo "/results/orders/cleanup/rc.txt file found"; exit 0; else echo "/results/orders/cleanup/rc.txt file not found"; exit 1; fi' | grep "/results/orders/cleanup/rc.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/cleanup/rc.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc --stdin -- du -k /results/orders/cleanup/rc.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/cleanup/rc.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- source : /results/orders/cleanup/rc.txt @ overseer-0-7894b8d7df-xbkzc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/rc.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7894b8d7df-xbkzc:/results/orders/cleanup/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/rc.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- Checking pod: overseer-0-7894b8d7df-xbkzc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc --stdin -- bash -c 'if [ -f "/results/orders/cleanup/stderr.txt" ]; then echo "/results/orders/cleanup/stderr.txt file found"; exit 0; else echo "/results/orders/cleanup/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/cleanup/stderr.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/cleanup/stderr.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc --stdin -- du -k /results/orders/cleanup/stderr.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 0 /results/orders/cleanup/stderr.txt --- stderr --- - Download file (size 0k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- source : /results/orders/cleanup/stderr.txt @ overseer-0-7894b8d7df-xbkzc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/stderr.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7894b8d7df-xbkzc:/results/orders/cleanup/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/stderr.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- Checking pod: overseer-0-7894b8d7df-xbkzc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc --stdin -- bash -c 'if [ -f "/results/orders/cleanup/stdout.txt" ]; then echo "/results/orders/cleanup/stdout.txt file found"; exit 0; else echo "/results/orders/cleanup/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/cleanup/stdout.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/cleanup/stdout.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc --stdin -- du -k /results/orders/cleanup/stdout.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 116 /results/orders/cleanup/stdout.txt --- stderr --- - Download file (size 116k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- source : /results/orders/cleanup/stdout.txt @ overseer-0-7894b8d7df-xbkzc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/stdout.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7894b8d7df-xbkzc:/results/orders/cleanup/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/stdout.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- ________________________________________________________________________________ [2024-03-06 20:25:06] cleanup show_cmd : Display order command ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- Checking pod: overseer-0-7894b8d7df-xbkzc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc --stdin -- bash -c 'if [ -f "/results/orders/cleanup/cmd.txt" ]; then echo "/results/orders/cleanup/cmd.txt file found"; exit 0; else echo "/results/orders/cleanup/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/cleanup/cmd.txt file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/cleanup/cmd.txt file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-7894b8d7df-xbkzc --stdin -- du -k /results/orders/cleanup/cmd.txt [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/cleanup/cmd.txt --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- source : /results/orders/cleanup/cmd.txt @ overseer-0-7894b8d7df-xbkzc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/cmd.txt [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7894b8d7df-xbkzc --- stderr --- [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-7894b8d7df-xbkzc:/results/orders/cleanup/cmd.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/cmd.txt [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/cmd.txt is small (1 lines), printing all lines: ----- output ----- /lodestar/clients/gatling-for-pyrock.sh --run-mode local --simulation idm.simple_managed_users.ManagedUsersDelete --simulations-folder /lodestar/pyrock/shared/clients/gatling/ --run-description "idm.simple_managed_users.ManagedUsersDelete@ema-wajih-iga" --results-folder /results/gatling/cleanup --extra-run-jvm-options "-Xmx4G" --no-reports ________________________________________________________________________________ [2024-03-06 20:25:10] cleanup show_rc : Display rc order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2024-03-06 20:25:10] cleanup show_stdout : Display stdout order ________________________________________________________________________________ [print_head_tail]: Print head (100 lines) and tail (100 lines) of input file (/mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/stdout.txt is 1776 lines): ----- output ----- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling 20:14:35.827 [WARN ] i.g.c.ZincCompiler$ - -target is deprecated: Use -release instead to compile against the correct platform API. 20:14:45.514 [WARN ] i.g.c.ZincCompiler$ - one warning found Gatling 3.10.4 is available! (you're using 3.9.5) think time multiplier is 0x Simulation idm.simple_managed_users.ManagedUsersDelete started... ================================================================================ 2024-03-06 20:14:53 5s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=1316 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=1216 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:14:58 10s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=2733 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=2633 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:15:03 15s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=4159 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=4059 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:15:08 20s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=5640 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=5540 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:15:13 25s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=7144 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=7044 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:15:18 30s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=8671 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) [...] > Global (OK=145724 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=145624 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:23:08 500s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=147249 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=147149 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:23:13 505s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=148821 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=148721 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:23:18 510s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=150395 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=150295 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [--------------------------------------------------------------------------] 0% waiting: 0 / active: 20 / done: 0 ================================================================================ ================================================================================ 2024-03-06 20:23:18 510s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=150413 KO=0 ) > restLoginInitiate (OK=20 KO=0 ) > restLoginUsernamePasswordCallback (OK=20 KO=0 ) > Skip 2FA (OK=20 KO=0 ) > User Authorize PKCE stage (OK=20 KO=0 ) > User AccessToken PKCE stage (OK=20 KO=0 ) > Delete Managed User (OK=150313 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [##########################################################################]100% waiting: 0 / active: 0 / done: 20 ================================================================================ Simulation idm.simple_managed_users.ManagedUsersDelete completed in 510 seconds ---------------------- [06/Mar/2024 20:23:18] Create tar file cleanup.tar.gz ---------------------- RESULTS_FOLDER=/results/gatling/ RESULT_FOLDER=cleanup SIMULATION_PATH=cleanup/managedusersdelete-20240306201447915 PWD=/results/gatling/cleanup/managedusersdelete-20240306201447915 [cmd] tar -czvf /results/gatling//cleanup.tar.gz --exclude=simulation.log * /results/gatling ---------------------- [06/Mar/2024 20:23:18] Update /results/gatling//latest ---------------------- ---------------------- [06/Mar/2024 20:23:18] Update /results/gatling//latest.tar.gz ---------------------- ________________________________________________________________________________ [2024-03-06 20:25:10] cleanup show_stderr : Display stderr order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_simple_managed_users/05_Data_init/02_cleanup/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [2024-03-06 20:25:10] cleanup check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-03-06 20:25:10] cleanup print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-03-06 20:25:10] cleanup post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped