--Task-- name: cleanup enabled: True class_name: GatlingTask source_name: overseer-0 source_namespace: >default< target_name: idm target_namespace: >default< start: 0 stop: None timeout: 1h (3600 seconds) loop: False interval: None dependencies: ['dump-uid'] wait_for: [] options: {'simulation': 'idm.simple_managed_users.ManagedUsersDelete', 'concurrency': 30, 'java-opts': '-Dcsvfile=/results/idm/user_feeder_delete.csv -Drealm=alpha'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [21/Sep/2022 21:43:37] cleanup pre : N/A ________________________________________________________________________________ Pod log file : /results/orders/cleanup/stdout.txt Pod log : /results/orders/cleanup ________________________________________________________________________________ [21/Sep/2022 21:43:37] cleanup print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/clients/gatling-for-pyrock.sh -s idm.simple_managed_users.ManagedUsersDelete -sf /lodestar/pyrock/shared/clients/gatling/ -rd idm.simple_managed_users.ManagedUsersDelete@IDC -rf /results/gatling/cleanup --no-reports ________________________________________________________________________________ [21/Sep/2022 21:43:37] cleanup create_order : Create order for overseer with the command to run ________________________________________________________________________________ Userpool size is not defined for the task in conf.yaml and cannot find how many users (entries) are in id-repo, please check the conf.yaml file. Default for selected Gatling simulation will be used. [21/Sep/2022 21:43:37] - INFO: Get overseer pod resources requests memory [loop_until]: kubectl --namespace=xlou get pods overseer-0-c7fc5cc47-x4c97 -o jsonpath={.spec.containers[].resources.requests.memory} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 4Gi --- stderr --- Order file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/order.json { "name": "cleanup", "command": "/lodestar/clients/gatling-for-pyrock.sh -s idm.simple_managed_users.ManagedUsersDelete -sf /lodestar/pyrock/shared/clients/gatling/ -rd idm.simple_managed_users.ManagedUsersDelete@IDC -rf /results/gatling/cleanup --no-reports", "out-dir": "/results/orders/cleanup", "environment": { "JAVA_OPTS": "-Dam_host=openam-fr-pit-testing18.forgeblocks.com -Dam_oauth2_scope=openid^fr:idm:* -DamadminPassword=M@ythe4th -DamadminUsername=xiaosong.lou@forgerock.com -Dconcurrency=30 -Dcsvfile=/results/idm/user_feeder_delete.csv -Didc=true -Didm_host=openam-fr-pit-testing18.forgeblocks.com -Doauth2_client_id=idmAdminClient -Doauth2_redirect_uri=/platform/appAuthHelperRedirect.html -Drealm=alpha -Duser_password=T35!tr0c-k123 -Xmx4G -Dduration=3996" } } ________________________________________________________________________________ [21/Sep/2022 21:43:37] cleanup loop_until_ready : Loop until overseer pod is ready to accept order ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 30 0 --:--:-- --:--:-- --:--:-- 30 ________________________________________________________________________________ [21/Sep/2022 21:43:37] cleanup start_order : Send the order to the overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/order.json overseer-0-c7fc5cc47-x4c97:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer [21/Sep/2022 21:43:39] - INFO: Check if Gatling simulation started successfully [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -- head /results/orders/cleanup/stdout.txt | grep "started..." [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 6s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 12s (rc=0) - failed to find expected output: started... - retry [loop_until]: Function succeeded after 18s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling think time multiplier is 0x Simulation idm.simple_managed_users.ManagedUsersDelete started... ================================================================================ 2022-09-21 22:43:56 0s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=150 KO=0 ) > restLoginInitiate (OK=30 KO=0 ) > restLoginUsernamePasswordCallback (OK=30 KO=0 ) --- stderr --- ________________________________________________________________________________ [21/Sep/2022 21:43:57] cleanup wait_stop_by_itself : Wait the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 1h Run command curl --fail -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt And exit (continue) if status == WAITING PASS : Order stopped by itself after 5s and before timeout (1h) ________________________________________________________________________________ [21/Sep/2022 21:44:03] cleanup stop_order : Stop the order on overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -- rm -f /results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order ran during 24s ________________________________________________________________________________ [21/Sep/2022 21:44:04] cleanup download_logs : Download order.tar.gz ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- Checking pod: overseer-0-c7fc5cc47-x4c97 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- bash -c 'if [ -f "/results/orders/cleanup/order.tar.gz" ]; then echo "/results/orders/cleanup/order.tar.gz file found"; exit 0; else echo "/results/orders/cleanup/order.tar.gz file not found"; exit 1; fi' | grep "/results/orders/cleanup/order.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/cleanup/order.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -i -- du -k /results/orders/cleanup/order.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/cleanup/order.tar.gz --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- source : /results/orders/cleanup/order.tar.gz @ overseer-0-c7fc5cc47-x4c97 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/order.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-c7fc5cc47-x4c97:/results/orders/cleanup/order.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/order.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- - Extract archive zip file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/order.tar.gz destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup ________________________________________________________________________________ [21/Sep/2022 21:44:07] cleanup show_cmd : Display order command ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/cmd.txt is small (1 lines), printing all lines: ----- output ----- /lodestar/clients/gatling-for-pyrock.sh -s idm.simple_managed_users.ManagedUsersDelete -sf /lodestar/pyrock/shared/clients/gatling/ -rd idm.simple_managed_users.ManagedUsersDelete@IDC -rf /results/gatling/cleanup --no-reports ________________________________________________________________________________ [21/Sep/2022 21:44:07] cleanup show_rc : Display rc order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [21/Sep/2022 21:44:07] cleanup show_stdout : Display stdout order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/stdout.txt is small (38 lines), printing all lines: ----- output ----- GATLING_HOME is set to /home/jenkins/lodestar/clients/gatling think time multiplier is 0x Simulation idm.simple_managed_users.ManagedUsersDelete started... ================================================================================ 2022-09-21 22:43:56 0s elapsed ---- Requests ------------------------------------------------------------------ > Global (OK=150 KO=0 ) > restLoginInitiate (OK=30 KO=0 ) > restLoginUsernamePasswordCallback (OK=30 KO=0 ) > Skip 2FA (OK=30 KO=0 ) > User Authorize PKCE stage (OK=30 KO=0 ) > User AccessToken PKCE stage (OK=30 KO=0 ) ---- Managed User Delete ------------------------------------------------------- [##########################################################################]100% waiting: 0 / active: 0 / done: 30 ================================================================================ Simulation idm.simple_managed_users.ManagedUsersDelete completed in 0 seconds ---------------------- [21/Sep/2022 22:43:56] Create tar file cleanup.tar.gz ---------------------- RESULTS_FOLDER=/results/gatling/ RESULT_FOLDER=cleanup SIMULATION_PATH=cleanup/managedusersdelete-20220921214354503 PWD=/results/gatling/cleanup/managedusersdelete-20220921214354503 [cmd] tar -czvf /results/gatling//cleanup.tar.gz --exclude=simulation.log * /results/gatling ---------------------- [21/Sep/2022 22:43:56] Update /results/gatling//latest ---------------------- ---------------------- [21/Sep/2022 22:43:56] Update /results/gatling//latest.tar.gz ---------------------- ________________________________________________________________________________ [21/Sep/2022 21:44:07] cleanup show_stderr : Display stderr order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/03_Data_init/02_cleanup/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [21/Sep/2022 21:44:07] cleanup check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [21/Sep/2022 21:44:07] cleanup print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [21/Sep/2022 21:44:07] cleanup post : Post ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped