--Task-- name: prepare-workload enabled: True class_name: PrepareWorkloadTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {'_options_': '--preload_output /results/idm/preload.csv'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [21/Feb/2023 00:50:35] prepare-workload pre : Checking task config ________________________________________________________________________________ [21/Feb/2023 00:50:35] - INFO: Timeout for this Task has changed to 2h (7200 seconds) [21/Feb/2023 00:50:35] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset Pod log file : /results/orders/prepare-workload/stdout.txt Pod log : /results/orders/prepare-workload [21/Feb/2023 00:50:35] - INFO: --preload_records param with its value was added automatically ________________________________________________________________________________ [21/Feb/2023 00:50:35] prepare-workload print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ [21/Feb/2023 00:50:35] - INFO: --preload_records param with its value was added automatically /lodestar/pyrock/shared/scripts/idm/prepare_workload.py --preload_records 1000000 --preload_output /results/idm/preload.csv ________________________________________________________________________________ [21/Feb/2023 00:50:35] prepare-workload create_order : Create order for overseer with the command to run ________________________________________________________________________________ [21/Feb/2023 00:50:35] - INFO: --preload_records param with its value was added automatically Order file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/order.json { "name": "prepare-workload", "command": "/lodestar/pyrock/shared/scripts/idm/prepare_workload.py --preload_records 1000000 --preload_output /results/idm/preload.csv", "out-dir": "/results/orders/prepare-workload" } ________________________________________________________________________________ [21/Feb/2023 00:50:35] prepare-workload loop_until_ready : Loop until overseer pod is ready to accept order ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-bsln.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [21/Feb/2023 00:50:35] prepare-workload start_order : Send the order to the overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cc5dd9f4c-pr5wc --- stderr --- [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/order.json overseer-0-7cc5dd9f4c-pr5wc:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [21/Feb/2023 00:50:37] prepare-workload wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 2h Waiting for status (curl --fail -k https://overseer-0.xlou.iam.xlou-bsln.engineeringpit.com/orders/status.txt) == WAITING Order is running since 5s, retry Order is running since 10s, retry PASS : Order stopped by itself after 15s and before timeout (2h) ________________________________________________________________________________ [21/Feb/2023 00:50:53] prepare-workload stop_order : Stop the order on overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cc5dd9f4c-pr5wc --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-7cc5dd9f4c-pr5wc -- rm -f /results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order ran during 16s ________________________________________________________________________________ [21/Feb/2023 00:50:54] prepare-workload download_logs : Download order.tar.gz ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cc5dd9f4c-pr5wc --- stderr --- Checking pod: overseer-0-7cc5dd9f4c-pr5wc for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cc5dd9f4c-pr5wc --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-7cc5dd9f4c-pr5wc -i -- bash -c 'if [ -f "/results/orders/prepare-workload/order.tar.gz" ]; then echo "/results/orders/prepare-workload/order.tar.gz file found"; exit 0; else echo "/results/orders/prepare-workload/order.tar.gz file not found"; exit 1; fi' | grep "/results/orders/prepare-workload/order.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/prepare-workload/order.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cc5dd9f4c-pr5wc --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-7cc5dd9f4c-pr5wc -i -- du -k /results/orders/prepare-workload/order.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/prepare-workload/order.tar.gz --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cc5dd9f4c-pr5wc --- stderr --- source : /results/orders/prepare-workload/order.tar.gz @ overseer-0-7cc5dd9f4c-pr5wc destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/order.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-7cc5dd9f4c-pr5wc --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-7cc5dd9f4c-pr5wc:/results/orders/prepare-workload/order.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/order.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- - Extract archive zip file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/order.tar.gz destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload ________________________________________________________________________________ [21/Feb/2023 00:50:57] prepare-workload show_cmd : Display order command ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/cmd.txt is small (1 lines), printing all lines: ----- output ----- /lodestar/pyrock/shared/scripts/idm/prepare_workload.py --preload_records 1000000 --preload_output /results/idm/preload.csv ________________________________________________________________________________ [21/Feb/2023 00:50:57] prepare-workload show_rc : Display rc order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [21/Feb/2023 00:50:57] prepare-workload show_stdout : Display stdout order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/stdout.txt is small (2 lines), printing all lines: ----- output ----- [pass] File created : /results/idm/preload.csv with 1000000 records [pass] File created : /tmp/benchmark_users.csv with 3000 records ________________________________________________________________________________ [21/Feb/2023 00:50:57] prepare-workload show_stderr : Display stderr order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform_login_pta/04_Data_init/01_prepare-workload/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [21/Feb/2023 00:50:57] prepare-workload check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [21/Feb/2023 00:50:57] prepare-workload print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [21/Feb/2023 00:50:57] prepare-workload post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped