--Task-- name: prepare-workload enabled: True class_name: PrepareWorkloadTask source_name: overseer-0 source_namespace: >default< target_name: overseer-0 target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: ['cleanup'] wait_for: ['Pre-check Num Users'] preceding_task: None options: {'_options_': '--preload_output /results/idm/preload.csv --benchmark_records 1500000 --benchmark_output /results/idm/benchmark_users.csv'} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock 2025-05-15 23:18:05 - INFO: Timeout for this Task has changed to 5m (300 seconds) 2025-05-15 23:18:05 - INFO: timeout was set to Task default (1.2x self.expected_duration) or 300 seconds (whatever is higher)), because it was unset 2025-05-15 23:18:05 - INFO: Interval for this Task has changed to 5s (5 seconds) 2025-05-15 23:18:05 - INFO: interval was set to Task default because it was unset, based on self.timeout value because task is allowed to stop by itself Pod log file : /results/orders/prepare-workload/stdout.txt Pod log : /results/orders/prepare-workload 2025-05-15 23:18:05 - INFO: --preload_records param with its value was added automatically ________________________________________________________________________________ [2025-05-15 23:18:05] prepare-workload print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ 2025-05-15 23:18:05 - INFO: --preload_records param with its value was added automatically /lodestar/pyrock/shared/scripts/idm/prepare_workload.py --preload_records 10000000 --preload_output /results/idm/preload.csv --benchmark_records 1500000 --benchmark_output /results/idm/benchmark_users.csv ________________________________________________________________________________ [2025-05-15 23:18:05] prepare-workload create_order : Create order for overseer with the command to run ________________________________________________________________________________ 2025-05-15 23:18:05 - INFO: --preload_records param with its value was added automatically Order file: /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/order.json { "name": "prepare-workload", "command": "/lodestar/pyrock/shared/scripts/idm/prepare_workload.py --preload_records 10000000 --preload_output /results/idm/preload.csv --benchmark_records 1500000 --benchmark_output /results/idm/benchmark_users.csv", "out-dir": "/results/orders/prepare-workload" } ________________________________________________________________________________ [2025-05-15 23:18:05] prepare-workload loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2025-05-15 23:18:05,641 INFO 2025-05-15 23:18:05,641 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2025-05-15 23:18:05,641 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2025-05-15 23:18:05,854 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:18:05,854 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:18:05,854 DEBUG --- stdout --- 2025-05-15 23:18:05,854 DEBUG WAITING 2025-05-15 23:18:05,854 DEBUG --- stderr --- 2025-05-15 23:18:05,854 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 34 0 --:--:-- --:--:-- --:--:-- 34 ________________________________________________________________________________ [2025-05-15 23:18:05] prepare-workload start_order : Send the order to the overseer pod ________________________________________________________________________________ 2025-05-15 23:18:05,854 INFO 2025-05-15 23:18:05,854 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-05-15 23:18:05,854 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-05-15 23:18:06,163 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-05-15 23:18:06,163 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:18:06,163 DEBUG --- stdout --- 2025-05-15 23:18:06,163 DEBUG overseer-0-898c87646-8747d 2025-05-15 23:18:06,163 DEBUG --- stderr --- 2025-05-15 23:18:06,163 DEBUG 2025-05-15 23:18:06,164 INFO 2025-05-15 23:18:06,164 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/order.json overseer-0-898c87646-8747d:/results/orders/order.json 2025-05-15 23:18:06,164 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-05-15 23:18:07,495 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:18:07,495 DEBUG --- stdout --- 2025-05-15 23:18:07,495 DEBUG 2025-05-15 23:18:07,495 DEBUG --- stderr --- 2025-05-15 23:18:07,495 DEBUG Order has been successfully forwarded to overseer ________________________________________________________________________________ [2025-05-15 23:18:07] prepare-workload wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 5m. Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 5s, retry Order is running since 10s, retry Order is running since 15s, retry Order is running since 20s, retry Order is running since 26s, retry Order is running since 31s, retry Order is running since 36s, retry Order is running since 41s, retry Order is running since 47s, retry Order is running since 52s, retry Order is running since 57s, retry Order is running since 1m 02s, retry Order is running since 1m 08s, retry Order is running since 1m 13s, retry Order is running since 1m 18s, retry PASS : Order stopped by itself after 1m 23s and before timeout (5m) ________________________________________________________________________________ [2025-05-15 23:19:31] prepare-workload stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2025-05-15 23:19:31,362 INFO 2025-05-15 23:19:31,362 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-05-15 23:19:31,362 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-05-15 23:19:31,635 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-05-15 23:19:31,636 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:31,636 DEBUG --- stdout --- 2025-05-15 23:19:31,636 DEBUG overseer-0-898c87646-8747d 2025-05-15 23:19:31,636 DEBUG --- stderr --- 2025-05-15 23:19:31,636 DEBUG 2025-05-15 23:19:31,636 INFO 2025-05-15 23:19:31,636 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d -- rm -f /results/orders/order.json 2025-05-15 23:19:31,636 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-05-15 23:19:32,381 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:32,381 DEBUG --- stdout --- 2025-05-15 23:19:32,381 DEBUG 2025-05-15 23:19:32,381 DEBUG --- stderr --- 2025-05-15 23:19:32,381 DEBUG Order ran during 1m 24s ________________________________________________________________________________ [2025-05-15 23:19:32] prepare-workload download_logs : Download individual order files ________________________________________________________________________________ 2025-05-15 23:19:32 - PASS: file already downloaded /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/order.json 2025-05-15 23:19:32,382 INFO 2025-05-15 23:19:32,382 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-05-15 23:19:32,382 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-05-15 23:19:32,656 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-05-15 23:19:32,656 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:32,656 DEBUG --- stdout --- 2025-05-15 23:19:32,657 DEBUG overseer-0-898c87646-8747d 2025-05-15 23:19:32,657 DEBUG --- stderr --- 2025-05-15 23:19:32,657 DEBUG Checking if file exists on pod 'overseer-0-898c87646-8747d', wait max 3 minutes if not. 2025-05-15 23:19:32,657 INFO 2025-05-15 23:19:32,657 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d --stdin -- bash -c 'if [ -f "/results/orders/prepare-workload/rc.txt" ]; then echo "/results/orders/prepare-workload/rc.txt file found"; exit 0; else echo "/results/orders/prepare-workload/rc.txt file not found"; exit 1; fi' | grep "/results/orders/prepare-workload/rc.txt file found" 2025-05-15 23:19:32,657 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-05-15 23:19:33,568 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:19:33,568 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:33,568 DEBUG --- stdout --- 2025-05-15 23:19:33,568 DEBUG /results/orders/prepare-workload/rc.txt file found 2025-05-15 23:19:33,569 DEBUG --- stderr --- 2025-05-15 23:19:33,569 DEBUG 2025-05-15 23:19:33,570 INFO 2025-05-15 23:19:33,570 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d --stdin -- du -k /results/orders/prepare-workload/rc.txt | grep "^\d+ .+$" 2025-05-15 23:19:33,570 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-05-15 23:19:34,355 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:19:34,355 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:34,355 DEBUG --- stdout --- 2025-05-15 23:19:34,355 DEBUG 4 /results/orders/prepare-workload/rc.txt 2025-05-15 23:19:34,355 DEBUG --- stderr --- 2025-05-15 23:19:34,355 DEBUG - Download file (size 4kB) source : /results/orders/prepare-workload/rc.txt @ overseer-0-898c87646-8747d destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/rc.txt 2025-05-15 23:19:34,356 INFO 2025-05-15 23:19:34,356 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-898c87646-8747d:/results/orders/prepare-workload/rc.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/rc.txt 2025-05-15 23:19:34,356 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-05-15 23:19:35,093 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:35,093 DEBUG --- stdout --- 2025-05-15 23:19:35,093 DEBUG tar: Removing leading `/' from member names 2025-05-15 23:19:35,093 DEBUG --- stderr --- 2025-05-15 23:19:35,093 DEBUG 2025-05-15 23:19:35,094 INFO 2025-05-15 23:19:35,094 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-05-15 23:19:35,094 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-05-15 23:19:35,369 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-05-15 23:19:35,369 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:35,369 DEBUG --- stdout --- 2025-05-15 23:19:35,369 DEBUG overseer-0-898c87646-8747d 2025-05-15 23:19:35,369 DEBUG --- stderr --- 2025-05-15 23:19:35,369 DEBUG Checking if file exists on pod 'overseer-0-898c87646-8747d', wait max 3 minutes if not. 2025-05-15 23:19:35,370 INFO 2025-05-15 23:19:35,370 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d --stdin -- bash -c 'if [ -f "/results/orders/prepare-workload/stderr.txt" ]; then echo "/results/orders/prepare-workload/stderr.txt file found"; exit 0; else echo "/results/orders/prepare-workload/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/prepare-workload/stderr.txt file found" 2025-05-15 23:19:35,370 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-05-15 23:19:36,150 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:19:36,150 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:36,150 DEBUG --- stdout --- 2025-05-15 23:19:36,150 DEBUG /results/orders/prepare-workload/stderr.txt file found 2025-05-15 23:19:36,150 DEBUG --- stderr --- 2025-05-15 23:19:36,150 DEBUG 2025-05-15 23:19:36,151 INFO 2025-05-15 23:19:36,151 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d --stdin -- du -k /results/orders/prepare-workload/stderr.txt | grep "^\d+ .+$" 2025-05-15 23:19:36,151 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-05-15 23:19:36,929 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:19:36,929 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:36,929 DEBUG --- stdout --- 2025-05-15 23:19:36,929 DEBUG 0 /results/orders/prepare-workload/stderr.txt 2025-05-15 23:19:36,929 DEBUG --- stderr --- 2025-05-15 23:19:36,929 DEBUG - Download file (size 0B) source : /results/orders/prepare-workload/stderr.txt @ overseer-0-898c87646-8747d destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/stderr.txt 2025-05-15 23:19:36,930 INFO 2025-05-15 23:19:36,930 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-898c87646-8747d:/results/orders/prepare-workload/stderr.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/stderr.txt 2025-05-15 23:19:36,930 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-05-15 23:19:37,677 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:37,677 DEBUG --- stdout --- 2025-05-15 23:19:37,677 DEBUG tar: Removing leading `/' from member names 2025-05-15 23:19:37,677 DEBUG --- stderr --- 2025-05-15 23:19:37,678 DEBUG 2025-05-15 23:19:37,678 INFO 2025-05-15 23:19:37,678 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-05-15 23:19:37,678 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-05-15 23:19:37,967 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-05-15 23:19:37,967 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:37,967 DEBUG --- stdout --- 2025-05-15 23:19:37,967 DEBUG overseer-0-898c87646-8747d 2025-05-15 23:19:37,967 DEBUG --- stderr --- 2025-05-15 23:19:37,967 DEBUG Checking if file exists on pod 'overseer-0-898c87646-8747d', wait max 3 minutes if not. 2025-05-15 23:19:37,968 INFO 2025-05-15 23:19:37,968 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d --stdin -- bash -c 'if [ -f "/results/orders/prepare-workload/stdout.txt" ]; then echo "/results/orders/prepare-workload/stdout.txt file found"; exit 0; else echo "/results/orders/prepare-workload/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/prepare-workload/stdout.txt file found" 2025-05-15 23:19:37,968 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-05-15 23:19:38,751 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:19:38,752 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:38,752 DEBUG --- stdout --- 2025-05-15 23:19:38,752 DEBUG /results/orders/prepare-workload/stdout.txt file found 2025-05-15 23:19:38,752 DEBUG --- stderr --- 2025-05-15 23:19:38,752 DEBUG 2025-05-15 23:19:38,752 INFO 2025-05-15 23:19:38,752 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d --stdin -- du -k /results/orders/prepare-workload/stdout.txt | grep "^\d+ .+$" 2025-05-15 23:19:38,752 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-05-15 23:19:39,541 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:19:39,541 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:39,541 DEBUG --- stdout --- 2025-05-15 23:19:39,541 DEBUG 4 /results/orders/prepare-workload/stdout.txt 2025-05-15 23:19:39,541 DEBUG --- stderr --- 2025-05-15 23:19:39,541 DEBUG - Download file (size 4kB) source : /results/orders/prepare-workload/stdout.txt @ overseer-0-898c87646-8747d destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/stdout.txt 2025-05-15 23:19:39,542 INFO 2025-05-15 23:19:39,542 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-898c87646-8747d:/results/orders/prepare-workload/stdout.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/stdout.txt 2025-05-15 23:19:39,542 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-05-15 23:19:40,253 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:40,253 DEBUG --- stdout --- 2025-05-15 23:19:40,253 DEBUG tar: Removing leading `/' from member names 2025-05-15 23:19:40,253 DEBUG --- stderr --- 2025-05-15 23:19:40,253 DEBUG ________________________________________________________________________________ [2025-05-15 23:19:40] prepare-workload show_cmd : Display order command ________________________________________________________________________________ 2025-05-15 23:19:40,254 INFO 2025-05-15 23:19:40,254 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2025-05-15 23:19:40,254 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2025-05-15 23:19:40,528 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2025-05-15 23:19:40,528 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:40,528 DEBUG --- stdout --- 2025-05-15 23:19:40,528 DEBUG overseer-0-898c87646-8747d 2025-05-15 23:19:40,528 DEBUG --- stderr --- 2025-05-15 23:19:40,528 DEBUG Checking if file exists on pod 'overseer-0-898c87646-8747d', wait max 3 minutes if not. 2025-05-15 23:19:40,529 INFO 2025-05-15 23:19:40,529 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d --stdin -- bash -c 'if [ -f "/results/orders/prepare-workload/cmd.txt" ]; then echo "/results/orders/prepare-workload/cmd.txt file found"; exit 0; else echo "/results/orders/prepare-workload/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/prepare-workload/cmd.txt file found" 2025-05-15 23:19:40,529 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2025-05-15 23:19:41,317 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:19:41,317 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:41,317 DEBUG --- stdout --- 2025-05-15 23:19:41,317 DEBUG /results/orders/prepare-workload/cmd.txt file found 2025-05-15 23:19:41,317 DEBUG --- stderr --- 2025-05-15 23:19:41,317 DEBUG 2025-05-15 23:19:41,318 INFO 2025-05-15 23:19:41,318 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-898c87646-8747d --stdin -- du -k /results/orders/prepare-workload/cmd.txt | grep "^\d+ .+$" 2025-05-15 23:19:41,318 INFO [loop_until]: (max_time=240, interval=10, expected_rc=[0] 2025-05-15 23:19:42,113 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2025-05-15 23:19:42,113 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:42,113 DEBUG --- stdout --- 2025-05-15 23:19:42,113 DEBUG 4 /results/orders/prepare-workload/cmd.txt 2025-05-15 23:19:42,113 DEBUG --- stderr --- 2025-05-15 23:19:42,113 DEBUG - Download file (size 4kB) source : /results/orders/prepare-workload/cmd.txt @ overseer-0-898c87646-8747d destination : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/cmd.txt 2025-05-15 23:19:42,113 INFO 2025-05-15 23:19:42,113 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-898c87646-8747d:/results/orders/prepare-workload/cmd.txt /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/cmd.txt 2025-05-15 23:19:42,113 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2025-05-15 23:19:42,858 INFO [loop_until]: OK (rc = 0) 2025-05-15 23:19:42,858 DEBUG --- stdout --- 2025-05-15 23:19:42,858 DEBUG tar: Removing leading `/' from member names 2025-05-15 23:19:42,858 DEBUG --- stderr --- 2025-05-15 23:19:42,858 DEBUG 2025-05-15 23:19:42,858 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/cmd.txt is small (1 lines), printing all lines: 2025-05-15 23:19:42,858 INFO ----- output ----- /lodestar/pyrock/shared/scripts/idm/prepare_workload.py --preload_records 10000000 --preload_output /results/idm/preload.csv --benchmark_records 1500000 --benchmark_output /results/idm/benchmark_users.csv ________________________________________________________________________________ [2025-05-15 23:19:42] prepare-workload show_rc : Display rc order ________________________________________________________________________________ 2025-05-15 23:19:42,859 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/rc.txt is small (1 lines), printing all lines: 2025-05-15 23:19:42,859 INFO ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [2025-05-15 23:19:42] prepare-workload show_stdout : Display stdout order ________________________________________________________________________________ 2025-05-15 23:19:42,859 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/stdout.txt is small (2 lines), printing all lines: 2025-05-15 23:19:42,859 INFO ----- output ----- [pass] File created : /results/idm/preload.csv with 10000000 records [pass] File created : /results/idm/benchmark_users.csv with 1500000 records ________________________________________________________________________________ [2025-05-15 23:19:42] prepare-workload show_stderr : Display stderr order ________________________________________________________________________________ 2025-05-15 23:19:42,859 DEBUG [print_head_tail]: Input file /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_login_tree/05_Data_Init/03_prepare-workload/stderr.txt is small (0 lines), printing all lines: 2025-05-15 23:19:42,859 INFO ----- output ----- ________________________________________________________________________________ [2025-05-15 23:19:42] prepare-workload check_rc_and_logs : Check order's outputs ________________________________________________________________________________ CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2025-05-15 23:19:43] prepare-workload print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2025-05-15 23:19:43] prepare-workload post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped