--Task-- name: MakeFeeders_ds-idrepo enabled: True class_name: MakeFeedersTask source_name: overseer-0 source_namespace: >default< target_name: ds-idrepo target_namespace: >default< start: 0.0 stop: None timeout: no timeout loop: False interval: None dependencies: ['MakeUsers_ds-idrepo'] wait_for: [] preceding_task: None options: {'out_dir': '/results/ds-idrepo', 'ldif_file': '/results/ds-idrepo/user_entries.ldif', 'zip_file': '/results/ds-idrepo/feeders.tar.gz'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-04-17 16:17:43] MakeFeeders_ds-idrepo pre : Checking task config ________________________________________________________________________________ Pod log file : /results/orders/MakeFeeders_ds-idrepo/stdout.txt Pod log : /results/orders/MakeFeeders_ds-idrepo ________________________________________________________________________________ [2024-04-17 16:17:43] MakeFeeders_ds-idrepo print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ python3 /lodestar/pyrock/shared/scripts/ds/generate_feeders.py --ldif-file /results/ds-idrepo/user_entries.ldif --out-dir /results/ds-idrepo --zip-file /results/ds-idrepo/feeders.tar.gz ________________________________________________________________________________ [2024-04-17 16:17:43] MakeFeeders_ds-idrepo create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/order.json { "name": "MakeFeeders_ds-idrepo", "command": "python3 /lodestar/pyrock/shared/scripts/ds/generate_feeders.py --ldif-file /results/ds-idrepo/user_entries.ldif --out-dir /results/ds-idrepo --zip-file /results/ds-idrepo/feeders.tar.gz", "out-dir": "/results/orders/MakeFeeders_ds-idrepo" } ________________________________________________________________________________ [2024-04-17 16:17:43] MakeFeeders_ds-idrepo loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-04-17 16:17:43,280 INFO 2024-04-17 16:17:43,280 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-04-17 16:17:43,280 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-04-17 16:17:43,597 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-17 16:17:43,598 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:17:43,598 DEBUG --- stdout --- 2024-04-17 16:17:43,598 DEBUG WAITING 2024-04-17 16:17:43,598 DEBUG --- stderr --- 2024-04-17 16:17:43,598 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 24 0 --:--:-- --:--:-- --:--:-- 24 ________________________________________________________________________________ [2024-04-17 16:17:43] MakeFeeders_ds-idrepo start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-04-17 16:17:43,598 INFO 2024-04-17 16:17:43,598 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:17:43,598 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:17:43,989 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:17:43,990 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:17:43,990 DEBUG --- stdout --- 2024-04-17 16:17:43,990 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:17:43,990 DEBUG --- stderr --- 2024-04-17 16:17:43,990 DEBUG 2024-04-17 16:17:43,991 INFO 2024-04-17 16:17:43,991 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/order.json overseer-0-5c67bf94db-77mh9:/results/orders/order.json 2024-04-17 16:17:43,991 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-17 16:17:45,424 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:17:45,424 DEBUG --- stdout --- 2024-04-17 16:17:45,424 DEBUG 2024-04-17 16:17:45,425 DEBUG --- stderr --- 2024-04-17 16:17:45,425 DEBUG Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-04-17 16:17:45] MakeFeeders_ds-idrepo wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 59s Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 5s, retry Order is running since 10s, retry Order is running since 15s, retry Order is running since 20s, retry Order is running since 26s, retry PASS : Order stopped by itself after 31s and before timeout (59s) ________________________________________________________________________________ [2024-04-17 16:18:16] MakeFeeders_ds-idrepo stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-04-17 16:18:16,790 INFO 2024-04-17 16:18:16,790 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:16,790 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:17,126 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:17,126 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:17,126 DEBUG --- stdout --- 2024-04-17 16:18:17,126 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:17,126 DEBUG --- stderr --- 2024-04-17 16:18:17,126 DEBUG 2024-04-17 16:18:17,127 INFO 2024-04-17 16:18:17,127 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 -- rm -f /results/orders/order.json 2024-04-17 16:18:17,127 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-17 16:18:17,880 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:17,881 DEBUG --- stdout --- 2024-04-17 16:18:17,881 DEBUG 2024-04-17 16:18:17,881 DEBUG --- stderr --- 2024-04-17 16:18:17,881 DEBUG Order ran during 32s ________________________________________________________________________________ [2024-04-17 16:18:17] MakeFeeders_ds-idrepo download_logs : Download individual order files ________________________________________________________________________________ [2024-04-17 16:18:17] - PASS: file already downloaded /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/order.json 2024-04-17 16:18:17,882 INFO 2024-04-17 16:18:17,882 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:17,882 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:18,209 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:18,210 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:18,210 DEBUG --- stdout --- 2024-04-17 16:18:18,210 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:18,210 DEBUG --- stderr --- 2024-04-17 16:18:18,210 DEBUG Checking pod: overseer-0-5c67bf94db-77mh9 for file exists, if not wait. 2024-04-17 16:18:18,210 INFO 2024-04-17 16:18:18,210 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:18,210 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:18,537 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:18,537 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:18,537 DEBUG --- stdout --- 2024-04-17 16:18:18,537 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:18,538 DEBUG --- stderr --- 2024-04-17 16:18:18,538 DEBUG 2024-04-17 16:18:18,538 INFO 2024-04-17 16:18:18,538 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 --stdin -- bash -c 'if [ -f "/results/orders/MakeFeeders_ds-idrepo/rc.txt" ]; then echo "/results/orders/MakeFeeders_ds-idrepo/rc.txt file found"; exit 0; else echo "/results/orders/MakeFeeders_ds-idrepo/rc.txt file not found"; exit 1; fi' | grep "/results/orders/MakeFeeders_ds-idrepo/rc.txt file found" 2024-04-17 16:18:18,538 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-17 16:18:19,378 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-17 16:18:19,378 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:19,378 DEBUG --- stdout --- 2024-04-17 16:18:19,379 DEBUG /results/orders/MakeFeeders_ds-idrepo/rc.txt file found 2024-04-17 16:18:19,379 DEBUG --- stderr --- 2024-04-17 16:18:19,379 DEBUG 2024-04-17 16:18:19,379 INFO 2024-04-17 16:18:19,379 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:19,379 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:19,688 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:19,688 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:19,688 DEBUG --- stdout --- 2024-04-17 16:18:19,689 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:19,689 DEBUG --- stderr --- 2024-04-17 16:18:19,689 DEBUG 2024-04-17 16:18:19,689 INFO 2024-04-17 16:18:19,689 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 --stdin -- du -k /results/orders/MakeFeeders_ds-idrepo/rc.txt 2024-04-17 16:18:20,555 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-17 16:18:20,555 DEBUG --- stdout --- 2024-04-17 16:18:20,555 DEBUG 4 /results/orders/MakeFeeders_ds-idrepo/rc.txt 2024-04-17 16:18:20,555 DEBUG --- stderr --- 2024-04-17 16:18:20,555 DEBUG 2024-04-17 16:18:20,555 INFO - Download file (size 4k) 2024-04-17 16:18:20,556 INFO 2024-04-17 16:18:20,556 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:20,556 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:20,857 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:20,857 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:20,857 DEBUG --- stdout --- 2024-04-17 16:18:20,857 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:20,858 DEBUG --- stderr --- 2024-04-17 16:18:20,858 DEBUG source : /results/orders/MakeFeeders_ds-idrepo/rc.txt @ overseer-0-5c67bf94db-77mh9 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/rc.txt 2024-04-17 16:18:20,858 INFO 2024-04-17 16:18:20,858 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:20,858 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:21,167 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:21,167 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:21,167 DEBUG --- stdout --- 2024-04-17 16:18:21,167 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:21,167 DEBUG --- stderr --- 2024-04-17 16:18:21,167 DEBUG 2024-04-17 16:18:21,168 INFO 2024-04-17 16:18:21,168 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5c67bf94db-77mh9:/results/orders/MakeFeeders_ds-idrepo/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/rc.txt 2024-04-17 16:18:21,168 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-17 16:18:21,928 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:21,929 DEBUG --- stdout --- 2024-04-17 16:18:21,929 DEBUG tar: Removing leading `/' from member names 2024-04-17 16:18:21,929 DEBUG --- stderr --- 2024-04-17 16:18:21,929 DEBUG 2024-04-17 16:18:21,929 INFO 2024-04-17 16:18:21,929 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:21,930 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:22,251 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:22,252 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:22,252 DEBUG --- stdout --- 2024-04-17 16:18:22,252 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:22,252 DEBUG --- stderr --- 2024-04-17 16:18:22,252 DEBUG Checking pod: overseer-0-5c67bf94db-77mh9 for file exists, if not wait. 2024-04-17 16:18:22,252 INFO 2024-04-17 16:18:22,252 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:22,252 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:22,573 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:22,573 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:22,573 DEBUG --- stdout --- 2024-04-17 16:18:22,573 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:22,573 DEBUG --- stderr --- 2024-04-17 16:18:22,573 DEBUG 2024-04-17 16:18:22,574 INFO 2024-04-17 16:18:22,574 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 --stdin -- bash -c 'if [ -f "/results/orders/MakeFeeders_ds-idrepo/stderr.txt" ]; then echo "/results/orders/MakeFeeders_ds-idrepo/stderr.txt file found"; exit 0; else echo "/results/orders/MakeFeeders_ds-idrepo/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/MakeFeeders_ds-idrepo/stderr.txt file found" 2024-04-17 16:18:22,574 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-17 16:18:23,437 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-17 16:18:23,437 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:23,438 DEBUG --- stdout --- 2024-04-17 16:18:23,438 DEBUG /results/orders/MakeFeeders_ds-idrepo/stderr.txt file found 2024-04-17 16:18:23,438 DEBUG --- stderr --- 2024-04-17 16:18:23,438 DEBUG 2024-04-17 16:18:23,438 INFO 2024-04-17 16:18:23,438 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:23,439 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:23,814 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:23,814 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:23,814 DEBUG --- stdout --- 2024-04-17 16:18:23,815 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:23,815 DEBUG --- stderr --- 2024-04-17 16:18:23,815 DEBUG 2024-04-17 16:18:23,815 INFO 2024-04-17 16:18:23,815 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 --stdin -- du -k /results/orders/MakeFeeders_ds-idrepo/stderr.txt 2024-04-17 16:18:24,697 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-17 16:18:24,697 DEBUG --- stdout --- 2024-04-17 16:18:24,697 DEBUG 0 /results/orders/MakeFeeders_ds-idrepo/stderr.txt 2024-04-17 16:18:24,697 DEBUG --- stderr --- 2024-04-17 16:18:24,697 DEBUG 2024-04-17 16:18:24,698 INFO - Download file (size 0k) 2024-04-17 16:18:24,698 INFO 2024-04-17 16:18:24,698 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:24,698 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:24,999 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:25,000 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:25,000 DEBUG --- stdout --- 2024-04-17 16:18:25,000 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:25,000 DEBUG --- stderr --- 2024-04-17 16:18:25,000 DEBUG source : /results/orders/MakeFeeders_ds-idrepo/stderr.txt @ overseer-0-5c67bf94db-77mh9 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stderr.txt 2024-04-17 16:18:25,000 INFO 2024-04-17 16:18:25,000 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:25,000 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:25,303 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:25,303 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:25,303 DEBUG --- stdout --- 2024-04-17 16:18:25,303 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:25,303 DEBUG --- stderr --- 2024-04-17 16:18:25,303 DEBUG 2024-04-17 16:18:25,303 INFO 2024-04-17 16:18:25,303 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5c67bf94db-77mh9:/results/orders/MakeFeeders_ds-idrepo/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stderr.txt 2024-04-17 16:18:25,303 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-17 16:18:26,044 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:26,044 DEBUG --- stdout --- 2024-04-17 16:18:26,044 DEBUG tar: Removing leading `/' from member names 2024-04-17 16:18:26,044 DEBUG --- stderr --- 2024-04-17 16:18:26,045 DEBUG 2024-04-17 16:18:26,045 INFO 2024-04-17 16:18:26,045 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:26,045 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:26,363 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:26,363 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:26,363 DEBUG --- stdout --- 2024-04-17 16:18:26,363 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:26,363 DEBUG --- stderr --- 2024-04-17 16:18:26,363 DEBUG Checking pod: overseer-0-5c67bf94db-77mh9 for file exists, if not wait. 2024-04-17 16:18:26,364 INFO 2024-04-17 16:18:26,364 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:26,364 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:26,682 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:26,682 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:26,683 DEBUG --- stdout --- 2024-04-17 16:18:26,683 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:26,683 DEBUG --- stderr --- 2024-04-17 16:18:26,683 DEBUG 2024-04-17 16:18:26,683 INFO 2024-04-17 16:18:26,683 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 --stdin -- bash -c 'if [ -f "/results/orders/MakeFeeders_ds-idrepo/stdout.txt" ]; then echo "/results/orders/MakeFeeders_ds-idrepo/stdout.txt file found"; exit 0; else echo "/results/orders/MakeFeeders_ds-idrepo/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/MakeFeeders_ds-idrepo/stdout.txt file found" 2024-04-17 16:18:26,683 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-17 16:18:27,516 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-17 16:18:27,518 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:27,518 DEBUG --- stdout --- 2024-04-17 16:18:27,518 DEBUG /results/orders/MakeFeeders_ds-idrepo/stdout.txt file found 2024-04-17 16:18:27,518 DEBUG --- stderr --- 2024-04-17 16:18:27,518 DEBUG 2024-04-17 16:18:27,518 INFO 2024-04-17 16:18:27,518 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:27,519 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:27,819 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:27,819 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:27,819 DEBUG --- stdout --- 2024-04-17 16:18:27,819 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:27,819 DEBUG --- stderr --- 2024-04-17 16:18:27,819 DEBUG 2024-04-17 16:18:27,819 INFO 2024-04-17 16:18:27,819 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 --stdin -- du -k /results/orders/MakeFeeders_ds-idrepo/stdout.txt 2024-04-17 16:18:28,638 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-17 16:18:28,639 DEBUG --- stdout --- 2024-04-17 16:18:28,639 DEBUG 4 /results/orders/MakeFeeders_ds-idrepo/stdout.txt 2024-04-17 16:18:28,639 DEBUG --- stderr --- 2024-04-17 16:18:28,639 DEBUG 2024-04-17 16:18:28,639 INFO - Download file (size 4k) 2024-04-17 16:18:28,639 INFO 2024-04-17 16:18:28,639 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:28,639 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:28,950 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:28,950 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:28,951 DEBUG --- stdout --- 2024-04-17 16:18:28,951 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:28,951 DEBUG --- stderr --- 2024-04-17 16:18:28,951 DEBUG source : /results/orders/MakeFeeders_ds-idrepo/stdout.txt @ overseer-0-5c67bf94db-77mh9 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stdout.txt 2024-04-17 16:18:28,951 INFO 2024-04-17 16:18:28,951 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:28,951 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:29,273 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:29,274 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:29,274 DEBUG --- stdout --- 2024-04-17 16:18:29,274 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:29,274 DEBUG --- stderr --- 2024-04-17 16:18:29,274 DEBUG 2024-04-17 16:18:29,275 INFO 2024-04-17 16:18:29,275 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5c67bf94db-77mh9:/results/orders/MakeFeeders_ds-idrepo/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stdout.txt 2024-04-17 16:18:29,275 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-17 16:18:30,088 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:30,088 DEBUG --- stdout --- 2024-04-17 16:18:30,089 DEBUG tar: Removing leading `/' from member names 2024-04-17 16:18:30,089 DEBUG --- stderr --- 2024-04-17 16:18:30,089 DEBUG ________________________________________________________________________________ [2024-04-17 16:18:30] MakeFeeders_ds-idrepo show_cmd : Display order command ________________________________________________________________________________ 2024-04-17 16:18:30,090 INFO 2024-04-17 16:18:30,090 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:30,090 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:30,470 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:30,471 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:30,471 DEBUG --- stdout --- 2024-04-17 16:18:30,471 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:30,471 DEBUG --- stderr --- 2024-04-17 16:18:30,471 DEBUG Checking pod: overseer-0-5c67bf94db-77mh9 for file exists, if not wait. 2024-04-17 16:18:30,472 INFO 2024-04-17 16:18:30,472 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:30,472 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:30,856 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:30,856 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:30,856 DEBUG --- stdout --- 2024-04-17 16:18:30,856 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:30,856 DEBUG --- stderr --- 2024-04-17 16:18:30,856 DEBUG 2024-04-17 16:18:30,857 INFO 2024-04-17 16:18:30,857 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 --stdin -- bash -c 'if [ -f "/results/orders/MakeFeeders_ds-idrepo/cmd.txt" ]; then echo "/results/orders/MakeFeeders_ds-idrepo/cmd.txt file found"; exit 0; else echo "/results/orders/MakeFeeders_ds-idrepo/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/MakeFeeders_ds-idrepo/cmd.txt file found" 2024-04-17 16:18:30,857 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-17 16:18:31,743 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-17 16:18:31,744 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:31,744 DEBUG --- stdout --- 2024-04-17 16:18:31,744 DEBUG /results/orders/MakeFeeders_ds-idrepo/cmd.txt file found 2024-04-17 16:18:31,744 DEBUG --- stderr --- 2024-04-17 16:18:31,744 DEBUG 2024-04-17 16:18:31,744 INFO 2024-04-17 16:18:31,744 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:31,744 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:32,045 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:32,045 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:32,045 DEBUG --- stdout --- 2024-04-17 16:18:32,045 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:32,045 DEBUG --- stderr --- 2024-04-17 16:18:32,045 DEBUG 2024-04-17 16:18:32,045 INFO 2024-04-17 16:18:32,046 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5c67bf94db-77mh9 --stdin -- du -k /results/orders/MakeFeeders_ds-idrepo/cmd.txt 2024-04-17 16:18:32,869 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-17 16:18:32,870 DEBUG --- stdout --- 2024-04-17 16:18:32,871 DEBUG 4 /results/orders/MakeFeeders_ds-idrepo/cmd.txt 2024-04-17 16:18:32,871 DEBUG --- stderr --- 2024-04-17 16:18:32,871 DEBUG 2024-04-17 16:18:32,871 INFO - Download file (size 4k) 2024-04-17 16:18:32,872 INFO 2024-04-17 16:18:32,872 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:32,872 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:33,190 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:33,190 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:33,190 DEBUG --- stdout --- 2024-04-17 16:18:33,190 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:33,190 DEBUG --- stderr --- 2024-04-17 16:18:33,190 DEBUG source : /results/orders/MakeFeeders_ds-idrepo/cmd.txt @ overseer-0-5c67bf94db-77mh9 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/cmd.txt 2024-04-17 16:18:33,191 INFO 2024-04-17 16:18:33,191 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-17 16:18:33,191 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-17 16:18:33,503 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-17 16:18:33,504 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:33,504 DEBUG --- stdout --- 2024-04-17 16:18:33,504 DEBUG overseer-0-5c67bf94db-77mh9 2024-04-17 16:18:33,504 DEBUG --- stderr --- 2024-04-17 16:18:33,504 DEBUG 2024-04-17 16:18:33,504 INFO 2024-04-17 16:18:33,504 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5c67bf94db-77mh9:/results/orders/MakeFeeders_ds-idrepo/cmd.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/cmd.txt 2024-04-17 16:18:33,504 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-17 16:18:34,277 INFO [loop_until]: OK (rc = 0) 2024-04-17 16:18:34,278 DEBUG --- stdout --- 2024-04-17 16:18:34,278 DEBUG tar: Removing leading `/' from member names 2024-04-17 16:18:34,278 DEBUG --- stderr --- 2024-04-17 16:18:34,278 DEBUG 2024-04-17 16:18:34,278 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/cmd.txt is small (1 lines), printing all lines: 2024-04-17 16:18:34,278 DEBUG ----- output ----- 2024-04-17 16:18:34,278 DEBUG python3 /lodestar/pyrock/shared/scripts/ds/generate_feeders.py --ldif-file /results/ds-idrepo/user_entries.ldif --out-dir /results/ds-idrepo --zip-file /results/ds-idrepo/feeders.tar.gz 2024-04-17 16:18:34,278 INFO ________________________________________________________________________________ [2024-04-17 16:18:34] MakeFeeders_ds-idrepo show_rc : Display rc order ________________________________________________________________________________ 2024-04-17 16:18:34,279 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/rc.txt is small (1 lines), printing all lines: 2024-04-17 16:18:34,279 DEBUG ----- output ----- 2024-04-17 16:18:34,279 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-04-17 16:18:34,279 INFO ________________________________________________________________________________ [2024-04-17 16:18:34] MakeFeeders_ds-idrepo show_stdout : Display stdout order ________________________________________________________________________________ 2024-04-17 16:18:34,279 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stdout.txt is small (12 lines), printing all lines: 2024-04-17 16:18:34,279 DEBUG ----- output ----- 2024-04-17 16:18:34,279 DEBUG ----------------------------- Generating feeders, please wait..... ----------------------------- Files generated in 21s - dn file : /results/ds-idrepo/feeders/ds-idrepo.dn - login file : /results/ds-idrepo/feeders/ds-idrepo.login - bind file : /results/ds-idrepo/feeders/ds-idrepo.bind --------------------- Zipping /results/ds-idrepo/feeders, please wait..... --------------------- Zip generated in 8s - zip file : /results/ds-idrepo/feeders.tar.gz Finished without any error in 30s. 2024-04-17 16:18:34,279 INFO ________________________________________________________________________________ [2024-04-17 16:18:34] MakeFeeders_ds-idrepo show_stderr : Display stderr order ________________________________________________________________________________ 2024-04-17 16:18:34,279 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stderr.txt is small (0 lines), printing all lines: 2024-04-17 16:18:34,279 DEBUG ----- output ----- 2024-04-17 16:18:34,279 DEBUG 2024-04-17 16:18:34,279 INFO ________________________________________________________________________________ [2024-04-17 16:18:34] MakeFeeders_ds-idrepo check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-04-17 16:18:34] MakeFeeders_ds-idrepo print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-04-17 16:18:34] MakeFeeders_ds-idrepo post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped