--Task-- name: MakeFeeders_ds-idrepo enabled: True class_name: MakeFeedersTask source_name: overseer-0 source_namespace: >default< target_name: ds-idrepo target_namespace: >default< start: 0.0 stop: None timeout: no timeout loop: False interval: None dependencies: ['MakeUsers_ds-idrepo'] wait_for: [] preceding_task: None options: {'out_dir': '/results/ds-idrepo', 'ldif_file': '/results/ds-idrepo/user_entries.ldif', 'zip_file': '/results/ds-idrepo/feeders.tar.gz'} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-04-13 22:57:10] MakeFeeders_ds-idrepo pre : Checking task config ________________________________________________________________________________ Pod log file : /results/orders/MakeFeeders_ds-idrepo/stdout.txt Pod log : /results/orders/MakeFeeders_ds-idrepo ________________________________________________________________________________ [2024-04-13 22:57:10] MakeFeeders_ds-idrepo print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ python3 /lodestar/pyrock/shared/scripts/ds/generate_feeders.py --ldif-file /results/ds-idrepo/user_entries.ldif --out-dir /results/ds-idrepo --zip-file /results/ds-idrepo/feeders.tar.gz ________________________________________________________________________________ [2024-04-13 22:57:10] MakeFeeders_ds-idrepo create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/order.json { "name": "MakeFeeders_ds-idrepo", "command": "python3 /lodestar/pyrock/shared/scripts/ds/generate_feeders.py --ldif-file /results/ds-idrepo/user_entries.ldif --out-dir /results/ds-idrepo --zip-file /results/ds-idrepo/feeders.tar.gz", "out-dir": "/results/orders/MakeFeeders_ds-idrepo" } ________________________________________________________________________________ [2024-04-13 22:57:10] MakeFeeders_ds-idrepo loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-04-13 22:57:10,387 INFO 2024-04-13 22:57:10,387 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-04-13 22:57:10,387 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-04-13 22:57:10,680 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-13 22:57:10,680 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:10,680 DEBUG --- stdout --- 2024-04-13 22:57:10,680 DEBUG WAITING 2024-04-13 22:57:10,680 DEBUG --- stderr --- 2024-04-13 22:57:10,680 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 26 0 --:--:-- --:--:-- --:--:-- 25 ________________________________________________________________________________ [2024-04-13 22:57:10] MakeFeeders_ds-idrepo start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-04-13 22:57:10,680 INFO 2024-04-13 22:57:10,681 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:10,681 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:11,002 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:11,002 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:11,002 DEBUG --- stdout --- 2024-04-13 22:57:11,002 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:11,002 DEBUG --- stderr --- 2024-04-13 22:57:11,002 DEBUG 2024-04-13 22:57:11,003 INFO 2024-04-13 22:57:11,003 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/order.json overseer-0-5584f6c4db-bcn5q:/results/orders/order.json 2024-04-13 22:57:11,003 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-13 22:57:12,375 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:12,375 DEBUG --- stdout --- 2024-04-13 22:57:12,375 DEBUG 2024-04-13 22:57:12,375 DEBUG --- stderr --- 2024-04-13 22:57:12,375 DEBUG Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-04-13 22:57:12] MakeFeeders_ds-idrepo wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 59s Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING Order is running since 5s, retry Order is running since 10s, retry Order is running since 15s, retry Order is running since 20s, retry Order is running since 26s, retry PASS : Order stopped by itself after 31s and before timeout (59s) ________________________________________________________________________________ [2024-04-13 22:57:43] MakeFeeders_ds-idrepo stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-04-13 22:57:43,709 INFO 2024-04-13 22:57:43,710 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:43,710 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:44,039 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:44,039 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:44,039 DEBUG --- stdout --- 2024-04-13 22:57:44,039 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:44,040 DEBUG --- stderr --- 2024-04-13 22:57:44,040 DEBUG 2024-04-13 22:57:44,040 INFO 2024-04-13 22:57:44,040 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q -- rm -f /results/orders/order.json 2024-04-13 22:57:44,040 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-13 22:57:44,807 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:44,807 DEBUG --- stdout --- 2024-04-13 22:57:44,807 DEBUG 2024-04-13 22:57:44,807 DEBUG --- stderr --- 2024-04-13 22:57:44,807 DEBUG Order ran during 32s ________________________________________________________________________________ [2024-04-13 22:57:44] MakeFeeders_ds-idrepo download_logs : Download individual order files ________________________________________________________________________________ [2024-04-13 22:57:44] - PASS: file already downloaded /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/order.json 2024-04-13 22:57:44,808 INFO 2024-04-13 22:57:44,808 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:44,808 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:45,132 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:45,132 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:45,132 DEBUG --- stdout --- 2024-04-13 22:57:45,132 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:45,132 DEBUG --- stderr --- 2024-04-13 22:57:45,132 DEBUG Checking pod: overseer-0-5584f6c4db-bcn5q for file exists, if not wait. 2024-04-13 22:57:45,133 INFO 2024-04-13 22:57:45,133 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:45,133 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:45,450 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:45,450 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:45,450 DEBUG --- stdout --- 2024-04-13 22:57:45,451 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:45,451 DEBUG --- stderr --- 2024-04-13 22:57:45,451 DEBUG 2024-04-13 22:57:45,451 INFO 2024-04-13 22:57:45,451 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q --stdin -- bash -c 'if [ -f "/results/orders/MakeFeeders_ds-idrepo/rc.txt" ]; then echo "/results/orders/MakeFeeders_ds-idrepo/rc.txt file found"; exit 0; else echo "/results/orders/MakeFeeders_ds-idrepo/rc.txt file not found"; exit 1; fi' | grep "/results/orders/MakeFeeders_ds-idrepo/rc.txt file found" 2024-04-13 22:57:45,451 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-13 22:57:46,295 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-13 22:57:46,295 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:46,295 DEBUG --- stdout --- 2024-04-13 22:57:46,295 DEBUG /results/orders/MakeFeeders_ds-idrepo/rc.txt file found 2024-04-13 22:57:46,295 DEBUG --- stderr --- 2024-04-13 22:57:46,295 DEBUG 2024-04-13 22:57:46,296 INFO 2024-04-13 22:57:46,296 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:46,296 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:46,613 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:46,614 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:46,614 DEBUG --- stdout --- 2024-04-13 22:57:46,614 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:46,614 DEBUG --- stderr --- 2024-04-13 22:57:46,614 DEBUG 2024-04-13 22:57:46,614 INFO 2024-04-13 22:57:46,614 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q --stdin -- du -k /results/orders/MakeFeeders_ds-idrepo/rc.txt 2024-04-13 22:57:47,427 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-13 22:57:47,428 DEBUG --- stdout --- 2024-04-13 22:57:47,428 DEBUG 4 /results/orders/MakeFeeders_ds-idrepo/rc.txt 2024-04-13 22:57:47,428 DEBUG --- stderr --- 2024-04-13 22:57:47,428 DEBUG 2024-04-13 22:57:47,428 INFO - Download file (size 4k) 2024-04-13 22:57:47,428 INFO 2024-04-13 22:57:47,428 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:47,428 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:47,776 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:47,776 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:47,776 DEBUG --- stdout --- 2024-04-13 22:57:47,776 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:47,776 DEBUG --- stderr --- 2024-04-13 22:57:47,776 DEBUG source : /results/orders/MakeFeeders_ds-idrepo/rc.txt @ overseer-0-5584f6c4db-bcn5q destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/rc.txt 2024-04-13 22:57:47,777 INFO 2024-04-13 22:57:47,777 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:47,777 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:48,093 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:48,093 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:48,093 DEBUG --- stdout --- 2024-04-13 22:57:48,094 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:48,094 DEBUG --- stderr --- 2024-04-13 22:57:48,094 DEBUG 2024-04-13 22:57:48,094 INFO 2024-04-13 22:57:48,094 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5584f6c4db-bcn5q:/results/orders/MakeFeeders_ds-idrepo/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/rc.txt 2024-04-13 22:57:48,094 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-13 22:57:48,843 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:48,843 DEBUG --- stdout --- 2024-04-13 22:57:48,843 DEBUG tar: Removing leading `/' from member names 2024-04-13 22:57:48,843 DEBUG --- stderr --- 2024-04-13 22:57:48,843 DEBUG 2024-04-13 22:57:48,844 INFO 2024-04-13 22:57:48,844 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:48,844 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:49,237 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:49,238 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:49,238 DEBUG --- stdout --- 2024-04-13 22:57:49,238 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:49,238 DEBUG --- stderr --- 2024-04-13 22:57:49,238 DEBUG Checking pod: overseer-0-5584f6c4db-bcn5q for file exists, if not wait. 2024-04-13 22:57:49,238 INFO 2024-04-13 22:57:49,239 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:49,239 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:49,630 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:49,631 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:49,631 DEBUG --- stdout --- 2024-04-13 22:57:49,631 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:49,631 DEBUG --- stderr --- 2024-04-13 22:57:49,631 DEBUG 2024-04-13 22:57:49,632 INFO 2024-04-13 22:57:49,632 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q --stdin -- bash -c 'if [ -f "/results/orders/MakeFeeders_ds-idrepo/stderr.txt" ]; then echo "/results/orders/MakeFeeders_ds-idrepo/stderr.txt file found"; exit 0; else echo "/results/orders/MakeFeeders_ds-idrepo/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/MakeFeeders_ds-idrepo/stderr.txt file found" 2024-04-13 22:57:49,632 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-13 22:57:50,469 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-13 22:57:50,469 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:50,469 DEBUG --- stdout --- 2024-04-13 22:57:50,469 DEBUG /results/orders/MakeFeeders_ds-idrepo/stderr.txt file found 2024-04-13 22:57:50,469 DEBUG --- stderr --- 2024-04-13 22:57:50,469 DEBUG 2024-04-13 22:57:50,469 INFO 2024-04-13 22:57:50,469 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:50,469 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:50,771 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:50,771 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:50,771 DEBUG --- stdout --- 2024-04-13 22:57:50,771 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:50,771 DEBUG --- stderr --- 2024-04-13 22:57:50,771 DEBUG 2024-04-13 22:57:50,771 INFO 2024-04-13 22:57:50,771 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q --stdin -- du -k /results/orders/MakeFeeders_ds-idrepo/stderr.txt 2024-04-13 22:57:51,591 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-13 22:57:51,591 DEBUG --- stdout --- 2024-04-13 22:57:51,591 DEBUG 0 /results/orders/MakeFeeders_ds-idrepo/stderr.txt 2024-04-13 22:57:51,591 DEBUG --- stderr --- 2024-04-13 22:57:51,591 DEBUG 2024-04-13 22:57:51,591 INFO - Download file (size 0k) 2024-04-13 22:57:51,592 INFO 2024-04-13 22:57:51,592 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:51,592 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:51,915 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:51,916 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:51,916 DEBUG --- stdout --- 2024-04-13 22:57:51,916 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:51,916 DEBUG --- stderr --- 2024-04-13 22:57:51,916 DEBUG source : /results/orders/MakeFeeders_ds-idrepo/stderr.txt @ overseer-0-5584f6c4db-bcn5q destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stderr.txt 2024-04-13 22:57:51,916 INFO 2024-04-13 22:57:51,916 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:51,916 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:52,238 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:52,239 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:52,239 DEBUG --- stdout --- 2024-04-13 22:57:52,239 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:52,239 DEBUG --- stderr --- 2024-04-13 22:57:52,239 DEBUG 2024-04-13 22:57:52,239 INFO 2024-04-13 22:57:52,240 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5584f6c4db-bcn5q:/results/orders/MakeFeeders_ds-idrepo/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stderr.txt 2024-04-13 22:57:52,240 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-13 22:57:53,018 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:53,018 DEBUG --- stdout --- 2024-04-13 22:57:53,018 DEBUG tar: Removing leading `/' from member names 2024-04-13 22:57:53,018 DEBUG --- stderr --- 2024-04-13 22:57:53,019 DEBUG 2024-04-13 22:57:53,019 INFO 2024-04-13 22:57:53,019 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:53,019 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:53,386 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:53,386 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:53,386 DEBUG --- stdout --- 2024-04-13 22:57:53,386 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:53,386 DEBUG --- stderr --- 2024-04-13 22:57:53,386 DEBUG Checking pod: overseer-0-5584f6c4db-bcn5q for file exists, if not wait. 2024-04-13 22:57:53,387 INFO 2024-04-13 22:57:53,387 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:53,387 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:53,722 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:53,722 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:53,722 DEBUG --- stdout --- 2024-04-13 22:57:53,722 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:53,723 DEBUG --- stderr --- 2024-04-13 22:57:53,723 DEBUG 2024-04-13 22:57:53,723 INFO 2024-04-13 22:57:53,723 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q --stdin -- bash -c 'if [ -f "/results/orders/MakeFeeders_ds-idrepo/stdout.txt" ]; then echo "/results/orders/MakeFeeders_ds-idrepo/stdout.txt file found"; exit 0; else echo "/results/orders/MakeFeeders_ds-idrepo/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/MakeFeeders_ds-idrepo/stdout.txt file found" 2024-04-13 22:57:53,723 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-13 22:57:54,543 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-13 22:57:54,544 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:54,545 DEBUG --- stdout --- 2024-04-13 22:57:54,545 DEBUG /results/orders/MakeFeeders_ds-idrepo/stdout.txt file found 2024-04-13 22:57:54,545 DEBUG --- stderr --- 2024-04-13 22:57:54,545 DEBUG 2024-04-13 22:57:54,546 INFO 2024-04-13 22:57:54,546 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:54,546 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:54,887 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:54,887 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:54,887 DEBUG --- stdout --- 2024-04-13 22:57:54,887 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:54,887 DEBUG --- stderr --- 2024-04-13 22:57:54,888 DEBUG 2024-04-13 22:57:54,888 INFO 2024-04-13 22:57:54,888 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q --stdin -- du -k /results/orders/MakeFeeders_ds-idrepo/stdout.txt 2024-04-13 22:57:55,750 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-13 22:57:55,751 DEBUG --- stdout --- 2024-04-13 22:57:55,751 DEBUG 4 /results/orders/MakeFeeders_ds-idrepo/stdout.txt 2024-04-13 22:57:55,751 DEBUG --- stderr --- 2024-04-13 22:57:55,751 DEBUG 2024-04-13 22:57:55,751 INFO - Download file (size 4k) 2024-04-13 22:57:55,751 INFO 2024-04-13 22:57:55,751 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:55,751 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:56,054 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:56,055 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:56,055 DEBUG --- stdout --- 2024-04-13 22:57:56,055 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:56,055 DEBUG --- stderr --- 2024-04-13 22:57:56,055 DEBUG source : /results/orders/MakeFeeders_ds-idrepo/stdout.txt @ overseer-0-5584f6c4db-bcn5q destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stdout.txt 2024-04-13 22:57:56,055 INFO 2024-04-13 22:57:56,055 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:56,055 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:56,357 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:56,357 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:56,357 DEBUG --- stdout --- 2024-04-13 22:57:56,358 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:56,358 DEBUG --- stderr --- 2024-04-13 22:57:56,358 DEBUG 2024-04-13 22:57:56,358 INFO 2024-04-13 22:57:56,358 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5584f6c4db-bcn5q:/results/orders/MakeFeeders_ds-idrepo/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stdout.txt 2024-04-13 22:57:56,358 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-13 22:57:57,106 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:57,106 DEBUG --- stdout --- 2024-04-13 22:57:57,107 DEBUG tar: Removing leading `/' from member names 2024-04-13 22:57:57,107 DEBUG --- stderr --- 2024-04-13 22:57:57,107 DEBUG ________________________________________________________________________________ [2024-04-13 22:57:57] MakeFeeders_ds-idrepo show_cmd : Display order command ________________________________________________________________________________ 2024-04-13 22:57:57,107 INFO 2024-04-13 22:57:57,107 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:57,107 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:57,426 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:57,426 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:57,426 DEBUG --- stdout --- 2024-04-13 22:57:57,427 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:57,427 DEBUG --- stderr --- 2024-04-13 22:57:57,427 DEBUG Checking pod: overseer-0-5584f6c4db-bcn5q for file exists, if not wait. 2024-04-13 22:57:57,427 INFO 2024-04-13 22:57:57,427 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:57,427 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:57,748 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:57,748 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:57,748 DEBUG --- stdout --- 2024-04-13 22:57:57,748 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:57,748 DEBUG --- stderr --- 2024-04-13 22:57:57,748 DEBUG 2024-04-13 22:57:57,749 INFO 2024-04-13 22:57:57,749 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q --stdin -- bash -c 'if [ -f "/results/orders/MakeFeeders_ds-idrepo/cmd.txt" ]; then echo "/results/orders/MakeFeeders_ds-idrepo/cmd.txt file found"; exit 0; else echo "/results/orders/MakeFeeders_ds-idrepo/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/MakeFeeders_ds-idrepo/cmd.txt file found" 2024-04-13 22:57:57,749 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-13 22:57:58,568 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-13 22:57:58,568 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:58,568 DEBUG --- stdout --- 2024-04-13 22:57:58,568 DEBUG /results/orders/MakeFeeders_ds-idrepo/cmd.txt file found 2024-04-13 22:57:58,568 DEBUG --- stderr --- 2024-04-13 22:57:58,568 DEBUG 2024-04-13 22:57:58,569 INFO 2024-04-13 22:57:58,569 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:58,569 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:57:58,934 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:57:58,934 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:57:58,934 DEBUG --- stdout --- 2024-04-13 22:57:58,934 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:57:58,934 DEBUG --- stderr --- 2024-04-13 22:57:58,934 DEBUG 2024-04-13 22:57:58,935 INFO 2024-04-13 22:57:58,935 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5584f6c4db-bcn5q --stdin -- du -k /results/orders/MakeFeeders_ds-idrepo/cmd.txt 2024-04-13 22:57:59,815 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-13 22:57:59,815 DEBUG --- stdout --- 2024-04-13 22:57:59,816 DEBUG 4 /results/orders/MakeFeeders_ds-idrepo/cmd.txt 2024-04-13 22:57:59,816 DEBUG --- stderr --- 2024-04-13 22:57:59,816 DEBUG 2024-04-13 22:57:59,816 INFO - Download file (size 4k) 2024-04-13 22:57:59,817 INFO 2024-04-13 22:57:59,817 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:57:59,817 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:58:00,120 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:58:00,121 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:58:00,121 DEBUG --- stdout --- 2024-04-13 22:58:00,121 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:58:00,121 DEBUG --- stderr --- 2024-04-13 22:58:00,121 DEBUG source : /results/orders/MakeFeeders_ds-idrepo/cmd.txt @ overseer-0-5584f6c4db-bcn5q destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/cmd.txt 2024-04-13 22:58:00,121 INFO 2024-04-13 22:58:00,121 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-13 22:58:00,121 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-13 22:58:00,470 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-13 22:58:00,471 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:58:00,471 DEBUG --- stdout --- 2024-04-13 22:58:00,471 DEBUG overseer-0-5584f6c4db-bcn5q 2024-04-13 22:58:00,471 DEBUG --- stderr --- 2024-04-13 22:58:00,471 DEBUG 2024-04-13 22:58:00,471 INFO 2024-04-13 22:58:00,472 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-5584f6c4db-bcn5q:/results/orders/MakeFeeders_ds-idrepo/cmd.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/cmd.txt 2024-04-13 22:58:00,472 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-13 22:58:01,260 INFO [loop_until]: OK (rc = 0) 2024-04-13 22:58:01,260 DEBUG --- stdout --- 2024-04-13 22:58:01,260 DEBUG tar: Removing leading `/' from member names 2024-04-13 22:58:01,260 DEBUG --- stderr --- 2024-04-13 22:58:01,260 DEBUG 2024-04-13 22:58:01,261 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/cmd.txt is small (1 lines), printing all lines: 2024-04-13 22:58:01,261 DEBUG ----- output ----- 2024-04-13 22:58:01,261 DEBUG python3 /lodestar/pyrock/shared/scripts/ds/generate_feeders.py --ldif-file /results/ds-idrepo/user_entries.ldif --out-dir /results/ds-idrepo --zip-file /results/ds-idrepo/feeders.tar.gz 2024-04-13 22:58:01,261 INFO ________________________________________________________________________________ [2024-04-13 22:58:01] MakeFeeders_ds-idrepo show_rc : Display rc order ________________________________________________________________________________ 2024-04-13 22:58:01,261 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/rc.txt is small (1 lines), printing all lines: 2024-04-13 22:58:01,261 DEBUG ----- output ----- 2024-04-13 22:58:01,261 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-04-13 22:58:01,261 INFO ________________________________________________________________________________ [2024-04-13 22:58:01] MakeFeeders_ds-idrepo show_stdout : Display stdout order ________________________________________________________________________________ 2024-04-13 22:58:01,261 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stdout.txt is small (12 lines), printing all lines: 2024-04-13 22:58:01,261 DEBUG ----- output ----- 2024-04-13 22:58:01,261 DEBUG ----------------------------- Generating feeders, please wait..... ----------------------------- Files generated in 20s - dn file : /results/ds-idrepo/feeders/ds-idrepo.dn - login file : /results/ds-idrepo/feeders/ds-idrepo.login - bind file : /results/ds-idrepo/feeders/ds-idrepo.bind --------------------- Zipping /results/ds-idrepo/feeders, please wait..... --------------------- Zip generated in 8s - zip file : /results/ds-idrepo/feeders.tar.gz Finished without any error in 29s. 2024-04-13 22:58:01,261 INFO ________________________________________________________________________________ [2024-04-13 22:58:01] MakeFeeders_ds-idrepo show_stderr : Display stderr order ________________________________________________________________________________ 2024-04-13 22:58:01,262 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/05_Data_Init/02_MakeFeeders_ds-idrepo/stderr.txt is small (0 lines), printing all lines: 2024-04-13 22:58:01,262 DEBUG ----- output ----- 2024-04-13 22:58:01,262 DEBUG 2024-04-13 22:58:01,262 INFO ________________________________________________________________________________ [2024-04-13 22:58:01] MakeFeeders_ds-idrepo check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-04-13 22:58:01] MakeFeeders_ds-idrepo print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-04-13 22:58:01] MakeFeeders_ds-idrepo post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped