--Task-- name: DSPrimeTask_ds_idrepo_1 enabled: True class_name: DSSearchRateTask source_name: overseer-0 source_namespace: >default< target_name: ds-idrepo-1 target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: ['DSPrimeTask_ds_idrepo_0'] wait_for: [] preceding_task: None options: {'_options_': "--noRebind --warmUpDuration 10 --numConnections 1 --numConcurrentRequests 10 --baseDn 'ou=people,ou=identities' --maxIterations 1000000 --argument 'inc(0, 1000000)'"} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-04-11 01:45:21] DSPrimeTask_ds_idrepo_1 pre : N/A ________________________________________________________________________________ [2024-04-11 01:45:21] - INFO: target component (ds-idrepo-1) is a DS pod [2024-04-11 01:45:21] - INFO: Timeout for this Task has changed to 59s (-1 seconds) [2024-04-11 01:45:21] - INFO: timeout was set to unlimited, because it was unset Pod log file : /results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt Pod log : /results/orders/DSPrimeTask_ds_idrepo_1 ________________________________________________________________________________ [2024-04-11 01:45:21] DSPrimeTask_ds_idrepo_1 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ /lodestar/clients/ds/bin/searchrate --maxDuration 1 --bindPassword "BeqxyXdenFnTwBIdWkspvdilgvkC12cq" --bindDn "uid=admin" --trustAll --useStartTls --port 1389 --statInterval 120 --noPropertiesFile --hostname 'ds-idrepo-1.ds-idrepo' --noRebind --warmUpDuration 10 --numConnections 1 --numConcurrentRequests 10 --baseDn 'ou=people,ou=identities' --maxIterations 1000000 --argument 'inc(0, 1000000)' '(uid=user.{})' ________________________________________________________________________________ [2024-04-11 01:45:21] DSPrimeTask_ds_idrepo_1 create_order : Create order for overseer with the command to run ________________________________________________________________________________ Order file: /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/order.json { "name": "DSPrimeTask_ds_idrepo_1", "command": "/lodestar/clients/ds/bin/searchrate --maxDuration 1 --bindPassword **** --bindDn \"uid=admin\" --trustAll --useStartTls --port 1389 --statInterval 120 --noPropertiesFile --hostname 'ds-idrepo-1.ds-idrepo' --noRebind --warmUpDuration 10 --numConnections 1 --numConcurrentRequests 10 --baseDn 'ou=people,ou=identities' --maxIterations 1000000 --argument 'inc(0, 1000000)' '(uid=user.{})'", "out-dir": "/results/orders/DSPrimeTask_ds_idrepo_1" } ________________________________________________________________________________ [2024-04-11 01:45:21] DSPrimeTask_ds_idrepo_1 loop_until_ready : Wait for preceding task to finish if it uses same Overseer as a source, then loop for max_time until Overseer pod status is READY to accept order :param max_time: periodically check overseer status for this many seconds at maximum :param interval: interval between two periodical checks :return: ________________________________________________________________________________ 2024-04-11 01:45:21,964 INFO 2024-04-11 01:45:21,964 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-04-11 01:45:21,964 INFO [loop_until]: (max_time=300, interval=5, expected_rc=[0] 2024-04-11 01:45:22,202 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-11 01:45:22,202 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:45:22,202 DEBUG --- stdout --- 2024-04-11 01:45:22,203 DEBUG WAITING 2024-04-11 01:45:22,203 DEBUG --- stderr --- 2024-04-11 01:45:22,203 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 33 0 --:--:-- --:--:-- --:--:-- 33 ________________________________________________________________________________ [2024-04-11 01:45:22] DSPrimeTask_ds_idrepo_1 start_order : Send the order to the overseer pod ________________________________________________________________________________ 2024-04-11 01:45:22,203 INFO 2024-04-11 01:45:22,203 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:45:22,203 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:45:22,527 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:45:22,527 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:45:22,527 DEBUG --- stdout --- 2024-04-11 01:45:22,527 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:45:22,527 DEBUG --- stderr --- 2024-04-11 01:45:22,527 DEBUG 2024-04-11 01:45:22,527 INFO 2024-04-11 01:45:22,527 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/order.json overseer-0-78845f4f8c-v2r2q:/results/orders/order.json 2024-04-11 01:45:22,528 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-11 01:45:23,950 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:45:23,950 DEBUG --- stdout --- 2024-04-11 01:45:23,950 DEBUG 2024-04-11 01:45:23,950 DEBUG --- stderr --- 2024-04-11 01:45:23,950 DEBUG Order has been successfully forwarded to overseer ________________________________________________________________________________ [2024-04-11 01:45:23] DSPrimeTask_ds_idrepo_1 wait_stop_by_itself : Wait for the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 59s Waiting for status (curl --fail --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt) == WAITING PASS : Order stopped by itself after 2m and before timeout (59s) ________________________________________________________________________________ [2024-04-11 01:47:24] DSPrimeTask_ds_idrepo_1 stop_order : Stop the order on overseer pod ________________________________________________________________________________ 2024-04-11 01:47:24,227 INFO 2024-04-11 01:47:24,227 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:24,227 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:24,574 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:24,574 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:24,574 DEBUG --- stdout --- 2024-04-11 01:47:24,574 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:24,574 DEBUG --- stderr --- 2024-04-11 01:47:24,574 DEBUG 2024-04-11 01:47:24,574 INFO 2024-04-11 01:47:24,574 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q -- rm -f /results/orders/order.json 2024-04-11 01:47:24,575 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-11 01:47:25,383 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:25,384 DEBUG --- stdout --- 2024-04-11 01:47:25,384 DEBUG 2024-04-11 01:47:25,384 DEBUG --- stderr --- 2024-04-11 01:47:25,384 DEBUG Order ran during 2m 01s ________________________________________________________________________________ [2024-04-11 01:47:25] DSPrimeTask_ds_idrepo_1 download_logs : Download individual order files ________________________________________________________________________________ [2024-04-11 01:47:25] - PASS: file already downloaded /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/order.json 2024-04-11 01:47:25,385 INFO 2024-04-11 01:47:25,385 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:25,385 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:25,690 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:25,690 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:25,690 DEBUG --- stdout --- 2024-04-11 01:47:25,691 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:25,691 DEBUG --- stderr --- 2024-04-11 01:47:25,691 DEBUG Checking pod: overseer-0-78845f4f8c-v2r2q for file exists, if not wait. 2024-04-11 01:47:25,691 INFO 2024-04-11 01:47:25,691 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:25,691 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:26,000 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:26,000 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:26,000 DEBUG --- stdout --- 2024-04-11 01:47:26,000 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:26,001 DEBUG --- stderr --- 2024-04-11 01:47:26,001 DEBUG 2024-04-11 01:47:26,001 INFO 2024-04-11 01:47:26,001 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q --stdin -- bash -c 'if [ -f "/results/orders/DSPrimeTask_ds_idrepo_1/rc.txt" ]; then echo "/results/orders/DSPrimeTask_ds_idrepo_1/rc.txt file found"; exit 0; else echo "/results/orders/DSPrimeTask_ds_idrepo_1/rc.txt file not found"; exit 1; fi' | grep "/results/orders/DSPrimeTask_ds_idrepo_1/rc.txt file found" 2024-04-11 01:47:26,001 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-11 01:47:26,816 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-11 01:47:26,816 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:26,816 DEBUG --- stdout --- 2024-04-11 01:47:26,816 DEBUG /results/orders/DSPrimeTask_ds_idrepo_1/rc.txt file found 2024-04-11 01:47:26,816 DEBUG --- stderr --- 2024-04-11 01:47:26,816 DEBUG 2024-04-11 01:47:26,816 INFO 2024-04-11 01:47:26,816 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:26,816 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:27,117 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:27,118 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:27,118 DEBUG --- stdout --- 2024-04-11 01:47:27,118 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:27,118 DEBUG --- stderr --- 2024-04-11 01:47:27,118 DEBUG 2024-04-11 01:47:27,118 INFO 2024-04-11 01:47:27,118 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q --stdin -- du -k /results/orders/DSPrimeTask_ds_idrepo_1/rc.txt 2024-04-11 01:47:27,936 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-11 01:47:27,936 DEBUG --- stdout --- 2024-04-11 01:47:27,937 DEBUG 4 /results/orders/DSPrimeTask_ds_idrepo_1/rc.txt 2024-04-11 01:47:27,937 DEBUG --- stderr --- 2024-04-11 01:47:27,937 DEBUG 2024-04-11 01:47:27,937 INFO - Download file (size 4k) 2024-04-11 01:47:27,937 INFO 2024-04-11 01:47:27,937 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:27,937 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:28,240 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:28,240 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:28,240 DEBUG --- stdout --- 2024-04-11 01:47:28,240 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:28,240 DEBUG --- stderr --- 2024-04-11 01:47:28,240 DEBUG source : /results/orders/DSPrimeTask_ds_idrepo_1/rc.txt @ overseer-0-78845f4f8c-v2r2q destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/rc.txt 2024-04-11 01:47:28,241 INFO 2024-04-11 01:47:28,241 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:28,241 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:28,555 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:28,555 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:28,555 DEBUG --- stdout --- 2024-04-11 01:47:28,555 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:28,555 DEBUG --- stderr --- 2024-04-11 01:47:28,555 DEBUG 2024-04-11 01:47:28,556 INFO 2024-04-11 01:47:28,556 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-78845f4f8c-v2r2q:/results/orders/DSPrimeTask_ds_idrepo_1/rc.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/rc.txt 2024-04-11 01:47:28,556 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-11 01:47:29,363 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:29,363 DEBUG --- stdout --- 2024-04-11 01:47:29,363 DEBUG tar: Removing leading `/' from member names 2024-04-11 01:47:29,363 DEBUG --- stderr --- 2024-04-11 01:47:29,363 DEBUG 2024-04-11 01:47:29,363 INFO 2024-04-11 01:47:29,364 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:29,364 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:29,669 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:29,669 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:29,669 DEBUG --- stdout --- 2024-04-11 01:47:29,669 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:29,669 DEBUG --- stderr --- 2024-04-11 01:47:29,670 DEBUG Checking pod: overseer-0-78845f4f8c-v2r2q for file exists, if not wait. 2024-04-11 01:47:29,670 INFO 2024-04-11 01:47:29,670 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:29,670 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:29,976 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:29,977 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:29,977 DEBUG --- stdout --- 2024-04-11 01:47:29,977 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:29,977 DEBUG --- stderr --- 2024-04-11 01:47:29,977 DEBUG 2024-04-11 01:47:29,977 INFO 2024-04-11 01:47:29,977 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q --stdin -- bash -c 'if [ -f "/results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt" ]; then echo "/results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt file found"; exit 0; else echo "/results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt file not found"; exit 1; fi' | grep "/results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt file found" 2024-04-11 01:47:29,977 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-11 01:47:30,813 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-11 01:47:30,813 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:30,813 DEBUG --- stdout --- 2024-04-11 01:47:30,813 DEBUG /results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt file found 2024-04-11 01:47:30,813 DEBUG --- stderr --- 2024-04-11 01:47:30,813 DEBUG 2024-04-11 01:47:30,813 INFO 2024-04-11 01:47:30,813 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:30,813 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:31,135 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:31,136 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:31,136 DEBUG --- stdout --- 2024-04-11 01:47:31,136 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:31,136 DEBUG --- stderr --- 2024-04-11 01:47:31,136 DEBUG 2024-04-11 01:47:31,136 INFO 2024-04-11 01:47:31,136 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q --stdin -- du -k /results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt 2024-04-11 01:47:31,989 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-11 01:47:31,991 DEBUG --- stdout --- 2024-04-11 01:47:31,991 DEBUG 0 /results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt 2024-04-11 01:47:31,991 DEBUG --- stderr --- 2024-04-11 01:47:31,991 DEBUG 2024-04-11 01:47:31,991 INFO - Download file (size 0k) 2024-04-11 01:47:31,992 INFO 2024-04-11 01:47:31,992 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:31,992 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:32,358 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:32,359 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:32,359 DEBUG --- stdout --- 2024-04-11 01:47:32,359 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:32,359 DEBUG --- stderr --- 2024-04-11 01:47:32,359 DEBUG source : /results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt @ overseer-0-78845f4f8c-v2r2q destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/stderr.txt 2024-04-11 01:47:32,360 INFO 2024-04-11 01:47:32,360 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:32,360 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:32,708 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:32,708 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:32,708 DEBUG --- stdout --- 2024-04-11 01:47:32,708 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:32,710 DEBUG --- stderr --- 2024-04-11 01:47:32,710 DEBUG 2024-04-11 01:47:32,710 INFO 2024-04-11 01:47:32,710 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-78845f4f8c-v2r2q:/results/orders/DSPrimeTask_ds_idrepo_1/stderr.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/stderr.txt 2024-04-11 01:47:32,710 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-11 01:47:33,474 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:33,474 DEBUG --- stdout --- 2024-04-11 01:47:33,474 DEBUG tar: Removing leading `/' from member names 2024-04-11 01:47:33,474 DEBUG --- stderr --- 2024-04-11 01:47:33,474 DEBUG 2024-04-11 01:47:33,475 INFO 2024-04-11 01:47:33,475 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:33,475 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:33,802 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:33,802 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:33,802 DEBUG --- stdout --- 2024-04-11 01:47:33,802 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:33,802 DEBUG --- stderr --- 2024-04-11 01:47:33,802 DEBUG Checking pod: overseer-0-78845f4f8c-v2r2q for file exists, if not wait. 2024-04-11 01:47:33,803 INFO 2024-04-11 01:47:33,803 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:33,803 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:34,127 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:34,127 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:34,127 DEBUG --- stdout --- 2024-04-11 01:47:34,127 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:34,127 DEBUG --- stderr --- 2024-04-11 01:47:34,127 DEBUG 2024-04-11 01:47:34,128 INFO 2024-04-11 01:47:34,128 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q --stdin -- bash -c 'if [ -f "/results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt" ]; then echo "/results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt file found"; exit 0; else echo "/results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt file not found"; exit 1; fi' | grep "/results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt file found" 2024-04-11 01:47:34,128 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-11 01:47:34,973 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-11 01:47:34,973 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:34,973 DEBUG --- stdout --- 2024-04-11 01:47:34,973 DEBUG /results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt file found 2024-04-11 01:47:34,973 DEBUG --- stderr --- 2024-04-11 01:47:34,973 DEBUG 2024-04-11 01:47:34,974 INFO 2024-04-11 01:47:34,974 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:34,974 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:35,288 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:35,288 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:35,288 DEBUG --- stdout --- 2024-04-11 01:47:35,288 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:35,288 DEBUG --- stderr --- 2024-04-11 01:47:35,288 DEBUG 2024-04-11 01:47:35,288 INFO 2024-04-11 01:47:35,289 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q --stdin -- du -k /results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt 2024-04-11 01:47:36,122 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-11 01:47:36,123 DEBUG --- stdout --- 2024-04-11 01:47:36,123 DEBUG 4 /results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt 2024-04-11 01:47:36,123 DEBUG --- stderr --- 2024-04-11 01:47:36,123 DEBUG 2024-04-11 01:47:36,123 INFO - Download file (size 4k) 2024-04-11 01:47:36,124 INFO 2024-04-11 01:47:36,124 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:36,124 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:36,472 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:36,473 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:36,473 DEBUG --- stdout --- 2024-04-11 01:47:36,473 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:36,473 DEBUG --- stderr --- 2024-04-11 01:47:36,473 DEBUG source : /results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt @ overseer-0-78845f4f8c-v2r2q destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/stdout.txt 2024-04-11 01:47:36,473 INFO 2024-04-11 01:47:36,473 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:36,473 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:36,835 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:36,835 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:36,835 DEBUG --- stdout --- 2024-04-11 01:47:36,835 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:36,835 DEBUG --- stderr --- 2024-04-11 01:47:36,835 DEBUG 2024-04-11 01:47:36,835 INFO 2024-04-11 01:47:36,835 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-78845f4f8c-v2r2q:/results/orders/DSPrimeTask_ds_idrepo_1/stdout.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/stdout.txt 2024-04-11 01:47:36,835 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-11 01:47:37,581 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:37,582 DEBUG --- stdout --- 2024-04-11 01:47:37,582 DEBUG tar: Removing leading `/' from member names 2024-04-11 01:47:37,582 DEBUG --- stderr --- 2024-04-11 01:47:37,582 DEBUG ________________________________________________________________________________ [2024-04-11 01:47:37] DSPrimeTask_ds_idrepo_1 show_cmd : Display order command ________________________________________________________________________________ 2024-04-11 01:47:37,583 INFO 2024-04-11 01:47:37,583 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:37,583 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:37,930 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:37,930 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:37,930 DEBUG --- stdout --- 2024-04-11 01:47:37,930 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:37,930 DEBUG --- stderr --- 2024-04-11 01:47:37,930 DEBUG Checking pod: overseer-0-78845f4f8c-v2r2q for file exists, if not wait. 2024-04-11 01:47:37,931 INFO 2024-04-11 01:47:37,931 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:37,931 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:38,323 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:38,324 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:38,324 DEBUG --- stdout --- 2024-04-11 01:47:38,324 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:38,324 DEBUG --- stderr --- 2024-04-11 01:47:38,324 DEBUG 2024-04-11 01:47:38,325 INFO 2024-04-11 01:47:38,325 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q --stdin -- bash -c 'if [ -f "/results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt" ]; then echo "/results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt file found"; exit 0; else echo "/results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt file not found"; exit 1; fi' | grep "/results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt file found" 2024-04-11 01:47:38,325 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-11 01:47:39,203 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-11 01:47:39,203 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:39,203 DEBUG --- stdout --- 2024-04-11 01:47:39,203 DEBUG /results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt file found 2024-04-11 01:47:39,203 DEBUG --- stderr --- 2024-04-11 01:47:39,203 DEBUG 2024-04-11 01:47:39,203 INFO 2024-04-11 01:47:39,203 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:39,203 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:39,509 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:39,509 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:39,509 DEBUG --- stdout --- 2024-04-11 01:47:39,509 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:39,509 DEBUG --- stderr --- 2024-04-11 01:47:39,509 DEBUG 2024-04-11 01:47:39,509 INFO 2024-04-11 01:47:39,510 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-78845f4f8c-v2r2q --stdin -- du -k /results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt 2024-04-11 01:47:40,344 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-11 01:47:40,344 DEBUG --- stdout --- 2024-04-11 01:47:40,344 DEBUG 4 /results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt 2024-04-11 01:47:40,345 DEBUG --- stderr --- 2024-04-11 01:47:40,345 DEBUG 2024-04-11 01:47:40,345 INFO - Download file (size 4k) 2024-04-11 01:47:40,345 INFO 2024-04-11 01:47:40,345 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:40,345 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:40,653 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:40,653 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:40,653 DEBUG --- stdout --- 2024-04-11 01:47:40,653 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:40,653 DEBUG --- stderr --- 2024-04-11 01:47:40,653 DEBUG source : /results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt @ overseer-0-78845f4f8c-v2r2q destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/cmd.txt 2024-04-11 01:47:40,653 INFO 2024-04-11 01:47:40,653 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-11 01:47:40,653 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-11 01:47:40,959 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-11 01:47:40,960 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:40,960 DEBUG --- stdout --- 2024-04-11 01:47:40,960 DEBUG overseer-0-78845f4f8c-v2r2q 2024-04-11 01:47:40,960 DEBUG --- stderr --- 2024-04-11 01:47:40,960 DEBUG 2024-04-11 01:47:40,960 INFO 2024-04-11 01:47:40,960 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp --retries=100 overseer-0-78845f4f8c-v2r2q:/results/orders/DSPrimeTask_ds_idrepo_1/cmd.txt /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/cmd.txt 2024-04-11 01:47:40,960 INFO [loop_until]: (max_time=-1, interval=5, expected_rc=[0] 2024-04-11 01:47:41,713 INFO [loop_until]: OK (rc = 0) 2024-04-11 01:47:41,713 DEBUG --- stdout --- 2024-04-11 01:47:41,714 DEBUG tar: Removing leading `/' from member names 2024-04-11 01:47:41,714 DEBUG --- stderr --- 2024-04-11 01:47:41,714 DEBUG 2024-04-11 01:47:41,715 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/cmd.txt is small (1 lines), printing all lines: 2024-04-11 01:47:41,715 DEBUG ----- output ----- 2024-04-11 01:47:41,715 DEBUG /lodestar/clients/ds/bin/searchrate --maxDuration 1 --bindPassword "BeqxyXdenFnTwBIdWkspvdilgvkC12cq" --bindDn "uid=admin" --trustAll --useStartTls --port 1389 --statInterval 120 --noPropertiesFile --hostname 'ds-idrepo-1.ds-idrepo' --noRebind --warmUpDuration 10 --numConnections 1 --numConcurrentRequests 10 --baseDn 'ou=people,ou=identities' --maxIterations 1000000 --argument 'inc(0, 1000000)' '(uid=user.{})' 2024-04-11 01:47:41,715 INFO ________________________________________________________________________________ [2024-04-11 01:47:41] DSPrimeTask_ds_idrepo_1 show_rc : Display rc order ________________________________________________________________________________ 2024-04-11 01:47:41,716 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/rc.txt is small (1 lines), printing all lines: 2024-04-11 01:47:41,716 DEBUG ----- output ----- 2024-04-11 01:47:41,716 DEBUG CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) 2024-04-11 01:47:41,716 INFO ________________________________________________________________________________ [2024-04-11 01:47:41] DSPrimeTask_ds_idrepo_1 show_stdout : Display stdout order ________________________________________________________________________________ 2024-04-11 01:47:41,717 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/stdout.txt is small (7 lines), printing all lines: 2024-04-11 01:47:41,717 DEBUG ----- output ----- 2024-04-11 01:47:41,717 DEBUG Warming up for 10 seconds... -------------------------------------------------------------------------------------------- | Throughput | Response Time | Additional | | (ops/second) | (milliseconds) | Statistics | | recent average | recent average 99.9% 99.99% 99.999% | err/sec Entries/Srch | -------------------------------------------------------------------------------------------- | 0.0 0.0 | - - 10.88 11.40 11.40 | 0.0 - | 2024-04-11 01:47:41,717 INFO ________________________________________________________________________________ [2024-04-11 01:47:41] DSPrimeTask_ds_idrepo_1 show_stderr : Display stderr order ________________________________________________________________________________ 2024-04-11 01:47:41,718 DEBUG [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/06_Validation/03_DSPrimeTask_ds_idrepo_1/stderr.txt is small (0 lines), printing all lines: 2024-04-11 01:47:41,718 DEBUG ----- output ----- 2024-04-11 01:47:41,718 DEBUG 2024-04-11 01:47:41,718 INFO ________________________________________________________________________________ [2024-04-11 01:47:41] DSPrimeTask_ds_idrepo_1 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [2024-04-11 01:47:41] DSPrimeTask_ds_idrepo_1 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [2024-04-11 01:47:41] DSPrimeTask_ds_idrepo_1 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped