--Task-- name: DSPrimeTask_id_repo_2 enabled: True class_name: DSSearchRateTask source_name: overseer-0 source_namespace: >default< target_name: ds-idrepo-2 target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: ['DSPrimeTask_id_repo_1'] wait_for: [] options: {'_options_': "--noRebind --warmUpDuration 10 --maxDuration 300 --numConnections 64 --numConcurrentRequests 8 -b 'ou=people,ou=identities'"} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [20/Sep/2022 21:48:47] DSPrimeTask_id_repo_2 pre : N/A ________________________________________________________________________________ [20/Sep/2022 21:48:47] - INFO: target (ds-idrepo-2) is a ds pod [20/Sep/2022 21:48:47] - INFO: Timeout for this Task has changed to 59s (-1 seconds) Pod log file : /results/orders/DSPrimeTask_id_repo_2/stdout.txt Pod log : /results/orders/DSPrimeTask_id_repo_2 [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "eWQnSznAHi4gPsJ88mtzfKp1DPMslQux" -b "ds-mon-base-dn=ou=identities,ds-cfg-backend-id=amIdentityStore,cn=backends,cn=monitor" -s base "objectclass=*" ds-mon-base-dn-entry-count [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ds-mon-base-dn=ou=identities,ds-cfg-backend-id=amIdentityStore,cn=backends,cn=monitor ds-mon-base-dn-entry-count: 10000021 --- stderr --- ________________________________________________________________________________ [20/Sep/2022 21:48:49] DSPrimeTask_id_repo_2 print_command : Display the command to be forwarded to overseer as an order ________________________________________________________________________________ [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "eWQnSznAHi4gPsJ88mtzfKp1DPMslQux" -b "ds-mon-base-dn=ou=identities,ds-cfg-backend-id=amIdentityStore,cn=backends,cn=monitor" -s base "objectclass=*" ds-mon-base-dn-entry-count [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ds-mon-base-dn=ou=identities,ds-cfg-backend-id=amIdentityStore,cn=backends,cn=monitor ds-mon-base-dn-entry-count: 10000021 --- stderr --- /lodestar/clients/ds/bin/searchrate --noPropertiesFile -h ds-idrepo-2.ds-idrepo -w "eWQnSznAHi4gPsJ88mtzfKp1DPMslQux" -D "uid=admin" --trustAll --useStartTls -p 1389 -i 120 --noRebind --warmUpDuration 10 --maxDuration 300 --numConnections 64 --numConcurrentRequests 8 -b 'ou=people,ou=identities' -g 'rand(0,10000021)' '(uid=user.{})' ________________________________________________________________________________ [20/Sep/2022 21:48:51] DSPrimeTask_id_repo_2 create_order : Create order for overseer with the command to run ________________________________________________________________________________ [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "eWQnSznAHi4gPsJ88mtzfKp1DPMslQux" -b "ds-mon-base-dn=ou=identities,ds-cfg-backend-id=amIdentityStore,cn=backends,cn=monitor" -s base "objectclass=*" ds-mon-base-dn-entry-count [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ds-mon-base-dn=ou=identities,ds-cfg-backend-id=amIdentityStore,cn=backends,cn=monitor ds-mon-base-dn-entry-count: 10000021 --- stderr --- Order file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/order.json { "name": "DSPrimeTask_id_repo_2", "command": "/lodestar/clients/ds/bin/searchrate --noPropertiesFile -h ds-idrepo-2.ds-idrepo -w \"eWQnSznAHi4gPsJ88mtzfKp1DPMslQux\" -D \"uid=admin\" --trustAll --useStartTls -p 1389 -i 120 --noRebind --warmUpDuration 10 --maxDuration 300 --numConnections 64 --numConcurrentRequests 8 -b 'ou=people,ou=identities' -g 'rand(0,10000021)' '(uid=user.{})'", "out-dir": "/results/orders/DSPrimeTask_id_repo_2" } ________________________________________________________________________________ [20/Sep/2022 21:48:52] DSPrimeTask_id_repo_2 loop_until_ready : Loop until overseer pod is ready to accept order ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 30 0 --:--:-- --:--:-- --:--:-- 30 ________________________________________________________________________________ [20/Sep/2022 21:48:53] DSPrimeTask_id_repo_2 start_order : Send the order to the overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-95878b9d5-x62k6 --- stderr --- [loop_until]: kubectl --namespace=xlou cp /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/order.json overseer-0-95878b9d5-x62k6:/results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order has been successfully forwarded to overseer ________________________________________________________________________________ [20/Sep/2022 21:48:54] DSPrimeTask_id_repo_2 wait_stop_by_itself : Wait the order to stop by itself ________________________________________________________________________________ Task may stop by itself (no stop defined in configuration file), wait until overseer ends the order - timeout is 59s Run command curl --fail -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt And exit (continue) if status == WAITING Order is running since 2m, retry Order is running since 4m, retry PASS : Order stopped by itself after 6m 01s and before timeout (59s) ________________________________________________________________________________ [20/Sep/2022 21:54:56] DSPrimeTask_id_repo_2 stop_order : Stop the order on overseer pod ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-95878b9d5-x62k6 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-95878b9d5-x62k6 -- rm -f /results/orders/order.json [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- Order ran during 6m 02s ________________________________________________________________________________ [20/Sep/2022 21:54:57] DSPrimeTask_id_repo_2 download_logs : Download order.tar.gz ________________________________________________________________________________ [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-95878b9d5-x62k6 --- stderr --- Checking pod: overseer-0-95878b9d5-x62k6 for file exists, if not wait. [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-95878b9d5-x62k6 --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-95878b9d5-x62k6 -i -- bash -c 'if [ -f "/results/orders/DSPrimeTask_id_repo_2/order.tar.gz" ]; then echo "/results/orders/DSPrimeTask_id_repo_2/order.tar.gz file found"; exit 0; else echo "/results/orders/DSPrimeTask_id_repo_2/order.tar.gz file not found"; exit 1; fi' | grep "/results/orders/DSPrimeTask_id_repo_2/order.tar.gz file found" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- /results/orders/DSPrimeTask_id_repo_2/order.tar.gz file found --- stderr --- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-95878b9d5-x62k6 --- stderr --- [run_command]: kubectl --namespace=xlou exec overseer-0-95878b9d5-x62k6 -i -- du -k /results/orders/DSPrimeTask_id_repo_2/order.tar.gz [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- 4 /results/orders/DSPrimeTask_id_repo_2/order.tar.gz --- stderr --- - Download file (size 4k) [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-95878b9d5-x62k6 --- stderr --- source : /results/orders/DSPrimeTask_id_repo_2/order.tar.gz @ overseer-0-95878b9d5-x62k6 destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/order.tar.gz [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-95878b9d5-x62k6 --- stderr --- [loop_until]: kubectl --namespace=xlou cp overseer-0-95878b9d5-x62k6:/results/orders/DSPrimeTask_id_repo_2/order.tar.gz /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/order.tar.gz [loop_until]: (max_time=-1, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- tar: Removing leading `/' from member names --- stderr --- - Extract archive zip file : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/order.tar.gz destination : /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2 ________________________________________________________________________________ [20/Sep/2022 21:55:01] DSPrimeTask_id_repo_2 show_cmd : Display order command ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/cmd.txt is small (1 lines), printing all lines: ----- output ----- /lodestar/clients/ds/bin/searchrate --noPropertiesFile -h ds-idrepo-2.ds-idrepo -w "eWQnSznAHi4gPsJ88mtzfKp1DPMslQux" -D "uid=admin" --trustAll --useStartTls -p 1389 -i 120 --noRebind --warmUpDuration 10 --maxDuration 300 --numConnections 64 --numConcurrentRequests 8 -b 'ou=people,ou=identities' -g 'rand(0,10000021)' '(uid=user.{})' ________________________________________________________________________________ [20/Sep/2022 21:55:01] DSPrimeTask_id_repo_2 show_rc : Display rc order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/rc.txt is small (1 lines), printing all lines: ----- output ----- CMD SUCCESS: command returns code 0 (expected [0, -9, 143, 137, -15]) ________________________________________________________________________________ [20/Sep/2022 21:55:01] DSPrimeTask_id_repo_2 show_stdout : Display stdout order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/stdout.txt is small (9 lines), printing all lines: ----- output ----- Warming up for 10 seconds... -------------------------------------------------------------------------------------------- | Throughput | Response Time | Additional | | (ops/second) | (milliseconds) | Statistics | | recent average | recent average 99.9% 99.99% 99.999% | err/sec Entries/Srch | -------------------------------------------------------------------------------------------- | 30147.8 30147.8 | 16.985 16.985 130.02 154.14 181.40 | 0.0 1.0 | | 82421.7 56284.8 | 6.208 9.094 120.06 137.36 161.48 | 0.0 1.0 | | 82300.3 60769.7 | 6.220 8.423 117.96 134.22 160.43 | 0.0 1.0 | ________________________________________________________________________________ [20/Sep/2022 21:55:01] DSPrimeTask_id_repo_2 show_stderr : Display stderr order ________________________________________________________________________________ [print_head_tail]: Input file /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/04_Validation/05_DSPrimeTask_id_repo_2/stderr.txt is small (0 lines), printing all lines: ----- output ----- ________________________________________________________________________________ [20/Sep/2022 21:55:01] DSPrimeTask_id_repo_2 check_rc_and_logs : Check order's outputs ________________________________________________________________________________ PASS: no error found in rc log PASS: no error found in stdout log PASS: no error found in stderr log ________________________________________________________________________________ [20/Sep/2022 21:55:01] DSPrimeTask_id_repo_2 print_overseer_logs : Print overseer logs from the K8s pod ________________________________________________________________________________ Task result is INIT no need to display logs. ________________________________________________________________________________ [20/Sep/2022 21:55:01] DSPrimeTask_id_repo_2 post : Check output ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped