--Task-- name: MakeUsers_ds-idrepo enabled: True class_name: MakeUsersTask source_name: overseer-0 source_namespace: >default< target_name: ds-idrepo target_namespace: >default< start: 0 stop: None timeout: no timeout loop: False interval: None dependencies: [] wait_for: [] options: {'out_dir': '/results/ds-idrepo', 'ldif_file': '/results/ds-idrepo/user_entries.ldif', 'num_entries': 10000000} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [19/Apr/2023 12:19:42] MakeUsers_ds-idrepo pre : N/A ________________________________________________________________________________ source (overseer-0) is a component [19/Apr/2023 12:19:42] - INFO: Note seed-via-ldif mode is platform-mode ________________________________________________________________________________ [19/Apr/2023 12:19:42] MakeUsers_ds-idrepo step1 : Make sure overseer is not busy ________________________________________________________________________________ [loop_until]: curl -k https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" [loop_until]: (max_time=120, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- WAITING --- stderr --- % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 27 0 --:--:-- --:--:-- --:--:-- 27 ________________________________________________________________________________ [19/Apr/2023 12:19:42] MakeUsers_ds-idrepo step2 : Generate ldif template and process on overseer ________________________________________________________________________________ [19/Apr/2023 12:19:42] - INFO: Skipping this step. No ldif file will be generated via makeldif. ________________________________________________________________________________ [19/Apr/2023 12:19:42] MakeUsers_ds-idrepo step3 : Import or add entries on ds-idrepo instance (pod) ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /lodestar/pyrock/shared/scripts/idc/backup-restore && python3 /lodestar/pyrock/shared/scripts/idc/backup-restore/gen_platform_users.py --cdm --numusers 10000000 --out-dir /results/ds-idrepo --names-file /lodestar/pyrock/shared/scripts/idc/backup-restore/names.txt" [loop_until]: (max_time=1200, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /results/ds-idrepo && cat amIdentityStore.ldif | gzip -c > amIdentityStore.ldif.gz" [loop_until]: (max_time=600, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /results/ds-idrepo && cat idmRepo.ldif | gzip -c > idmRepo.ldif.gz" [loop_until]: (max_time=600, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "ln -s amIdentityStore.ldif /results/ds-idrepo/user_entries.ldif" [loop_until]: (max_time=600, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /results/ds-idrepo && kubectl -n xlou cp -c ds amIdentityStore.ldif.gz ds-idrepo-0:/opt/opendj/data" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /results/ds-idrepo && kubectl -n xlou cp -c ds idmRepo.ldif.gz ds-idrepo-0:/opt/opendj/data" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /results/ds-idrepo && kubectl -n xlou cp -c ds amIdentityStore.ldif.gz ds-idrepo-1:/opt/opendj/data" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /results/ds-idrepo && kubectl -n xlou cp -c ds idmRepo.ldif.gz ds-idrepo-1:/opt/opendj/data" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /results/ds-idrepo && kubectl -n xlou cp -c ds amIdentityStore.ldif.gz ds-idrepo-2:/opt/opendj/data" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec overseer-0-75cdb64b9b-dx642 -- bash -c "cd /results/ds-idrepo && kubectl -n xlou cp -c ds idmRepo.ldif.gz ds-idrepo-2:/opt/opendj/data" [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [19/Apr/2023 12:33:53] - INFO: Calling import_ldif() in a thread. Check /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/05_Data_init/01_MakeUsers_ds-idrepo/datainit_thread.log for output [19/Apr/2023 12:33:53] - INFO: Calling import_ldif() in a thread. Check /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/05_Data_init/01_MakeUsers_ds-idrepo/datainit_thread.log for output [19/Apr/2023 12:33:53] - INFO: Calling import_ldif() in a thread. Check /mnt/disks/data/xslou/lodestar-fork/results/pyrock/platform/05_Data_init/01_MakeUsers_ds-idrepo/datainit_thread.log for output ________________________________________________________________________________ [19/Apr/2023 12:47:32] MakeUsers_ds-idrepo post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped