--Task-- name: make-and-import-users enabled: True class_name: MakeUsersTask source_name: overseer-0 source_namespace: >default< target_name: rcs_ds-idrepo target_namespace: rcs start: 0.0 stop: None timeout: 1d (86400 seconds) loop: False interval: None dependencies: ['cleanup'] wait_for: ['Pre-check Num Users'] preceding_task: None options: {'ldif_file': '/results/users.ldif', 'out_dir': '/results/ds-idrepo', 'add_rcs_note': True} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock ________________________________________________________________________________ [2024-12-17 17:51:52] make-and-import-users pre : N/A ________________________________________________________________________________ source (overseer-0) is a component 2024-12-17 17:51:52 - INFO: Note seed-via-ldif mode is native-mode ________________________________________________________________________________ [2024-12-17 17:51:52] make-and-import-users step1 : Generate ldif template ________________________________________________________________________________ location : /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_idm_recon/shared/ds-idrepo.template ------------ # identities to import into remote DJ behind RCS for IDM recon # NOTE: # structure of identities in this LDIF is the same as for direct import into ds-idrepo to reuse PyRock code define suffix=ou=identities define maildomain=example.com define numusers=200000000 branch: [suffix] objectClass: top objectClass: organizationalUnit branch: ou=Groups,[suffix] objectClass: top objectClass: organizationalUnit branch: ou=People,[suffix] objectClass: top objectClass: organizationalUnit subordinateTemplate: person:[numusers] template: person rdnAttr: fr-idm-uuid objectClass: top objectClass: person objectClass: organizationalPerson objectClass: inetOrgPerson objectClass: iplanet-am-user-service objectClass: devicePrintProfilesContainer objectClass: kbaInfoContainer objectClass: fr-idm-managed-user-explicit objectClass: forgerock-am-dashboard-service objectClass: inetuser objectClass: iplanet-am-auth-configuration-service objectClass: iplanet-am-managed-person objectClass: iPlanetPreferences objectClass: oathDeviceProfilesContainer objectClass: pushDeviceProfilesContainer objectClass: sunAMAuthAccountLockout objectClass: sunFMSAML2NameIdentifier objectClass: webauthnDeviceProfilesContainer fr-idm-uuid: givenName: sn: cn: {givenName} {sn} description: This is the description for {cn}. inetUserStatus: active uid: user. mail: {uid}@[maildomain] telephoneNumber: userPassword: T35!tr0c-k123 ------------ ________________________________________________________________________________ [2024-12-17 17:51:52] make-and-import-users step2 : Create folder on overseer ________________________________________________________________________________ 2024-12-17 17:51:52,092 INFO 2024-12-17 17:51:52,092 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-9sbfx -- mkdir -p /results/ds-idrepo/template 2024-12-17 17:51:52,092 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-12-17 17:51:52,808 INFO [loop_until]: OK (rc = 0) 2024-12-17 17:51:52,808 DEBUG --- stdout --- 2024-12-17 17:51:52,808 DEBUG 2024-12-17 17:51:52,809 DEBUG --- stderr --- 2024-12-17 17:51:52,809 DEBUG 2024-12-17 17:51:52,809 INFO 2024-12-17 17:51:52,809 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/shared/config/custom/iga/manager_ids.txt overseer-0-5865b977f-9sbfx:/results/ds-idrepo/template 2024-12-17 17:51:52,809 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-12-17 17:51:54,214 INFO [loop_until]: OK (rc = 0) 2024-12-17 17:51:54,214 DEBUG --- stdout --- 2024-12-17 17:51:54,214 DEBUG 2024-12-17 17:51:54,214 DEBUG --- stderr --- 2024-12-17 17:51:54,214 DEBUG ________________________________________________________________________________ [2024-12-17 17:51:54] make-and-import-users step3 : Copy template to overseer ________________________________________________________________________________ 2024-12-17 17:51:54,215 INFO 2024-12-17 17:51:54,215 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /mnt/disk1/xslou/workshop/lodestar-fork/results/pyrock/idc_idm_recon/shared/ds-idrepo.template overseer-0-5865b977f-9sbfx:/results/ds-idrepo/template 2024-12-17 17:51:54,215 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-12-17 17:51:55,549 INFO [loop_until]: OK (rc = 0) 2024-12-17 17:51:55,549 DEBUG --- stdout --- 2024-12-17 17:51:55,549 DEBUG 2024-12-17 17:51:55,549 DEBUG --- stderr --- 2024-12-17 17:51:55,549 DEBUG ________________________________________________________________________________ [2024-12-17 17:51:55] make-and-import-users step4 : Make sure overseer is not busy ________________________________________________________________________________ 2024-12-17 17:51:55,550 INFO 2024-12-17 17:51:55,550 INFO [loop_until]: curl --insecure https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com/orders/status.txt | grep "WAITING" 2024-12-17 17:51:55,550 INFO [loop_until]: (max_time=120, interval=5, expected_rc=[0] 2024-12-17 17:51:55,836 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-12-17 17:51:55,836 INFO [loop_until]: OK (rc = 0) 2024-12-17 17:51:55,836 DEBUG --- stdout --- 2024-12-17 17:51:55,836 DEBUG WAITING 2024-12-17 17:51:55,836 DEBUG --- stderr --- 2024-12-17 17:51:55,836 DEBUG % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7 100 7 0 0 25 0 --:--:-- --:--:-- --:--:-- 25 ________________________________________________________________________________ [2024-12-17 17:51:55] make-and-import-users step5 : Generate ldif file on overseer ________________________________________________________________________________ 2024-12-17 17:51:55,837 INFO 2024-12-17 17:51:55,837 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-9sbfx -- /lodestar/clients/ds/bin/makeldif --outputLdif /results/users.ldif /results/ds-idrepo/template/ds-idrepo.template 2024-12-17 17:51:55,837 INFO [loop_until]: (max_time=86400, interval=5, expected_rc=[0] 2024-12-17 18:41:28,960 INFO [loop_until]: OK (rc = 0) 2024-12-17 18:41:28,960 DEBUG --- stdout --- 2024-12-17 18:41:28,981 DEBUG [print_head_tail]: Print head (100 lines) and tail (100 lines) of input string (200001 lines): 2024-12-17 18:41:28,981 DEBUG ----- output ----- 2024-12-17 18:41:28,981 DEBUG Processed 1000 entries 2024-12-17 18:41:28,981 DEBUG Processed 2000 entries 2024-12-17 18:41:28,982 DEBUG Processed 3000 entries 2024-12-17 18:41:28,982 DEBUG Processed 4000 entries 2024-12-17 18:41:28,982 DEBUG Processed 5000 entries 2024-12-17 18:41:28,982 DEBUG Processed 6000 entries 2024-12-17 18:41:28,982 DEBUG Processed 7000 entries 2024-12-17 18:41:28,982 DEBUG Processed 8000 entries 2024-12-17 18:41:28,982 DEBUG Processed 9000 entries 2024-12-17 18:41:28,982 DEBUG Processed 10000 entries 2024-12-17 18:41:28,982 DEBUG Processed 11000 entries 2024-12-17 18:41:28,982 DEBUG Processed 12000 entries 2024-12-17 18:41:28,982 DEBUG Processed 13000 entries 2024-12-17 18:41:28,982 DEBUG Processed 14000 entries 2024-12-17 18:41:28,982 DEBUG Processed 15000 entries 2024-12-17 18:41:28,982 DEBUG Processed 16000 entries 2024-12-17 18:41:28,982 DEBUG Processed 17000 entries 2024-12-17 18:41:28,982 DEBUG Processed 18000 entries 2024-12-17 18:41:28,982 DEBUG Processed 19000 entries 2024-12-17 18:41:28,982 DEBUG Processed 20000 entries 2024-12-17 18:41:28,982 DEBUG Processed 21000 entries 2024-12-17 18:41:28,982 DEBUG Processed 22000 entries 2024-12-17 18:41:28,982 DEBUG Processed 23000 entries 2024-12-17 18:41:28,982 DEBUG Processed 24000 entries 2024-12-17 18:41:28,982 DEBUG Processed 25000 entries 2024-12-17 18:41:28,982 DEBUG Processed 26000 entries 2024-12-17 18:41:28,982 DEBUG Processed 27000 entries 2024-12-17 18:41:28,982 DEBUG Processed 28000 entries 2024-12-17 18:41:28,982 DEBUG Processed 29000 entries 2024-12-17 18:41:28,982 DEBUG Processed 30000 entries 2024-12-17 18:41:28,982 DEBUG Processed 31000 entries 2024-12-17 18:41:28,982 DEBUG Processed 32000 entries 2024-12-17 18:41:28,982 DEBUG Processed 33000 entries 2024-12-17 18:41:28,982 DEBUG Processed 34000 entries 2024-12-17 18:41:28,982 DEBUG Processed 35000 entries 2024-12-17 18:41:28,982 DEBUG Processed 36000 entries 2024-12-17 18:41:28,982 DEBUG Processed 37000 entries 2024-12-17 18:41:28,982 DEBUG Processed 38000 entries 2024-12-17 18:41:28,982 DEBUG Processed 39000 entries 2024-12-17 18:41:28,982 DEBUG Processed 40000 entries 2024-12-17 18:41:28,982 DEBUG Processed 41000 entries 2024-12-17 18:41:28,982 DEBUG Processed 42000 entries 2024-12-17 18:41:28,982 DEBUG Processed 43000 entries 2024-12-17 18:41:28,982 DEBUG Processed 44000 entries 2024-12-17 18:41:28,982 DEBUG Processed 45000 entries 2024-12-17 18:41:28,982 DEBUG Processed 46000 entries 2024-12-17 18:41:28,982 DEBUG Processed 47000 entries 2024-12-17 18:41:28,982 DEBUG Processed 48000 entries 2024-12-17 18:41:28,982 DEBUG Processed 49000 entries 2024-12-17 18:41:28,982 DEBUG Processed 50000 entries 2024-12-17 18:41:28,982 DEBUG Processed 51000 entries 2024-12-17 18:41:28,982 DEBUG Processed 52000 entries 2024-12-17 18:41:28,982 DEBUG Processed 53000 entries 2024-12-17 18:41:28,982 DEBUG Processed 54000 entries 2024-12-17 18:41:28,982 DEBUG Processed 55000 entries 2024-12-17 18:41:28,982 DEBUG Processed 56000 entries 2024-12-17 18:41:28,982 DEBUG Processed 57000 entries 2024-12-17 18:41:28,982 DEBUG Processed 58000 entries 2024-12-17 18:41:28,982 DEBUG Processed 59000 entries 2024-12-17 18:41:28,982 DEBUG Processed 60000 entries 2024-12-17 18:41:28,982 DEBUG Processed 61000 entries 2024-12-17 18:41:28,982 DEBUG Processed 62000 entries 2024-12-17 18:41:28,982 DEBUG Processed 63000 entries 2024-12-17 18:41:28,982 DEBUG Processed 64000 entries 2024-12-17 18:41:28,982 DEBUG Processed 65000 entries 2024-12-17 18:41:28,982 DEBUG Processed 66000 entries 2024-12-17 18:41:28,982 DEBUG Processed 67000 entries 2024-12-17 18:41:28,982 DEBUG Processed 68000 entries 2024-12-17 18:41:28,982 DEBUG Processed 69000 entries 2024-12-17 18:41:28,983 DEBUG Processed 70000 entries 2024-12-17 18:41:28,983 DEBUG Processed 71000 entries 2024-12-17 18:41:28,983 DEBUG Processed 72000 entries 2024-12-17 18:41:28,983 DEBUG Processed 73000 entries 2024-12-17 18:41:28,983 DEBUG Processed 74000 entries 2024-12-17 18:41:28,983 DEBUG Processed 75000 entries 2024-12-17 18:41:28,983 DEBUG Processed 76000 entries 2024-12-17 18:41:28,983 DEBUG Processed 77000 entries 2024-12-17 18:41:28,983 DEBUG Processed 78000 entries 2024-12-17 18:41:28,983 DEBUG Processed 79000 entries 2024-12-17 18:41:28,983 DEBUG Processed 80000 entries 2024-12-17 18:41:28,983 DEBUG Processed 81000 entries 2024-12-17 18:41:28,983 DEBUG Processed 82000 entries 2024-12-17 18:41:28,983 DEBUG Processed 83000 entries 2024-12-17 18:41:28,983 DEBUG Processed 84000 entries 2024-12-17 18:41:28,983 DEBUG Processed 85000 entries 2024-12-17 18:41:28,983 DEBUG Processed 86000 entries 2024-12-17 18:41:28,983 DEBUG Processed 87000 entries 2024-12-17 18:41:28,983 DEBUG Processed 88000 entries 2024-12-17 18:41:28,983 DEBUG Processed 89000 entries 2024-12-17 18:41:28,983 DEBUG Processed 90000 entries 2024-12-17 18:41:28,983 DEBUG Processed 91000 entries 2024-12-17 18:41:28,983 DEBUG Processed 92000 entries 2024-12-17 18:41:28,983 DEBUG Processed 93000 entries 2024-12-17 18:41:28,983 DEBUG Processed 94000 entries 2024-12-17 18:41:28,983 DEBUG Processed 95000 entries 2024-12-17 18:41:28,983 DEBUG Processed 96000 entries 2024-12-17 18:41:28,983 DEBUG Processed 97000 entries 2024-12-17 18:41:28,983 DEBUG Processed 98000 entries 2024-12-17 18:41:28,983 DEBUG Processed 99000 entries 2024-12-17 18:41:28,983 DEBUG Processed 100000 entries 2024-12-17 18:41:28,983 DEBUG 2024-12-17 18:41:28,983 DEBUG 2024-12-17 18:41:28,983 DEBUG 2024-12-17 18:41:28,983 DEBUG [...] 2024-12-17 18:41:28,983 DEBUG 2024-12-17 18:41:28,983 DEBUG 2024-12-17 18:41:28,983 DEBUG 2024-12-17 18:41:28,983 DEBUG Processed 199902000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199903000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199904000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199905000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199906000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199907000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199908000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199909000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199910000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199911000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199912000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199913000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199914000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199915000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199916000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199917000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199918000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199919000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199920000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199921000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199922000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199923000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199924000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199925000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199926000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199927000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199928000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199929000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199930000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199931000 entries 2024-12-17 18:41:28,983 DEBUG Processed 199932000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199933000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199934000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199935000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199936000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199937000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199938000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199939000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199940000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199941000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199942000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199943000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199944000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199945000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199946000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199947000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199948000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199949000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199950000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199951000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199952000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199953000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199954000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199955000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199956000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199957000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199958000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199959000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199960000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199961000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199962000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199963000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199964000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199965000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199966000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199967000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199968000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199969000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199970000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199971000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199972000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199973000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199974000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199975000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199976000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199977000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199978000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199979000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199980000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199981000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199982000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199983000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199984000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199985000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199986000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199987000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199988000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199989000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199990000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199991000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199992000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199993000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199994000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199995000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199996000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199997000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199998000 entries 2024-12-17 18:41:28,984 DEBUG Processed 199999000 entries 2024-12-17 18:41:28,984 DEBUG Processed 200000000 entries 2024-12-17 18:41:28,984 DEBUG LDIF processing complete. 200000003 entries written 2024-12-17 18:41:28,988 DEBUG --- stderr --- 2024-12-17 18:41:28,988 DEBUG ________________________________________________________________________________ [2024-12-17 18:41:28] make-and-import-users step6 : Import or add entries on ds-idrepo instance (pod) ________________________________________________________________________________ 2024-12-17 18:41:28 - INFO: Option seed-via-ldif is set hence using ldif import for data loading 2024-12-17 18:41:28,989 INFO 2024-12-17 18:41:28,989 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec overseer-0-5865b977f-9sbfx -- bash -c "perl -pe '$_ x=!! (/dn: fr-/ .. 1)' /results/users.ldif | gzip -c > /results/users.ldif.gz" 2024-12-17 18:41:28,989 INFO [loop_until]: (max_time=600, interval=5, expected_rc=[0] 2024-12-17 19:16:29,704 ERROR [loop_until]: Reach max timeout : max_time=10m 2024-12-17 19:16:29,704 DEBUG --- stdout --- 2024-12-17 19:16:29,704 DEBUG 2024-12-17 19:16:29,704 DEBUG --- stderr --- 2024-12-17 19:16:29,704 DEBUG 2024-12-17 19:16:29 - INFO: Traceback (most recent call last): File "/mnt/disk1/xslou/workshop/lodestar-fork/pyrock/lib/scheduler/tasks/Task.py", line 603, in run self._run() File "/mnt/disk1/xslou/workshop/lodestar-fork/pyrock/lib/scheduler/tasks/StepTask.py", line 54, in _run self._run_method(step) File "/mnt/disk1/xslou/workshop/lodestar-fork/pyrock/lib/scheduler/tasks/Task.py", line 644, in _run_method exec("self.%s()" % method) File "", line 1, in File "/mnt/disk1/xslou/workshop/lodestar-fork/pyrock/tasks/deployment/datainit.py", line 246, in step6 kubectl(args=cmd, max_time=600, component=self.source) File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/cloud_utils.py", line 107, in kubectl return __kubectl(args, namespace, no_loop=no_loop, output_file=output_file, expected_rc=expected_rc, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/cloud_utils.py", line 181, in __kubectl return cmd.loop_until(command, max_time=max_time, interval=interval, verbose=verbose, expected_rc=expected_rc, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/utils/cmd/cmd.py", line 578, in loop_until raise FailException(message=exception_message) shared.lib.utils.exception.FailException: [loop_until]: Reach max timeout : max_time=10m Setting result to FAIL Task has been successfully stopped