--Task--
name: Deploy_all_forgerock_components
enabled: True
class_name: DeployComponentsTask
source_name: controller
source_namespace: >default<
target_name: controller
target_namespace: >default<
start: 0.0
stop: None
timeout: no timeout
loop: False
interval: None
dependencies: ['Enable_prometheus_admin_api']
wait_for: []
preceding_task: None
options: {}
group_name: None
Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock
________________________________________________________________________________
[2024-04-11 01:16:20] Deploy_all_forgerock_components pre : Initialising task parameters
________________________________________________________________________________
task will be executed on controller (localhost)
________________________________________________________________________________
[2024-04-11 01:16:20] Deploy_all_forgerock_components step1 : Deploy components
________________________________________________________________________________
2024-04-11 01:16:20,825 INFO
2024-04-11 01:16:20,825 INFO ******************************** Cleaning up existing namespace ********************************
2024-04-11 01:16:21,141 INFO
2024-04-11 01:16:21,141 INFO ------------------ Deleting secret agent controller ------------------
2024-04-11 01:16:21,478 INFO
2024-04-11 01:16:21,478 INFO [loop_until]: kubectl --namespace=xlou delete sac --all
2024-04-11 01:16:21,478 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:16:22,088 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:16:22,088 DEBUG --- stdout ---
2024-04-11 01:16:22,088 DEBUG secretagentconfiguration.secret-agent.secrets.forgerock.io "forgerock-sac" deleted
2024-04-11 01:16:22,088 DEBUG --- stderr ---
2024-04-11 01:16:22,088 DEBUG
2024-04-11 01:16:22,088 INFO
2024-04-11 01:16:22,088 INFO ----------------------- Deleting all resources -----------------------
2024-04-11 01:16:22,088 INFO
2024-04-11 01:16:22,088 INFO [loop_until]: kubectl --namespace=xlou delete all --all --grace-period=0 --force
2024-04-11 01:16:22,088 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:16:33,394 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:16:33,395 DEBUG --- stdout ---
2024-04-11 01:16:33,395 DEBUG pod "admin-ui-c4c7bf584-gjk7g" force deleted
pod "am-5b5bd8567b-ckf7p" force deleted
pod "am-5b5bd8567b-td2qp" force deleted
pod "am-5b5bd8567b-wl5wj" force deleted
pod "amster-qsmbx" force deleted
pod "ds-cts-0" force deleted
pod "ds-cts-1" force deleted
pod "ds-cts-2" force deleted
pod "ds-idrepo-0" force deleted
pod "ds-idrepo-1" force deleted
pod "ds-idrepo-2" force deleted
pod "end-user-ui-58878d7668-fcgkh" force deleted
pod "idm-668d898cfd-rsd7v" force deleted
pod "idm-668d898cfd-srb2d" force deleted
pod "ldif-importer-7gcq2" force deleted
pod "lodemon-548c447fc7-gbhmp" force deleted
pod "login-ui-5fdf49fc66-chmjv" force deleted
pod "overseer-0-5457987c5d-4bcvs" force deleted
service "admin-ui" force deleted
service "am" force deleted
service "ds-cts" force deleted
service "ds-idrepo" force deleted
service "end-user-ui" force deleted
service "idm" force deleted
service "login-ui" force deleted
service "overseer-0" force deleted
deployment.apps "admin-ui" force deleted
deployment.apps "am" force deleted
deployment.apps "end-user-ui" force deleted
deployment.apps "idm" force deleted
deployment.apps "lodemon" force deleted
deployment.apps "login-ui" force deleted
deployment.apps "overseer-0" force deleted
statefulset.apps "ds-cts" force deleted
statefulset.apps "ds-idrepo" force deleted
job.batch "amster" force deleted
job.batch "ldif-importer" force deleted
2024-04-11 01:16:33,395 DEBUG --- stderr ---
2024-04-11 01:16:33,395 DEBUG Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
2024-04-11 01:16:33,395 INFO
2024-04-11 01:16:33,395 INFO [loop_until]: kubectl --namespace xlou get pods | grep "No resources found"
2024-04-11 01:16:33,395 INFO [loop_until]: (max_time=360, interval=10, expected_rc=[0]
2024-04-11 01:16:33,846 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:16:44,328 INFO [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:16:54,806 INFO [loop_until]: Function succeeded after 21s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:17:05,317 INFO [loop_until]: Function succeeded after 31s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:17:15,777 INFO [loop_until]: Function succeeded after 42s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:17:26,225 INFO [loop_until]: Function succeeded after 52s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:17:36,685 INFO [loop_until]: Function succeeded after 1m 03s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:17:47,145 INFO [loop_until]: Function succeeded after 1m 13s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:17:57,591 INFO [loop_until]: Function succeeded after 1m 24s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:18:08,050 INFO [loop_until]: Function succeeded after 1m 34s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:18:18,497 INFO [loop_until]: Function succeeded after 1m 45s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:18:28,895 INFO [loop_until]: Function succeeded after 1m 55s (rc=0) - failed to find expected output: No resources found - retry
2024-04-11 01:18:39,216 INFO [loop_until]: Function succeeded after 2m 05s (rc=0) - expected pattern found
2024-04-11 01:18:39,217 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:39,217 DEBUG --- stdout ---
2024-04-11 01:18:39,217 DEBUG
2024-04-11 01:18:39,217 DEBUG --- stderr ---
2024-04-11 01:18:39,217 DEBUG No resources found in xlou namespace.
2024-04-11 01:18:39,217 INFO
2024-04-11 01:18:39,217 INFO ------------------------- Deleting configmap -------------------------
2024-04-11 01:18:39,217 INFO
2024-04-11 01:18:39,217 INFO [loop_until]: kubectl --namespace=xlou get configmap --output jsonpath={.items[*].metadata.name}
2024-04-11 01:18:39,217 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:39,688 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:39,689 DEBUG --- stdout ---
2024-04-11 01:18:39,689 DEBUG am-logback amster-files amster-retain idm idm-logging-properties kube-root-ca.crt lodemon-config lodemon-deployments overseer-config-0 platform-config
2024-04-11 01:18:39,689 DEBUG --- stderr ---
2024-04-11 01:18:39,689 DEBUG
2024-04-11 01:18:39,689 INFO
2024-04-11 01:18:39,689 INFO [loop_until]: kubectl --namespace=xlou delete configmap am-logback --ignore-not-found
2024-04-11 01:18:39,689 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:40,112 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:40,112 DEBUG --- stdout ---
2024-04-11 01:18:40,113 DEBUG configmap "am-logback" deleted
2024-04-11 01:18:40,113 DEBUG --- stderr ---
2024-04-11 01:18:40,113 DEBUG
2024-04-11 01:18:40,113 INFO
2024-04-11 01:18:40,113 INFO [loop_until]: kubectl --namespace=xlou delete configmap amster-files --ignore-not-found
2024-04-11 01:18:40,113 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:40,540 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:40,541 DEBUG --- stdout ---
2024-04-11 01:18:40,541 DEBUG configmap "amster-files" deleted
2024-04-11 01:18:40,541 DEBUG --- stderr ---
2024-04-11 01:18:40,541 DEBUG
2024-04-11 01:18:40,541 INFO
2024-04-11 01:18:40,541 INFO [loop_until]: kubectl --namespace=xlou delete configmap amster-retain --ignore-not-found
2024-04-11 01:18:40,541 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:40,951 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:40,951 DEBUG --- stdout ---
2024-04-11 01:18:40,951 DEBUG configmap "amster-retain" deleted
2024-04-11 01:18:40,951 DEBUG --- stderr ---
2024-04-11 01:18:40,951 DEBUG
2024-04-11 01:18:40,952 INFO
2024-04-11 01:18:40,952 INFO [loop_until]: kubectl --namespace=xlou delete configmap idm --ignore-not-found
2024-04-11 01:18:40,952 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:41,361 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:41,361 DEBUG --- stdout ---
2024-04-11 01:18:41,361 DEBUG configmap "idm" deleted
2024-04-11 01:18:41,361 DEBUG --- stderr ---
2024-04-11 01:18:41,361 DEBUG
2024-04-11 01:18:41,361 INFO
2024-04-11 01:18:41,361 INFO [loop_until]: kubectl --namespace=xlou delete configmap idm-logging-properties --ignore-not-found
2024-04-11 01:18:41,361 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:41,792 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:41,792 DEBUG --- stdout ---
2024-04-11 01:18:41,792 DEBUG configmap "idm-logging-properties" deleted
2024-04-11 01:18:41,792 DEBUG --- stderr ---
2024-04-11 01:18:41,792 DEBUG
2024-04-11 01:18:41,793 INFO
2024-04-11 01:18:41,793 INFO [loop_until]: kubectl --namespace=xlou delete configmap kube-root-ca.crt --ignore-not-found
2024-04-11 01:18:41,793 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:42,221 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:42,221 DEBUG --- stdout ---
2024-04-11 01:18:42,221 DEBUG configmap "kube-root-ca.crt" deleted
2024-04-11 01:18:42,221 DEBUG --- stderr ---
2024-04-11 01:18:42,221 DEBUG
2024-04-11 01:18:42,222 INFO
2024-04-11 01:18:42,222 INFO [loop_until]: kubectl --namespace=xlou delete configmap lodemon-config --ignore-not-found
2024-04-11 01:18:42,222 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:42,641 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:42,641 DEBUG --- stdout ---
2024-04-11 01:18:42,642 DEBUG configmap "lodemon-config" deleted
2024-04-11 01:18:42,642 DEBUG --- stderr ---
2024-04-11 01:18:42,642 DEBUG
2024-04-11 01:18:42,642 INFO
2024-04-11 01:18:42,642 INFO [loop_until]: kubectl --namespace=xlou delete configmap lodemon-deployments --ignore-not-found
2024-04-11 01:18:42,642 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:43,066 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:43,066 DEBUG --- stdout ---
2024-04-11 01:18:43,066 DEBUG configmap "lodemon-deployments" deleted
2024-04-11 01:18:43,066 DEBUG --- stderr ---
2024-04-11 01:18:43,066 DEBUG
2024-04-11 01:18:43,066 INFO
2024-04-11 01:18:43,066 INFO [loop_until]: kubectl --namespace=xlou delete configmap overseer-config-0 --ignore-not-found
2024-04-11 01:18:43,066 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:43,610 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:43,610 DEBUG --- stdout ---
2024-04-11 01:18:43,610 DEBUG configmap "overseer-config-0" deleted
2024-04-11 01:18:43,610 DEBUG --- stderr ---
2024-04-11 01:18:43,610 DEBUG
2024-04-11 01:18:43,610 INFO
2024-04-11 01:18:43,610 INFO [loop_until]: kubectl --namespace=xlou delete configmap platform-config --ignore-not-found
2024-04-11 01:18:43,610 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:44,043 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:44,045 DEBUG --- stdout ---
2024-04-11 01:18:44,045 DEBUG configmap "platform-config" deleted
2024-04-11 01:18:44,045 DEBUG --- stderr ---
2024-04-11 01:18:44,045 DEBUG
2024-04-11 01:18:44,045 INFO
2024-04-11 01:18:44,045 INFO --------------------------- Deleting secret ---------------------------
2024-04-11 01:18:44,045 INFO
2024-04-11 01:18:44,046 INFO [loop_until]: kubectl --namespace=xlou get secret ****
2024-04-11 01:18:44,046 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:44,444 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:44,444 DEBUG --- stdout ---
2024-04-11 01:18:44,444 DEBUG cloud-storage-credentials-cts cloud-storage-credentials-idrepo
2024-04-11 01:18:44,444 DEBUG --- stderr ---
2024-04-11 01:18:44,444 DEBUG
2024-04-11 01:18:44,445 INFO
2024-04-11 01:18:44,445 INFO [loop_until]: kubectl --namespace=xlou delete secret **** --ignore-not-found
2024-04-11 01:18:44,445 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:44,869 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:44,869 DEBUG --- stdout ---
2024-04-11 01:18:44,869 DEBUG secret "cloud-storage-credentials-cts" deleted
2024-04-11 01:18:44,869 DEBUG --- stderr ---
2024-04-11 01:18:44,869 DEBUG
2024-04-11 01:18:44,869 INFO
2024-04-11 01:18:44,869 INFO [loop_until]: kubectl --namespace=xlou delete secret **** --ignore-not-found
2024-04-11 01:18:44,869 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:45,305 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:45,305 DEBUG --- stdout ---
2024-04-11 01:18:45,305 DEBUG secret "cloud-storage-credentials-idrepo" deleted
2024-04-11 01:18:45,305 DEBUG --- stderr ---
2024-04-11 01:18:45,305 DEBUG
2024-04-11 01:18:45,305 INFO
2024-04-11 01:18:45,305 INFO -------------------------- Deleting ingress --------------------------
2024-04-11 01:18:45,305 INFO
2024-04-11 01:18:45,305 INFO [loop_until]: kubectl --namespace=xlou get ingress --output jsonpath={.items[*].metadata.name}
2024-04-11 01:18:45,305 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:45,674 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:45,675 DEBUG --- stdout ---
2024-04-11 01:18:45,675 DEBUG forgerock ig overseer-0
2024-04-11 01:18:45,675 DEBUG --- stderr ---
2024-04-11 01:18:45,675 DEBUG
2024-04-11 01:18:45,675 INFO
2024-04-11 01:18:45,675 INFO [loop_until]: kubectl --namespace=xlou delete ingress forgerock --ignore-not-found
2024-04-11 01:18:45,675 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:46,088 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:46,088 DEBUG --- stdout ---
2024-04-11 01:18:46,088 DEBUG ingress.networking.k8s.io "forgerock" deleted
2024-04-11 01:18:46,088 DEBUG --- stderr ---
2024-04-11 01:18:46,088 DEBUG
2024-04-11 01:18:46,089 INFO
2024-04-11 01:18:46,089 INFO [loop_until]: kubectl --namespace=xlou delete ingress ig --ignore-not-found
2024-04-11 01:18:46,089 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:46,502 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:46,502 DEBUG --- stdout ---
2024-04-11 01:18:46,502 DEBUG ingress.networking.k8s.io "ig" deleted
2024-04-11 01:18:46,502 DEBUG --- stderr ---
2024-04-11 01:18:46,502 DEBUG
2024-04-11 01:18:46,502 INFO
2024-04-11 01:18:46,502 INFO [loop_until]: kubectl --namespace=xlou delete ingress overseer-0 --ignore-not-found
2024-04-11 01:18:46,502 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:46,920 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:46,920 DEBUG --- stdout ---
2024-04-11 01:18:46,920 DEBUG ingress.networking.k8s.io "overseer-0" deleted
2024-04-11 01:18:46,920 DEBUG --- stderr ---
2024-04-11 01:18:46,920 DEBUG
2024-04-11 01:18:46,920 INFO
2024-04-11 01:18:46,920 INFO ---------------------------- Deleting pvc ----------------------------
2024-04-11 01:18:46,921 INFO
2024-04-11 01:18:46,921 INFO [loop_until]: kubectl --namespace=xlou get pvc --output jsonpath={.items[*].metadata.name}
2024-04-11 01:18:46,921 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:47,332 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:47,332 DEBUG --- stdout ---
2024-04-11 01:18:47,332 DEBUG data-ds-cts-0 data-ds-cts-1 data-ds-cts-2 data-ds-idrepo-0 data-ds-idrepo-1 data-ds-idrepo-2 overseer-0
2024-04-11 01:18:47,332 DEBUG --- stderr ---
2024-04-11 01:18:47,332 DEBUG
2024-04-11 01:18:47,332 INFO
2024-04-11 01:18:47,332 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-cts-0 --ignore-not-found
2024-04-11 01:18:47,332 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:47,745 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:47,746 DEBUG --- stdout ---
2024-04-11 01:18:47,746 DEBUG persistentvolumeclaim "data-ds-cts-0" deleted
2024-04-11 01:18:47,746 DEBUG --- stderr ---
2024-04-11 01:18:47,746 DEBUG
2024-04-11 01:18:47,746 INFO
2024-04-11 01:18:47,746 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-cts-1 --ignore-not-found
2024-04-11 01:18:47,746 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:48,180 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:48,180 DEBUG --- stdout ---
2024-04-11 01:18:48,180 DEBUG persistentvolumeclaim "data-ds-cts-1" deleted
2024-04-11 01:18:48,181 DEBUG --- stderr ---
2024-04-11 01:18:48,181 DEBUG
2024-04-11 01:18:48,181 INFO
2024-04-11 01:18:48,181 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-cts-2 --ignore-not-found
2024-04-11 01:18:48,181 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:48,617 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:48,617 DEBUG --- stdout ---
2024-04-11 01:18:48,617 DEBUG persistentvolumeclaim "data-ds-cts-2" deleted
2024-04-11 01:18:48,617 DEBUG --- stderr ---
2024-04-11 01:18:48,617 DEBUG
2024-04-11 01:18:48,617 INFO
2024-04-11 01:18:48,618 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-idrepo-0 --ignore-not-found
2024-04-11 01:18:48,618 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:49,040 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:49,041 DEBUG --- stdout ---
2024-04-11 01:18:49,041 DEBUG persistentvolumeclaim "data-ds-idrepo-0" deleted
2024-04-11 01:18:49,041 DEBUG --- stderr ---
2024-04-11 01:18:49,041 DEBUG
2024-04-11 01:18:49,041 INFO
2024-04-11 01:18:49,041 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-idrepo-1 --ignore-not-found
2024-04-11 01:18:49,041 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:49,469 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:49,470 DEBUG --- stdout ---
2024-04-11 01:18:49,471 DEBUG persistentvolumeclaim "data-ds-idrepo-1" deleted
2024-04-11 01:18:49,471 DEBUG --- stderr ---
2024-04-11 01:18:49,471 DEBUG
2024-04-11 01:18:49,471 INFO
2024-04-11 01:18:49,471 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-idrepo-2 --ignore-not-found
2024-04-11 01:18:49,471 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:49,906 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:49,907 DEBUG --- stdout ---
2024-04-11 01:18:49,907 DEBUG persistentvolumeclaim "data-ds-idrepo-2" deleted
2024-04-11 01:18:49,907 DEBUG --- stderr ---
2024-04-11 01:18:49,907 DEBUG
2024-04-11 01:18:49,907 INFO
2024-04-11 01:18:49,907 INFO [loop_until]: kubectl --namespace=xlou delete pvc overseer-0 --ignore-not-found
2024-04-11 01:18:49,907 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:50,327 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:50,327 DEBUG --- stdout ---
2024-04-11 01:18:50,327 DEBUG persistentvolumeclaim "overseer-0" deleted
2024-04-11 01:18:50,327 DEBUG --- stderr ---
2024-04-11 01:18:50,327 DEBUG
2024-04-11 01:18:50,328 INFO
2024-04-11 01:18:50,328 INFO [loop_until]: kubectl --namespace=xlou delete pv ds-backup-xlou --ignore-not-found
2024-04-11 01:18:50,328 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:50,737 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:50,737 DEBUG --- stdout ---
2024-04-11 01:18:50,737 DEBUG
2024-04-11 01:18:50,737 DEBUG --- stderr ---
2024-04-11 01:18:50,737 DEBUG Warning: deleting cluster-scoped resources, not scoped to the provided namespace
2024-04-11 01:18:50,737 INFO
2024-04-11 01:18:50,737 INFO ----------------- Deleting admin clusterrolebindings -----------------
2024-04-11 01:18:50,737 INFO
2024-04-11 01:18:50,737 INFO [loop_until]: kubectl get clusterrolebinding --output jsonpath="{range .items[?(@.subjects[0].namespace=='xlou')]}{.metadata.name} {end}"
2024-04-11 01:18:50,737 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:51,341 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:51,341 DEBUG --- stdout ---
2024-04-11 01:18:51,341 DEBUG k8s-svc-acct-crb-xlou k8s-svc-acct-crb-xlou-0
2024-04-11 01:18:51,341 DEBUG --- stderr ---
2024-04-11 01:18:51,341 DEBUG
2024-04-11 01:18:51,341 INFO Deleting clusterrolebinding k8s-svc-acct-crb-xlou associated with xlou namespace
2024-04-11 01:18:51,341 INFO
2024-04-11 01:18:51,342 INFO [loop_until]: kubectl delete clusterrolebinding k8s-svc-acct-crb-xlou
2024-04-11 01:18:51,342 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:51,762 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:51,762 DEBUG --- stdout ---
2024-04-11 01:18:51,762 DEBUG clusterrolebinding.rbac.authorization.k8s.io "k8s-svc-acct-crb-xlou" deleted
2024-04-11 01:18:51,762 DEBUG --- stderr ---
2024-04-11 01:18:51,762 DEBUG
2024-04-11 01:18:51,762 INFO Deleting clusterrolebinding k8s-svc-acct-crb-xlou-0 associated with xlou namespace
2024-04-11 01:18:51,762 INFO
2024-04-11 01:18:51,762 INFO [loop_until]: kubectl delete clusterrolebinding k8s-svc-acct-crb-xlou-0
2024-04-11 01:18:51,762 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:18:52,171 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:52,171 DEBUG --- stdout ---
2024-04-11 01:18:52,171 DEBUG clusterrolebinding.rbac.authorization.k8s.io "k8s-svc-acct-crb-xlou-0" deleted
2024-04-11 01:18:52,171 DEBUG --- stderr ---
2024-04-11 01:18:52,171 DEBUG
2024-04-11 01:18:52,171 INFO
2024-04-11 01:18:52,171 INFO ------------------------- Deleting namespace -------------------------
2024-04-11 01:18:52,484 INFO
2024-04-11 01:18:52,484 INFO [loop_until]: kubectl delete namespaces xlou --grace-period=0 --force
2024-04-11 01:18:52,484 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:18:59,681 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:18:59,682 DEBUG --- stdout ---
2024-04-11 01:18:59,682 DEBUG namespace "xlou" force deleted
2024-04-11 01:18:59,682 DEBUG --- stderr ---
2024-04-11 01:18:59,682 DEBUG Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
2024-04-11 01:19:20,936 INFO
2024-04-11 01:19:20,937 INFO ************************************* Creating deployment *************************************
2024-04-11 01:19:20,937 INFO Creating normal (forgeops) type deployment for deployment: stack
2024-04-11 01:19:20,968 INFO
2024-04-11 01:19:20,968 INFO ------- Custom component configuration present. Loading values -------
2024-04-11 01:19:20,968 INFO
2024-04-11 01:19:20,968 INFO ************************************ Configuring components ************************************
2024-04-11 01:19:21,373 INFO Namespace xlou does not exist, no resources to delete
2024-04-11 01:19:21,373 INFO
2024-04-11 01:19:21,373 INFO [loop_until]: kubectl create namespace xlou
2024-04-11 01:19:21,373 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:19:21,717 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:19:21,717 DEBUG --- stdout ---
2024-04-11 01:19:21,717 DEBUG namespace/xlou created
2024-04-11 01:19:21,717 DEBUG --- stderr ---
2024-04-11 01:19:21,717 DEBUG
2024-04-11 01:19:21,718 INFO
2024-04-11 01:19:21,718 INFO [loop_until]: kubectl label namespace xlou self-service=false timeout=48
2024-04-11 01:19:21,718 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:19:22,129 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:19:22,130 DEBUG --- stdout ---
2024-04-11 01:19:22,130 DEBUG namespace/xlou labeled
2024-04-11 01:19:22,130 DEBUG --- stderr ---
2024-04-11 01:19:22,130 DEBUG
2024-04-11 01:19:22,130 INFO
2024-04-11 01:19:22,130 INFO Applying custom configuration, dockerfiles to deployment and custom lodestar component configuration
2024-04-11 01:19:22,131 INFO Copying /mnt/disks/data/xslou/lodestar-fork/shared/config/custom/session_timeout_3minutes/docker/am to /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am
2024-04-11 01:19:22,133 INFO No custom features provided. Nothing to do.
2024-04-11 01:19:22,134 INFO
2024-04-11 01:19:22,134 INFO ---- Updating components image tag/repo from platform-images repo ----
2024-04-11 01:19:22,134 INFO
2024-04-11 01:19:22,134 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --clean
2024-04-11 01:19:22,234 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:22,234 DEBUG --- stdout ---
2024-04-11 01:19:22,234 DEBUG [INFO] Cleaning up.
[WARNING] Found nothing to clean.
2024-04-11 01:19:22,234 DEBUG --- stderr ---
2024-04-11 01:19:22,234 DEBUG
2024-04-11 01:19:22,234 INFO
2024-04-11 01:19:22,235 INFO
2024-04-11 01:19:22,235 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products ds
2024-04-11 01:19:28,265 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:28,265 DEBUG --- stdout ---
2024-04-11 01:19:28,265 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images.
[INFO] Repo is at f371ba881217080a766a4d1e2be1e768f6badeb0 on branch HEAD
[INFO] Updating products ds
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/dsutil/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/ds-new/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/proxy/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
2024-04-11 01:19:28,265 DEBUG --- stderr ---
2024-04-11 01:19:28,265 DEBUG
2024-04-11 01:19:28,265 INFO
2024-04-11 01:19:28,265 INFO
2024-04-11 01:19:28,265 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products am
2024-04-11 01:19:28,388 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:28,388 DEBUG --- stdout ---
2024-04-11 01:19:28,388 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images.
[INFO] Found existing files, attempting to not clone.
[INFO] Repo is at f371ba881217080a766a4d1e2be1e768f6badeb0 on branch HEAD
[INFO] Updating products am
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am/Dockerfile to use gcr.io/forgerock-io/am-cdk/pit1:7.6.0-a89ff42c02de792a1493750badb7bf8554c69559
2024-04-11 01:19:28,388 DEBUG --- stderr ---
2024-04-11 01:19:28,388 DEBUG
2024-04-11 01:19:28,388 INFO
2024-04-11 01:19:28,388 INFO
2024-04-11 01:19:28,389 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products amster
2024-04-11 01:19:28,509 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:28,510 DEBUG --- stdout ---
2024-04-11 01:19:28,510 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images.
[INFO] Found existing files, attempting to not clone.
[INFO] Repo is at f371ba881217080a766a4d1e2be1e768f6badeb0 on branch HEAD
[INFO] Updating products amster
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster/Dockerfile to use gcr.io/forgerock-io/amster/pit1:7.6.0-a89ff42c02de792a1493750badb7bf8554c69559
2024-04-11 01:19:28,510 DEBUG --- stderr ---
2024-04-11 01:19:28,510 DEBUG
2024-04-11 01:19:28,510 INFO
2024-04-11 01:19:28,510 INFO
2024-04-11 01:19:28,510 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products idm
2024-04-11 01:19:28,619 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:28,620 DEBUG --- stdout ---
2024-04-11 01:19:28,620 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images.
[INFO] Found existing files, attempting to not clone.
[INFO] Repo is at f371ba881217080a766a4d1e2be1e768f6badeb0 on branch HEAD
[INFO] Updating products idm
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm/Dockerfile to use gcr.io/forgerock-io/idm-cdk/pit1:7.6.0-837ae72b84acb5834895e649a50c85cab1dce9e8
2024-04-11 01:19:28,620 DEBUG --- stderr ---
2024-04-11 01:19:28,620 DEBUG
2024-04-11 01:19:28,620 INFO
2024-04-11 01:19:28,620 INFO
2024-04-11 01:19:28,620 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products ui
2024-04-11 01:19:28,788 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:28,788 DEBUG --- stdout ---
2024-04-11 01:19:28,788 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images.
[INFO] Found existing files, attempting to not clone.
[INFO] Repo is at f371ba881217080a766a4d1e2be1e768f6badeb0 on branch HEAD
[INFO] Updating products ui
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui to use gcr.io/forgerock-io/platform-admin-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui to use gcr.io/forgerock-io/platform-enduser-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626
[INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui to use gcr.io/forgerock-io/platform-login-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626
2024-04-11 01:19:28,788 DEBUG --- stderr ---
2024-04-11 01:19:28,788 DEBUG
2024-04-11 01:19:28,788 INFO
2024-04-11 01:19:28,789 INFO
2024-04-11 01:19:28,789 INFO - Checking if component Dockerfile/kustomize needs additional update -
2024-04-11 01:19:28,789 INFO
2024-04-11 01:19:28,789 INFO
2024-04-11 01:19:28,789 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker ds cts
2024-04-11 01:19:28,866 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:28,866 DEBUG --- stdout ---
2024-04-11 01:19:28,866 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts
2024-04-11 01:19:28,866 DEBUG --- stderr ---
2024-04-11 01:19:28,866 DEBUG
2024-04-11 01:19:28,866 INFO
2024-04-11 01:19:28,867 INFO Checking if ds-cts dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution)
2024-04-11 01:19:28,867 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts/Dockerfile: gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
2024-04-11 01:19:31,960 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts/Dockerfile
2024-04-11 01:19:31,960 INFO
2024-04-11 01:19:31,960 INFO
2024-04-11 01:19:31,960 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker ds idrepo
2024-04-11 01:19:32,074 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:32,074 DEBUG --- stdout ---
2024-04-11 01:19:32,075 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo
2024-04-11 01:19:32,075 DEBUG --- stderr ---
2024-04-11 01:19:32,075 DEBUG
2024-04-11 01:19:32,075 INFO
2024-04-11 01:19:32,075 INFO Checking if ds-idrepo dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution)
2024-04-11 01:19:32,075 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo/Dockerfile: gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
2024-04-11 01:19:34,722 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo/Dockerfile
2024-04-11 01:19:34,722 INFO
2024-04-11 01:19:34,722 INFO
2024-04-11 01:19:34,722 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker am
2024-04-11 01:19:34,834 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:34,834 DEBUG --- stdout ---
2024-04-11 01:19:34,834 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am
2024-04-11 01:19:34,834 DEBUG --- stderr ---
2024-04-11 01:19:34,834 DEBUG
2024-04-11 01:19:34,834 INFO
2024-04-11 01:19:34,835 INFO Checking if am dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution)
2024-04-11 01:19:34,835 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am/Dockerfile: gcr.io/forgerock-io/am-cdk/pit1:7.6.0-a89ff42c02de792a1493750badb7bf8554c69559
2024-04-11 01:19:37,724 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am/Dockerfile
2024-04-11 01:19:37,724 INFO
2024-04-11 01:19:37,724 INFO
2024-04-11 01:19:37,725 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker amster
2024-04-11 01:19:37,832 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:37,832 DEBUG --- stdout ---
2024-04-11 01:19:37,833 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster
2024-04-11 01:19:37,833 DEBUG --- stderr ---
2024-04-11 01:19:37,833 DEBUG
2024-04-11 01:19:37,833 INFO
2024-04-11 01:19:37,833 INFO Checking if amster dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution)
2024-04-11 01:19:37,833 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster/Dockerfile: gcr.io/forgerock-io/amster/pit1:7.6.0-a89ff42c02de792a1493750badb7bf8554c69559
2024-04-11 01:19:40,494 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster/Dockerfile
2024-04-11 01:19:40,494 INFO
2024-04-11 01:19:40,495 INFO
2024-04-11 01:19:40,495 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker idm
2024-04-11 01:19:40,605 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:40,605 DEBUG --- stdout ---
2024-04-11 01:19:40,605 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm
2024-04-11 01:19:40,606 DEBUG --- stderr ---
2024-04-11 01:19:40,606 DEBUG
2024-04-11 01:19:40,606 INFO
2024-04-11 01:19:40,606 INFO Checking if idm dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution)
2024-04-11 01:19:40,606 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm/Dockerfile: gcr.io/forgerock-io/idm-cdk/pit1:7.6.0-837ae72b84acb5834895e649a50c85cab1dce9e8
2024-04-11 01:19:43,513 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm/Dockerfile
2024-04-11 01:19:43,514 INFO
2024-04-11 01:19:43,514 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path kustomize base end-user-ui
2024-04-11 01:19:43,640 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:43,640 DEBUG --- stdout ---
2024-04-11 01:19:43,641 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui
2024-04-11 01:19:43,641 DEBUG --- stderr ---
2024-04-11 01:19:43,641 DEBUG
2024-04-11 01:19:43,641 INFO
2024-04-11 01:19:43,644 INFO
2024-04-11 01:19:43,644 INFO Checking if end-user-ui kustomize file /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui/kustomization.yaml needs additional update (custom tag/repo from config.yaml or image name resolution)
2024-04-11 01:19:43,644 INFO Read image line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui/kustomization.yaml: gcr.io/forgerock-io/platform-enduser-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626
2024-04-11 01:19:46,652 INFO No need to update the image line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui/kustomization.yaml
2024-04-11 01:19:46,653 INFO
2024-04-11 01:19:46,653 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path kustomize base login-ui
2024-04-11 01:19:46,766 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:46,766 DEBUG --- stdout ---
2024-04-11 01:19:46,767 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui
2024-04-11 01:19:46,767 DEBUG --- stderr ---
2024-04-11 01:19:46,767 DEBUG
2024-04-11 01:19:46,767 INFO
2024-04-11 01:19:46,771 INFO
2024-04-11 01:19:46,772 INFO Checking if login-ui kustomize file /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui/kustomization.yaml needs additional update (custom tag/repo from config.yaml or image name resolution)
2024-04-11 01:19:46,772 INFO Read image line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui/kustomization.yaml: gcr.io/forgerock-io/platform-login-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626
2024-04-11 01:19:49,661 INFO No need to update the image line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui/kustomization.yaml
2024-04-11 01:19:49,661 INFO
2024-04-11 01:19:49,661 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path kustomize base admin-ui
2024-04-11 01:19:49,773 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:49,774 DEBUG --- stdout ---
2024-04-11 01:19:49,774 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui
2024-04-11 01:19:49,774 DEBUG --- stderr ---
2024-04-11 01:19:49,774 DEBUG
2024-04-11 01:19:49,774 INFO
2024-04-11 01:19:49,779 INFO
2024-04-11 01:19:49,779 INFO Checking if admin-ui kustomize file /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui/kustomization.yaml needs additional update (custom tag/repo from config.yaml or image name resolution)
2024-04-11 01:19:49,779 INFO Read image line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui/kustomization.yaml: gcr.io/forgerock-io/platform-admin-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626
2024-04-11 01:19:52,779 INFO No need to update the image line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui/kustomization.yaml
2024-04-11 01:19:52,779 INFO
2024-04-11 01:19:52,779 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path kustomize overlay medium
2024-04-11 01:19:52,882 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:19:52,882 DEBUG --- stdout ---
2024-04-11 01:19:52,882 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/overlay/medium
2024-04-11 01:19:52,882 DEBUG --- stderr ---
2024-04-11 01:19:52,882 DEBUG
2024-04-11 01:19:52,882 INFO
2024-04-11 01:19:53,251 INFO
2024-04-11 01:19:53,251 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm delete --filename /tmp/tmpv46_oxsd
2024-04-11 01:19:53,252 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0, 1]
2024-04-11 01:19:53,576 INFO [loop_until]: OK (rc = 1)
2024-04-11 01:19:53,576 DEBUG --- stdout ---
2024-04-11 01:19:53,576 DEBUG
2024-04-11 01:19:53,576 DEBUG --- stderr ---
2024-04-11 01:19:53,576 DEBUG Error from server (NotFound): error when deleting "/tmp/tmpv46_oxsd": secrets "sslcert" not found
2024-04-11 01:19:53,576 INFO
2024-04-11 01:19:53,576 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm apply --filename /tmp/tmpv46_oxsd
2024-04-11 01:19:53,576 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:19:54,820 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:19:54,820 DEBUG --- stdout ---
2024-04-11 01:19:54,821 DEBUG secret/sslcert created
2024-04-11 01:19:54,821 DEBUG --- stderr ---
2024-04-11 01:19:54,821 DEBUG
2024-04-11 01:19:54,830 INFO Loading external components from config.yaml
2024-04-11 01:19:54,950 INFO No external components defined.
2024-04-11 01:19:55,067 INFO
2024-04-11 01:19:55,067 INFO *********************************** Cluster readiness check ***********************************
2024-04-11 01:19:55,067 INFO
2024-04-11 01:19:55,067 INFO ------------------------- Checking K8s api... -------------------------
2024-04-11 01:19:55,741 INFO
2024-04-11 01:19:55,741 INFO ----------------- Checking DNS/Konnectivity agent... -----------------
2024-04-11 01:19:59,068 INFO All pre-deployment cluster checks passed.
2024-04-11 01:19:59,068 INFO
2024-04-11 01:19:59,068 INFO *********************************** Cluster resources check ***********************************
2024-04-11 01:19:59,068 INFO
2024-04-11 01:19:59,068 INFO -------------- Checking if cert-manager is installed... --------------
2024-04-11 01:19:59,759 INFO cert-manager is installed
2024-04-11 01:19:59,759 INFO
2024-04-11 01:19:59,759 INFO ----------- Checking if secret-agent-system is installed... -----------
2024-04-11 01:20:00,421 INFO secret-agent-system is installed
2024-04-11 01:20:00,421 INFO
2024-04-11 01:20:00,422 INFO ------------------ Checking if nginx is installed... ------------------
2024-04-11 01:20:01,060 INFO nginx is installed
2024-04-11 01:20:01,178 INFO
2024-04-11 01:20:01,178 INFO ------ Checking if network services global dns is configured... ------
2024-04-11 01:20:01,256 INFO Running ping against: default-http-backend.iam.xlou-cdm.engineeringpit.com
2024-04-11 01:20:05,396 INFO network services global dns is configured
2024-04-11 01:20:05,397 INFO
2024-04-11 01:20:05,397 INFO ---- Checking if disk storage type has been updated to use ssd... ----
2024-04-11 01:20:05,736 INFO disk storage type has been updated to use ssd
2024-04-11 01:20:05,874 INFO
2024-04-11 01:20:05,874 INFO ------------ Checking if lodestar-ssl-cert is installed... ------------
2024-04-11 01:20:06,525 INFO lodestar-ssl-cert is installed
2024-04-11 01:20:06,526 INFO
2024-04-11 01:20:06,526 INFO ------------- Checking if intezer-protect is installed... -------------
2024-04-11 01:20:07,222 INFO intezer-protect is installed
2024-04-11 01:20:07,223 INFO
2024-04-11 01:20:07,223 INFO ******************************* Verify docker daemon is running *******************************
2024-04-11 01:20:07,297 INFO Docker daemon is running
2024-04-11 01:20:07,297 INFO
2024-04-11 01:20:07,297 INFO ************************** The following components will be deployed **************************
2024-04-11 01:20:07,297 INFO - ds-cts (DS)
- ds-idrepo (DS)
- am (AM)
- amster (Amster)
- idm (IDM)
- end-user-ui (EndUserUi)
- login-ui (LoginUi)
- admin-ui (AdminUi)
2024-04-11 01:20:07,297 INFO
2024-04-11 01:20:07,297 INFO ---------- Build product images using forgeops build command ----------
2024-04-11 01:20:07,420 INFO
2024-04-11 01:20:07,420 INFO [run_command]: kubectl config current-context
2024-04-11 01:20:07,503 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:20:07,503 DEBUG --- stdout ---
2024-04-11 01:20:07,503 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm
2024-04-11 01:20:07,503 DEBUG --- stderr ---
2024-04-11 01:20:07,503 DEBUG
2024-04-11 01:20:07,503 INFO
2024-04-11 01:20:07,503 INFO
2024-04-11 01:20:07,504 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build ds-cts --config-profile=cdk --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-d49ad6a5879fab3530729d8773297783d042f903
2024-04-11 01:20:07,504 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'}
2024-04-11 01:20:10,420 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/ds-cts]
2024-04-11 01:20:10,521 INFO 1f875f357bc3: Preparing
2024-04-11 01:20:10,621 INFO a19dba0be6db: Preparing
2024-04-11 01:20:10,722 INFO 01c80f9cd31c: Preparing
2024-04-11 01:20:10,823 INFO 54977640d8ff: Preparing
2024-04-11 01:20:10,924 INFO 064abaee2efe: Preparing
2024-04-11 01:20:11,025 INFO cbd9008fcc14: Preparing
2024-04-11 01:20:11,125 INFO 1ce7f08455d4: Preparing
2024-04-11 01:20:11,226 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:11,327 INFO 0f72daa50aea: Preparing
2024-04-11 01:20:11,427 INFO 7a4845b451a9: Preparing
2024-04-11 01:20:11,528 INFO 1fc9aae9e6e1: Preparing
2024-04-11 01:20:11,629 INFO 044ee1204247: Preparing
2024-04-11 01:20:11,729 INFO 6832d9c30d64: Preparing
2024-04-11 01:20:11,830 INFO 3c8879ab2cf2: Preparing
2024-04-11 01:20:11,930 INFO 0f72daa50aea: Waiting
2024-04-11 01:20:12,031 INFO 7a4845b451a9: Waiting
2024-04-11 01:20:12,131 INFO 1fc9aae9e6e1: Waiting
2024-04-11 01:20:12,232 INFO 044ee1204247: Waiting
2024-04-11 01:20:12,332 INFO 6832d9c30d64: Waiting
2024-04-11 01:20:12,433 INFO 3c8879ab2cf2: Waiting
2024-04-11 01:20:12,533 INFO cbd9008fcc14: Waiting
2024-04-11 01:20:12,634 INFO 1ce7f08455d4: Waiting
2024-04-11 01:20:12,734 INFO 5f70bf18a086: Waiting
2024-04-11 01:20:12,835 INFO 064abaee2efe: Layer already exists
2024-04-11 01:20:12,935 INFO a19dba0be6db: Layer already exists
2024-04-11 01:20:13,036 INFO 1f875f357bc3: Layer already exists
2024-04-11 01:20:13,136 INFO 54977640d8ff: Layer already exists
2024-04-11 01:20:13,237 INFO 01c80f9cd31c: Layer already exists
2024-04-11 01:20:13,337 INFO cbd9008fcc14: Layer already exists
2024-04-11 01:20:13,438 INFO 5f70bf18a086: Layer already exists
2024-04-11 01:20:13,538 INFO 0f72daa50aea: Layer already exists
2024-04-11 01:20:13,639 INFO 1ce7f08455d4: Layer already exists
2024-04-11 01:20:13,739 INFO 7a4845b451a9: Layer already exists
2024-04-11 01:20:13,840 INFO 1fc9aae9e6e1: Layer already exists
2024-04-11 01:20:13,940 INFO 044ee1204247: Layer already exists
2024-04-11 01:20:14,041 INFO 6832d9c30d64: Layer already exists
2024-04-11 01:20:14,141 INFO 3c8879ab2cf2: Layer already exists
2024-04-11 01:20:14,242 INFO xlou-7.6.0-d49ad6a5879fab3530729d8773297783d042f903: digest: sha256:d4625dfdd91929be72a5064d8bf9b53167e17f81160a4fb99e14abf4d21541a7 size: 3252
2024-04-11 01:20:14,342 INFO [1;95mUpdated the image_defaulter with your new image for ds-cts: "gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-7.6.0-d49ad6a5879fab3530729d8773297783d042f903".[0m
2024-04-11 01:20:14,443 ERROR #0 building with "default" instance using docker driver
2024-04-11 01:20:14,443 ERROR
2024-04-11 01:20:14,443 ERROR #1 [internal] load build definition from Dockerfile
2024-04-11 01:20:14,443 ERROR #1 transferring dockerfile: 529B 0.0s done
2024-04-11 01:20:14,443 ERROR #1 DONE 0.0s
2024-04-11 01:20:14,443 ERROR
2024-04-11 01:20:14,443 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
2024-04-11 01:20:14,443 ERROR #2 DONE 0.4s
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #3 [internal] load .dockerignore
2024-04-11 01:20:14,444 ERROR #3 transferring context: 2B done
2024-04-11 01:20:14,444 ERROR #3 DONE 0.0s
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #4 [1/7] FROM gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903@sha256:f5da421b3fa9a262d8d8a3d36e9d3777a421bbec723f2522c417b942702fe62a
2024-04-11 01:20:14,444 ERROR #4 DONE 0.0s
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #5 [internal] load build context
2024-04-11 01:20:14,444 ERROR #5 transferring context: 71.67kB 0.0s done
2024-04-11 01:20:14,444 ERROR #5 DONE 0.0s
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #6 [3/7] RUN chown -R forgerock:root /opt/opendj
2024-04-11 01:20:14,444 ERROR #6 CACHED
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #7 [6/7] COPY --chown=forgerock:root scripts /opt/opendj/scripts
2024-04-11 01:20:14,444 ERROR #7 CACHED
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #8 [2/7] COPY debian-buster-sources.list /etc/apt/sources.list
2024-04-11 01:20:14,444 ERROR #8 CACHED
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #9 [5/7] COPY --chown=forgerock:root cts /opt/opendj/
2024-04-11 01:20:14,444 ERROR #9 CACHED
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #10 [4/7] COPY --chown=forgerock:root common /opt/opendj/
2024-04-11 01:20:14,444 ERROR #10 CACHED
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #11 [7/7] RUN bin/setup.sh && bin/relax-security-settings.sh && rm bin/setup.sh bin/relax-security-settings.sh
2024-04-11 01:20:14,444 ERROR #11 CACHED
2024-04-11 01:20:14,444 ERROR
2024-04-11 01:20:14,444 ERROR #12 exporting to image
2024-04-11 01:20:14,445 ERROR #12 exporting layers done
2024-04-11 01:20:14,445 ERROR #12 writing image sha256:26995a65f78983e9368bc7ee813fc02cbf78d7d19d38b071b099347cfcffe225 done
2024-04-11 01:20:14,445 ERROR #12 naming to gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-7.6.0-d49ad6a5879fab3530729d8773297783d042f903 done
2024-04-11 01:20:14,445 ERROR #12 DONE 0.0s
2024-04-11 01:20:14,603 INFO
2024-04-11 01:20:14,603 INFO [run_command]: kubectl config current-context
2024-04-11 01:20:14,677 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:20:14,677 DEBUG --- stdout ---
2024-04-11 01:20:14,677 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm
2024-04-11 01:20:14,677 DEBUG --- stderr ---
2024-04-11 01:20:14,677 DEBUG
2024-04-11 01:20:14,677 INFO
2024-04-11 01:20:14,677 INFO
2024-04-11 01:20:14,678 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build ds-idrepo --config-profile=cdk --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-d49ad6a5879fab3530729d8773297783d042f903
2024-04-11 01:20:14,678 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'}
2024-04-11 01:20:17,492 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/ds-idrepo]
2024-04-11 01:20:17,593 INFO 10653c6cbcd5: Preparing
2024-04-11 01:20:17,694 INFO 0ca5d3d26b83: Preparing
2024-04-11 01:20:17,794 INFO e144dba4a797: Preparing
2024-04-11 01:20:17,895 INFO 5df20a8aea5c: Preparing
2024-04-11 01:20:17,995 INFO e3ba025c5405: Preparing
2024-04-11 01:20:18,096 INFO 751baa1f03ff: Preparing
2024-04-11 01:20:18,196 INFO 54977640d8ff: Preparing
2024-04-11 01:20:18,297 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:18,397 INFO cbd9008fcc14: Preparing
2024-04-11 01:20:18,498 INFO 1ce7f08455d4: Preparing
2024-04-11 01:20:18,599 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:18,699 INFO 0f72daa50aea: Preparing
2024-04-11 01:20:18,800 INFO 7a4845b451a9: Preparing
2024-04-11 01:20:18,901 INFO 1fc9aae9e6e1: Preparing
2024-04-11 01:20:19,001 INFO 044ee1204247: Preparing
2024-04-11 01:20:19,102 INFO 6832d9c30d64: Preparing
2024-04-11 01:20:19,203 INFO 3c8879ab2cf2: Preparing
2024-04-11 01:20:19,303 INFO 751baa1f03ff: Waiting
2024-04-11 01:20:19,404 INFO 54977640d8ff: Waiting
2024-04-11 01:20:19,505 INFO 5f70bf18a086: Waiting
2024-04-11 01:20:19,606 INFO cbd9008fcc14: Waiting
2024-04-11 01:20:19,706 INFO 1ce7f08455d4: Waiting
2024-04-11 01:20:19,807 INFO 0f72daa50aea: Waiting
2024-04-11 01:20:19,907 INFO 7a4845b451a9: Waiting
2024-04-11 01:20:20,008 INFO 1fc9aae9e6e1: Waiting
2024-04-11 01:20:20,108 INFO 3c8879ab2cf2: Waiting
2024-04-11 01:20:20,209 INFO 044ee1204247: Waiting
2024-04-11 01:20:20,310 INFO 6832d9c30d64: Waiting
2024-04-11 01:20:20,410 INFO e144dba4a797: Layer already exists
2024-04-11 01:20:20,511 INFO 0ca5d3d26b83: Layer already exists
2024-04-11 01:20:20,611 INFO 5df20a8aea5c: Layer already exists
2024-04-11 01:20:20,712 INFO e3ba025c5405: Layer already exists
2024-04-11 01:20:20,812 INFO 10653c6cbcd5: Layer already exists
2024-04-11 01:20:20,913 INFO 54977640d8ff: Layer already exists
2024-04-11 01:20:21,013 INFO 5f70bf18a086: Layer already exists
2024-04-11 01:20:21,114 INFO cbd9008fcc14: Layer already exists
2024-04-11 01:20:21,214 INFO 1ce7f08455d4: Layer already exists
2024-04-11 01:20:21,315 INFO 751baa1f03ff: Layer already exists
2024-04-11 01:20:21,415 INFO 0f72daa50aea: Layer already exists
2024-04-11 01:20:21,516 INFO 7a4845b451a9: Layer already exists
2024-04-11 01:20:21,617 INFO 1fc9aae9e6e1: Layer already exists
2024-04-11 01:20:21,717 INFO 044ee1204247: Layer already exists
2024-04-11 01:20:21,818 INFO 6832d9c30d64: Layer already exists
2024-04-11 01:20:21,918 INFO 3c8879ab2cf2: Layer already exists
2024-04-11 01:20:22,019 INFO xlou-7.6.0-d49ad6a5879fab3530729d8773297783d042f903: digest: sha256:3d88403ace504e53841404bc005ad2bcc95df2a6a1f2eaceef779646ed5034b8 size: 3869
2024-04-11 01:20:22,120 INFO [1;95mUpdated the image_defaulter with your new image for ds-idrepo: "gcr.io/engineeringpit/lodestar-images/ds-idrepo:xlou-7.6.0-d49ad6a5879fab3530729d8773297783d042f903".[0m
2024-04-11 01:20:22,221 ERROR #0 building with "default" instance using docker driver
2024-04-11 01:20:22,221 ERROR
2024-04-11 01:20:22,221 ERROR #1 [internal] load build definition from Dockerfile
2024-04-11 01:20:22,221 ERROR #1 transferring dockerfile: 2.45kB done
2024-04-11 01:20:22,221 ERROR #1 DONE 0.0s
2024-04-11 01:20:22,221 ERROR
2024-04-11 01:20:22,221 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903
2024-04-11 01:20:22,221 ERROR #2 DONE 0.4s
2024-04-11 01:20:22,221 ERROR
2024-04-11 01:20:22,221 ERROR #3 [internal] load .dockerignore
2024-04-11 01:20:22,221 ERROR #3 transferring context: 2B done
2024-04-11 01:20:22,221 ERROR #3 DONE 0.0s
2024-04-11 01:20:22,221 ERROR
2024-04-11 01:20:22,221 ERROR #4 [ 1/10] FROM gcr.io/forgerock-io/ds/pit1:7.6.0-d49ad6a5879fab3530729d8773297783d042f903@sha256:f5da421b3fa9a262d8d8a3d36e9d3777a421bbec723f2522c417b942702fe62a
2024-04-11 01:20:22,221 ERROR #4 DONE 0.0s
2024-04-11 01:20:22,221 ERROR
2024-04-11 01:20:22,221 ERROR #5 [internal] load build context
2024-04-11 01:20:22,221 ERROR #5 transferring context: 37.97kB 0.0s done
2024-04-11 01:20:22,221 ERROR #5 DONE 0.0s
2024-04-11 01:20:22,221 ERROR
2024-04-11 01:20:22,221 ERROR #6 [ 8/10] COPY --chown=forgerock:root idrepo/*.ldif /var/tmp/
2024-04-11 01:20:22,221 ERROR #6 CACHED
2024-04-11 01:20:22,221 ERROR
2024-04-11 01:20:22,221 ERROR #7 [ 4/10] COPY --chown=forgerock:root common /opt/opendj/
2024-04-11 01:20:22,222 ERROR #7 CACHED
2024-04-11 01:20:22,222 ERROR
2024-04-11 01:20:22,222 ERROR #8 [ 3/10] WORKDIR /opt/opendj
2024-04-11 01:20:22,222 ERROR #8 CACHED
2024-04-11 01:20:22,222 ERROR
2024-04-11 01:20:22,222 ERROR #9 [ 6/10] COPY --chown=forgerock:root scripts /opt/opendj/scripts
2024-04-11 01:20:22,222 ERROR #9 CACHED
2024-04-11 01:20:22,222 ERROR
2024-04-11 01:20:22,222 ERROR #10 [ 2/10] COPY debian-buster-sources.list /etc/apt/sources.list
2024-04-11 01:20:22,222 ERROR #10 CACHED
2024-04-11 01:20:22,222 ERROR
2024-04-11 01:20:22,222 ERROR #11 [ 9/10] RUN chmod +w template/setup-profiles/AM/config/6.5/base-entries.ldif && cat scripts/external-am-datastore.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat uma/opendj_uma_audit.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat uma/opendj_uma_pending_requests.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat uma/opendj_uma_resource_set_labels.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat uma/opendj_uma_resource_sets.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat /var/tmp/alpha_bravo.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && chmod +w template/setup-profiles/AM/identity-store/7.0/base-entries.ldif && cat /var/tmp/orgs.ldif >> template/setup-profiles/AM/identity-store/7.0/base-entries.ldif && rm /var/tmp/*ldif
2024-04-11 01:20:22,222 ERROR #11 CACHED
2024-04-11 01:20:22,222 ERROR
2024-04-11 01:20:22,222 ERROR #12 [ 5/10] COPY --chown=forgerock:root idrepo /opt/opendj/
2024-04-11 01:20:22,222 ERROR #12 CACHED
2024-04-11 01:20:22,222 ERROR
2024-04-11 01:20:22,222 ERROR #13 [ 7/10] COPY --chown=forgerock:root uma /opt/opendj/uma
2024-04-11 01:20:22,222 ERROR #13 CACHED
2024-04-11 01:20:22,222 ERROR
2024-04-11 01:20:22,222 ERROR #14 [10/10] RUN bin/setup.sh && bin/relax-security-settings.sh && rm bin/setup.sh bin/relax-security-settings.sh
2024-04-11 01:20:22,222 ERROR #14 CACHED
2024-04-11 01:20:22,222 ERROR
2024-04-11 01:20:22,222 ERROR #15 exporting to image
2024-04-11 01:20:22,222 ERROR #15 exporting layers done
2024-04-11 01:20:22,222 ERROR #15 writing image sha256:3c81eae135483e4583b6566a2da81ffbd3ff2e9b9c35273f182bee26c85defe1 done
2024-04-11 01:20:22,222 ERROR #15 naming to gcr.io/engineeringpit/lodestar-images/ds-idrepo:xlou-7.6.0-d49ad6a5879fab3530729d8773297783d042f903 done
2024-04-11 01:20:22,222 ERROR #15 DONE 0.0s
2024-04-11 01:20:22,349 INFO
2024-04-11 01:20:22,350 INFO [run_command]: kubectl config current-context
2024-04-11 01:20:22,431 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:20:22,432 DEBUG --- stdout ---
2024-04-11 01:20:22,432 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm
2024-04-11 01:20:22,432 DEBUG --- stderr ---
2024-04-11 01:20:22,432 DEBUG
2024-04-11 01:20:22,432 INFO
2024-04-11 01:20:22,432 INFO
2024-04-11 01:20:22,432 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build am --config-profile=cdk --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-a89ff42c02de792a1493750badb7bf8554c69559
2024-04-11 01:20:22,432 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'}
2024-04-11 01:20:25,349 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/am]
2024-04-11 01:20:25,450 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:25,551 INFO d14095bbf1af: Preparing
2024-04-11 01:20:25,651 INFO bfc499f16350: Preparing
2024-04-11 01:20:25,752 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:25,852 INFO d61f97cb4cd9: Preparing
2024-04-11 01:20:25,953 INFO 516e941703bc: Preparing
2024-04-11 01:20:26,054 INFO 819483beeac8: Preparing
2024-04-11 01:20:26,154 INFO 34317d1a521a: Preparing
2024-04-11 01:20:26,255 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:26,355 INFO 208badabe066: Preparing
2024-04-11 01:20:26,456 INFO e0eae498f619: Preparing
2024-04-11 01:20:26,557 INFO 9294c7eaa717: Preparing
2024-04-11 01:20:26,657 INFO f868d81874e3: Preparing
2024-04-11 01:20:26,758 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:26,859 INFO c1ff8a4df204: Preparing
2024-04-11 01:20:26,959 INFO 5e38b4b8392b: Preparing
2024-04-11 01:20:27,060 INFO 5b77d9c0759d: Preparing
2024-04-11 01:20:27,160 INFO e3cf515c9979: Preparing
2024-04-11 01:20:27,261 INFO 92c86ce17109: Preparing
2024-04-11 01:20:27,361 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:27,462 INFO 78d28b3af9bc: Preparing
2024-04-11 01:20:27,562 INFO 63a02fcbd23a: Preparing
2024-04-11 01:20:27,663 INFO f428df318334: Preparing
2024-04-11 01:20:27,763 INFO de1896743546: Preparing
2024-04-11 01:20:27,864 INFO 996808601d1a: Preparing
2024-04-11 01:20:27,964 INFO f5f0ca534769: Preparing
2024-04-11 01:20:28,065 INFO 43d7655d9763: Preparing
2024-04-11 01:20:28,165 INFO 817ab35adf00: Preparing
2024-04-11 01:20:28,266 INFO 5f63da0df493: Preparing
2024-04-11 01:20:28,366 INFO da8cb439b1ac: Preparing
2024-04-11 01:20:28,467 INFO fe8e4dddae73: Preparing
2024-04-11 01:20:28,567 INFO 68ee30e1fd27: Preparing
2024-04-11 01:20:28,668 INFO 87b291586f25: Preparing
2024-04-11 01:20:28,768 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:28,869 INFO 28108f2b4915: Preparing
2024-04-11 01:20:28,969 INFO 99c31f9d1164: Preparing
2024-04-11 01:20:29,070 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:29,170 INFO 3538abc054e4: Preparing
2024-04-11 01:20:29,273 INFO 4d51694422e1: Preparing
2024-04-11 01:20:29,373 INFO 55e9978ff1c0: Preparing
2024-04-11 01:20:29,474 INFO 0db6428be520: Preparing
2024-04-11 01:20:29,574 INFO 293d674cfca1: Preparing
2024-04-11 01:20:29,675 INFO 2e34c6d2bb66: Preparing
2024-04-11 01:20:29,775 INFO 72361db6ff3c: Preparing
2024-04-11 01:20:29,876 INFO 8a2d41061b80: Preparing
2024-04-11 01:20:29,976 INFO 167d9a67eab6: Preparing
2024-04-11 01:20:30,077 INFO 17031737aa00: Preparing
2024-04-11 01:20:30,178 INFO 5498e8c22f69: Preparing
2024-04-11 01:20:30,278 INFO f5f0ca534769: Waiting
2024-04-11 01:20:30,379 INFO 43d7655d9763: Waiting
2024-04-11 01:20:30,480 INFO 817ab35adf00: Waiting
2024-04-11 01:20:30,580 INFO 5f63da0df493: Waiting
2024-04-11 01:20:30,681 INFO da8cb439b1ac: Waiting
2024-04-11 01:20:30,782 INFO fe8e4dddae73: Waiting
2024-04-11 01:20:30,882 INFO 68ee30e1fd27: Waiting
2024-04-11 01:20:30,983 INFO 87b291586f25: Waiting
2024-04-11 01:20:31,084 INFO 28108f2b4915: Waiting
2024-04-11 01:20:31,184 INFO 99c31f9d1164: Waiting
2024-04-11 01:20:31,285 INFO 3538abc054e4: Waiting
2024-04-11 01:20:31,386 INFO 4d51694422e1: Waiting
2024-04-11 01:20:31,486 INFO 55e9978ff1c0: Waiting
2024-04-11 01:20:31,587 INFO 0db6428be520: Waiting
2024-04-11 01:20:31,688 INFO 293d674cfca1: Waiting
2024-04-11 01:20:31,788 INFO 2e34c6d2bb66: Waiting
2024-04-11 01:20:31,889 INFO 72361db6ff3c: Waiting
2024-04-11 01:20:31,989 INFO 8a2d41061b80: Waiting
2024-04-11 01:20:32,090 INFO 167d9a67eab6: Waiting
2024-04-11 01:20:32,191 INFO 17031737aa00: Waiting
2024-04-11 01:20:32,292 INFO 5498e8c22f69: Waiting
2024-04-11 01:20:32,392 INFO 819483beeac8: Waiting
2024-04-11 01:20:32,493 INFO 34317d1a521a: Waiting
2024-04-11 01:20:32,594 INFO 208badabe066: Waiting
2024-04-11 01:20:32,694 INFO e0eae498f619: Waiting
2024-04-11 01:20:32,795 INFO 9294c7eaa717: Waiting
2024-04-11 01:20:32,896 INFO f868d81874e3: Waiting
2024-04-11 01:20:32,996 INFO c1ff8a4df204: Waiting
2024-04-11 01:20:33,097 INFO 5e38b4b8392b: Waiting
2024-04-11 01:20:33,197 INFO 5b77d9c0759d: Waiting
2024-04-11 01:20:33,298 INFO e3cf515c9979: Waiting
2024-04-11 01:20:33,399 INFO 92c86ce17109: Waiting
2024-04-11 01:20:33,499 INFO 78d28b3af9bc: Waiting
2024-04-11 01:20:33,600 INFO 63a02fcbd23a: Waiting
2024-04-11 01:20:33,701 INFO f428df318334: Waiting
2024-04-11 01:20:33,801 INFO de1896743546: Waiting
2024-04-11 01:20:33,902 INFO 996808601d1a: Waiting
2024-04-11 01:20:34,003 INFO bfc499f16350: Layer already exists
2024-04-11 01:20:34,103 INFO d61f97cb4cd9: Layer already exists
2024-04-11 01:20:34,204 INFO 516e941703bc: Layer already exists
2024-04-11 01:20:34,306 INFO 5f70bf18a086: Layer already exists
2024-04-11 01:20:34,407 INFO d14095bbf1af: Layer already exists
2024-04-11 01:20:34,507 INFO 819483beeac8: Layer already exists
2024-04-11 01:20:34,608 INFO 34317d1a521a: Layer already exists
2024-04-11 01:20:34,709 INFO 9294c7eaa717: Layer already exists
2024-04-11 01:20:34,809 INFO e0eae498f619: Layer already exists
2024-04-11 01:20:34,910 INFO 208badabe066: Layer already exists
2024-04-11 01:20:35,011 INFO f868d81874e3: Layer already exists
2024-04-11 01:20:35,111 INFO c1ff8a4df204: Layer already exists
2024-04-11 01:20:35,212 INFO 5e38b4b8392b: Layer already exists
2024-04-11 01:20:35,312 INFO e3cf515c9979: Layer already exists
2024-04-11 01:20:35,413 INFO 5b77d9c0759d: Layer already exists
2024-04-11 01:20:35,513 INFO 92c86ce17109: Layer already exists
2024-04-11 01:20:35,614 INFO 78d28b3af9bc: Layer already exists
2024-04-11 01:20:35,714 INFO f428df318334: Layer already exists
2024-04-11 01:20:35,815 INFO 63a02fcbd23a: Layer already exists
2024-04-11 01:20:35,915 INFO de1896743546: Layer already exists
2024-04-11 01:20:36,016 INFO 996808601d1a: Layer already exists
2024-04-11 01:20:36,116 INFO f5f0ca534769: Layer already exists
2024-04-11 01:20:36,217 INFO 817ab35adf00: Layer already exists
2024-04-11 01:20:36,317 INFO 43d7655d9763: Layer already exists
2024-04-11 01:20:36,418 INFO 5f63da0df493: Layer already exists
2024-04-11 01:20:36,518 INFO da8cb439b1ac: Layer already exists
2024-04-11 01:20:36,619 INFO fe8e4dddae73: Layer already exists
2024-04-11 01:20:36,719 INFO 68ee30e1fd27: Layer already exists
2024-04-11 01:20:36,820 INFO 28108f2b4915: Layer already exists
2024-04-11 01:20:36,920 INFO 87b291586f25: Layer already exists
2024-04-11 01:20:37,021 INFO 99c31f9d1164: Layer already exists
2024-04-11 01:20:37,121 INFO 3538abc054e4: Layer already exists
2024-04-11 01:20:37,222 INFO 4d51694422e1: Layer already exists
2024-04-11 01:20:37,322 INFO 55e9978ff1c0: Layer already exists
2024-04-11 01:20:37,423 INFO 0db6428be520: Layer already exists
2024-04-11 01:20:37,523 INFO 293d674cfca1: Layer already exists
2024-04-11 01:20:37,624 INFO 2e34c6d2bb66: Layer already exists
2024-04-11 01:20:37,724 INFO 72361db6ff3c: Layer already exists
2024-04-11 01:20:37,825 INFO 8a2d41061b80: Layer already exists
2024-04-11 01:20:37,925 INFO 167d9a67eab6: Layer already exists
2024-04-11 01:20:38,026 INFO 17031737aa00: Layer already exists
2024-04-11 01:20:38,126 INFO 5498e8c22f69: Layer already exists
2024-04-11 01:20:38,227 INFO xlou-7.6.0-a89ff42c02de792a1493750badb7bf8554c69559: digest: sha256:e033c9c8cf9d219201c80ec7ff6eefee11fdb711f068570aa06b39775a27ab69 size: 10325
2024-04-11 01:20:38,327 INFO [1;95mUpdated the image_defaulter with your new image for am: "gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-a89ff42c02de792a1493750badb7bf8554c69559".[0m
2024-04-11 01:20:38,428 ERROR #0 building with "default" instance using docker driver
2024-04-11 01:20:38,428 ERROR
2024-04-11 01:20:38,428 ERROR #1 [internal] load build definition from Dockerfile
2024-04-11 01:20:38,428 ERROR #1 transferring dockerfile: 489B done
2024-04-11 01:20:38,428 ERROR #1 DONE 0.0s
2024-04-11 01:20:38,428 ERROR
2024-04-11 01:20:38,428 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/am-cdk/pit1:7.6.0-a89ff42c02de792a1493750badb7bf8554c69559
2024-04-11 01:20:38,428 ERROR #2 DONE 0.4s
2024-04-11 01:20:38,428 ERROR
2024-04-11 01:20:38,428 ERROR #3 [internal] load .dockerignore
2024-04-11 01:20:38,428 ERROR #3 transferring context: 2B done
2024-04-11 01:20:38,428 ERROR #3 DONE 0.0s
2024-04-11 01:20:38,429 ERROR
2024-04-11 01:20:38,429 ERROR #4 [1/5] FROM gcr.io/forgerock-io/am-cdk/pit1:7.6.0-a89ff42c02de792a1493750badb7bf8554c69559@sha256:9879849d74c193e203bbff71e903abb5dd9d9aaa4367975817b3d43f6263c14e
2024-04-11 01:20:38,429 ERROR #4 DONE 0.0s
2024-04-11 01:20:38,429 ERROR
2024-04-11 01:20:38,429 ERROR #5 [internal] load build context
2024-04-11 01:20:38,429 ERROR #5 transferring context: 3.83kB done
2024-04-11 01:20:38,429 ERROR #5 DONE 0.0s
2024-04-11 01:20:38,429 ERROR
2024-04-11 01:20:38,429 ERROR #6 [2/5] RUN echo "\033[0;36m*** Building 'cdk' profile ***\033[0m"
2024-04-11 01:20:38,429 ERROR #6 CACHED
2024-04-11 01:20:38,429 ERROR
2024-04-11 01:20:38,429 ERROR #7 [3/5] COPY --chown=forgerock:root config-profiles/cdk/ /home/forgerock/openam/
2024-04-11 01:20:38,429 ERROR #7 CACHED
2024-04-11 01:20:38,429 ERROR
2024-04-11 01:20:38,429 ERROR #8 [4/5] COPY --chown=forgerock:root *.sh /home/forgerock/
2024-04-11 01:20:38,429 ERROR #8 CACHED
2024-04-11 01:20:38,429 ERROR
2024-04-11 01:20:38,429 ERROR #9 [5/5] WORKDIR /home/forgerock
2024-04-11 01:20:38,429 ERROR #9 CACHED
2024-04-11 01:20:38,429 ERROR
2024-04-11 01:20:38,429 ERROR #10 exporting to image
2024-04-11 01:20:38,429 ERROR #10 exporting layers done
2024-04-11 01:20:38,429 ERROR #10 writing image sha256:92ccb0a0ed09d1d8b284e6c9f7fa27ce5bf748fe27229697239f5d5de5ee0972 done
2024-04-11 01:20:38,429 ERROR #10 naming to gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-a89ff42c02de792a1493750badb7bf8554c69559 done
2024-04-11 01:20:38,429 ERROR #10 DONE 0.0s
2024-04-11 01:20:38,545 INFO
2024-04-11 01:20:38,546 INFO [run_command]: kubectl config current-context
2024-04-11 01:20:38,612 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:20:38,612 DEBUG --- stdout ---
2024-04-11 01:20:38,613 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm
2024-04-11 01:20:38,613 DEBUG --- stderr ---
2024-04-11 01:20:38,613 DEBUG
2024-04-11 01:20:38,613 INFO
2024-04-11 01:20:38,613 INFO
2024-04-11 01:20:38,613 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build amster --config-profile=cdk --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-a89ff42c02de792a1493750badb7bf8554c69559
2024-04-11 01:20:38,613 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'}
2024-04-11 01:20:41,127 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/amster]
2024-04-11 01:20:41,227 INFO 33f0552bce8f: Preparing
2024-04-11 01:20:41,328 INFO 7ee260b27c39: Preparing
2024-04-11 01:20:41,428 INFO c6ded4b82ccb: Preparing
2024-04-11 01:20:41,529 INFO 950651be32a7: Preparing
2024-04-11 01:20:41,629 INFO 083d008a2312: Preparing
2024-04-11 01:20:41,730 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:41,830 INFO 7a0d79c60180: Preparing
2024-04-11 01:20:41,931 INFO eed8a33a4a5b: Preparing
2024-04-11 01:20:42,031 INFO 61337a2b3537: Preparing
2024-04-11 01:20:42,132 INFO 4737ff059b91: Preparing
2024-04-11 01:20:42,232 INFO 90847e50c633: Preparing
2024-04-11 01:20:42,333 INFO af68b949bf90: Preparing
2024-04-11 01:20:42,433 INFO d72ac74a94bf: Preparing
2024-04-11 01:20:42,534 INFO 2a0a0e1c5937: Preparing
2024-04-11 01:20:42,634 INFO 1bb0e359458e: Preparing
2024-04-11 01:20:42,735 INFO 3c8879ab2cf2: Preparing
2024-04-11 01:20:42,835 INFO 5f70bf18a086: Waiting
2024-04-11 01:20:42,936 INFO 7a0d79c60180: Waiting
2024-04-11 01:20:43,036 INFO eed8a33a4a5b: Waiting
2024-04-11 01:20:43,137 INFO 61337a2b3537: Waiting
2024-04-11 01:20:43,237 INFO 4737ff059b91: Waiting
2024-04-11 01:20:43,338 INFO 90847e50c633: Waiting
2024-04-11 01:20:43,439 INFO af68b949bf90: Waiting
2024-04-11 01:20:43,539 INFO d72ac74a94bf: Waiting
2024-04-11 01:20:43,640 INFO 2a0a0e1c5937: Waiting
2024-04-11 01:20:43,741 INFO 1bb0e359458e: Waiting
2024-04-11 01:20:43,841 INFO 3c8879ab2cf2: Waiting
2024-04-11 01:20:43,942 INFO 083d008a2312: Layer already exists
2024-04-11 01:20:44,042 INFO 33f0552bce8f: Layer already exists
2024-04-11 01:20:44,143 INFO 950651be32a7: Layer already exists
2024-04-11 01:20:44,244 INFO 7ee260b27c39: Layer already exists
2024-04-11 01:20:44,344 INFO c6ded4b82ccb: Layer already exists
2024-04-11 01:20:44,445 INFO 7a0d79c60180: Layer already exists
2024-04-11 01:20:44,545 INFO 5f70bf18a086: Layer already exists
2024-04-11 01:20:44,646 INFO eed8a33a4a5b: Layer already exists
2024-04-11 01:20:44,746 INFO 4737ff059b91: Layer already exists
2024-04-11 01:20:44,847 INFO 61337a2b3537: Layer already exists
2024-04-11 01:20:44,947 INFO 90847e50c633: Layer already exists
2024-04-11 01:20:45,048 INFO af68b949bf90: Layer already exists
2024-04-11 01:20:45,148 INFO d72ac74a94bf: Layer already exists
2024-04-11 01:20:45,249 INFO 2a0a0e1c5937: Layer already exists
2024-04-11 01:20:45,349 INFO 1bb0e359458e: Layer already exists
2024-04-11 01:20:45,450 INFO 3c8879ab2cf2: Layer already exists
2024-04-11 01:20:45,551 INFO xlou-7.6.0-a89ff42c02de792a1493750badb7bf8554c69559: digest: sha256:5bae94e30e77ffc5c2fdb4315e5d3f9fcc973c5c06fac4b4b724b4d12fdad5c1 size: 3666
2024-04-11 01:20:45,651 INFO [1;91mEmbedding AM dynamic configs in the amster image is deprecated. Manage AM dynamic config with the bin/amster cmd instead.[0m
2024-04-11 01:20:45,752 INFO [1;95mUpdated the image_defaulter with your new image for amster: "gcr.io/engineeringpit/lodestar-images/amster:xlou-7.6.0-a89ff42c02de792a1493750badb7bf8554c69559".[0m
2024-04-11 01:20:45,853 ERROR #0 building with "default" instance using docker driver
2024-04-11 01:20:45,853 ERROR
2024-04-11 01:20:45,853 ERROR #1 [internal] load build definition from Dockerfile
2024-04-11 01:20:45,853 ERROR #1 transferring dockerfile: 802B done
2024-04-11 01:20:45,853 ERROR #1 DONE 0.0s
2024-04-11 01:20:45,853 ERROR
2024-04-11 01:20:45,853 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/amster/pit1:7.6.0-a89ff42c02de792a1493750badb7bf8554c69559
2024-04-11 01:20:45,853 ERROR #2 DONE 0.4s
2024-04-11 01:20:45,853 ERROR
2024-04-11 01:20:45,853 ERROR #3 [internal] load .dockerignore
2024-04-11 01:20:45,853 ERROR #3 transferring context: 2B done
2024-04-11 01:20:45,853 ERROR #3 DONE 0.0s
2024-04-11 01:20:45,853 ERROR
2024-04-11 01:20:45,853 ERROR #4 [1/6] FROM gcr.io/forgerock-io/amster/pit1:7.6.0-a89ff42c02de792a1493750badb7bf8554c69559@sha256:07099b50a37de7556b1927f134162db9f9983dbf11a77d44d3302c5de5b0276a
2024-04-11 01:20:45,853 ERROR #4 DONE 0.0s
2024-04-11 01:20:45,854 ERROR
2024-04-11 01:20:45,854 ERROR #5 [internal] load build context
2024-04-11 01:20:45,854 ERROR #5 transferring context: 41.18kB done
2024-04-11 01:20:45,854 ERROR #5 DONE 0.0s
2024-04-11 01:20:45,854 ERROR
2024-04-11 01:20:45,854 ERROR #6 [2/6] RUN apt-get update && apt-get install -y openldap-utils jq inotify-tools && apt-get clean && rm -r /var/lib/apt/lists /var/cache/apt/archives
2024-04-11 01:20:45,854 ERROR #6 CACHED
2024-04-11 01:20:45,854 ERROR
2024-04-11 01:20:45,854 ERROR #7 [5/6] COPY --chown=forgerock:root scripts /opt/amster
2024-04-11 01:20:45,854 ERROR #7 CACHED
2024-04-11 01:20:45,854 ERROR
2024-04-11 01:20:45,854 ERROR #8 [3/6] RUN echo "\033[0;36m*** Building 'cdk' profile ***\033[0m"
2024-04-11 01:20:45,854 ERROR #8 CACHED
2024-04-11 01:20:45,854 ERROR
2024-04-11 01:20:45,854 ERROR #9 [4/6] COPY --chown=forgerock:root config-profiles/cdk/ /opt/amster
2024-04-11 01:20:45,854 ERROR #9 CACHED
2024-04-11 01:20:45,854 ERROR
2024-04-11 01:20:45,854 ERROR #10 [6/6] RUN chmod 777 /opt/amster
2024-04-11 01:20:45,854 ERROR #10 CACHED
2024-04-11 01:20:45,854 ERROR
2024-04-11 01:20:45,854 ERROR #11 exporting to image
2024-04-11 01:20:45,854 ERROR #11 exporting layers done
2024-04-11 01:20:45,854 ERROR #11 writing image sha256:3dac0f99ba3e3e588e1c1304f4216d1e41c3cc2b38fc7066bb9a3020dcadf9bb done
2024-04-11 01:20:45,854 ERROR #11 naming to gcr.io/engineeringpit/lodestar-images/amster:xlou-7.6.0-a89ff42c02de792a1493750badb7bf8554c69559 done
2024-04-11 01:20:45,854 ERROR #11 DONE 0.0s
2024-04-11 01:20:45,977 INFO
2024-04-11 01:20:45,977 INFO [run_command]: kubectl config current-context
2024-04-11 01:20:46,056 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:20:46,057 DEBUG --- stdout ---
2024-04-11 01:20:46,057 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm
2024-04-11 01:20:46,057 DEBUG --- stderr ---
2024-04-11 01:20:46,057 DEBUG
2024-04-11 01:20:46,057 INFO
2024-04-11 01:20:46,057 INFO
2024-04-11 01:20:46,058 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build idm --config-profile=cdk --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-837ae72b84acb5834895e649a50c85cab1dce9e8
2024-04-11 01:20:46,058 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'}
2024-04-11 01:20:48,571 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/idm]
2024-04-11 01:20:48,672 INFO 3681e92008df: Preparing
2024-04-11 01:20:48,772 INFO 7be7781ca659: Preparing
2024-04-11 01:20:48,873 INFO 0a26614bbc68: Preparing
2024-04-11 01:20:48,973 INFO d0f7cdaf296c: Preparing
2024-04-11 01:20:49,074 INFO 0015bca83720: Preparing
2024-04-11 01:20:49,174 INFO 43c0aa1ddc02: Preparing
2024-04-11 01:20:49,275 INFO 5f70bf18a086: Preparing
2024-04-11 01:20:49,376 INFO 04c134b0dd6c: Preparing
2024-04-11 01:20:49,476 INFO 17a17b0c035d: Preparing
2024-04-11 01:20:49,577 INFO 5d58d9e04fc0: Preparing
2024-04-11 01:20:49,677 INFO d72ac74a94bf: Preparing
2024-04-11 01:20:49,778 INFO 2a0a0e1c5937: Preparing
2024-04-11 01:20:49,879 INFO 1bb0e359458e: Preparing
2024-04-11 01:20:49,982 INFO 3c8879ab2cf2: Preparing
2024-04-11 01:20:50,083 INFO 5d58d9e04fc0: Waiting
2024-04-11 01:20:50,184 INFO d72ac74a94bf: Waiting
2024-04-11 01:20:50,284 INFO 2a0a0e1c5937: Waiting
2024-04-11 01:20:50,385 INFO 1bb0e359458e: Waiting
2024-04-11 01:20:50,485 INFO 3c8879ab2cf2: Waiting
2024-04-11 01:20:50,586 INFO 43c0aa1ddc02: Waiting
2024-04-11 01:20:50,686 INFO 5f70bf18a086: Waiting
2024-04-11 01:20:50,787 INFO 04c134b0dd6c: Waiting
2024-04-11 01:20:50,887 INFO 17a17b0c035d: Waiting
2024-04-11 01:20:50,988 INFO 0015bca83720: Layer already exists
2024-04-11 01:20:51,088 INFO d0f7cdaf296c: Layer already exists
2024-04-11 01:20:51,189 INFO 7be7781ca659: Layer already exists
2024-04-11 01:20:51,289 INFO 3681e92008df: Layer already exists
2024-04-11 01:20:51,390 INFO 0a26614bbc68: Layer already exists
2024-04-11 01:20:51,491 INFO 43c0aa1ddc02: Layer already exists
2024-04-11 01:20:51,591 INFO 5f70bf18a086: Layer already exists
2024-04-11 01:20:51,692 INFO 04c134b0dd6c: Layer already exists
2024-04-11 01:20:51,793 INFO 5d58d9e04fc0: Layer already exists
2024-04-11 01:20:51,893 INFO 17a17b0c035d: Layer already exists
2024-04-11 01:20:51,994 INFO 2a0a0e1c5937: Layer already exists
2024-04-11 01:20:52,095 INFO d72ac74a94bf: Layer already exists
2024-04-11 01:20:52,195 INFO 3c8879ab2cf2: Layer already exists
2024-04-11 01:20:52,296 INFO 1bb0e359458e: Layer already exists
2024-04-11 01:20:52,397 INFO xlou-7.6.0-837ae72b84acb5834895e649a50c85cab1dce9e8: digest: sha256:9160172affdaf3d5fd35c0002cae416b7d1b53de240e7ffdb96e3bdeeebb8c1d size: 3240
2024-04-11 01:20:52,497 INFO [1;95mUpdated the image_defaulter with your new image for idm: "gcr.io/engineeringpit/lodestar-images/idm:xlou-7.6.0-837ae72b84acb5834895e649a50c85cab1dce9e8".[0m
2024-04-11 01:20:52,598 ERROR #0 building with "default" instance using docker driver
2024-04-11 01:20:52,598 ERROR
2024-04-11 01:20:52,598 ERROR #1 [internal] load build definition from Dockerfile
2024-04-11 01:20:52,598 ERROR #1 transferring dockerfile: 1.08kB done
2024-04-11 01:20:52,598 ERROR #1 DONE 0.0s
2024-04-11 01:20:52,598 ERROR
2024-04-11 01:20:52,598 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/idm-cdk/pit1:7.6.0-837ae72b84acb5834895e649a50c85cab1dce9e8
2024-04-11 01:20:52,598 ERROR #2 DONE 0.4s
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #3 [internal] load .dockerignore
2024-04-11 01:20:52,599 ERROR #3 transferring context: 2B done
2024-04-11 01:20:52,599 ERROR #3 DONE 0.0s
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #4 [1/7] FROM gcr.io/forgerock-io/idm-cdk/pit1:7.6.0-837ae72b84acb5834895e649a50c85cab1dce9e8@sha256:7e1cac1ce96f8bf65cf9b69e7045b04870c2a95d45fcccc5ec64955be9ee55e6
2024-04-11 01:20:52,599 ERROR #4 DONE 0.0s
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #5 [internal] load build context
2024-04-11 01:20:52,599 ERROR #5 transferring context: 281.63kB 0.0s done
2024-04-11 01:20:52,599 ERROR #5 DONE 0.0s
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #6 [4/7] RUN echo "\033[0;36m*** Building 'cdk' profile ***\033[0m"
2024-04-11 01:20:52,599 ERROR #6 CACHED
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #7 [6/7] COPY --chown=forgerock:root bin/import-pem-certs.sh /opt/openidm/bin
2024-04-11 01:20:52,599 ERROR #7 CACHED
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #8 [3/7] RUN rm -f bundle/org.apache.felix.webconsole*.jar && rm -f bundle/openidm-felix-webconsole-*.jar
2024-04-11 01:20:52,599 ERROR #8 CACHED
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #9 [2/7] COPY debian-buster-sources.list /etc/apt/sources.list
2024-04-11 01:20:52,599 ERROR #9 CACHED
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #10 [5/7] COPY --chown=forgerock:root config-profiles/cdk/ /opt/openidm
2024-04-11 01:20:52,599 ERROR #10 CACHED
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #11 [7/7] COPY --chown=forgerock:root . /opt/openidm
2024-04-11 01:20:52,599 ERROR #11 CACHED
2024-04-11 01:20:52,599 ERROR
2024-04-11 01:20:52,599 ERROR #12 exporting to image
2024-04-11 01:20:52,599 ERROR #12 exporting layers done
2024-04-11 01:20:52,599 ERROR #12 writing image sha256:3a534c86c4f6420587f525ebd55faca3e94238bf77d010bdc2a64658f01690bc done
2024-04-11 01:20:52,599 ERROR #12 naming to gcr.io/engineeringpit/lodestar-images/idm:xlou-7.6.0-837ae72b84acb5834895e649a50c85cab1dce9e8 done
2024-04-11 01:20:52,599 ERROR #12 DONE 0.0s
2024-04-11 01:20:52,600 INFO
2024-04-11 01:20:52,600 INFO -------- Deploy product images using forgeops install command --------
2024-04-11 01:20:52,726 INFO
2024-04-11 01:20:52,726 INFO [run_command]: kubectl config current-context
2024-04-11 01:20:52,806 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:20:52,806 DEBUG --- stdout ---
2024-04-11 01:20:52,806 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm
2024-04-11 01:20:52,806 DEBUG --- stderr ---
2024-04-11 01:20:52,806 DEBUG
2024-04-11 01:20:52,806 INFO
2024-04-11 01:20:52,807 INFO
2024-04-11 01:20:52,807 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops install --namespace=xlou --fqdn xlou.iam.xlou-cdm.engineeringpit.com --custom /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/overlay/internal-profiles/medium-old --legacy all
2024-04-11 01:20:52,807 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'}
2024-04-11 01:20:56,929 INFO customresourcedefinition.apiextensions.k8s.io/secretagentconfigurations.secret-agent.secrets.forgerock.io condition met
2024-04-11 01:20:57,431 INFO deployment.apps/secret-agent-controller-manager condition met
2024-04-11 01:20:57,732 INFO NAME READY STATUS RESTARTS AGE
2024-04-11 01:20:57,833 INFO secret-agent-controller-manager-85df555854-fhtqk 2/2 Running 0 10h
2024-04-11 01:20:59,738 INFO configmap/platform-config created
2024-04-11 01:21:00,039 INFO ingress.networking.k8s.io/forgerock created
2024-04-11 01:21:00,340 INFO ingress.networking.k8s.io/ig created
2024-04-11 01:21:01,644 INFO certificate.cert-manager.io/ds-master-cert created
2024-04-11 01:21:01,947 INFO certificate.cert-manager.io/ds-ssl-cert created
2024-04-11 01:21:02,248 INFO issuer.cert-manager.io/selfsigned-issuer created
2024-04-11 01:21:02,850 INFO secretagentconfiguration.secret-agent.secrets.forgerock.io/forgerock-sac created
2024-04-11 01:21:02,951 INFO Checking cert-manager and related CRDs: [1;96mcert-manager CRD found in cluster.[0m
2024-04-11 01:21:03,051 INFO Checking secret-agent operator and related CRDs: [1;96msecret-agent CRD found in cluster.[0m
2024-04-11 01:21:03,152 INFO [1;96m
2024-04-11 01:21:03,252 INFO Checking secret-agent operator is running...[0m
2024-04-11 01:21:03,353 INFO [1;96msecret-agent operator is running[0m
2024-04-11 01:21:03,453 INFO
2024-04-11 01:21:03,554 INFO [1;96mInstalling component(s): ['all'] platform: "custom-old" in namespace: "xlou" from deployment manifests in "None".
2024-04-11 01:21:03,654 INFO [0m
2024-04-11 01:21:03,755 INFO [1;96mDeploying base.yaml. This is a one time activity.[0m
2024-04-11 01:21:03,856 INFO [1;96m
2024-04-11 01:21:03,956 INFO Waiting for K8s secrets.[0m
2024-04-11 01:21:04,559 INFO Waiting for secret "am-env-secrets" to exist in the cluster: .done
2024-04-11 01:21:08,974 INFO Waiting for secret "idm-env-secrets" to exist in the cluster: ...done
2024-04-11 01:21:09,377 INFO Waiting for secret "ds-passwords" to exist in the cluster: done
2024-04-11 01:21:11,584 INFO Waiting for secret "ds-env-secrets" to exist in the cluster: secret/cloud-storage-credentials-cts created
2024-04-11 01:21:11,784 INFO secret/cloud-storage-credentials-idrepo created
2024-04-11 01:21:12,086 INFO service/ds-cts created
2024-04-11 01:21:12,286 INFO service/ds-idrepo created
2024-04-11 01:21:12,587 INFO statefulset.apps/ds-cts created
2024-04-11 01:21:12,888 INFO statefulset.apps/ds-idrepo created
2024-04-11 01:21:13,089 INFO job.batch/ldif-importer created
2024-04-11 01:21:13,190 INFO done
2024-04-11 01:21:13,290 INFO [1;96m
2024-04-11 01:21:13,391 INFO Deploying ds.yaml. This includes all directory resources.[0m
2024-04-11 01:21:13,492 INFO [1;96m
2024-04-11 01:21:13,592 INFO Waiting for DS deployment. This can take a few minutes. First installation takes longer.[0m
2024-04-11 01:21:14,094 INFO Waiting for statefulset "ds-idrepo" to exist in the cluster: Waiting for 3 pods to be ready...
2024-04-11 01:21:48,901 INFO Waiting for 2 pods to be ready...
2024-04-11 01:21:49,001 INFO Waiting for 2 pods to be ready...
2024-04-11 01:22:25,111 INFO Waiting for 1 pods to be ready...
2024-04-11 01:22:25,212 INFO Waiting for 1 pods to be ready...
2024-04-11 01:22:58,414 INFO statefulset rolling update complete 3 pods at revision ds-idrepo-76f9f698cf...
2024-04-11 01:22:58,514 INFO done
2024-04-11 01:22:59,418 INFO Waiting for Service Account Password Update: done
2024-04-11 01:23:00,321 INFO Waiting for statefulset "ds-cts" to exist in the cluster: statefulset rolling update complete 3 pods at revision ds-cts-bf5d4667...
2024-04-11 01:23:00,421 INFO done
2024-04-11 01:23:05,034 INFO Waiting for Service Account Password Update: configmap/am-logback created
2024-04-11 01:23:05,235 INFO configmap/amster-files created
2024-04-11 01:23:05,536 INFO configmap/idm created
2024-04-11 01:23:05,736 INFO configmap/idm-logging-properties created
2024-04-11 01:23:06,038 INFO service/am created
2024-04-11 01:23:06,238 INFO service/idm created
2024-04-11 01:23:06,539 INFO deployment.apps/am created
2024-04-11 01:23:06,841 INFO deployment.apps/idm created
2024-04-11 01:23:07,142 INFO job.batch/amster created
2024-04-11 01:23:09,149 INFO done
2024-04-11 01:23:09,250 INFO [1;96mCleaning up amster components.[0m
2024-04-11 01:23:09,350 INFO [1;96m
2024-04-11 01:23:09,451 INFO Deploying apps.[0m
2024-04-11 01:23:09,552 INFO [1;96m
2024-04-11 01:23:09,652 INFO Waiting for AM deployment. This can take a few minutes. First installation takes longer.[0m
2024-04-11 01:23:37,343 INFO Waiting for deployment "am" to exist in the cluster: deployment.apps/am condition met
2024-04-11 01:23:38,947 INFO configmap/amster-retain created
2024-04-11 01:23:39,048 INFO done
2024-04-11 01:23:39,149 INFO [1;96m
2024-04-11 01:23:39,249 INFO Waiting for amster job to complete. This can take several minutes.[0m
2024-04-11 01:24:01,314 INFO Waiting for job "amster" to exist in the cluster: job.batch/amster condition met
2024-04-11 01:24:01,414 INFO done
2024-04-11 01:24:01,515 INFO [1;96m
2024-04-11 01:24:01,616 INFO Waiting for IDM deployment. This can take a few minutes. First installation takes longer.[0m
2024-04-11 01:24:07,434 INFO Waiting for deployment "idm" to exist in the cluster: pod/idm-668d898cfd-2vqdm condition met
2024-04-11 01:24:07,635 INFO pod/idm-668d898cfd-st2t7 condition met
2024-04-11 01:24:09,340 INFO service/admin-ui created
2024-04-11 01:24:09,541 INFO service/end-user-ui created
2024-04-11 01:24:09,741 INFO service/login-ui created
2024-04-11 01:24:10,042 INFO deployment.apps/admin-ui created
2024-04-11 01:24:10,343 INFO deployment.apps/end-user-ui created
2024-04-11 01:24:10,544 INFO deployment.apps/login-ui created
2024-04-11 01:24:10,645 INFO done
2024-04-11 01:24:10,745 INFO [1;96m
2024-04-11 01:24:10,846 INFO Deploying UI.[0m
2024-04-11 01:24:10,946 INFO [1;96m
2024-04-11 01:24:11,046 INFO Waiting for K8s secrets.[0m
2024-04-11 01:24:11,147 INFO Waiting for secret "am-env-secrets" to exist in the cluster: done
2024-04-11 01:24:11,247 INFO Waiting for secret "idm-env-secrets" to exist in the cluster: done
2024-04-11 01:24:11,448 INFO Waiting for secret "ds-passwords" to exist in the cluster: done
2024-04-11 01:24:13,956 INFO Waiting for secret "ds-env-secrets" to exist in the cluster: done
2024-04-11 01:24:14,056 INFO [1;96m
2024-04-11 01:24:14,157 INFO Relevant passwords:[0m
2024-04-11 01:24:14,258 INFO 1q1hdZzTipTrDIdXfQMGk1W3 (amadmin user)
2024-04-11 01:24:14,358 INFO BeqxyXdenFnTwBIdWkspvdilgvkC12cq (uid=admin user)
2024-04-11 01:24:14,460 INFO ZCwClKS47tnN7SMXA2d7o5QDLjWFZCqw (App str svc acct (uid=am-config,ou=admins,ou=am-config))
2024-04-11 01:24:14,560 INFO IBHnwvMTVaKFOPkQ3fuHgLTC6jvCOrl6 (CTS svc acct (uid=openam_cts,ou=admins,ou=famrecords,ou=openam-session,ou=tokens))
2024-04-11 01:24:14,661 INFO alRMjDW4Dl7AUO2IoCIqlnM2Gpbk58Ma (ID repo svc acct (uid=am-identity-bind-account,ou=admins,ou=identities))
2024-04-11 01:24:14,762 INFO [1;96m
2024-04-11 01:24:14,862 INFO Relevant URLs:[0m
2024-04-11 01:24:14,963 INFO https://xlou.iam.xlou-cdm.engineeringpit.com/platform
2024-04-11 01:24:15,063 INFO https://xlou.iam.xlou-cdm.engineeringpit.com/admin
2024-04-11 01:24:15,164 INFO https://xlou.iam.xlou-cdm.engineeringpit.com/am
2024-04-11 01:24:15,264 INFO https://xlou.iam.xlou-cdm.engineeringpit.com/enduser
2024-04-11 01:24:15,365 INFO [1;96m
2024-04-11 01:24:15,465 INFO Enjoy your deployment![0m
2024-04-11 01:24:15,566 ERROR # Warning: 'vars' is deprecated. Please use 'replacements' instead. [EXPERIMENTAL] Run 'kustomize edit fix' to update your Kustomization automatically.
2024-04-11 01:24:15,566 ERROR # Warning: 'patchesJson6902' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically.
2024-04-11 01:24:15,566 ERROR # Warning: 'patchesStrategicMerge' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically.
2024-04-11 01:24:15,566 INFO Setting context for components to: gke_engineeringpit_us-east1-d_xlou-cdm
2024-04-11 01:24:15,566 INFO
2024-04-11 01:24:15,566 INFO **************************** Initializing component pods for DS-CTS ****************************
2024-04-11 01:24:15,566 INFO
2024-04-11 01:24:15,566 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:15,567 INFO
2024-04-11 01:24:15,567 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-cts --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:15,567 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:15,955 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:15,955 DEBUG --- stdout ---
2024-04-11 01:24:15,955 DEBUG 3
2024-04-11 01:24:15,955 DEBUG --- stderr ---
2024-04-11 01:24:15,955 DEBUG
2024-04-11 01:24:15,956 INFO
2024-04-11 01:24:15,956 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:24:15,956 INFO
2024-04-11 01:24:15,956 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=ds-cts --output jsonpath={.items[*].metadata.name}` | grep 3
2024-04-11 01:24:15,956 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:24:16,397 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
2024-04-11 01:24:16,397 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:16,397 DEBUG --- stdout ---
2024-04-11 01:24:16,397 DEBUG ds-cts-0 ds-cts-1 ds-cts-2
2024-04-11 01:24:16,397 DEBUG --- stderr ---
2024-04-11 01:24:16,397 DEBUG
2024-04-11 01:24:16,397 INFO
2024-04-11 01:24:16,397 INFO -------------------- Check pod ds-cts-0 is running --------------------
2024-04-11 01:24:16,398 INFO
2024-04-11 01:24:16,398 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-0 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:16,398 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:16,757 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:16,758 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:16,758 DEBUG --- stdout ---
2024-04-11 01:24:16,758 DEBUG Running
2024-04-11 01:24:16,758 DEBUG --- stderr ---
2024-04-11 01:24:16,758 DEBUG
2024-04-11 01:24:16,758 INFO
2024-04-11 01:24:16,758 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-0 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:16,758 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:17,121 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:17,121 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:17,121 DEBUG --- stdout ---
2024-04-11 01:24:17,121 DEBUG true
2024-04-11 01:24:17,121 DEBUG --- stderr ---
2024-04-11 01:24:17,121 DEBUG
2024-04-11 01:24:17,121 INFO
2024-04-11 01:24:17,121 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-0 --output jsonpath={.status.startTime}
2024-04-11 01:24:17,121 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:17,484 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:17,484 DEBUG --- stdout ---
2024-04-11 01:24:17,484 DEBUG 2024-04-11T01:21:16Z
2024-04-11 01:24:17,484 DEBUG --- stderr ---
2024-04-11 01:24:17,484 DEBUG
2024-04-11 01:24:17,486 INFO
2024-04-11 01:24:17,486 INFO ------------- Check pod ds-cts-0 filesystem is accessible -------------
2024-04-11 01:24:18,338 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:18,338 INFO
2024-04-11 01:24:18,338 INFO ------------------ Check pod ds-cts-0 restart count ------------------
2024-04-11 01:24:18,339 INFO
2024-04-11 01:24:18,339 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-0 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:18,339 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:18,703 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:18,703 DEBUG --- stdout ---
2024-04-11 01:24:18,703 DEBUG 0
2024-04-11 01:24:18,703 DEBUG --- stderr ---
2024-04-11 01:24:18,703 DEBUG
2024-04-11 01:24:18,703 INFO Pod ds-cts-0 has been restarted 0 times.
2024-04-11 01:24:18,703 INFO
2024-04-11 01:24:18,703 INFO -------------------- Check pod ds-cts-1 is running --------------------
2024-04-11 01:24:18,703 INFO
2024-04-11 01:24:18,703 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-1 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:18,704 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:19,087 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:19,087 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:19,087 DEBUG --- stdout ---
2024-04-11 01:24:19,087 DEBUG Running
2024-04-11 01:24:19,087 DEBUG --- stderr ---
2024-04-11 01:24:19,087 DEBUG
2024-04-11 01:24:19,088 INFO
2024-04-11 01:24:19,088 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-1 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:19,088 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:19,447 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:19,447 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:19,448 DEBUG --- stdout ---
2024-04-11 01:24:19,449 DEBUG true
2024-04-11 01:24:19,449 DEBUG --- stderr ---
2024-04-11 01:24:19,449 DEBUG
2024-04-11 01:24:19,449 INFO
2024-04-11 01:24:19,449 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-1 --output jsonpath={.status.startTime}
2024-04-11 01:24:19,449 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:19,821 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:19,821 DEBUG --- stdout ---
2024-04-11 01:24:19,821 DEBUG 2024-04-11T01:21:42Z
2024-04-11 01:24:19,821 DEBUG --- stderr ---
2024-04-11 01:24:19,821 DEBUG
2024-04-11 01:24:19,822 INFO
2024-04-11 01:24:19,822 INFO ------------- Check pod ds-cts-1 filesystem is accessible -------------
2024-04-11 01:24:20,672 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:20,672 INFO
2024-04-11 01:24:20,673 INFO ------------------ Check pod ds-cts-1 restart count ------------------
2024-04-11 01:24:20,673 INFO
2024-04-11 01:24:20,673 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-1 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:20,673 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:21,052 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:21,052 DEBUG --- stdout ---
2024-04-11 01:24:21,052 DEBUG 0
2024-04-11 01:24:21,052 DEBUG --- stderr ---
2024-04-11 01:24:21,053 DEBUG
2024-04-11 01:24:21,053 INFO Pod ds-cts-1 has been restarted 0 times.
2024-04-11 01:24:21,053 INFO
2024-04-11 01:24:21,053 INFO -------------------- Check pod ds-cts-2 is running --------------------
2024-04-11 01:24:21,053 INFO
2024-04-11 01:24:21,053 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-2 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:21,053 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:21,421 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:21,421 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:21,422 DEBUG --- stdout ---
2024-04-11 01:24:21,422 DEBUG Running
2024-04-11 01:24:21,422 DEBUG --- stderr ---
2024-04-11 01:24:21,422 DEBUG
2024-04-11 01:24:21,422 INFO
2024-04-11 01:24:21,422 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-2 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:21,422 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:21,786 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:21,786 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:21,786 DEBUG --- stdout ---
2024-04-11 01:24:21,786 DEBUG true
2024-04-11 01:24:21,786 DEBUG --- stderr ---
2024-04-11 01:24:21,786 DEBUG
2024-04-11 01:24:21,786 INFO
2024-04-11 01:24:21,786 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-2 --output jsonpath={.status.startTime}
2024-04-11 01:24:21,786 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:22,143 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:22,143 DEBUG --- stdout ---
2024-04-11 01:24:22,143 DEBUG 2024-04-11T01:22:08Z
2024-04-11 01:24:22,143 DEBUG --- stderr ---
2024-04-11 01:24:22,143 DEBUG
2024-04-11 01:24:22,144 INFO
2024-04-11 01:24:22,144 INFO ------------- Check pod ds-cts-2 filesystem is accessible -------------
2024-04-11 01:24:22,982 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:22,983 INFO
2024-04-11 01:24:22,983 INFO ------------------ Check pod ds-cts-2 restart count ------------------
2024-04-11 01:24:22,983 INFO
2024-04-11 01:24:22,983 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-2 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:22,983 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:23,338 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:23,338 DEBUG --- stdout ---
2024-04-11 01:24:23,338 DEBUG 0
2024-04-11 01:24:23,338 DEBUG --- stderr ---
2024-04-11 01:24:23,338 DEBUG
2024-04-11 01:24:23,338 INFO Pod ds-cts-2 has been restarted 0 times.
2024-04-11 01:24:23,338 INFO
2024-04-11 01:24:23,338 INFO ************************** Initializing component pods for DS-IDREPO **************************
2024-04-11 01:24:23,339 INFO
2024-04-11 01:24:23,339 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:23,339 INFO
2024-04-11 01:24:23,339 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-idrepo --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:23,339 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:23,718 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:23,719 DEBUG --- stdout ---
2024-04-11 01:24:23,719 DEBUG 3
2024-04-11 01:24:23,719 DEBUG --- stderr ---
2024-04-11 01:24:23,719 DEBUG
2024-04-11 01:24:23,719 INFO
2024-04-11 01:24:23,719 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:24:23,719 INFO
2024-04-11 01:24:23,719 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=ds-idrepo --output jsonpath={.items[*].metadata.name}` | grep 3
2024-04-11 01:24:23,719 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:24:24,165 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
2024-04-11 01:24:24,165 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:24,165 DEBUG --- stdout ---
2024-04-11 01:24:24,165 DEBUG ds-idrepo-0 ds-idrepo-1 ds-idrepo-2
2024-04-11 01:24:24,165 DEBUG --- stderr ---
2024-04-11 01:24:24,165 DEBUG
2024-04-11 01:24:24,165 INFO
2024-04-11 01:24:24,165 INFO ------------------ Check pod ds-idrepo-0 is running ------------------
2024-04-11 01:24:24,165 INFO
2024-04-11 01:24:24,165 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-0 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:24,166 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:24,534 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:24,535 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:24,535 DEBUG --- stdout ---
2024-04-11 01:24:24,535 DEBUG Running
2024-04-11 01:24:24,535 DEBUG --- stderr ---
2024-04-11 01:24:24,535 DEBUG
2024-04-11 01:24:24,535 INFO
2024-04-11 01:24:24,535 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-0 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:24,535 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:24,914 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:24,915 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:24,915 DEBUG --- stdout ---
2024-04-11 01:24:24,915 DEBUG true
2024-04-11 01:24:24,915 DEBUG --- stderr ---
2024-04-11 01:24:24,915 DEBUG
2024-04-11 01:24:24,915 INFO
2024-04-11 01:24:24,915 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-0 --output jsonpath={.status.startTime}
2024-04-11 01:24:24,915 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:25,289 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:25,289 DEBUG --- stdout ---
2024-04-11 01:24:25,289 DEBUG 2024-04-11T01:21:16Z
2024-04-11 01:24:25,290 DEBUG --- stderr ---
2024-04-11 01:24:25,290 DEBUG
2024-04-11 01:24:25,290 INFO
2024-04-11 01:24:25,290 INFO ----------- Check pod ds-idrepo-0 filesystem is accessible -----------
2024-04-11 01:24:26,137 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:26,137 INFO
2024-04-11 01:24:26,137 INFO ----------------- Check pod ds-idrepo-0 restart count -----------------
2024-04-11 01:24:26,138 INFO
2024-04-11 01:24:26,138 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-0 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:26,138 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:26,513 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:26,513 DEBUG --- stdout ---
2024-04-11 01:24:26,513 DEBUG 0
2024-04-11 01:24:26,513 DEBUG --- stderr ---
2024-04-11 01:24:26,513 DEBUG
2024-04-11 01:24:26,513 INFO Pod ds-idrepo-0 has been restarted 0 times.
2024-04-11 01:24:26,513 INFO
2024-04-11 01:24:26,513 INFO ------------------ Check pod ds-idrepo-1 is running ------------------
2024-04-11 01:24:26,514 INFO
2024-04-11 01:24:26,514 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-1 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:26,514 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:26,913 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:26,913 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:26,913 DEBUG --- stdout ---
2024-04-11 01:24:26,913 DEBUG Running
2024-04-11 01:24:26,913 DEBUG --- stderr ---
2024-04-11 01:24:26,913 DEBUG
2024-04-11 01:24:26,914 INFO
2024-04-11 01:24:26,914 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-1 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:26,914 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:27,285 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:27,286 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:27,286 DEBUG --- stdout ---
2024-04-11 01:24:27,286 DEBUG true
2024-04-11 01:24:27,286 DEBUG --- stderr ---
2024-04-11 01:24:27,286 DEBUG
2024-04-11 01:24:27,286 INFO
2024-04-11 01:24:27,286 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-1 --output jsonpath={.status.startTime}
2024-04-11 01:24:27,286 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:27,660 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:27,660 DEBUG --- stdout ---
2024-04-11 01:24:27,660 DEBUG 2024-04-11T01:21:52Z
2024-04-11 01:24:27,660 DEBUG --- stderr ---
2024-04-11 01:24:27,660 DEBUG
2024-04-11 01:24:27,661 INFO
2024-04-11 01:24:27,661 INFO ----------- Check pod ds-idrepo-1 filesystem is accessible -----------
2024-04-11 01:24:28,515 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:28,515 INFO
2024-04-11 01:24:28,515 INFO ----------------- Check pod ds-idrepo-1 restart count -----------------
2024-04-11 01:24:28,515 INFO
2024-04-11 01:24:28,515 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-1 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:28,515 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:28,896 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:28,897 DEBUG --- stdout ---
2024-04-11 01:24:28,897 DEBUG 0
2024-04-11 01:24:28,897 DEBUG --- stderr ---
2024-04-11 01:24:28,897 DEBUG
2024-04-11 01:24:28,897 INFO Pod ds-idrepo-1 has been restarted 0 times.
2024-04-11 01:24:28,897 INFO
2024-04-11 01:24:28,897 INFO ------------------ Check pod ds-idrepo-2 is running ------------------
2024-04-11 01:24:28,897 INFO
2024-04-11 01:24:28,897 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-2 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:28,897 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:29,253 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:29,253 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:29,253 DEBUG --- stdout ---
2024-04-11 01:24:29,253 DEBUG Running
2024-04-11 01:24:29,253 DEBUG --- stderr ---
2024-04-11 01:24:29,253 DEBUG
2024-04-11 01:24:29,254 INFO
2024-04-11 01:24:29,254 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-2 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:29,254 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:29,613 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:29,614 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:29,614 DEBUG --- stdout ---
2024-04-11 01:24:29,615 DEBUG true
2024-04-11 01:24:29,615 DEBUG --- stderr ---
2024-04-11 01:24:29,615 DEBUG
2024-04-11 01:24:29,615 INFO
2024-04-11 01:24:29,615 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-2 --output jsonpath={.status.startTime}
2024-04-11 01:24:29,615 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:29,989 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:29,990 DEBUG --- stdout ---
2024-04-11 01:24:29,990 DEBUG 2024-04-11T01:22:29Z
2024-04-11 01:24:29,990 DEBUG --- stderr ---
2024-04-11 01:24:29,990 DEBUG
2024-04-11 01:24:29,990 INFO
2024-04-11 01:24:29,990 INFO ----------- Check pod ds-idrepo-2 filesystem is accessible -----------
2024-04-11 01:24:30,837 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:30,837 INFO
2024-04-11 01:24:30,837 INFO ----------------- Check pod ds-idrepo-2 restart count -----------------
2024-04-11 01:24:30,837 INFO
2024-04-11 01:24:30,837 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-2 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:30,837 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:31,214 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:31,214 DEBUG --- stdout ---
2024-04-11 01:24:31,215 DEBUG 0
2024-04-11 01:24:31,215 DEBUG --- stderr ---
2024-04-11 01:24:31,215 DEBUG
2024-04-11 01:24:31,215 INFO Pod ds-idrepo-2 has been restarted 0 times.
2024-04-11 01:24:31,215 INFO
2024-04-11 01:24:31,215 INFO ****************************** Initializing component pods for AM ******************************
2024-04-11 01:24:31,215 INFO
2024-04-11 01:24:31,215 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:31,215 INFO
2024-04-11 01:24:31,215 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app=am --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:31,215 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:31,635 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:31,636 DEBUG --- stdout ---
2024-04-11 01:24:31,636 DEBUG 3
2024-04-11 01:24:31,636 DEBUG --- stderr ---
2024-04-11 01:24:31,636 DEBUG
2024-04-11 01:24:31,636 INFO
2024-04-11 01:24:31,636 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:24:31,636 INFO
2024-04-11 01:24:31,636 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=am --output jsonpath={.items[*].metadata.name}` | grep 3
2024-04-11 01:24:31,636 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:24:32,085 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
2024-04-11 01:24:32,085 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:32,085 DEBUG --- stdout ---
2024-04-11 01:24:32,085 DEBUG am-5b5bd8567b-6lzwk am-5b5bd8567b-8h2w4 am-5b5bd8567b-qlkw6
2024-04-11 01:24:32,085 DEBUG --- stderr ---
2024-04-11 01:24:32,085 DEBUG
2024-04-11 01:24:32,086 INFO
2024-04-11 01:24:32,086 INFO -------------- Check pod am-5b5bd8567b-6lzwk is running --------------
2024-04-11 01:24:32,086 INFO
2024-04-11 01:24:32,086 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-5b5bd8567b-6lzwk -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:32,086 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:32,481 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:32,482 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:32,482 DEBUG --- stdout ---
2024-04-11 01:24:32,482 DEBUG Running
2024-04-11 01:24:32,482 DEBUG --- stderr ---
2024-04-11 01:24:32,482 DEBUG
2024-04-11 01:24:32,482 INFO
2024-04-11 01:24:32,482 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-5b5bd8567b-6lzwk -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:32,482 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:32,861 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:32,862 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:32,862 DEBUG --- stdout ---
2024-04-11 01:24:32,862 DEBUG true
2024-04-11 01:24:32,862 DEBUG --- stderr ---
2024-04-11 01:24:32,862 DEBUG
2024-04-11 01:24:32,862 INFO
2024-04-11 01:24:32,862 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-5b5bd8567b-6lzwk --output jsonpath={.status.startTime}
2024-04-11 01:24:32,862 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:33,225 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:33,225 DEBUG --- stdout ---
2024-04-11 01:24:33,225 DEBUG 2024-04-11T01:23:06Z
2024-04-11 01:24:33,225 DEBUG --- stderr ---
2024-04-11 01:24:33,225 DEBUG
2024-04-11 01:24:33,226 INFO
2024-04-11 01:24:33,226 INFO ------- Check pod am-5b5bd8567b-6lzwk filesystem is accessible -------
2024-04-11 01:24:34,046 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:34,046 INFO
2024-04-11 01:24:34,046 INFO ------------- Check pod am-5b5bd8567b-6lzwk restart count -------------
2024-04-11 01:24:34,046 INFO
2024-04-11 01:24:34,046 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-5b5bd8567b-6lzwk --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:34,046 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:34,417 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:34,417 DEBUG --- stdout ---
2024-04-11 01:24:34,417 DEBUG 0
2024-04-11 01:24:34,417 DEBUG --- stderr ---
2024-04-11 01:24:34,417 DEBUG
2024-04-11 01:24:34,417 INFO Pod am-5b5bd8567b-6lzwk has been restarted 0 times.
2024-04-11 01:24:34,417 INFO
2024-04-11 01:24:34,417 INFO -------------- Check pod am-5b5bd8567b-8h2w4 is running --------------
2024-04-11 01:24:34,418 INFO
2024-04-11 01:24:34,418 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-5b5bd8567b-8h2w4 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:34,418 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:34,787 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:34,788 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:34,789 DEBUG --- stdout ---
2024-04-11 01:24:34,789 DEBUG Running
2024-04-11 01:24:34,789 DEBUG --- stderr ---
2024-04-11 01:24:34,789 DEBUG
2024-04-11 01:24:34,789 INFO
2024-04-11 01:24:34,789 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-5b5bd8567b-8h2w4 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:34,789 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:35,174 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:35,174 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:35,174 DEBUG --- stdout ---
2024-04-11 01:24:35,174 DEBUG true
2024-04-11 01:24:35,174 DEBUG --- stderr ---
2024-04-11 01:24:35,174 DEBUG
2024-04-11 01:24:35,175 INFO
2024-04-11 01:24:35,175 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-5b5bd8567b-8h2w4 --output jsonpath={.status.startTime}
2024-04-11 01:24:35,175 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:35,550 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:35,550 DEBUG --- stdout ---
2024-04-11 01:24:35,551 DEBUG 2024-04-11T01:23:06Z
2024-04-11 01:24:35,551 DEBUG --- stderr ---
2024-04-11 01:24:35,551 DEBUG
2024-04-11 01:24:35,551 INFO
2024-04-11 01:24:35,551 INFO ------- Check pod am-5b5bd8567b-8h2w4 filesystem is accessible -------
2024-04-11 01:24:36,383 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:36,384 INFO
2024-04-11 01:24:36,384 INFO ------------- Check pod am-5b5bd8567b-8h2w4 restart count -------------
2024-04-11 01:24:36,384 INFO
2024-04-11 01:24:36,384 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-5b5bd8567b-8h2w4 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:36,384 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:36,743 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:36,743 DEBUG --- stdout ---
2024-04-11 01:24:36,743 DEBUG 0
2024-04-11 01:24:36,743 DEBUG --- stderr ---
2024-04-11 01:24:36,743 DEBUG
2024-04-11 01:24:36,744 INFO Pod am-5b5bd8567b-8h2w4 has been restarted 0 times.
2024-04-11 01:24:36,744 INFO
2024-04-11 01:24:36,744 INFO -------------- Check pod am-5b5bd8567b-qlkw6 is running --------------
2024-04-11 01:24:36,744 INFO
2024-04-11 01:24:36,744 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-5b5bd8567b-qlkw6 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:36,744 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:37,118 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:37,118 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:37,119 DEBUG --- stdout ---
2024-04-11 01:24:37,119 DEBUG Running
2024-04-11 01:24:37,119 DEBUG --- stderr ---
2024-04-11 01:24:37,119 DEBUG
2024-04-11 01:24:37,119 INFO
2024-04-11 01:24:37,119 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-5b5bd8567b-qlkw6 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:37,119 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:37,494 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:37,494 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:37,494 DEBUG --- stdout ---
2024-04-11 01:24:37,494 DEBUG true
2024-04-11 01:24:37,494 DEBUG --- stderr ---
2024-04-11 01:24:37,495 DEBUG
2024-04-11 01:24:37,495 INFO
2024-04-11 01:24:37,495 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-5b5bd8567b-qlkw6 --output jsonpath={.status.startTime}
2024-04-11 01:24:37,495 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:37,869 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:37,869 DEBUG --- stdout ---
2024-04-11 01:24:37,869 DEBUG 2024-04-11T01:23:06Z
2024-04-11 01:24:37,869 DEBUG --- stderr ---
2024-04-11 01:24:37,869 DEBUG
2024-04-11 01:24:37,870 INFO
2024-04-11 01:24:37,870 INFO ------- Check pod am-5b5bd8567b-qlkw6 filesystem is accessible -------
2024-04-11 01:24:38,708 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:38,708 INFO
2024-04-11 01:24:38,708 INFO ------------- Check pod am-5b5bd8567b-qlkw6 restart count -------------
2024-04-11 01:24:38,708 INFO
2024-04-11 01:24:38,709 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-5b5bd8567b-qlkw6 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:38,709 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:39,080 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:39,080 DEBUG --- stdout ---
2024-04-11 01:24:39,080 DEBUG 0
2024-04-11 01:24:39,080 DEBUG --- stderr ---
2024-04-11 01:24:39,080 DEBUG
2024-04-11 01:24:39,081 INFO Pod am-5b5bd8567b-qlkw6 has been restarted 0 times.
2024-04-11 01:24:39,081 INFO
2024-04-11 01:24:39,081 INFO **************************** Initializing component pods for AMSTER ****************************
2024-04-11 01:24:39,081 INFO
2024-04-11 01:24:39,081 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:24:39,081 INFO
2024-04-11 01:24:39,081 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm --field-selector status.phase!=Failed get pods --selector app=amster --output jsonpath={.items[*].metadata.name}
2024-04-11 01:24:39,081 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:24:39,461 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:39,461 DEBUG --- stdout ---
2024-04-11 01:24:39,461 DEBUG amster-lqszt
2024-04-11 01:24:39,461 DEBUG --- stderr ---
2024-04-11 01:24:39,461 DEBUG
2024-04-11 01:24:39,461 INFO
2024-04-11 01:24:39,461 INFO ***************************** Initializing component pods for IDM *****************************
2024-04-11 01:24:39,462 INFO
2024-04-11 01:24:39,462 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:39,462 INFO
2024-04-11 01:24:39,462 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployment --selector app=idm --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:39,462 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:39,854 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:39,855 DEBUG --- stdout ---
2024-04-11 01:24:39,855 DEBUG 2
2024-04-11 01:24:39,855 DEBUG --- stderr ---
2024-04-11 01:24:39,855 DEBUG
2024-04-11 01:24:39,856 INFO
2024-04-11 01:24:39,856 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:24:39,856 INFO
2024-04-11 01:24:39,856 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=idm --output jsonpath={.items[*].metadata.name}` | grep 2
2024-04-11 01:24:39,856 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:24:40,246 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
2024-04-11 01:24:40,246 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:40,246 DEBUG --- stdout ---
2024-04-11 01:24:40,246 DEBUG idm-668d898cfd-2vqdm idm-668d898cfd-st2t7
2024-04-11 01:24:40,246 DEBUG --- stderr ---
2024-04-11 01:24:40,246 DEBUG
2024-04-11 01:24:40,246 INFO
2024-04-11 01:24:40,246 INFO -------------- Check pod idm-668d898cfd-2vqdm is running --------------
2024-04-11 01:24:40,247 INFO
2024-04-11 01:24:40,247 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods idm-668d898cfd-2vqdm -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:40,247 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:40,617 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:40,617 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:40,617 DEBUG --- stdout ---
2024-04-11 01:24:40,617 DEBUG Running
2024-04-11 01:24:40,617 DEBUG --- stderr ---
2024-04-11 01:24:40,617 DEBUG
2024-04-11 01:24:40,617 INFO
2024-04-11 01:24:40,617 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods idm-668d898cfd-2vqdm -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:40,617 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:40,991 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:40,991 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:40,991 DEBUG --- stdout ---
2024-04-11 01:24:40,991 DEBUG true
2024-04-11 01:24:40,991 DEBUG --- stderr ---
2024-04-11 01:24:40,991 DEBUG
2024-04-11 01:24:40,991 INFO
2024-04-11 01:24:40,991 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod idm-668d898cfd-2vqdm --output jsonpath={.status.startTime}
2024-04-11 01:24:40,991 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:41,352 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:41,352 DEBUG --- stdout ---
2024-04-11 01:24:41,352 DEBUG 2024-04-11T01:23:06Z
2024-04-11 01:24:41,352 DEBUG --- stderr ---
2024-04-11 01:24:41,352 DEBUG
2024-04-11 01:24:41,353 INFO
2024-04-11 01:24:41,353 INFO ------- Check pod idm-668d898cfd-2vqdm filesystem is accessible -------
2024-04-11 01:24:42,177 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:42,177 INFO
2024-04-11 01:24:42,177 INFO ------------ Check pod idm-668d898cfd-2vqdm restart count ------------
2024-04-11 01:24:42,177 INFO
2024-04-11 01:24:42,177 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod idm-668d898cfd-2vqdm --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:42,177 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:42,534 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:42,534 DEBUG --- stdout ---
2024-04-11 01:24:42,534 DEBUG 0
2024-04-11 01:24:42,534 DEBUG --- stderr ---
2024-04-11 01:24:42,534 DEBUG
2024-04-11 01:24:42,535 INFO Pod idm-668d898cfd-2vqdm has been restarted 0 times.
2024-04-11 01:24:42,535 INFO
2024-04-11 01:24:42,535 INFO -------------- Check pod idm-668d898cfd-st2t7 is running --------------
2024-04-11 01:24:42,535 INFO
2024-04-11 01:24:42,535 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods idm-668d898cfd-st2t7 -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:42,535 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:42,892 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:42,893 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:42,893 DEBUG --- stdout ---
2024-04-11 01:24:42,893 DEBUG Running
2024-04-11 01:24:42,893 DEBUG --- stderr ---
2024-04-11 01:24:42,893 DEBUG
2024-04-11 01:24:42,893 INFO
2024-04-11 01:24:42,893 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods idm-668d898cfd-st2t7 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:42,893 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:43,254 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:43,254 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:43,254 DEBUG --- stdout ---
2024-04-11 01:24:43,254 DEBUG true
2024-04-11 01:24:43,254 DEBUG --- stderr ---
2024-04-11 01:24:43,254 DEBUG
2024-04-11 01:24:43,255 INFO
2024-04-11 01:24:43,255 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod idm-668d898cfd-st2t7 --output jsonpath={.status.startTime}
2024-04-11 01:24:43,255 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:43,616 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:43,617 DEBUG --- stdout ---
2024-04-11 01:24:43,617 DEBUG 2024-04-11T01:23:06Z
2024-04-11 01:24:43,617 DEBUG --- stderr ---
2024-04-11 01:24:43,617 DEBUG
2024-04-11 01:24:43,617 INFO
2024-04-11 01:24:43,617 INFO ------- Check pod idm-668d898cfd-st2t7 filesystem is accessible -------
2024-04-11 01:24:44,455 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:44,456 INFO
2024-04-11 01:24:44,456 INFO ------------ Check pod idm-668d898cfd-st2t7 restart count ------------
2024-04-11 01:24:44,456 INFO
2024-04-11 01:24:44,456 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod idm-668d898cfd-st2t7 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:44,456 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:44,821 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:44,821 DEBUG --- stdout ---
2024-04-11 01:24:44,821 DEBUG 0
2024-04-11 01:24:44,821 DEBUG --- stderr ---
2024-04-11 01:24:44,821 DEBUG
2024-04-11 01:24:44,821 INFO Pod idm-668d898cfd-st2t7 has been restarted 0 times.
2024-04-11 01:24:44,821 INFO
2024-04-11 01:24:44,821 INFO ************************* Initializing component pods for END-USER-UI *************************
2024-04-11 01:24:44,821 INFO
2024-04-11 01:24:44,821 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:44,822 INFO
2024-04-11 01:24:44,822 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:44,822 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:45,133 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:45,135 DEBUG --- stdout ---
2024-04-11 01:24:45,135 DEBUG 1
2024-04-11 01:24:45,135 DEBUG --- stderr ---
2024-04-11 01:24:45,135 DEBUG
2024-04-11 01:24:45,136 INFO
2024-04-11 01:24:45,136 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:24:45,136 INFO
2024-04-11 01:24:45,136 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].metadata.name}` | grep 1
2024-04-11 01:24:45,136 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:24:45,447 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
2024-04-11 01:24:45,447 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:45,447 DEBUG --- stdout ---
2024-04-11 01:24:45,448 DEBUG end-user-ui-58878d7668-gjq6d
2024-04-11 01:24:45,448 DEBUG --- stderr ---
2024-04-11 01:24:45,448 DEBUG
2024-04-11 01:24:45,448 INFO
2024-04-11 01:24:45,448 INFO ---------- Check pod end-user-ui-58878d7668-gjq6d is running ----------
2024-04-11 01:24:45,448 INFO
2024-04-11 01:24:45,448 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods end-user-ui-58878d7668-gjq6d -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:45,448 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:45,784 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:45,784 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:45,784 DEBUG --- stdout ---
2024-04-11 01:24:45,784 DEBUG Running
2024-04-11 01:24:45,784 DEBUG --- stderr ---
2024-04-11 01:24:45,784 DEBUG
2024-04-11 01:24:45,784 INFO
2024-04-11 01:24:45,784 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods end-user-ui-58878d7668-gjq6d -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:45,784 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:46,098 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:46,098 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:46,098 DEBUG --- stdout ---
2024-04-11 01:24:46,098 DEBUG true
2024-04-11 01:24:46,098 DEBUG --- stderr ---
2024-04-11 01:24:46,098 DEBUG
2024-04-11 01:24:46,099 INFO
2024-04-11 01:24:46,099 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod end-user-ui-58878d7668-gjq6d --output jsonpath={.status.startTime}
2024-04-11 01:24:46,099 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:46,408 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:46,408 DEBUG --- stdout ---
2024-04-11 01:24:46,409 DEBUG 2024-04-11T01:24:10Z
2024-04-11 01:24:46,409 DEBUG --- stderr ---
2024-04-11 01:24:46,409 DEBUG
2024-04-11 01:24:46,409 INFO
2024-04-11 01:24:46,409 INFO --- Check pod end-user-ui-58878d7668-gjq6d filesystem is accessible ---
2024-04-11 01:24:47,177 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:47,178 INFO
2024-04-11 01:24:47,178 INFO -------- Check pod end-user-ui-58878d7668-gjq6d restart count --------
2024-04-11 01:24:47,178 INFO
2024-04-11 01:24:47,178 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod end-user-ui-58878d7668-gjq6d --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:47,178 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:47,475 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:47,475 DEBUG --- stdout ---
2024-04-11 01:24:47,476 DEBUG 0
2024-04-11 01:24:47,476 DEBUG --- stderr ---
2024-04-11 01:24:47,476 DEBUG
2024-04-11 01:24:47,476 INFO Pod end-user-ui-58878d7668-gjq6d has been restarted 0 times.
2024-04-11 01:24:47,476 INFO
2024-04-11 01:24:47,476 INFO *************************** Initializing component pods for LOGIN-UI ***************************
2024-04-11 01:24:47,476 INFO
2024-04-11 01:24:47,476 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:47,476 INFO
2024-04-11 01:24:47,476 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:47,476 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:47,779 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:47,779 DEBUG --- stdout ---
2024-04-11 01:24:47,779 DEBUG 1
2024-04-11 01:24:47,779 DEBUG --- stderr ---
2024-04-11 01:24:47,780 DEBUG
2024-04-11 01:24:47,780 INFO
2024-04-11 01:24:47,780 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:24:47,780 INFO
2024-04-11 01:24:47,780 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].metadata.name}` | grep 1
2024-04-11 01:24:47,780 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:24:48,089 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
2024-04-11 01:24:48,089 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:48,089 DEBUG --- stdout ---
2024-04-11 01:24:48,089 DEBUG login-ui-5fdf49fc66-s678w
2024-04-11 01:24:48,089 DEBUG --- stderr ---
2024-04-11 01:24:48,089 DEBUG
2024-04-11 01:24:48,089 INFO
2024-04-11 01:24:48,089 INFO ----------- Check pod login-ui-5fdf49fc66-s678w is running -----------
2024-04-11 01:24:48,090 INFO
2024-04-11 01:24:48,090 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods login-ui-5fdf49fc66-s678w -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:48,090 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:48,418 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:48,418 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:48,418 DEBUG --- stdout ---
2024-04-11 01:24:48,418 DEBUG Running
2024-04-11 01:24:48,418 DEBUG --- stderr ---
2024-04-11 01:24:48,418 DEBUG
2024-04-11 01:24:48,419 INFO
2024-04-11 01:24:48,419 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods login-ui-5fdf49fc66-s678w -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:48,419 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:48,737 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:48,737 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:48,737 DEBUG --- stdout ---
2024-04-11 01:24:48,737 DEBUG true
2024-04-11 01:24:48,737 DEBUG --- stderr ---
2024-04-11 01:24:48,737 DEBUG
2024-04-11 01:24:48,737 INFO
2024-04-11 01:24:48,737 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod login-ui-5fdf49fc66-s678w --output jsonpath={.status.startTime}
2024-04-11 01:24:48,737 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:49,049 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:49,049 DEBUG --- stdout ---
2024-04-11 01:24:49,049 DEBUG 2024-04-11T01:24:10Z
2024-04-11 01:24:49,049 DEBUG --- stderr ---
2024-04-11 01:24:49,049 DEBUG
2024-04-11 01:24:49,050 INFO
2024-04-11 01:24:49,050 INFO ---- Check pod login-ui-5fdf49fc66-s678w filesystem is accessible ----
2024-04-11 01:24:49,840 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:49,840 INFO
2024-04-11 01:24:49,840 INFO ---------- Check pod login-ui-5fdf49fc66-s678w restart count ----------
2024-04-11 01:24:49,841 INFO
2024-04-11 01:24:49,841 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod login-ui-5fdf49fc66-s678w --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:49,841 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:50,156 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:50,158 DEBUG --- stdout ---
2024-04-11 01:24:50,158 DEBUG 0
2024-04-11 01:24:50,158 DEBUG --- stderr ---
2024-04-11 01:24:50,158 DEBUG
2024-04-11 01:24:50,158 INFO Pod login-ui-5fdf49fc66-s678w has been restarted 0 times.
2024-04-11 01:24:50,158 INFO
2024-04-11 01:24:50,158 INFO *************************** Initializing component pods for ADMIN-UI ***************************
2024-04-11 01:24:50,158 INFO
2024-04-11 01:24:50,158 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:50,159 INFO
2024-04-11 01:24:50,159 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:50,159 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:50,460 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:50,460 DEBUG --- stdout ---
2024-04-11 01:24:50,460 DEBUG 1
2024-04-11 01:24:50,461 DEBUG --- stderr ---
2024-04-11 01:24:50,461 DEBUG
2024-04-11 01:24:50,461 INFO
2024-04-11 01:24:50,461 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:24:50,461 INFO
2024-04-11 01:24:50,461 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].metadata.name}` | grep 1
2024-04-11 01:24:50,461 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:24:50,764 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
2024-04-11 01:24:50,765 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:50,765 DEBUG --- stdout ---
2024-04-11 01:24:50,765 DEBUG admin-ui-c4c7bf584-pvbnd
2024-04-11 01:24:50,765 DEBUG --- stderr ---
2024-04-11 01:24:50,765 DEBUG
2024-04-11 01:24:50,765 INFO
2024-04-11 01:24:50,765 INFO ------------ Check pod admin-ui-c4c7bf584-pvbnd is running ------------
2024-04-11 01:24:50,765 INFO
2024-04-11 01:24:50,765 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods admin-ui-c4c7bf584-pvbnd -o=jsonpath={.status.phase} | grep "Running"
2024-04-11 01:24:50,765 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:51,112 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:51,112 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:51,112 DEBUG --- stdout ---
2024-04-11 01:24:51,112 DEBUG Running
2024-04-11 01:24:51,112 DEBUG --- stderr ---
2024-04-11 01:24:51,112 DEBUG
2024-04-11 01:24:51,113 INFO
2024-04-11 01:24:51,113 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods admin-ui-c4c7bf584-pvbnd -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-11 01:24:51,113 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-11 01:24:51,427 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:51,427 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:51,427 DEBUG --- stdout ---
2024-04-11 01:24:51,427 DEBUG true
2024-04-11 01:24:51,427 DEBUG --- stderr ---
2024-04-11 01:24:51,427 DEBUG
2024-04-11 01:24:51,428 INFO
2024-04-11 01:24:51,428 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod admin-ui-c4c7bf584-pvbnd --output jsonpath={.status.startTime}
2024-04-11 01:24:51,428 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:51,743 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:51,744 DEBUG --- stdout ---
2024-04-11 01:24:51,744 DEBUG 2024-04-11T01:24:10Z
2024-04-11 01:24:51,744 DEBUG --- stderr ---
2024-04-11 01:24:51,744 DEBUG
2024-04-11 01:24:51,744 INFO
2024-04-11 01:24:51,744 INFO ----- Check pod admin-ui-c4c7bf584-pvbnd filesystem is accessible -----
2024-04-11 01:24:52,504 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:52,505 INFO
2024-04-11 01:24:52,505 INFO ---------- Check pod admin-ui-c4c7bf584-pvbnd restart count ----------
2024-04-11 01:24:52,505 INFO
2024-04-11 01:24:52,505 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod admin-ui-c4c7bf584-pvbnd --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-11 01:24:52,505 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:52,803 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:52,803 DEBUG --- stdout ---
2024-04-11 01:24:52,803 DEBUG 0
2024-04-11 01:24:52,803 DEBUG --- stderr ---
2024-04-11 01:24:52,803 DEBUG
2024-04-11 01:24:52,803 INFO Pod admin-ui-c4c7bf584-pvbnd has been restarted 0 times.
2024-04-11 01:24:52,803 INFO
2024-04-11 01:24:52,803 INFO ***************************** Checking DS-CTS component is running *****************************
2024-04-11 01:24:52,803 INFO
2024-04-11 01:24:52,803 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:52,803 INFO
2024-04-11 01:24:52,804 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-cts --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:52,804 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:53,179 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:53,179 DEBUG --- stdout ---
2024-04-11 01:24:53,179 DEBUG 3
2024-04-11 01:24:53,179 DEBUG --- stderr ---
2024-04-11 01:24:53,179 DEBUG
2024-04-11 01:24:53,179 INFO
2024-04-11 01:24:53,179 INFO -------------- Waiting for 3 expected pod(s) to be ready --------------
2024-04-11 01:24:53,180 INFO
2024-04-11 01:24:53,180 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets ds-cts --output jsonpath="current:{.status.currentReplicas} ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "current:3 ready:3 replicas:3"
2024-04-11 01:24:53,180 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-11 01:24:53,565 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:53,566 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:53,566 DEBUG --- stdout ---
2024-04-11 01:24:53,566 DEBUG current:3 ready:3 replicas:3
2024-04-11 01:24:53,566 DEBUG --- stderr ---
2024-04-11 01:24:53,566 DEBUG
2024-04-11 01:24:53,566 INFO
2024-04-11 01:24:53,566 INFO *************************** Checking DS-IDREPO component is running ***************************
2024-04-11 01:24:53,566 INFO
2024-04-11 01:24:53,566 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:53,566 INFO
2024-04-11 01:24:53,566 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-idrepo --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:53,566 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:53,931 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:53,931 DEBUG --- stdout ---
2024-04-11 01:24:53,931 DEBUG 3
2024-04-11 01:24:53,931 DEBUG --- stderr ---
2024-04-11 01:24:53,931 DEBUG
2024-04-11 01:24:53,931 INFO
2024-04-11 01:24:53,931 INFO -------------- Waiting for 3 expected pod(s) to be ready --------------
2024-04-11 01:24:53,931 INFO
2024-04-11 01:24:53,931 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets ds-idrepo --output jsonpath="current:{.status.currentReplicas} ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "current:3 ready:3 replicas:3"
2024-04-11 01:24:53,931 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-11 01:24:54,313 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:54,313 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:54,313 DEBUG --- stdout ---
2024-04-11 01:24:54,313 DEBUG current:3 ready:3 replicas:3
2024-04-11 01:24:54,313 DEBUG --- stderr ---
2024-04-11 01:24:54,313 DEBUG
2024-04-11 01:24:54,313 INFO
2024-04-11 01:24:54,313 INFO ******************************* Checking AM component is running *******************************
2024-04-11 01:24:54,313 INFO
2024-04-11 01:24:54,313 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:54,314 INFO
2024-04-11 01:24:54,314 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app=am --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:54,314 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:54,694 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:54,695 DEBUG --- stdout ---
2024-04-11 01:24:54,695 DEBUG 3
2024-04-11 01:24:54,695 DEBUG --- stderr ---
2024-04-11 01:24:54,695 DEBUG
2024-04-11 01:24:54,695 INFO
2024-04-11 01:24:54,695 INFO -------------- Waiting for 3 expected pod(s) to be ready --------------
2024-04-11 01:24:54,695 INFO
2024-04-11 01:24:54,695 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments am --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:3 replicas:3"
2024-04-11 01:24:54,695 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-11 01:24:55,068 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:55,069 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:55,069 DEBUG --- stdout ---
2024-04-11 01:24:55,069 DEBUG ready:3 replicas:3
2024-04-11 01:24:55,069 DEBUG --- stderr ---
2024-04-11 01:24:55,069 DEBUG
2024-04-11 01:24:55,069 INFO
2024-04-11 01:24:55,069 INFO ***************************** Checking AMSTER component is running *****************************
2024-04-11 01:24:55,069 INFO
2024-04-11 01:24:55,069 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:55,069 INFO
2024-04-11 01:24:55,069 INFO -------------- Waiting for 1 expected pod(s) to be ready --------------
2024-04-11 01:24:55,069 INFO
2024-04-11 01:24:55,070 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get jobs amster --output jsonpath="{.status.succeeded}" | grep "1"
2024-04-11 01:24:55,070 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-11 01:24:55,435 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:55,436 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:55,436 DEBUG --- stdout ---
2024-04-11 01:24:55,436 DEBUG 1
2024-04-11 01:24:55,436 DEBUG --- stderr ---
2024-04-11 01:24:55,436 DEBUG
2024-04-11 01:24:55,436 INFO
2024-04-11 01:24:55,437 INFO ****************************** Checking IDM component is running ******************************
2024-04-11 01:24:55,437 INFO
2024-04-11 01:24:55,437 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:55,437 INFO
2024-04-11 01:24:55,437 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployment --selector app=idm --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:55,437 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:55,803 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:55,803 DEBUG --- stdout ---
2024-04-11 01:24:55,804 DEBUG 2
2024-04-11 01:24:55,804 DEBUG --- stderr ---
2024-04-11 01:24:55,804 DEBUG
2024-04-11 01:24:55,804 INFO
2024-04-11 01:24:55,804 INFO -------------- Waiting for 2 expected pod(s) to be ready --------------
2024-04-11 01:24:55,804 INFO
2024-04-11 01:24:55,804 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployment idm --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:2 replicas:2"
2024-04-11 01:24:55,804 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-11 01:24:56,166 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:56,166 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:56,166 DEBUG --- stdout ---
2024-04-11 01:24:56,166 DEBUG ready:2 replicas:2
2024-04-11 01:24:56,166 DEBUG --- stderr ---
2024-04-11 01:24:56,166 DEBUG
2024-04-11 01:24:56,166 INFO
2024-04-11 01:24:56,167 INFO ************************** Checking END-USER-UI component is running **************************
2024-04-11 01:24:56,167 INFO
2024-04-11 01:24:56,167 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:56,167 INFO
2024-04-11 01:24:56,167 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:56,167 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:56,463 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:56,464 DEBUG --- stdout ---
2024-04-11 01:24:56,464 DEBUG 1
2024-04-11 01:24:56,464 DEBUG --- stderr ---
2024-04-11 01:24:56,464 DEBUG
2024-04-11 01:24:56,464 INFO
2024-04-11 01:24:56,464 INFO -------------- Waiting for 1 expected pod(s) to be ready --------------
2024-04-11 01:24:56,464 INFO
2024-04-11 01:24:56,464 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments end-user-ui --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1"
2024-04-11 01:24:56,464 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-11 01:24:56,765 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:56,765 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:56,765 DEBUG --- stdout ---
2024-04-11 01:24:56,765 DEBUG ready:1 replicas:1
2024-04-11 01:24:56,765 DEBUG --- stderr ---
2024-04-11 01:24:56,765 DEBUG
2024-04-11 01:24:56,765 INFO
2024-04-11 01:24:56,765 INFO **************************** Checking LOGIN-UI component is running ****************************
2024-04-11 01:24:56,765 INFO
2024-04-11 01:24:56,765 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:56,766 INFO
2024-04-11 01:24:56,766 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:56,766 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:57,070 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:57,070 DEBUG --- stdout ---
2024-04-11 01:24:57,070 DEBUG 1
2024-04-11 01:24:57,071 DEBUG --- stderr ---
2024-04-11 01:24:57,071 DEBUG
2024-04-11 01:24:57,071 INFO
2024-04-11 01:24:57,071 INFO -------------- Waiting for 1 expected pod(s) to be ready --------------
2024-04-11 01:24:57,071 INFO
2024-04-11 01:24:57,071 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments login-ui --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1"
2024-04-11 01:24:57,071 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-11 01:24:57,426 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:57,426 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:57,426 DEBUG --- stdout ---
2024-04-11 01:24:57,426 DEBUG ready:1 replicas:1
2024-04-11 01:24:57,426 DEBUG --- stderr ---
2024-04-11 01:24:57,426 DEBUG
2024-04-11 01:24:57,426 INFO
2024-04-11 01:24:57,426 INFO **************************** Checking ADMIN-UI component is running ****************************
2024-04-11 01:24:57,427 INFO
2024-04-11 01:24:57,427 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:24:57,427 INFO
2024-04-11 01:24:57,427 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:24:57,427 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:24:57,728 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:57,728 DEBUG --- stdout ---
2024-04-11 01:24:57,728 DEBUG 1
2024-04-11 01:24:57,728 DEBUG --- stderr ---
2024-04-11 01:24:57,728 DEBUG
2024-04-11 01:24:57,728 INFO
2024-04-11 01:24:57,728 INFO -------------- Waiting for 1 expected pod(s) to be ready --------------
2024-04-11 01:24:57,729 INFO
2024-04-11 01:24:57,729 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments admin-ui --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1"
2024-04-11 01:24:57,729 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-11 01:24:58,023 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-11 01:24:58,023 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:58,023 DEBUG --- stdout ---
2024-04-11 01:24:58,023 DEBUG ready:1 replicas:1
2024-04-11 01:24:58,023 DEBUG --- stderr ---
2024-04-11 01:24:58,023 DEBUG
2024-04-11 01:24:58,023 INFO
2024-04-11 01:24:58,024 INFO ****************************** Livecheck stage: After deployment ******************************
2024-04-11 01:24:58,024 INFO
2024-04-11 01:24:58,024 INFO ---------------------- Running DS-CTS livecheck ----------------------
2024-04-11 01:24:58,024 INFO Livecheck to ds-cts-0
2024-04-11 01:24:58,024 INFO
2024-04-11 01:24:58,024 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get secret **** --output jsonpath="{.data.dirmanager\.pw}"
2024-04-11 01:24:58,024 INFO [loop_until]: (max_time=60, interval=5, expected_rc=[0]
2024-04-11 01:24:58,319 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:24:58,319 DEBUG --- stdout ---
2024-04-11 01:24:58,319 DEBUG QmVxeHlYZGVuRm5Ud0JJZFdrc3B2ZGlsZ3ZrQzEyY3E=
2024-04-11 01:24:58,319 DEBUG --- stderr ---
2024-04-11 01:24:58,319 DEBUG
2024-04-11 01:24:58,320 INFO
2024-04-11 01:24:58,320 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive
2024-04-11 01:25:00,230 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:25:00,231 DEBUG --- stdout ---
2024-04-11 01:25:00,231 DEBUG dn:
alive: true
2024-04-11 01:25:00,231 DEBUG --- stderr ---
2024-04-11 01:25:00,231 DEBUG
2024-04-11 01:25:00,231 INFO
2024-04-11 01:25:00,231 INFO Livecheck to ds-cts-1
2024-04-11 01:25:00,231 INFO
2024-04-11 01:25:00,232 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive
2024-04-11 01:25:02,125 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:25:02,125 DEBUG --- stdout ---
2024-04-11 01:25:02,125 DEBUG dn:
alive: true
2024-04-11 01:25:02,125 DEBUG --- stderr ---
2024-04-11 01:25:02,125 DEBUG
2024-04-11 01:25:02,125 INFO
2024-04-11 01:25:02,126 INFO Livecheck to ds-cts-2
2024-04-11 01:25:02,126 INFO
2024-04-11 01:25:02,126 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive
2024-04-11 01:25:04,062 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:25:04,062 DEBUG --- stdout ---
2024-04-11 01:25:04,062 DEBUG dn:
alive: true
2024-04-11 01:25:04,062 DEBUG --- stderr ---
2024-04-11 01:25:04,062 DEBUG
2024-04-11 01:25:04,062 INFO
2024-04-11 01:25:04,062 INFO
2024-04-11 01:25:04,063 INFO --------------------- Running DS-IDREPO livecheck ---------------------
2024-04-11 01:25:04,063 INFO Livecheck to ds-idrepo-0
2024-04-11 01:25:04,063 INFO
2024-04-11 01:25:04,063 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get secret **** --output jsonpath="{.data.dirmanager\.pw}"
2024-04-11 01:25:04,063 INFO [loop_until]: (max_time=60, interval=5, expected_rc=[0]
2024-04-11 01:25:04,365 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:04,365 DEBUG --- stdout ---
2024-04-11 01:25:04,365 DEBUG QmVxeHlYZGVuRm5Ud0JJZFdrc3B2ZGlsZ3ZrQzEyY3E=
2024-04-11 01:25:04,365 DEBUG --- stderr ---
2024-04-11 01:25:04,365 DEBUG
2024-04-11 01:25:04,365 INFO
2024-04-11 01:25:04,365 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-idrepo-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive
2024-04-11 01:25:06,170 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:25:06,170 DEBUG --- stdout ---
2024-04-11 01:25:06,170 DEBUG dn:
alive: true
2024-04-11 01:25:06,170 DEBUG --- stderr ---
2024-04-11 01:25:06,170 DEBUG
2024-04-11 01:25:06,170 INFO
2024-04-11 01:25:06,171 INFO Livecheck to ds-idrepo-1
2024-04-11 01:25:06,171 INFO
2024-04-11 01:25:06,171 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-idrepo-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive
2024-04-11 01:25:08,011 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:25:08,011 DEBUG --- stdout ---
2024-04-11 01:25:08,011 DEBUG dn:
alive: true
2024-04-11 01:25:08,011 DEBUG --- stderr ---
2024-04-11 01:25:08,011 DEBUG
2024-04-11 01:25:08,011 INFO
2024-04-11 01:25:08,011 INFO Livecheck to ds-idrepo-2
2024-04-11 01:25:08,012 INFO
2024-04-11 01:25:08,012 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-idrepo-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive
2024-04-11 01:25:09,815 INFO [run_command]: OK (rc = 0 - expected to be in [0])
2024-04-11 01:25:09,815 DEBUG --- stdout ---
2024-04-11 01:25:09,815 DEBUG dn:
alive: true
2024-04-11 01:25:09,815 DEBUG --- stderr ---
2024-04-11 01:25:09,815 DEBUG
2024-04-11 01:25:09,815 INFO
2024-04-11 01:25:09,816 INFO
2024-04-11 01:25:09,816 INFO ------------------------ Running AM livecheck ------------------------
2024-04-11 01:25:09,816 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/health/ready
2024-04-11 01:25:09,817 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/health/ready"
2024-04-11 01:25:10,101 INFO [http_cmd]: http status code OK
2024-04-11 01:25:10,101 DEBUG --- status code ---
2024-04-11 01:25:10,101 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:10,101 DEBUG --- http response ---
2024-04-11 01:25:10,101 DEBUG
2024-04-11 01:25:10,101 INFO
2024-04-11 01:25:10,101 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get secret **** --output jsonpath="{.data.AM_PASSWORDS_AMADMIN_CLEAR}"
2024-04-11 01:25:10,101 INFO [loop_until]: (max_time=60, interval=5, expected_rc=[0]
2024-04-11 01:25:10,416 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:10,417 DEBUG --- stdout ---
2024-04-11 01:25:10,417 DEBUG MXExaGRaelRpcFRyRElkWGZRTUdrMVcz
2024-04-11 01:25:10,417 DEBUG --- stderr ---
2024-04-11 01:25:10,417 DEBUG
2024-04-11 01:25:10,417 INFO Authenticate user amadmin via REST
2024-04-11 01:25:10,418 INFO [http_cmd]: curl -L --request POST "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/authenticate?realm=/"
2024-04-11 01:25:11,222 INFO [http_cmd]: http status code OK
2024-04-11 01:25:11,223 DEBUG --- status code ---
2024-04-11 01:25:11,223 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:11,223 DEBUG --- http response ---
2024-04-11 01:25:11,223 DEBUG {
"tokenId": "8HpOHPKXUE-X3Tlm5811V7f_78w.*AAJTSQACMDIAAlNLABxiMUF3ci9LK1RQQUN5TExTMDcvZjdXTTJqejQ9AAR0eXBlAANDVFMAAlMxAAIwMQ..*",
"successUrl": "/am/console",
"realm": "/"
}
2024-04-11 01:25:11,226 INFO
2024-04-11 01:25:11,227 INFO ---------------------- Running AMSTER livecheck ----------------------
2024-04-11 01:25:11,227 INFO
2024-04-11 01:25:11,227 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:11,228 INFO
2024-04-11 01:25:11,228 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm --field-selector status.phase!=Failed get pods --selector app=amster --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:11,228 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:11,595 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:11,596 DEBUG --- stdout ---
2024-04-11 01:25:11,597 DEBUG amster-lqszt
2024-04-11 01:25:11,598 DEBUG --- stderr ---
2024-04-11 01:25:11,598 DEBUG
2024-04-11 01:25:12,222 INFO Amster livecheck is passed
2024-04-11 01:25:12,222 INFO
2024-04-11 01:25:12,222 INFO ------------------------ Running IDM livecheck ------------------------
2024-04-11 01:25:12,222 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/info/ping
2024-04-11 01:25:12,223 INFO
2024-04-11 01:25:12,223 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get secret **** --output jsonpath="{.data.OPENIDM_ADMIN_PASSWORD}"
2024-04-11 01:25:12,223 INFO [loop_until]: (max_time=60, interval=5, expected_rc=[0]
2024-04-11 01:25:12,531 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:12,531 DEBUG --- stdout ---
2024-04-11 01:25:12,531 DEBUG ZGZLME9RT0RxemxncnJGd2pBMTdhbjY1
2024-04-11 01:25:12,531 DEBUG --- stderr ---
2024-04-11 01:25:12,531 DEBUG
2024-04-11 01:25:12,531 INFO Set admin password: dfK0OQODqzlgrrFwjA17an65
2024-04-11 01:25:12,532 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/info/ping"
2024-04-11 01:25:12,756 INFO [http_cmd]: http status code OK
2024-04-11 01:25:12,756 DEBUG --- status code ---
2024-04-11 01:25:12,756 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:12,756 DEBUG --- http response ---
2024-04-11 01:25:12,757 DEBUG {
"_id": "",
"_rev": "",
"shortDesc": "OpenIDM ready",
"state": "ACTIVE_READY"
}
2024-04-11 01:25:12,757 INFO Create new LoginSession for user "amadmin"
2024-04-11 01:25:12,757 INFO [LoginSession] Get "access_token" token for user "amadmin"
2024-04-11 01:25:12,757 INFO [LoginSession] Obtaining new "access_token" token from server because it was not obtained yet for the user
2024-04-11 01:25:12,757 INFO [LoginSession] Get "token_id" token for user "amadmin"
2024-04-11 01:25:12,757 INFO [LoginSession] Obtaining new "token_id" token from server because it was not obtained yet for the user
2024-04-11 01:25:12,757 INFO Authenticate user amadmin via REST
2024-04-11 01:25:12,757 INFO [http_cmd]: curl -L --request POST "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/authenticate?realm=/"
2024-04-11 01:25:12,999 INFO [http_cmd]: http status code OK
2024-04-11 01:25:12,999 DEBUG --- status code ---
2024-04-11 01:25:12,999 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:12,999 DEBUG --- http response ---
2024-04-11 01:25:13,000 DEBUG {
"tokenId": "Rak8A0aIjBfUwwuWCiP1U-KmY4Q.*AAJTSQACMDIAAlNLABxCOHArdmNLc2ZzeW9seWFHMjVOb0pJVmtQQ009AAR0eXBlAANDVFMAAlMxAAIwMQ..*",
"successUrl": "/am/console",
"realm": "/"
}
2024-04-11 01:25:13,000 INFO [LoginSession] Obtaining session info
2024-04-11 01:25:13,000 INFO [http_cmd]: curl -L --request POST "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/realms/root/sessions?_action=getSessionInfo"
2024-04-11 01:25:13,295 INFO [http_cmd]: http status code OK
2024-04-11 01:25:13,296 DEBUG --- status code ---
2024-04-11 01:25:13,296 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:13,296 DEBUG --- http response ---
2024-04-11 01:25:13,296 DEBUG {
"username": "amadmin",
"universalId": "id=amadmin,ou=user,ou=am-config",
"realm": "/",
"latestAccessTime": "2024-04-11T01:25:13Z",
"maxIdleExpirationTime": "2024-04-11T01:28:13Z",
"maxSessionExpirationTime": "2024-04-11T01:28:12Z",
"properties": {
"AMCtxId": "aec8387a-9a23-4b9f-af92-45ca988bd4a2-124"
}
}
2024-04-11 01:25:13,301 INFO Obtain Oauth2 authz code via REST
2024-04-11 01:25:13,301 DEBUG Oauth2 authorize for access token
2024-04-11 01:25:13,301 INFO [http_cmd]: curl --request POST --cookie "amlbcookie=01" --cookie "iPlanetDirectoryPro=Rak8A0aIjBfUwwuWCiP1U-KmY4Q.*AAJTSQACMDIAAlNLABxCOHArdmNLc2ZzeW9seWFHMjVOb0pJVmtQQ009AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "route=1712798713.935.25887.229101|f60edb382037eb2df1e800d563ad78a7" --data '{"decision": "Allow", "csrf": "Rak8A0aIjBfUwwuWCiP1U-KmY4Q.*AAJTSQACMDIAAlNLABxCOHArdmNLc2ZzeW9seWFHMjVOb0pJVmtQQ009AAR0eXBlAANDVFMAAlMxAAIwMQ..*"}' "https://xlou.iam.xlou-cdm.engineeringpit.com/am/oauth2/authorize?client_id=smokeclient&scope=fr:idm:*&redirect_uri=https://fake.com&response_type=code&realm=/"
2024-04-11 01:25:13,648 INFO [http_cmd]: http status code OK
2024-04-11 01:25:13,648 DEBUG --- status code ---
2024-04-11 01:25:13,648 DEBUG http status code is 302 (expected 302)
2024-04-11 01:25:13,649 DEBUG --- http response ---
2024-04-11 01:25:13,649 DEBUG {'Date': 'Thu, 11 Apr 2024 01:25:13 GMT', 'Content-Length': '0', 'Connection': 'keep-alive', 'X-Frame-Options': 'SAMEORIGIN', 'X-Content-Type-Options': 'nosniff', 'Cache-Control': 'no-store', 'Location': 'https://fake.com?code=_Mdr3EBc3X23oOBo_yvjSTsy0P4&iss=https%3A%2F%2Fxlou.iam.xlou-cdm.engineeringpit.com%2Fam%2Foauth2&client_id=smokeclient', 'Pragma': 'no-cache', 'Set-Cookie': 'OAUTH_REQUEST_ATTRIBUTES=DELETED; Expires=Thu, 01 Jan 1970 00:00:00 GMT; Path=/; Secure; HttpOnly; SameSite=none', 'Strict-Transport-Security': 'max-age=15724800; includeSubDomains'}
2024-04-11 01:25:13,649 DEBUG Oauth2 exchange authorize code for access token
2024-04-11 01:25:13,649 INFO [http_cmd]: curl -L --request POST --data '{"grant_type": "authorization_code", "redirect_uri": "https://fake.com", "client_id": "smokeclient", "code": "_Mdr3EBc3X23oOBo_yvjSTsy0P4"}' "https://xlou.iam.xlou-cdm.engineeringpit.com/am/oauth2/access_token?realm=/"
2024-04-11 01:25:13,865 INFO [http_cmd]: http status code OK
2024-04-11 01:25:13,865 DEBUG --- status code ---
2024-04-11 01:25:13,865 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:13,865 DEBUG --- http response ---
2024-04-11 01:25:13,865 DEBUG {
"access_token": "jaTsPUonm2Z7OMLF6Zb2-H0yhfQ",
"scope": "fr:idm:*",
"token_type": "Bearer",
"expires_in": 3599
}
2024-04-11 01:25:13,867 INFO Additional check to sync/queue to ensure sync with DS is ok (see LODESTAR-1245)
2024-04-11 01:25:13,868 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/sync/queue?_queryFilter=true&_pageSize=1"
2024-04-11 01:25:14,251 INFO [http_cmd]: http status code OK
2024-04-11 01:25:14,251 DEBUG --- status code ---
2024-04-11 01:25:14,251 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:14,251 DEBUG --- http response ---
2024-04-11 01:25:14,251 DEBUG {
"result": [],
"resultCount": 0,
"pagedResultsCookie": null,
"totalPagedResultsPolicy": "NONE",
"totalPagedResults": -1,
"remainingPagedResults": -1
}
2024-04-11 01:25:14,252 INFO Try to create, query and delete a user
2024-04-11 01:25:14,253 INFO Create user idm_vo9ddkgiqc in IDM
2024-04-11 01:25:14,253 INFO [http_cmd]: curl --header "Authorization: Bearer jaTsPUonm2Z7OMLF6Zb2-H0yhfQ" --header "Content-Type: application/json" --insecure -L --request POST --data '{"userName": "idm_vo9ddkgiqc", "givenName": "Peter", "sn": "Parker", "password": "T35tr0ck123", "telephoneNumber": "6669876987", "description": "IDM Test User", "roles": [], "mail": "idm_vo9ddkgiqc@forgerock.com"}' "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/managed/user?_action=create"
2024-04-11 01:25:14,673 INFO [http_cmd]: http status code OK
2024-04-11 01:25:14,673 DEBUG --- status code ---
2024-04-11 01:25:14,674 DEBUG http status code is 201 (expected [200, 201])
2024-04-11 01:25:14,674 DEBUG --- http response ---
2024-04-11 01:25:14,674 DEBUG [print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (34 lines):
2024-04-11 01:25:14,674 DEBUG ----- output -----
2024-04-11 01:25:14,674 DEBUG {
2024-04-11 01:25:14,674 DEBUG "_id": "36df9b45-7497-49a1-ba47-1756b2463d4b",
2024-04-11 01:25:14,674 DEBUG "_rev": "95e94b6a-8f5f-4703-bee0-2f142d3ca1de-71",
2024-04-11 01:25:14,674 DEBUG "country": null,
2024-04-11 01:25:14,674 DEBUG "mail": "idm_vo9ddkgiqc@forgerock.com",
2024-04-11 01:25:14,674 DEBUG "memberOfOrgIDs": [],
2024-04-11 01:25:14,674 DEBUG "postalCode": null,
2024-04-11 01:25:14,674 DEBUG "profileImage": null,
2024-04-11 01:25:14,674 DEBUG "expireAccount": null,
2024-04-11 01:25:14,674 DEBUG "activeDate": null,
2024-04-11 01:25:14,674 DEBUG
2024-04-11 01:25:14,674 DEBUG
2024-04-11 01:25:14,674 DEBUG
2024-04-11 01:25:14,674 DEBUG [...]
2024-04-11 01:25:14,674 DEBUG
2024-04-11 01:25:14,674 DEBUG
2024-04-11 01:25:14,674 DEBUG
2024-04-11 01:25:14,674 DEBUG "aliasList": [],
2024-04-11 01:25:14,674 DEBUG "kbaInfo": [],
2024-04-11 01:25:14,674 DEBUG "inactiveDate": null,
2024-04-11 01:25:14,674 DEBUG "sn": "Parker",
2024-04-11 01:25:14,675 DEBUG "preferences": null,
2024-04-11 01:25:14,675 DEBUG "userName": "idm_vo9ddkgiqc",
2024-04-11 01:25:14,675 DEBUG "passwordLastChangedTime": "2024-04-11T01:25:14.353Z",
2024-04-11 01:25:14,675 DEBUG "effectiveRoles": [],
2024-04-11 01:25:14,675 DEBUG "activateAccount": null
2024-04-11 01:25:14,675 DEBUG }
2024-04-11 01:25:14,675 INFO Query IDM to verify UserID 36df9b45-7497-49a1-ba47-1756b2463d4b is visible
2024-04-11 01:25:14,675 INFO [http_cmd]: curl --insecure -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/managed/user/36df9b45-7497-49a1-ba47-1756b2463d4b"
2024-04-11 01:25:14,954 INFO [http_cmd]: http status code OK
2024-04-11 01:25:14,955 DEBUG --- status code ---
2024-04-11 01:25:14,955 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:14,955 DEBUG --- http response ---
2024-04-11 01:25:14,955 DEBUG [print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (34 lines):
2024-04-11 01:25:14,955 DEBUG ----- output -----
2024-04-11 01:25:14,955 DEBUG {
2024-04-11 01:25:14,955 DEBUG "_id": "36df9b45-7497-49a1-ba47-1756b2463d4b",
2024-04-11 01:25:14,955 DEBUG "_rev": "95e94b6a-8f5f-4703-bee0-2f142d3ca1de-71",
2024-04-11 01:25:14,955 DEBUG "country": null,
2024-04-11 01:25:14,955 DEBUG "mail": "idm_vo9ddkgiqc@forgerock.com",
2024-04-11 01:25:14,955 DEBUG "memberOfOrgIDs": [],
2024-04-11 01:25:14,955 DEBUG "postalCode": null,
2024-04-11 01:25:14,955 DEBUG "profileImage": null,
2024-04-11 01:25:14,955 DEBUG "expireAccount": null,
2024-04-11 01:25:14,955 DEBUG "activeDate": null,
2024-04-11 01:25:14,955 DEBUG
2024-04-11 01:25:14,955 DEBUG
2024-04-11 01:25:14,955 DEBUG
2024-04-11 01:25:14,955 DEBUG [...]
2024-04-11 01:25:14,955 DEBUG
2024-04-11 01:25:14,955 DEBUG
2024-04-11 01:25:14,955 DEBUG
2024-04-11 01:25:14,955 DEBUG "aliasList": [],
2024-04-11 01:25:14,955 DEBUG "kbaInfo": [],
2024-04-11 01:25:14,955 DEBUG "inactiveDate": null,
2024-04-11 01:25:14,955 DEBUG "sn": "Parker",
2024-04-11 01:25:14,955 DEBUG "preferences": null,
2024-04-11 01:25:14,955 DEBUG "userName": "idm_vo9ddkgiqc",
2024-04-11 01:25:14,955 DEBUG "passwordLastChangedTime": "2024-04-11T01:25:14.353Z",
2024-04-11 01:25:14,955 DEBUG "effectiveRoles": [],
2024-04-11 01:25:14,955 DEBUG "activateAccount": null
2024-04-11 01:25:14,956 DEBUG }
2024-04-11 01:25:14,956 INFO Authenticate as user idm_vo9ddkgiqc
2024-04-11 01:25:14,956 INFO [http_cmd]: curl --insecure -L --request POST "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/authentication?_action=login"
2024-04-11 01:25:15,169 INFO [http_cmd]: http status code OK
2024-04-11 01:25:15,169 DEBUG --- status code ---
2024-04-11 01:25:15,169 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:15,169 DEBUG --- http response ---
2024-04-11 01:25:15,169 DEBUG {
"_id": "login",
"authorization": {
"id": "anonymous",
"roles": [
"internal/role/openidm-reg"
],
"component": "internal/user"
},
"authenticationId": "anonymous"
}
2024-04-11 01:25:15,171 INFO [http_cmd]: curl --insecure -L --request DELETE "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/managed/user/36df9b45-7497-49a1-ba47-1756b2463d4b"
2024-04-11 01:25:15,455 INFO [http_cmd]: http status code OK
2024-04-11 01:25:15,455 DEBUG --- status code ---
2024-04-11 01:25:15,455 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:15,455 DEBUG --- http response ---
2024-04-11 01:25:15,456 DEBUG [print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (34 lines):
2024-04-11 01:25:15,456 DEBUG ----- output -----
2024-04-11 01:25:15,456 DEBUG {
2024-04-11 01:25:15,456 DEBUG "_id": "36df9b45-7497-49a1-ba47-1756b2463d4b",
2024-04-11 01:25:15,456 DEBUG "_rev": "95e94b6a-8f5f-4703-bee0-2f142d3ca1de-71",
2024-04-11 01:25:15,456 DEBUG "country": null,
2024-04-11 01:25:15,456 DEBUG "mail": "idm_vo9ddkgiqc@forgerock.com",
2024-04-11 01:25:15,456 DEBUG "memberOfOrgIDs": [],
2024-04-11 01:25:15,456 DEBUG "postalCode": null,
2024-04-11 01:25:15,456 DEBUG "profileImage": null,
2024-04-11 01:25:15,456 DEBUG "expireAccount": null,
2024-04-11 01:25:15,456 DEBUG "activeDate": null,
2024-04-11 01:25:15,456 DEBUG
2024-04-11 01:25:15,456 DEBUG
2024-04-11 01:25:15,456 DEBUG
2024-04-11 01:25:15,456 DEBUG [...]
2024-04-11 01:25:15,456 DEBUG
2024-04-11 01:25:15,456 DEBUG
2024-04-11 01:25:15,456 DEBUG
2024-04-11 01:25:15,456 DEBUG "aliasList": [],
2024-04-11 01:25:15,457 DEBUG "kbaInfo": [],
2024-04-11 01:25:15,457 DEBUG "inactiveDate": null,
2024-04-11 01:25:15,457 DEBUG "sn": "Parker",
2024-04-11 01:25:15,457 DEBUG "preferences": null,
2024-04-11 01:25:15,457 DEBUG "userName": "idm_vo9ddkgiqc",
2024-04-11 01:25:15,457 DEBUG "passwordLastChangedTime": "2024-04-11T01:25:14.353Z",
2024-04-11 01:25:15,457 DEBUG "effectiveRoles": [],
2024-04-11 01:25:15,457 DEBUG "activateAccount": null
2024-04-11 01:25:15,457 DEBUG }
2024-04-11 01:25:15,461 INFO
2024-04-11 01:25:15,461 INFO -------------------- Running END-USER-UI livecheck --------------------
2024-04-11 01:25:15,461 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/enduser
2024-04-11 01:25:15,462 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/enduser"
2024-04-11 01:25:15,742 INFO [http_cmd]: http status code OK
2024-04-11 01:25:15,742 DEBUG --- status code ---
2024-04-11 01:25:15,742 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:15,742 DEBUG --- http response ---
2024-04-11 01:25:15,743 DEBUG Identity Management
[]
2024-04-11 01:25:15,744 INFO
2024-04-11 01:25:15,744 INFO --------------------- Running LOGIN-UI livecheck ---------------------
2024-04-11 01:25:15,744 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/am/XUI
2024-04-11 01:25:15,744 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/am/XUI"
2024-04-11 01:25:16,028 INFO [http_cmd]: http status code OK
2024-04-11 01:25:16,028 DEBUG --- status code ---
2024-04-11 01:25:16,028 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:16,028 DEBUG --- http response ---
2024-04-11 01:25:16,028 DEBUG Login
[]
2024-04-11 01:25:16,030 INFO
2024-04-11 01:25:16,031 INFO --------------------- Running ADMIN-UI livecheck ---------------------
2024-04-11 01:25:16,031 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/platform
2024-04-11 01:25:16,031 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/platform"
2024-04-11 01:25:16,319 INFO [http_cmd]: http status code OK
2024-04-11 01:25:16,320 DEBUG --- status code ---
2024-04-11 01:25:16,320 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:16,320 DEBUG --- http response ---
2024-04-11 01:25:16,320 DEBUG Platform Admin
[]
2024-04-11 01:25:16,322 INFO LIVECHECK SUCCEEDED
2024-04-11 01:25:16,322 INFO
2024-04-11 01:25:16,322 INFO **************************** Initializing component pods for DS-CTS ****************************
2024-04-11 01:25:16,322 INFO
2024-04-11 01:25:16,322 INFO --------------------- Get DS-CTS software version ---------------------
2024-04-11 01:25:16,323 INFO
2024-04-11 01:25:16,323 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- find /opt/opendj -name opendj-core.jar
2024-04-11 01:25:16,323 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0]
2024-04-11 01:25:17,146 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:17,147 DEBUG --- stdout ---
2024-04-11 01:25:17,147 DEBUG /opt/opendj/lib/opendj-core.jar
2024-04-11 01:25:17,147 DEBUG --- stderr ---
2024-04-11 01:25:17,147 DEBUG
2024-04-11 01:25:17,148 INFO
2024-04-11 01:25:17,148 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp ds-cts-0:/opt/opendj/lib/opendj-core.jar /tmp/ds-cts_info/opendj-core.jar --container ds
2024-04-11 01:25:17,148 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:18,434 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:18,434 DEBUG --- stdout ---
2024-04-11 01:25:18,434 DEBUG tar: Removing leading `/' from member names
2024-04-11 01:25:18,434 DEBUG --- stderr ---
2024-04-11 01:25:18,435 DEBUG
2024-04-11 01:25:18,442 INFO
2024-04-11 01:25:18,443 INFO ************************** Initializing component pods for DS-IDREPO **************************
2024-04-11 01:25:18,443 INFO
2024-04-11 01:25:18,443 INFO ------------------- Get DS-IDREPO software version -------------------
2024-04-11 01:25:18,443 INFO
2024-04-11 01:25:18,443 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-idrepo-0 --container ds -- find /opt/opendj -name opendj-core.jar
2024-04-11 01:25:18,443 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0]
2024-04-11 01:25:19,262 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:19,262 DEBUG --- stdout ---
2024-04-11 01:25:19,262 DEBUG /opt/opendj/lib/opendj-core.jar
2024-04-11 01:25:19,262 DEBUG --- stderr ---
2024-04-11 01:25:19,262 DEBUG
2024-04-11 01:25:19,262 INFO
2024-04-11 01:25:19,263 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp ds-idrepo-0:/opt/opendj/lib/opendj-core.jar /tmp/ds-idrepo_info/opendj-core.jar --container ds
2024-04-11 01:25:19,263 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:20,523 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:20,523 DEBUG --- stdout ---
2024-04-11 01:25:20,524 DEBUG tar: Removing leading `/' from member names
2024-04-11 01:25:20,524 DEBUG --- stderr ---
2024-04-11 01:25:20,524 DEBUG
2024-04-11 01:25:20,538 INFO
2024-04-11 01:25:20,538 INFO ****************************** Initializing component pods for AM ******************************
2024-04-11 01:25:20,538 INFO
2024-04-11 01:25:20,538 INFO ----------------------- Get AM software version -----------------------
2024-04-11 01:25:20,538 INFO Getting product version from https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/serverinfo/version
2024-04-11 01:25:20,539 INFO [LoginSession] Get "token_id" token for user "amadmin"
2024-04-11 01:25:20,539 DEBUG [LoginSession] re-using "token_id" token that remains valid for 2m 41s
2024-04-11 01:25:20,540 INFO [http_cmd]: curl -L --request GET --cookie "amlbcookie=01" --cookie "iPlanetDirectoryPro=Rak8A0aIjBfUwwuWCiP1U-KmY4Q.*AAJTSQACMDIAAlNLABxCOHArdmNLc2ZzeW9seWFHMjVOb0pJVmtQQ009AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "route=1712798713.935.25887.229101|f60edb382037eb2df1e800d563ad78a7" "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/serverinfo/version"
2024-04-11 01:25:20,789 INFO [http_cmd]: http status code OK
2024-04-11 01:25:20,790 DEBUG --- status code ---
2024-04-11 01:25:20,790 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:20,790 DEBUG --- http response ---
2024-04-11 01:25:20,790 DEBUG {
"_id": "version",
"_rev": "1507272562",
"version": "7.6.0-SNAPSHOT",
"fullVersion": "ForgeRock Access Management 7.6.0-SNAPSHOT Build a89ff42c02de792a1493750badb7bf8554c69559 (2024-April-09 19:07)",
"revision": "a89ff42c02de792a1493750badb7bf8554c69559",
"date": "2024-April-09 19:07"
}
2024-04-11 01:25:20,793 INFO
2024-04-11 01:25:20,793 INFO **************************** Initializing component pods for AMSTER ****************************
2024-04-11 01:25:20,793 INFO
2024-04-11 01:25:20,793 INFO ***************************** Initializing component pods for IDM *****************************
2024-04-11 01:25:20,793 INFO
2024-04-11 01:25:20,793 INFO ---------------------- Get IDM software version ----------------------
2024-04-11 01:25:20,793 INFO Getting product version from https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/info/version
2024-04-11 01:25:20,794 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/info/version"
2024-04-11 01:25:21,012 INFO [http_cmd]: http status code OK
2024-04-11 01:25:21,013 DEBUG --- status code ---
2024-04-11 01:25:21,013 DEBUG http status code is 200 (expected 200)
2024-04-11 01:25:21,013 DEBUG --- http response ---
2024-04-11 01:25:21,013 DEBUG {
"_id": "version",
"productVersion": "7.6.0-SNAPSHOT",
"productBuildDate": "20240409155559",
"productRevision": "837ae72b84"
}
2024-04-11 01:25:21,016 INFO
2024-04-11 01:25:21,016 INFO ************************* Initializing component pods for END-USER-UI *************************
2024-04-11 01:25:21,016 INFO
2024-04-11 01:25:21,016 INFO ------------------ Get END-USER-UI software version ------------------
2024-04-11 01:25:21,017 INFO
2024-04-11 01:25:21,017 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec end-user-ui-58878d7668-gjq6d --container end-user-ui -- find /usr/share/nginx/html -name chunk-vendors.*.js
2024-04-11 01:25:21,017 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0]
2024-04-11 01:25:21,755 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:21,755 DEBUG --- stdout ---
2024-04-11 01:25:21,755 DEBUG /usr/share/nginx/html/js/chunk-vendors.0380a414.js
2024-04-11 01:25:21,755 DEBUG --- stderr ---
2024-04-11 01:25:21,755 DEBUG
2024-04-11 01:25:21,756 INFO
2024-04-11 01:25:21,756 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp end-user-ui-58878d7668-gjq6d:/usr/share/nginx/html/js/chunk-vendors.0380a414.js /tmp/end-user-ui_info/chunk-vendors.0380a414.js --container end-user-ui
2024-04-11 01:25:21,756 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:22,896 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:22,896 DEBUG --- stdout ---
2024-04-11 01:25:22,896 DEBUG tar: Removing leading `/' from member names
2024-04-11 01:25:22,896 DEBUG --- stderr ---
2024-04-11 01:25:22,896 DEBUG
2024-04-11 01:25:22,932 INFO
2024-04-11 01:25:22,932 INFO *************************** Initializing component pods for LOGIN-UI ***************************
2024-04-11 01:25:22,932 INFO
2024-04-11 01:25:22,933 INFO -------------------- Get LOGIN-UI software version --------------------
2024-04-11 01:25:22,933 INFO
2024-04-11 01:25:22,933 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec login-ui-5fdf49fc66-s678w --container login-ui -- find /usr/share/nginx/html -name chunk-vendors.*.js
2024-04-11 01:25:22,933 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0]
2024-04-11 01:25:23,701 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:23,701 DEBUG --- stdout ---
2024-04-11 01:25:23,701 DEBUG /usr/share/nginx/html/js/chunk-vendors.f2fa5365.js
2024-04-11 01:25:23,701 DEBUG --- stderr ---
2024-04-11 01:25:23,701 DEBUG
2024-04-11 01:25:23,702 INFO
2024-04-11 01:25:23,702 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp login-ui-5fdf49fc66-s678w:/usr/share/nginx/html/js/chunk-vendors.f2fa5365.js /tmp/login-ui_info/chunk-vendors.f2fa5365.js --container login-ui
2024-04-11 01:25:23,702 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:24,842 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:24,842 DEBUG --- stdout ---
2024-04-11 01:25:24,842 DEBUG tar: Removing leading `/' from member names
2024-04-11 01:25:24,842 DEBUG --- stderr ---
2024-04-11 01:25:24,842 DEBUG
2024-04-11 01:25:24,860 INFO
2024-04-11 01:25:24,860 INFO *************************** Initializing component pods for ADMIN-UI ***************************
2024-04-11 01:25:24,860 INFO
2024-04-11 01:25:24,860 INFO -------------------- Get ADMIN-UI software version --------------------
2024-04-11 01:25:24,861 INFO
2024-04-11 01:25:24,861 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec admin-ui-c4c7bf584-pvbnd --container admin-ui -- find /usr/share/nginx/html -name chunk-vendors.*.js
2024-04-11 01:25:24,861 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0]
2024-04-11 01:25:25,606 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:25,606 DEBUG --- stdout ---
2024-04-11 01:25:25,606 DEBUG /usr/share/nginx/html/js/chunk-vendors.b3d879ac.js
2024-04-11 01:25:25,606 DEBUG --- stderr ---
2024-04-11 01:25:25,606 DEBUG
2024-04-11 01:25:25,607 INFO
2024-04-11 01:25:25,607 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp admin-ui-c4c7bf584-pvbnd:/usr/share/nginx/html/js/chunk-vendors.b3d879ac.js /tmp/admin-ui_info/chunk-vendors.b3d879ac.js --container admin-ui
2024-04-11 01:25:25,607 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:26,795 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:26,795 DEBUG --- stdout ---
2024-04-11 01:25:26,796 DEBUG tar: Removing leading `/' from member names
2024-04-11 01:25:26,796 DEBUG --- stderr ---
2024-04-11 01:25:26,796 DEBUG
2024-04-11 01:25:26,871 INFO
2024-04-11 01:25:26,871 INFO
2024-04-11 01:25:26,871 INFO ====================================================================================================
2024-04-11 01:25:26,871 INFO ================ Admin password for DS-CTS is: BeqxyXdenFnTwBIdWkspvdilgvkC12cq ================
2024-04-11 01:25:26,872 INFO ====================================================================================================
2024-04-11 01:25:26,872 INFO
2024-04-11 01:25:26,872 INFO ====================================================================================================
2024-04-11 01:25:26,872 INFO ============== Admin password for DS-IDREPO is: BeqxyXdenFnTwBIdWkspvdilgvkC12cq ==============
2024-04-11 01:25:26,872 INFO ====================================================================================================
2024-04-11 01:25:26,872 INFO
2024-04-11 01:25:26,872 INFO ====================================================================================================
2024-04-11 01:25:26,872 INFO ====================== Admin password for AM is: 1q1hdZzTipTrDIdXfQMGk1W3 ======================
2024-04-11 01:25:26,872 INFO ====================================================================================================
2024-04-11 01:25:26,872 INFO
2024-04-11 01:25:26,872 INFO ====================================================================================================
2024-04-11 01:25:26,872 INFO ===================== Admin password for IDM is: dfK0OQODqzlgrrFwjA17an65 =====================
2024-04-11 01:25:26,872 INFO ====================================================================================================
2024-04-11 01:25:26,872 INFO
2024-04-11 01:25:26,872 INFO *************************************** Dumping pod list ***************************************
2024-04-11 01:25:26,873 INFO Dumping pod list to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/_pod-list.txt
2024-04-11 01:25:27,385 INFO Dumping platform-config configmap to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/_platform-config_configmap.txt
2024-04-11 01:25:27,715 INFO
2024-04-11 01:25:27,715 INFO **************************** Initializing component pods for DS-CTS ****************************
2024-04-11 01:25:27,715 INFO
2024-04-11 01:25:27,716 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:25:27,716 INFO
2024-04-11 01:25:27,716 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-cts --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:25:27,716 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:28,103 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:28,104 DEBUG --- stdout ---
2024-04-11 01:25:28,105 DEBUG 3
2024-04-11 01:25:28,105 DEBUG --- stderr ---
2024-04-11 01:25:28,105 DEBUG
2024-04-11 01:25:28,105 INFO
2024-04-11 01:25:28,105 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:28,105 INFO
2024-04-11 01:25:28,105 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=ds-cts --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:28,105 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:28,560 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:28,561 DEBUG --- stdout ---
2024-04-11 01:25:28,561 DEBUG ds-cts-0 ds-cts-1 ds-cts-2
2024-04-11 01:25:28,561 DEBUG --- stderr ---
2024-04-11 01:25:28,561 DEBUG
2024-04-11 01:25:28,561 INFO
2024-04-11 01:25:28,561 INFO ************************** Initializing component pods for DS-IDREPO **************************
2024-04-11 01:25:28,561 INFO
2024-04-11 01:25:28,561 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:25:28,561 INFO
2024-04-11 01:25:28,561 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-idrepo --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:25:28,561 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:28,948 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:28,949 DEBUG --- stdout ---
2024-04-11 01:25:28,949 DEBUG 3
2024-04-11 01:25:28,949 DEBUG --- stderr ---
2024-04-11 01:25:28,949 DEBUG
2024-04-11 01:25:28,949 INFO
2024-04-11 01:25:28,949 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:28,949 INFO
2024-04-11 01:25:28,949 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=ds-idrepo --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:28,949 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:29,401 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:29,401 DEBUG --- stdout ---
2024-04-11 01:25:29,401 DEBUG ds-idrepo-0 ds-idrepo-1 ds-idrepo-2
2024-04-11 01:25:29,401 DEBUG --- stderr ---
2024-04-11 01:25:29,401 DEBUG
2024-04-11 01:25:29,401 INFO
2024-04-11 01:25:29,401 INFO ****************************** Initializing component pods for AM ******************************
2024-04-11 01:25:29,402 INFO
2024-04-11 01:25:29,402 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:25:29,402 INFO
2024-04-11 01:25:29,402 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app=am --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:25:29,402 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:29,784 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:29,785 DEBUG --- stdout ---
2024-04-11 01:25:29,785 DEBUG 3
2024-04-11 01:25:29,785 DEBUG --- stderr ---
2024-04-11 01:25:29,785 DEBUG
2024-04-11 01:25:29,785 INFO
2024-04-11 01:25:29,785 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:29,785 INFO
2024-04-11 01:25:29,785 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=am --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:29,785 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:30,234 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:30,234 DEBUG --- stdout ---
2024-04-11 01:25:30,234 DEBUG am-5b5bd8567b-6lzwk am-5b5bd8567b-8h2w4 am-5b5bd8567b-qlkw6
2024-04-11 01:25:30,234 DEBUG --- stderr ---
2024-04-11 01:25:30,234 DEBUG
2024-04-11 01:25:30,235 INFO
2024-04-11 01:25:30,235 INFO **************************** Initializing component pods for AMSTER ****************************
2024-04-11 01:25:30,235 INFO
2024-04-11 01:25:30,235 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:30,235 INFO
2024-04-11 01:25:30,235 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=amster --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:30,235 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:30,601 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:30,602 DEBUG --- stdout ---
2024-04-11 01:25:30,602 DEBUG amster-lqszt
2024-04-11 01:25:30,602 DEBUG --- stderr ---
2024-04-11 01:25:30,602 DEBUG
2024-04-11 01:25:30,602 INFO
2024-04-11 01:25:30,602 INFO ***************************** Initializing component pods for IDM *****************************
2024-04-11 01:25:30,602 INFO
2024-04-11 01:25:30,602 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:25:30,602 INFO
2024-04-11 01:25:30,602 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployment --selector app=idm --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:25:30,602 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:30,974 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:30,975 DEBUG --- stdout ---
2024-04-11 01:25:30,975 DEBUG 2
2024-04-11 01:25:30,975 DEBUG --- stderr ---
2024-04-11 01:25:30,975 DEBUG
2024-04-11 01:25:30,975 INFO
2024-04-11 01:25:30,975 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:30,975 INFO
2024-04-11 01:25:30,975 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=idm --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:30,976 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:31,367 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:31,368 DEBUG --- stdout ---
2024-04-11 01:25:31,368 DEBUG idm-668d898cfd-2vqdm idm-668d898cfd-st2t7
2024-04-11 01:25:31,368 DEBUG --- stderr ---
2024-04-11 01:25:31,368 DEBUG
2024-04-11 01:25:31,368 INFO
2024-04-11 01:25:31,368 INFO ************************* Initializing component pods for END-USER-UI *************************
2024-04-11 01:25:31,368 INFO
2024-04-11 01:25:31,368 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:25:31,368 INFO
2024-04-11 01:25:31,368 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:25:31,368 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:31,679 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:31,679 DEBUG --- stdout ---
2024-04-11 01:25:31,679 DEBUG 1
2024-04-11 01:25:31,679 DEBUG --- stderr ---
2024-04-11 01:25:31,679 DEBUG
2024-04-11 01:25:31,679 INFO
2024-04-11 01:25:31,679 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:31,680 INFO
2024-04-11 01:25:31,680 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:31,680 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:32,000 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:32,000 DEBUG --- stdout ---
2024-04-11 01:25:32,000 DEBUG end-user-ui-58878d7668-gjq6d
2024-04-11 01:25:32,000 DEBUG --- stderr ---
2024-04-11 01:25:32,000 DEBUG
2024-04-11 01:25:32,000 INFO
2024-04-11 01:25:32,000 INFO *************************** Initializing component pods for LOGIN-UI ***************************
2024-04-11 01:25:32,000 INFO
2024-04-11 01:25:32,000 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:25:32,001 INFO
2024-04-11 01:25:32,001 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:25:32,001 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:32,324 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:32,325 DEBUG --- stdout ---
2024-04-11 01:25:32,325 DEBUG 1
2024-04-11 01:25:32,325 DEBUG --- stderr ---
2024-04-11 01:25:32,325 DEBUG
2024-04-11 01:25:32,325 INFO
2024-04-11 01:25:32,325 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:32,326 INFO
2024-04-11 01:25:32,326 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:32,326 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:32,687 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:32,687 DEBUG --- stdout ---
2024-04-11 01:25:32,687 DEBUG login-ui-5fdf49fc66-s678w
2024-04-11 01:25:32,687 DEBUG --- stderr ---
2024-04-11 01:25:32,688 DEBUG
2024-04-11 01:25:32,688 INFO
2024-04-11 01:25:32,688 INFO *************************** Initializing component pods for ADMIN-UI ***************************
2024-04-11 01:25:32,688 INFO
2024-04-11 01:25:32,688 INFO --------------------- Get expected number of pods ---------------------
2024-04-11 01:25:32,688 INFO
2024-04-11 01:25:32,688 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].spec.replicas}
2024-04-11 01:25:32,688 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-11 01:25:33,071 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:33,072 DEBUG --- stdout ---
2024-04-11 01:25:33,072 DEBUG 1
2024-04-11 01:25:33,072 DEBUG --- stderr ---
2024-04-11 01:25:33,072 DEBUG
2024-04-11 01:25:33,072 INFO
2024-04-11 01:25:33,072 INFO ---------------------------- Get pod list ----------------------------
2024-04-11 01:25:33,072 INFO
2024-04-11 01:25:33,072 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].metadata.name}
2024-04-11 01:25:33,072 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-11 01:25:33,407 INFO [loop_until]: OK (rc = 0)
2024-04-11 01:25:33,407 DEBUG --- stdout ---
2024-04-11 01:25:33,408 DEBUG admin-ui-c4c7bf584-pvbnd
2024-04-11 01:25:33,409 DEBUG --- stderr ---
2024-04-11 01:25:33,409 DEBUG
2024-04-11 01:25:33,409 INFO
2024-04-11 01:25:33,409 INFO *********************************** Dumping components logs ***********************************
2024-04-11 01:25:33,409 INFO
2024-04-11 01:25:33,409 INFO ----------------------- Dumping logs for DS-CTS -----------------------
2024-04-11 01:25:34,574 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-cts-0.txt
2024-04-11 01:25:34,575 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-cts-0.txt
2024-04-11 01:25:34,575 INFO Check pod logs for errors
2024-04-11 01:25:35,694 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-cts-1.txt
2024-04-11 01:25:35,694 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-cts-1.txt
2024-04-11 01:25:35,695 INFO Check pod logs for errors
2024-04-11 01:25:36,773 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-cts-2.txt
2024-04-11 01:25:36,774 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-cts-2.txt
2024-04-11 01:25:36,774 INFO Check pod logs for errors
2024-04-11 01:25:36,774 INFO
2024-04-11 01:25:36,774 INFO --------------------- Dumping logs for DS-IDREPO ---------------------
2024-04-11 01:25:37,853 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-idrepo-0.txt
2024-04-11 01:25:37,854 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-idrepo-0.txt
2024-04-11 01:25:37,855 INFO Check pod logs for errors
2024-04-11 01:25:38,992 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-idrepo-1.txt
2024-04-11 01:25:38,993 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-idrepo-1.txt
2024-04-11 01:25:38,993 INFO Check pod logs for errors
2024-04-11 01:25:40,135 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-idrepo-2.txt
2024-04-11 01:25:40,135 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/ds-idrepo-2.txt
2024-04-11 01:25:40,135 INFO Check pod logs for errors
2024-04-11 01:25:40,135 INFO
2024-04-11 01:25:40,135 INFO ------------------------- Dumping logs for AM -------------------------
2024-04-11 01:25:41,459 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/am-5b5bd8567b-6lzwk.txt
2024-04-11 01:25:41,459 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/am-5b5bd8567b-6lzwk.txt
2024-04-11 01:25:41,460 INFO Check pod logs for errors
2024-04-11 01:25:42,654 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/am-5b5bd8567b-8h2w4.txt
2024-04-11 01:25:42,654 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/am-5b5bd8567b-8h2w4.txt
2024-04-11 01:25:42,654 INFO Check pod logs for errors
2024-04-11 01:25:43,979 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/am-5b5bd8567b-qlkw6.txt
2024-04-11 01:25:43,979 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/am-5b5bd8567b-qlkw6.txt
2024-04-11 01:25:43,980 INFO Check pod logs for errors
2024-04-11 01:25:43,980 INFO
2024-04-11 01:25:43,980 INFO ----------------------- Dumping logs for AMSTER -----------------------
2024-04-11 01:25:45,141 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/amster-lqszt.txt
2024-04-11 01:25:45,142 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/amster-lqszt.txt
2024-04-11 01:25:45,142 INFO Check pod logs for errors
2024-04-11 01:25:45,142 INFO
2024-04-11 01:25:45,142 INFO ------------------------ Dumping logs for IDM ------------------------
2024-04-11 01:25:46,528 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/idm-668d898cfd-2vqdm.txt
2024-04-11 01:25:46,528 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/idm-668d898cfd-2vqdm.txt
2024-04-11 01:25:46,530 INFO Check pod logs for errors
2024-04-11 01:25:47,858 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/idm-668d898cfd-st2t7.txt
2024-04-11 01:25:47,858 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/idm-668d898cfd-st2t7.txt
2024-04-11 01:25:47,860 INFO Check pod logs for errors
2024-04-11 01:25:47,861 INFO
2024-04-11 01:25:47,861 INFO -------------------- Dumping logs for END-USER-UI --------------------
2024-04-11 01:25:48,754 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/end-user-ui-58878d7668-gjq6d.txt
2024-04-11 01:25:48,755 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/end-user-ui-58878d7668-gjq6d.txt
2024-04-11 01:25:48,755 INFO Check pod logs for errors
2024-04-11 01:25:48,755 INFO
2024-04-11 01:25:48,755 INFO ---------------------- Dumping logs for LOGIN-UI ----------------------
2024-04-11 01:25:49,665 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/login-ui-5fdf49fc66-s678w.txt
2024-04-11 01:25:49,666 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/login-ui-5fdf49fc66-s678w.txt
2024-04-11 01:25:49,666 INFO Check pod logs for errors
2024-04-11 01:25:49,666 INFO
2024-04-11 01:25:49,666 INFO ---------------------- Dumping logs for ADMIN-UI ----------------------
2024-04-11 01:25:50,633 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/admin-ui-c4c7bf584-pvbnd.txt
2024-04-11 01:25:50,635 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240411_012526-after-deployment/admin-ui-c4c7bf584-pvbnd.txt
2024-04-11 01:25:50,635 INFO Check pod logs for errors
[2024-04-11 01:25:50] - INFO: Deployment successful
________________________________________________________________________________
[2024-04-11 01:25:50] Deploy_all_forgerock_components post : Post method
________________________________________________________________________________
Setting result to PASS
Task has been successfully stopped