--Task-- name: Deploy_all_forgerock_components enabled: True class_name: DeployComponentsTask source_name: controller source_namespace: >default< target_name: controller target_namespace: >default< start: 0.0 stop: None timeout: no timeout loop: False interval: None dependencies: ['Enable_prometheus_admin_api'] wait_for: [] preceding_task: None options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-04-25 17:12:20] Deploy_all_forgerock_components pre : Initialising task parameters ________________________________________________________________________________ task will be executed on controller (localhost) ________________________________________________________________________________ [2024-04-25 17:12:20] Deploy_all_forgerock_components step1 : Deploy components ________________________________________________________________________________ 2024-04-25 17:12:20,632 INFO 2024-04-25 17:12:20,633 INFO ******************************** Cleaning up existing namespace ******************************** 2024-04-25 17:12:20,949 INFO 2024-04-25 17:12:20,950 INFO ------------------ Deleting secret agent controller ------------------ 2024-04-25 17:12:21,264 INFO 2024-04-25 17:12:21,264 INFO [loop_until]: kubectl --namespace=xlou delete sac --all 2024-04-25 17:12:21,264 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:12:21,845 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:12:21,845 DEBUG --- stdout --- 2024-04-25 17:12:21,845 DEBUG secretagentconfiguration.secret-agent.secrets.forgerock.io "forgerock-sac" deleted 2024-04-25 17:12:21,845 DEBUG --- stderr --- 2024-04-25 17:12:21,845 DEBUG 2024-04-25 17:12:21,845 INFO 2024-04-25 17:12:21,845 INFO ----------------------- Deleting all resources ----------------------- 2024-04-25 17:12:21,845 INFO 2024-04-25 17:12:21,845 INFO [loop_until]: kubectl --namespace=xlou delete all --all --grace-period=0 --force 2024-04-25 17:12:21,845 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:12:33,234 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:12:33,234 DEBUG --- stdout --- 2024-04-25 17:12:33,235 DEBUG pod "admin-ui-c4c7bf584-qp6gx" force deleted pod "am-769b98f8d5-2pqrk" force deleted pod "am-769b98f8d5-2rr6f" force deleted pod "am-769b98f8d5-h2r87" force deleted pod "amster-8hg9v" force deleted pod "ds-cts-0" force deleted pod "ds-cts-1" force deleted pod "ds-cts-2" force deleted pod "ds-idrepo-0" force deleted pod "ds-idrepo-1" force deleted pod "ds-idrepo-2" force deleted pod "end-user-ui-58878d7668-zkqbp" force deleted pod "idm-6c95d7588f-98n7b" force deleted pod "idm-6c95d7588f-j6s6c" force deleted pod "ldif-importer-qtr9w" force deleted pod "lodemon-778c4f5c49-4tdnc" force deleted pod "login-ui-5fdf49fc66-7c9cd" force deleted pod "overseer-0-55d5975bd7-gp92m" force deleted service "admin-ui" force deleted service "am" force deleted service "ds-cts" force deleted service "ds-idrepo" force deleted service "end-user-ui" force deleted service "idm" force deleted service "login-ui" force deleted service "overseer-0" force deleted deployment.apps "admin-ui" force deleted deployment.apps "am" force deleted deployment.apps "end-user-ui" force deleted deployment.apps "idm" force deleted deployment.apps "lodemon" force deleted deployment.apps "login-ui" force deleted deployment.apps "overseer-0" force deleted statefulset.apps "ds-cts" force deleted statefulset.apps "ds-idrepo" force deleted job.batch "amster" force deleted job.batch "ldif-importer" force deleted 2024-04-25 17:12:33,235 DEBUG --- stderr --- 2024-04-25 17:12:33,235 DEBUG Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. 2024-04-25 17:12:33,235 INFO 2024-04-25 17:12:33,235 INFO [loop_until]: kubectl --namespace xlou get pods | grep "No resources found" 2024-04-25 17:12:33,235 INFO [loop_until]: (max_time=360, interval=10, expected_rc=[0] 2024-04-25 17:12:33,678 INFO [loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:12:44,147 INFO [loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:12:54,598 INFO [loop_until]: Function succeeded after 21s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:13:05,056 INFO [loop_until]: Function succeeded after 31s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:13:15,509 INFO [loop_until]: Function succeeded after 42s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:13:25,958 INFO [loop_until]: Function succeeded after 52s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:13:36,471 INFO [loop_until]: Function succeeded after 1m 03s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:13:47,016 INFO [loop_until]: Function succeeded after 1m 13s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:13:57,478 INFO [loop_until]: Function succeeded after 1m 24s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:14:07,925 INFO [loop_until]: Function succeeded after 1m 34s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:14:18,373 INFO [loop_until]: Function succeeded after 1m 45s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:14:28,805 INFO [loop_until]: Function succeeded after 1m 55s (rc=0) - failed to find expected output: No resources found - retry 2024-04-25 17:14:39,127 INFO [loop_until]: Function succeeded after 2m 05s (rc=0) - expected pattern found 2024-04-25 17:14:39,128 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:39,128 DEBUG --- stdout --- 2024-04-25 17:14:39,128 DEBUG 2024-04-25 17:14:39,128 DEBUG --- stderr --- 2024-04-25 17:14:39,128 DEBUG No resources found in xlou namespace. 2024-04-25 17:14:39,128 INFO 2024-04-25 17:14:39,128 INFO ------------------------- Deleting configmap ------------------------- 2024-04-25 17:14:39,128 INFO 2024-04-25 17:14:39,129 INFO [loop_until]: kubectl --namespace=xlou get configmap --output jsonpath={.items[*].metadata.name} 2024-04-25 17:14:39,129 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:39,599 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:39,599 DEBUG --- stdout --- 2024-04-25 17:14:39,599 DEBUG am-logback amster-files amster-retain idm idm-logging-properties kube-root-ca.crt lodemon-config lodemon-deployments overseer-config-0 platform-config 2024-04-25 17:14:39,599 DEBUG --- stderr --- 2024-04-25 17:14:39,599 DEBUG 2024-04-25 17:14:39,600 INFO 2024-04-25 17:14:39,600 INFO [loop_until]: kubectl --namespace=xlou delete configmap am-logback --ignore-not-found 2024-04-25 17:14:39,600 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:40,015 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:40,016 DEBUG --- stdout --- 2024-04-25 17:14:40,016 DEBUG configmap "am-logback" deleted 2024-04-25 17:14:40,016 DEBUG --- stderr --- 2024-04-25 17:14:40,016 DEBUG 2024-04-25 17:14:40,016 INFO 2024-04-25 17:14:40,016 INFO [loop_until]: kubectl --namespace=xlou delete configmap amster-files --ignore-not-found 2024-04-25 17:14:40,016 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:40,443 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:40,443 DEBUG --- stdout --- 2024-04-25 17:14:40,443 DEBUG configmap "amster-files" deleted 2024-04-25 17:14:40,443 DEBUG --- stderr --- 2024-04-25 17:14:40,443 DEBUG 2024-04-25 17:14:40,444 INFO 2024-04-25 17:14:40,444 INFO [loop_until]: kubectl --namespace=xlou delete configmap amster-retain --ignore-not-found 2024-04-25 17:14:40,444 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:40,855 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:40,855 DEBUG --- stdout --- 2024-04-25 17:14:40,856 DEBUG configmap "amster-retain" deleted 2024-04-25 17:14:40,856 DEBUG --- stderr --- 2024-04-25 17:14:40,856 DEBUG 2024-04-25 17:14:40,856 INFO 2024-04-25 17:14:40,856 INFO [loop_until]: kubectl --namespace=xlou delete configmap idm --ignore-not-found 2024-04-25 17:14:40,856 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:41,258 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:41,258 DEBUG --- stdout --- 2024-04-25 17:14:41,259 DEBUG configmap "idm" deleted 2024-04-25 17:14:41,259 DEBUG --- stderr --- 2024-04-25 17:14:41,259 DEBUG 2024-04-25 17:14:41,259 INFO 2024-04-25 17:14:41,259 INFO [loop_until]: kubectl --namespace=xlou delete configmap idm-logging-properties --ignore-not-found 2024-04-25 17:14:41,259 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:41,685 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:41,685 DEBUG --- stdout --- 2024-04-25 17:14:41,685 DEBUG configmap "idm-logging-properties" deleted 2024-04-25 17:14:41,685 DEBUG --- stderr --- 2024-04-25 17:14:41,685 DEBUG 2024-04-25 17:14:41,685 INFO 2024-04-25 17:14:41,685 INFO [loop_until]: kubectl --namespace=xlou delete configmap kube-root-ca.crt --ignore-not-found 2024-04-25 17:14:41,685 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:42,112 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:42,113 DEBUG --- stdout --- 2024-04-25 17:14:42,113 DEBUG configmap "kube-root-ca.crt" deleted 2024-04-25 17:14:42,113 DEBUG --- stderr --- 2024-04-25 17:14:42,113 DEBUG 2024-04-25 17:14:42,113 INFO 2024-04-25 17:14:42,113 INFO [loop_until]: kubectl --namespace=xlou delete configmap lodemon-config --ignore-not-found 2024-04-25 17:14:42,113 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:42,532 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:42,532 DEBUG --- stdout --- 2024-04-25 17:14:42,532 DEBUG configmap "lodemon-config" deleted 2024-04-25 17:14:42,532 DEBUG --- stderr --- 2024-04-25 17:14:42,532 DEBUG 2024-04-25 17:14:42,533 INFO 2024-04-25 17:14:42,533 INFO [loop_until]: kubectl --namespace=xlou delete configmap lodemon-deployments --ignore-not-found 2024-04-25 17:14:42,533 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:42,940 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:42,940 DEBUG --- stdout --- 2024-04-25 17:14:42,940 DEBUG configmap "lodemon-deployments" deleted 2024-04-25 17:14:42,941 DEBUG --- stderr --- 2024-04-25 17:14:42,941 DEBUG 2024-04-25 17:14:42,941 INFO 2024-04-25 17:14:42,941 INFO [loop_until]: kubectl --namespace=xlou delete configmap overseer-config-0 --ignore-not-found 2024-04-25 17:14:42,941 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:43,347 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:43,348 DEBUG --- stdout --- 2024-04-25 17:14:43,348 DEBUG configmap "overseer-config-0" deleted 2024-04-25 17:14:43,348 DEBUG --- stderr --- 2024-04-25 17:14:43,348 DEBUG 2024-04-25 17:14:43,348 INFO 2024-04-25 17:14:43,348 INFO [loop_until]: kubectl --namespace=xlou delete configmap platform-config --ignore-not-found 2024-04-25 17:14:43,348 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:43,760 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:43,761 DEBUG --- stdout --- 2024-04-25 17:14:43,762 DEBUG configmap "platform-config" deleted 2024-04-25 17:14:43,762 DEBUG --- stderr --- 2024-04-25 17:14:43,762 DEBUG 2024-04-25 17:14:43,762 INFO 2024-04-25 17:14:43,762 INFO --------------------------- Deleting secret --------------------------- 2024-04-25 17:14:43,763 INFO 2024-04-25 17:14:43,763 INFO [loop_until]: kubectl --namespace=xlou get secret **** 2024-04-25 17:14:43,763 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:44,325 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:44,325 DEBUG --- stdout --- 2024-04-25 17:14:44,325 DEBUG cloud-storage-credentials-cts cloud-storage-credentials-idrepo ds truststore truststore-pem 2024-04-25 17:14:44,325 DEBUG --- stderr --- 2024-04-25 17:14:44,325 DEBUG 2024-04-25 17:14:44,326 INFO 2024-04-25 17:14:44,326 INFO [loop_until]: kubectl --namespace=xlou delete secret **** --ignore-not-found 2024-04-25 17:14:44,326 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:44,757 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:44,757 DEBUG --- stdout --- 2024-04-25 17:14:44,757 DEBUG secret "cloud-storage-credentials-cts" deleted 2024-04-25 17:14:44,757 DEBUG --- stderr --- 2024-04-25 17:14:44,757 DEBUG 2024-04-25 17:14:44,758 INFO 2024-04-25 17:14:44,758 INFO [loop_until]: kubectl --namespace=xlou delete secret **** --ignore-not-found 2024-04-25 17:14:44,758 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:45,168 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:45,168 DEBUG --- stdout --- 2024-04-25 17:14:45,168 DEBUG secret "cloud-storage-credentials-idrepo" deleted 2024-04-25 17:14:45,168 DEBUG --- stderr --- 2024-04-25 17:14:45,168 DEBUG 2024-04-25 17:14:45,168 INFO 2024-04-25 17:14:45,168 INFO [loop_until]: kubectl --namespace=xlou delete secret **** --ignore-not-found 2024-04-25 17:14:45,168 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:45,596 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:45,597 DEBUG --- stdout --- 2024-04-25 17:14:45,597 DEBUG secret "ds" deleted 2024-04-25 17:14:45,597 DEBUG --- stderr --- 2024-04-25 17:14:45,597 DEBUG 2024-04-25 17:14:45,597 INFO 2024-04-25 17:14:45,597 INFO [loop_until]: kubectl --namespace=xlou delete secret **** --ignore-not-found 2024-04-25 17:14:45,597 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:46,019 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:46,020 DEBUG --- stdout --- 2024-04-25 17:14:46,020 DEBUG secret "truststore" deleted 2024-04-25 17:14:46,020 DEBUG --- stderr --- 2024-04-25 17:14:46,020 DEBUG 2024-04-25 17:14:46,021 INFO 2024-04-25 17:14:46,021 INFO [loop_until]: kubectl --namespace=xlou delete secret **** --ignore-not-found 2024-04-25 17:14:46,021 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:46,438 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:46,439 DEBUG --- stdout --- 2024-04-25 17:14:46,439 DEBUG secret "truststore-pem" deleted 2024-04-25 17:14:46,439 DEBUG --- stderr --- 2024-04-25 17:14:46,439 DEBUG 2024-04-25 17:14:46,439 INFO 2024-04-25 17:14:46,439 INFO -------------------------- Deleting ingress -------------------------- 2024-04-25 17:14:46,439 INFO 2024-04-25 17:14:46,439 INFO [loop_until]: kubectl --namespace=xlou get ingress --output jsonpath={.items[*].metadata.name} 2024-04-25 17:14:46,439 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:46,816 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:46,816 DEBUG --- stdout --- 2024-04-25 17:14:46,816 DEBUG forgerock ig overseer-0 2024-04-25 17:14:46,816 DEBUG --- stderr --- 2024-04-25 17:14:46,816 DEBUG 2024-04-25 17:14:46,816 INFO 2024-04-25 17:14:46,816 INFO [loop_until]: kubectl --namespace=xlou delete ingress forgerock --ignore-not-found 2024-04-25 17:14:46,816 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:47,281 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:47,281 DEBUG --- stdout --- 2024-04-25 17:14:47,281 DEBUG ingress.networking.k8s.io "forgerock" deleted 2024-04-25 17:14:47,281 DEBUG --- stderr --- 2024-04-25 17:14:47,281 DEBUG 2024-04-25 17:14:47,281 INFO 2024-04-25 17:14:47,281 INFO [loop_until]: kubectl --namespace=xlou delete ingress ig --ignore-not-found 2024-04-25 17:14:47,281 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:47,698 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:47,698 DEBUG --- stdout --- 2024-04-25 17:14:47,698 DEBUG ingress.networking.k8s.io "ig" deleted 2024-04-25 17:14:47,698 DEBUG --- stderr --- 2024-04-25 17:14:47,698 DEBUG 2024-04-25 17:14:47,698 INFO 2024-04-25 17:14:47,698 INFO [loop_until]: kubectl --namespace=xlou delete ingress overseer-0 --ignore-not-found 2024-04-25 17:14:47,698 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:48,121 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:48,122 DEBUG --- stdout --- 2024-04-25 17:14:48,122 DEBUG ingress.networking.k8s.io "overseer-0" deleted 2024-04-25 17:14:48,122 DEBUG --- stderr --- 2024-04-25 17:14:48,122 DEBUG 2024-04-25 17:14:48,122 INFO 2024-04-25 17:14:48,122 INFO ---------------------------- Deleting pvc ---------------------------- 2024-04-25 17:14:48,122 INFO 2024-04-25 17:14:48,122 INFO [loop_until]: kubectl --namespace=xlou get pvc --output jsonpath={.items[*].metadata.name} 2024-04-25 17:14:48,122 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:48,521 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:48,522 DEBUG --- stdout --- 2024-04-25 17:14:48,522 DEBUG data-ds-cts-0 data-ds-cts-1 data-ds-cts-2 data-ds-idrepo-0 data-ds-idrepo-1 data-ds-idrepo-2 overseer-0 2024-04-25 17:14:48,522 DEBUG --- stderr --- 2024-04-25 17:14:48,522 DEBUG 2024-04-25 17:14:48,522 INFO 2024-04-25 17:14:48,522 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-cts-0 --ignore-not-found 2024-04-25 17:14:48,522 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:48,935 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:48,936 DEBUG --- stdout --- 2024-04-25 17:14:48,936 DEBUG persistentvolumeclaim "data-ds-cts-0" deleted 2024-04-25 17:14:48,936 DEBUG --- stderr --- 2024-04-25 17:14:48,936 DEBUG 2024-04-25 17:14:48,937 INFO 2024-04-25 17:14:48,937 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-cts-1 --ignore-not-found 2024-04-25 17:14:48,937 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:49,352 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:49,352 DEBUG --- stdout --- 2024-04-25 17:14:49,352 DEBUG persistentvolumeclaim "data-ds-cts-1" deleted 2024-04-25 17:14:49,352 DEBUG --- stderr --- 2024-04-25 17:14:49,352 DEBUG 2024-04-25 17:14:49,352 INFO 2024-04-25 17:14:49,352 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-cts-2 --ignore-not-found 2024-04-25 17:14:49,352 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:49,762 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:49,762 DEBUG --- stdout --- 2024-04-25 17:14:49,763 DEBUG persistentvolumeclaim "data-ds-cts-2" deleted 2024-04-25 17:14:49,763 DEBUG --- stderr --- 2024-04-25 17:14:49,763 DEBUG 2024-04-25 17:14:49,763 INFO 2024-04-25 17:14:49,763 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-idrepo-0 --ignore-not-found 2024-04-25 17:14:49,763 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:50,177 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:50,177 DEBUG --- stdout --- 2024-04-25 17:14:50,177 DEBUG persistentvolumeclaim "data-ds-idrepo-0" deleted 2024-04-25 17:14:50,177 DEBUG --- stderr --- 2024-04-25 17:14:50,177 DEBUG 2024-04-25 17:14:50,177 INFO 2024-04-25 17:14:50,177 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-idrepo-1 --ignore-not-found 2024-04-25 17:14:50,177 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:50,599 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:50,600 DEBUG --- stdout --- 2024-04-25 17:14:50,600 DEBUG persistentvolumeclaim "data-ds-idrepo-1" deleted 2024-04-25 17:14:50,600 DEBUG --- stderr --- 2024-04-25 17:14:50,600 DEBUG 2024-04-25 17:14:50,600 INFO 2024-04-25 17:14:50,600 INFO [loop_until]: kubectl --namespace=xlou delete pvc data-ds-idrepo-2 --ignore-not-found 2024-04-25 17:14:50,600 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:51,019 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:51,019 DEBUG --- stdout --- 2024-04-25 17:14:51,019 DEBUG persistentvolumeclaim "data-ds-idrepo-2" deleted 2024-04-25 17:14:51,019 DEBUG --- stderr --- 2024-04-25 17:14:51,019 DEBUG 2024-04-25 17:14:51,019 INFO 2024-04-25 17:14:51,019 INFO [loop_until]: kubectl --namespace=xlou delete pvc overseer-0 --ignore-not-found 2024-04-25 17:14:51,019 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:51,450 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:51,451 DEBUG --- stdout --- 2024-04-25 17:14:51,451 DEBUG persistentvolumeclaim "overseer-0" deleted 2024-04-25 17:14:51,451 DEBUG --- stderr --- 2024-04-25 17:14:51,451 DEBUG 2024-04-25 17:14:51,451 INFO 2024-04-25 17:14:51,451 INFO [loop_until]: kubectl --namespace=xlou delete pv ds-backup-xlou --ignore-not-found 2024-04-25 17:14:51,451 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:51,868 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:51,868 DEBUG --- stdout --- 2024-04-25 17:14:51,869 DEBUG 2024-04-25 17:14:51,869 DEBUG --- stderr --- 2024-04-25 17:14:51,869 DEBUG Warning: deleting cluster-scoped resources, not scoped to the provided namespace 2024-04-25 17:14:51,869 INFO 2024-04-25 17:14:51,869 INFO ----------------- Deleting admin clusterrolebindings ----------------- 2024-04-25 17:14:51,869 INFO 2024-04-25 17:14:51,869 INFO [loop_until]: kubectl get clusterrolebinding --output jsonpath="{range .items[?(@.subjects[0].namespace=='xlou')]}{.metadata.name} {end}" 2024-04-25 17:14:51,869 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:52,433 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:52,433 DEBUG --- stdout --- 2024-04-25 17:14:52,433 DEBUG k8s-svc-acct-crb-xlou k8s-svc-acct-crb-xlou-0 2024-04-25 17:14:52,434 DEBUG --- stderr --- 2024-04-25 17:14:52,434 DEBUG 2024-04-25 17:14:52,434 INFO Deleting clusterrolebinding k8s-svc-acct-crb-xlou associated with xlou namespace 2024-04-25 17:14:52,434 INFO 2024-04-25 17:14:52,434 INFO [loop_until]: kubectl delete clusterrolebinding k8s-svc-acct-crb-xlou 2024-04-25 17:14:52,434 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:52,845 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:52,845 DEBUG --- stdout --- 2024-04-25 17:14:52,845 DEBUG clusterrolebinding.rbac.authorization.k8s.io "k8s-svc-acct-crb-xlou" deleted 2024-04-25 17:14:52,845 DEBUG --- stderr --- 2024-04-25 17:14:52,845 DEBUG 2024-04-25 17:14:52,845 INFO Deleting clusterrolebinding k8s-svc-acct-crb-xlou-0 associated with xlou namespace 2024-04-25 17:14:52,845 INFO 2024-04-25 17:14:52,845 INFO [loop_until]: kubectl delete clusterrolebinding k8s-svc-acct-crb-xlou-0 2024-04-25 17:14:52,845 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:14:53,278 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:14:53,278 DEBUG --- stdout --- 2024-04-25 17:14:53,279 DEBUG clusterrolebinding.rbac.authorization.k8s.io "k8s-svc-acct-crb-xlou-0" deleted 2024-04-25 17:14:53,279 DEBUG --- stderr --- 2024-04-25 17:14:53,279 DEBUG 2024-04-25 17:14:53,279 INFO 2024-04-25 17:14:53,279 INFO ------------------------- Deleting namespace ------------------------- 2024-04-25 17:14:53,592 INFO 2024-04-25 17:14:53,593 INFO [loop_until]: kubectl delete namespaces xlou --grace-period=0 --force 2024-04-25 17:14:53,593 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:15:00,529 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:15:00,529 DEBUG --- stdout --- 2024-04-25 17:15:00,530 DEBUG namespace "xlou" force deleted 2024-04-25 17:15:00,530 DEBUG --- stderr --- 2024-04-25 17:15:00,530 DEBUG Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely. 2024-04-25 17:15:27,202 INFO 2024-04-25 17:15:27,202 INFO ************************************* Creating deployment ************************************* 2024-04-25 17:15:27,202 INFO Creating normal (forgeops) type deployment for deployment: stack 2024-04-25 17:15:27,220 INFO 2024-04-25 17:15:27,220 INFO ------- Custom component configuration present. Loading values ------- 2024-04-25 17:15:27,220 INFO 2024-04-25 17:15:27,220 INFO ************************************ Configuring components ************************************ 2024-04-25 17:15:27,520 INFO Namespace xlou does not exist, no resources to delete 2024-04-25 17:15:27,520 INFO 2024-04-25 17:15:27,520 INFO [loop_until]: kubectl create namespace xlou 2024-04-25 17:15:27,520 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:15:27,833 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:15:27,833 DEBUG --- stdout --- 2024-04-25 17:15:27,833 DEBUG namespace/xlou created 2024-04-25 17:15:27,833 DEBUG --- stderr --- 2024-04-25 17:15:27,833 DEBUG 2024-04-25 17:15:27,834 INFO 2024-04-25 17:15:27,834 INFO [loop_until]: kubectl label namespace xlou self-service=false timeout=48 2024-04-25 17:15:27,834 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:15:28,232 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:15:28,232 DEBUG --- stdout --- 2024-04-25 17:15:28,232 DEBUG namespace/xlou labeled 2024-04-25 17:15:28,232 DEBUG --- stderr --- 2024-04-25 17:15:28,232 DEBUG 2024-04-25 17:15:28,232 INFO 2024-04-25 17:15:28,232 INFO Applying custom configuration, dockerfiles to deployment and custom lodestar component configuration 2024-04-25 17:15:28,234 INFO Copying /mnt/disks/data/xslou/lodestar-fork/shared/config/custom/session_timeout_3minutes/docker/am to /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am 2024-04-25 17:15:28,244 INFO No custom features provided. Nothing to do. 2024-04-25 17:15:28,244 INFO 2024-04-25 17:15:28,244 INFO ---- Updating components image tag/repo from platform-images repo ---- 2024-04-25 17:15:28,244 INFO 2024-04-25 17:15:28,244 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --clean 2024-04-25 17:15:28,336 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:28,336 DEBUG --- stdout --- 2024-04-25 17:15:28,337 DEBUG [INFO] Cleaning up. [WARNING] Found nothing to clean. 2024-04-25 17:15:28,337 DEBUG --- stderr --- 2024-04-25 17:15:28,337 DEBUG 2024-04-25 17:15:28,337 INFO 2024-04-25 17:15:28,337 INFO 2024-04-25 17:15:28,337 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products ds 2024-04-25 17:15:35,624 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:35,624 DEBUG --- stdout --- 2024-04-25 17:15:35,625 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images. [INFO] Repo is at bd18b716ef1801b3f839da0f557fe740e3a8b884 on branch HEAD [INFO] Updating products ds [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/dsutil/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/ds-new/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/proxy/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo/Dockerfile to use gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 2024-04-25 17:15:35,625 DEBUG --- stderr --- 2024-04-25 17:15:35,625 DEBUG 2024-04-25 17:15:35,625 INFO 2024-04-25 17:15:35,625 INFO 2024-04-25 17:15:35,625 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products am 2024-04-25 17:15:35,740 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:35,741 DEBUG --- stdout --- 2024-04-25 17:15:35,741 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images. [INFO] Found existing files, attempting to not clone. [INFO] Repo is at bd18b716ef1801b3f839da0f557fe740e3a8b884 on branch HEAD [INFO] Updating products am [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am/Dockerfile to use gcr.io/forgerock-io/am-cdk/pit1:7.6.0-1ea0b707baef4b0816b74795e83665828894daed 2024-04-25 17:15:35,741 DEBUG --- stderr --- 2024-04-25 17:15:35,741 DEBUG 2024-04-25 17:15:35,741 INFO 2024-04-25 17:15:35,741 INFO 2024-04-25 17:15:35,741 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products amster 2024-04-25 17:15:35,861 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:35,861 DEBUG --- stdout --- 2024-04-25 17:15:35,861 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images. [INFO] Found existing files, attempting to not clone. [INFO] Repo is at bd18b716ef1801b3f839da0f557fe740e3a8b884 on branch HEAD [INFO] Updating products amster [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster/Dockerfile to use gcr.io/forgerock-io/amster/pit1:7.6.0-1ea0b707baef4b0816b74795e83665828894daed 2024-04-25 17:15:35,861 DEBUG --- stderr --- 2024-04-25 17:15:35,861 DEBUG 2024-04-25 17:15:35,861 INFO 2024-04-25 17:15:35,862 INFO 2024-04-25 17:15:35,862 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products idm 2024-04-25 17:15:35,982 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:35,982 DEBUG --- stdout --- 2024-04-25 17:15:35,983 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images. [INFO] Found existing files, attempting to not clone. [INFO] Repo is at bd18b716ef1801b3f839da0f557fe740e3a8b884 on branch HEAD [INFO] Updating products idm [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm/Dockerfile to use gcr.io/forgerock-io/idm-cdk/pit1:7.6.0-2167d6704389428c732eacc70a8214428266f312 2024-04-25 17:15:35,983 DEBUG --- stderr --- 2024-04-25 17:15:35,983 DEBUG 2024-04-25 17:15:35,983 INFO 2024-04-25 17:15:35,983 INFO 2024-04-25 17:15:35,983 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/set-images --ref master-ready-for-dev-pipelines --products ui 2024-04-25 17:15:36,151 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:36,151 DEBUG --- stdout --- 2024-04-25 17:15:36,151 DEBUG [INFO] Setting repo up in /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/build/platform-images. [INFO] Found existing files, attempting to not clone. [INFO] Repo is at bd18b716ef1801b3f839da0f557fe740e3a8b884 on branch HEAD [INFO] Updating products ui [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui to use gcr.io/forgerock-io/platform-admin-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626 [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui to use gcr.io/forgerock-io/platform-enduser-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626 [INFO] Updating /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui to use gcr.io/forgerock-io/platform-login-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626 2024-04-25 17:15:36,151 DEBUG --- stderr --- 2024-04-25 17:15:36,151 DEBUG 2024-04-25 17:15:36,151 INFO 2024-04-25 17:15:36,151 INFO 2024-04-25 17:15:36,151 INFO - Checking if component Dockerfile/kustomize needs additional update - 2024-04-25 17:15:36,151 INFO 2024-04-25 17:15:36,152 INFO 2024-04-25 17:15:36,152 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker ds cts 2024-04-25 17:15:36,231 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:36,231 DEBUG --- stdout --- 2024-04-25 17:15:36,232 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts 2024-04-25 17:15:36,232 DEBUG --- stderr --- 2024-04-25 17:15:36,232 DEBUG 2024-04-25 17:15:36,232 INFO 2024-04-25 17:15:36,232 INFO Checking if ds-cts dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution) 2024-04-25 17:15:36,232 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts/Dockerfile: gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 2024-04-25 17:15:39,011 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/cts/Dockerfile 2024-04-25 17:15:39,011 INFO 2024-04-25 17:15:39,011 INFO 2024-04-25 17:15:39,011 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker ds idrepo 2024-04-25 17:15:39,131 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:39,132 DEBUG --- stdout --- 2024-04-25 17:15:39,132 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo 2024-04-25 17:15:39,132 DEBUG --- stderr --- 2024-04-25 17:15:39,132 DEBUG 2024-04-25 17:15:39,132 INFO 2024-04-25 17:15:39,132 INFO Checking if ds-idrepo dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution) 2024-04-25 17:15:39,133 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo/Dockerfile: gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 2024-04-25 17:15:41,818 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/ds/idrepo/Dockerfile 2024-04-25 17:15:41,819 INFO 2024-04-25 17:15:41,819 INFO 2024-04-25 17:15:41,819 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker am 2024-04-25 17:15:41,971 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:41,972 DEBUG --- stdout --- 2024-04-25 17:15:41,972 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am 2024-04-25 17:15:41,972 DEBUG --- stderr --- 2024-04-25 17:15:41,972 DEBUG 2024-04-25 17:15:41,972 INFO 2024-04-25 17:15:41,972 INFO Checking if am dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution) 2024-04-25 17:15:41,973 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am/Dockerfile: gcr.io/forgerock-io/am-cdk/pit1:7.6.0-1ea0b707baef4b0816b74795e83665828894daed 2024-04-25 17:15:44,446 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/am/Dockerfile 2024-04-25 17:15:44,446 INFO 2024-04-25 17:15:44,447 INFO 2024-04-25 17:15:44,447 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker amster 2024-04-25 17:15:44,565 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:44,565 DEBUG --- stdout --- 2024-04-25 17:15:44,566 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster 2024-04-25 17:15:44,566 DEBUG --- stderr --- 2024-04-25 17:15:44,566 DEBUG 2024-04-25 17:15:44,566 INFO 2024-04-25 17:15:44,566 INFO Checking if amster dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution) 2024-04-25 17:15:44,566 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster/Dockerfile: gcr.io/forgerock-io/amster/pit1:7.6.0-1ea0b707baef4b0816b74795e83665828894daed 2024-04-25 17:15:47,117 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/amster/Dockerfile 2024-04-25 17:15:47,118 INFO 2024-04-25 17:15:47,119 INFO 2024-04-25 17:15:47,119 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path docker idm 2024-04-25 17:15:47,240 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:47,241 DEBUG --- stdout --- 2024-04-25 17:15:47,241 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm 2024-04-25 17:15:47,241 DEBUG --- stderr --- 2024-04-25 17:15:47,241 DEBUG 2024-04-25 17:15:47,241 INFO 2024-04-25 17:15:47,241 INFO Checking if idm dockerfile /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm/Dockerfile needs additional update (custom tag/repo from config.yaml or image name resolution) 2024-04-25 17:15:47,241 INFO Read FROM line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm/Dockerfile: gcr.io/forgerock-io/idm-cdk/pit1:7.6.0-2167d6704389428c732eacc70a8214428266f312 2024-04-25 17:15:49,820 INFO No need to update FROM line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/docker/idm/Dockerfile 2024-04-25 17:15:49,820 INFO 2024-04-25 17:15:49,820 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path kustomize base end-user-ui 2024-04-25 17:15:49,942 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:49,943 DEBUG --- stdout --- 2024-04-25 17:15:49,943 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui 2024-04-25 17:15:49,943 DEBUG --- stderr --- 2024-04-25 17:15:49,943 DEBUG 2024-04-25 17:15:49,943 INFO 2024-04-25 17:15:49,946 INFO 2024-04-25 17:15:49,946 INFO Checking if end-user-ui kustomize file /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui/kustomization.yaml needs additional update (custom tag/repo from config.yaml or image name resolution) 2024-04-25 17:15:49,946 INFO Read image line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui/kustomization.yaml: gcr.io/forgerock-io/platform-enduser-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626 2024-04-25 17:15:52,658 INFO No need to update the image line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/end-user-ui/kustomization.yaml 2024-04-25 17:15:52,660 INFO 2024-04-25 17:15:52,660 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path kustomize base login-ui 2024-04-25 17:15:52,774 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:52,774 DEBUG --- stdout --- 2024-04-25 17:15:52,775 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui 2024-04-25 17:15:52,775 DEBUG --- stderr --- 2024-04-25 17:15:52,775 DEBUG 2024-04-25 17:15:52,775 INFO 2024-04-25 17:15:52,780 INFO 2024-04-25 17:15:52,780 INFO Checking if login-ui kustomize file /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui/kustomization.yaml needs additional update (custom tag/repo from config.yaml or image name resolution) 2024-04-25 17:15:52,780 INFO Read image line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui/kustomization.yaml: gcr.io/forgerock-io/platform-login-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626 2024-04-25 17:15:55,468 INFO No need to update the image line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/login-ui/kustomization.yaml 2024-04-25 17:15:55,468 INFO 2024-04-25 17:15:55,469 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/config path kustomize base admin-ui 2024-04-25 17:15:55,588 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:15:55,588 DEBUG --- stdout --- 2024-04-25 17:15:55,588 DEBUG /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui 2024-04-25 17:15:55,588 DEBUG --- stderr --- 2024-04-25 17:15:55,588 DEBUG 2024-04-25 17:15:55,589 INFO 2024-04-25 17:15:55,592 INFO 2024-04-25 17:15:55,593 INFO Checking if admin-ui kustomize file /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui/kustomization.yaml needs additional update (custom tag/repo from config.yaml or image name resolution) 2024-04-25 17:15:55,593 INFO Read image line from /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui/kustomization.yaml: gcr.io/forgerock-io/platform-admin-ui/docker-build:7.6.0-SNAPSHOT-e28d3cbe3f9d1b58834dbaa041c4c5d0f2cae626 2024-04-25 17:15:58,523 INFO No need to update the image line for /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/base/admin-ui/kustomization.yaml 2024-04-25 17:15:58,969 INFO 2024-04-25 17:15:58,969 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm delete --filename /tmp/tmpxi4bz5sy 2024-04-25 17:15:58,970 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0, 1] 2024-04-25 17:15:59,296 INFO [loop_until]: OK (rc = 1) 2024-04-25 17:15:59,297 DEBUG --- stdout --- 2024-04-25 17:15:59,297 DEBUG 2024-04-25 17:15:59,297 DEBUG --- stderr --- 2024-04-25 17:15:59,297 DEBUG Error from server (NotFound): error when deleting "/tmp/tmpxi4bz5sy": secrets "sslcert" not found 2024-04-25 17:15:59,297 INFO 2024-04-25 17:15:59,297 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm apply --filename /tmp/tmpxi4bz5sy 2024-04-25 17:15:59,297 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:16:00,507 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:16:00,507 DEBUG --- stdout --- 2024-04-25 17:16:00,507 DEBUG secret/sslcert created 2024-04-25 17:16:00,507 DEBUG --- stderr --- 2024-04-25 17:16:00,507 DEBUG 2024-04-25 17:16:00,518 INFO Loading external components from config.yaml 2024-04-25 17:16:00,638 INFO No external components defined. 2024-04-25 17:16:00,759 INFO 2024-04-25 17:16:00,760 INFO *********************************** Cluster readiness check *********************************** 2024-04-25 17:16:00,760 INFO 2024-04-25 17:16:00,760 INFO ------------------------- Checking K8s api... ------------------------- 2024-04-25 17:16:01,446 INFO 2024-04-25 17:16:01,446 INFO ----------------- Checking DNS/Konnectivity agent... ----------------- 2024-04-25 17:16:04,703 INFO All pre-deployment cluster checks passed. 2024-04-25 17:16:04,704 INFO 2024-04-25 17:16:04,704 INFO *********************************** Cluster resources check *********************************** 2024-04-25 17:16:04,704 INFO 2024-04-25 17:16:04,704 INFO -------------- Checking if cert-manager is installed... -------------- 2024-04-25 17:16:05,388 INFO cert-manager is installed 2024-04-25 17:16:05,388 INFO 2024-04-25 17:16:05,388 INFO ----------- Checking if secret-agent-system is installed... ----------- 2024-04-25 17:16:06,017 INFO secret-agent-system is installed 2024-04-25 17:16:06,018 INFO 2024-04-25 17:16:06,018 INFO ------------------ Checking if nginx is installed... ------------------ 2024-04-25 17:16:06,654 INFO nginx is installed 2024-04-25 17:16:06,766 INFO 2024-04-25 17:16:06,767 INFO ------ Checking if network services global dns is configured... ------ 2024-04-25 17:16:06,842 INFO Running ping against: default-http-backend.iam.xlou-cdm.engineeringpit.com 2024-04-25 17:16:10,980 INFO network services global dns is configured 2024-04-25 17:16:10,980 INFO 2024-04-25 17:16:10,980 INFO ---- Checking if disk storage type has been updated to use ssd... ---- 2024-04-25 17:16:11,300 INFO disk storage type has been updated to use ssd 2024-04-25 17:16:11,420 INFO 2024-04-25 17:16:11,420 INFO ------------ Checking if lodestar-ssl-cert is installed... ------------ 2024-04-25 17:16:12,060 INFO lodestar-ssl-cert is installed 2024-04-25 17:16:12,060 INFO 2024-04-25 17:16:12,061 INFO ------------- Checking if intezer-protect is installed... ------------- 2024-04-25 17:16:12,795 INFO intezer-protect is installed 2024-04-25 17:16:12,795 INFO 2024-04-25 17:16:12,795 INFO ******************************* Verify docker daemon is running ******************************* 2024-04-25 17:16:12,849 INFO Docker daemon is running 2024-04-25 17:16:12,849 INFO 2024-04-25 17:16:12,849 INFO ************************** The following components will be deployed ************************** 2024-04-25 17:16:12,849 INFO - ds-cts (DS) - ds-idrepo (DS) - am (AM) - amster (Amster) - idm (IDM) - end-user-ui (EndUserUi) - login-ui (LoginUi) - admin-ui (AdminUi) 2024-04-25 17:16:12,849 INFO 2024-04-25 17:16:12,849 INFO ---------- Build product images using forgeops build command ---------- 2024-04-25 17:16:12,849 DEBUG xxxx 2024-04-25 17:16:12,849 DEBUG medium 2024-04-25 17:16:12,849 DEBUG True 2024-04-25 17:16:12,849 DEBUG xxxx 2024-04-25 17:16:12,964 INFO 2024-04-25 17:16:12,964 INFO [run_command]: kubectl config current-context 2024-04-25 17:16:13,030 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:16:13,030 DEBUG --- stdout --- 2024-04-25 17:16:13,030 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm 2024-04-25 17:16:13,030 DEBUG --- stderr --- 2024-04-25 17:16:13,030 DEBUG 2024-04-25 17:16:13,031 INFO 2024-04-25 17:16:13,031 INFO 2024-04-25 17:16:13,031 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build ds-cts --config-profile=default --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 2024-04-25 17:16:13,031 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'} 2024-04-25 17:16:54,842 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/ds-cts] 2024-04-25 17:16:54,942 INFO 4a310406c4da: Preparing 2024-04-25 17:16:55,043 INFO 3d1e4c63f74c: Preparing 2024-04-25 17:16:55,143 INFO 58539c188602: Preparing 2024-04-25 17:16:55,244 INFO 297a2fe49b1c: Preparing 2024-04-25 17:16:55,344 INFO e2b5f826a555: Preparing 2024-04-25 17:16:55,445 INFO 242789162e90: Preparing 2024-04-25 17:16:55,545 INFO a3b89d8e4ee1: Preparing 2024-04-25 17:16:55,646 INFO 5f70bf18a086: Preparing 2024-04-25 17:16:55,746 INFO 4157912709d4: Preparing 2024-04-25 17:16:55,847 INFO 181f0c62b19f: Preparing 2024-04-25 17:16:55,947 INFO 54695949bfe7: Preparing 2024-04-25 17:16:56,048 INFO 4576b7e2f70a: Preparing 2024-04-25 17:16:56,148 INFO bcc69cc8293b: Preparing 2024-04-25 17:16:56,249 INFO 420179ad2efa: Preparing 2024-04-25 17:16:56,349 INFO 5f70bf18a086: Waiting 2024-04-25 17:16:56,450 INFO 4157912709d4: Waiting 2024-04-25 17:16:56,550 INFO 181f0c62b19f: Waiting 2024-04-25 17:16:56,651 INFO 54695949bfe7: Waiting 2024-04-25 17:16:56,751 INFO 4576b7e2f70a: Waiting 2024-04-25 17:16:56,852 INFO bcc69cc8293b: Waiting 2024-04-25 17:16:56,952 INFO 420179ad2efa: Waiting 2024-04-25 17:16:57,053 INFO 242789162e90: Waiting 2024-04-25 17:16:57,153 INFO a3b89d8e4ee1: Waiting 2024-04-25 17:16:57,254 INFO 58539c188602: Layer already exists 2024-04-25 17:16:57,355 INFO e2b5f826a555: Layer already exists 2024-04-25 17:16:57,455 INFO 297a2fe49b1c: Layer already exists 2024-04-25 17:16:57,556 INFO 5f70bf18a086: Layer already exists 2024-04-25 17:16:57,656 INFO 242789162e90: Layer already exists 2024-04-25 17:16:57,757 INFO a3b89d8e4ee1: Layer already exists 2024-04-25 17:16:57,858 INFO 54695949bfe7: Layer already exists 2024-04-25 17:16:57,958 INFO 181f0c62b19f: Layer already exists 2024-04-25 17:16:58,059 INFO 4157912709d4: Layer already exists 2024-04-25 17:16:58,160 INFO 4576b7e2f70a: Layer already exists 2024-04-25 17:16:58,260 INFO bcc69cc8293b: Layer already exists 2024-04-25 17:16:58,361 INFO 420179ad2efa: Layer already exists 2024-04-25 17:16:58,461 INFO 3d1e4c63f74c: Pushed 2024-04-25 17:16:58,562 INFO 4a310406c4da: Pushed 2024-04-25 17:17:00,067 INFO xlou-7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4: digest: sha256:62f9d16858f67b46f8605128b1dfd3b88f4b0483a6b5a443e4b5bed7e8b23b7b size: 3252 2024-04-25 17:17:00,167 INFO Updated the image_defaulter with your new image for ds-cts: "gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4". 2024-04-25 17:17:00,268 ERROR #0 building with "default" instance using docker driver 2024-04-25 17:17:00,268 ERROR 2024-04-25 17:17:00,269 ERROR #1 [internal] load build definition from Dockerfile 2024-04-25 17:17:00,269 ERROR #1 transferring dockerfile: 529B done 2024-04-25 17:17:00,269 ERROR #1 DONE 0.0s 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 2024-04-25 17:17:00,269 ERROR #2 DONE 0.4s 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #3 [internal] load .dockerignore 2024-04-25 17:17:00,269 ERROR #3 transferring context: 2B done 2024-04-25 17:17:00,269 ERROR #3 DONE 0.0s 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #4 [1/7] FROM gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4@sha256:b76eac17d4efc6b7f4a51f35a11e913376232ca9041687ffb75726afdb8647c2 2024-04-25 17:17:00,269 ERROR #4 DONE 0.0s 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #5 [internal] load build context 2024-04-25 17:17:00,269 ERROR #5 transferring context: 71.67kB done 2024-04-25 17:17:00,269 ERROR #5 DONE 0.0s 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #6 [2/7] COPY debian-buster-sources.list /etc/apt/sources.list 2024-04-25 17:17:00,269 ERROR #6 CACHED 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #7 [3/7] RUN chown -R forgerock:root /opt/opendj 2024-04-25 17:17:00,269 ERROR #7 CACHED 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #8 [4/7] COPY --chown=forgerock:root common /opt/opendj/ 2024-04-25 17:17:00,269 ERROR #8 CACHED 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #9 [5/7] COPY --chown=forgerock:root cts /opt/opendj/ 2024-04-25 17:17:00,269 ERROR #9 CACHED 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #10 [6/7] COPY --chown=forgerock:root scripts /opt/opendj/scripts 2024-04-25 17:17:00,269 ERROR #10 DONE 0.1s 2024-04-25 17:17:00,269 ERROR 2024-04-25 17:17:00,269 ERROR #11 [7/7] RUN bin/setup.sh && bin/relax-security-settings.sh && rm bin/setup.sh bin/relax-security-settings.sh 2024-04-25 17:17:00,269 ERROR #11 5.454 2024-04-25 17:17:00,270 ERROR #11 5.456 Configuring profile AM CTS data store........ Done 2024-04-25 17:17:00,270 ERROR #11 21.62 2024-04-25 17:17:00,270 ERROR #11 21.62 Configuring profile DS proxied server...... Done 2024-04-25 17:17:00,270 ERROR #11 31.42 create-trust-manager-provider --provider-name "PEM Trust Manager" --type pem --set enabled:true --set pem-directory:pem-trust-directory 2024-04-25 17:17:00,270 ERROR #11 32.56 2024-04-25 17:17:00,270 ERROR #11 32.56 The Pem Trust Manager Provider was created successfully 2024-04-25 17:17:00,270 ERROR #11 32.57 2024-04-25 17:17:00,270 ERROR #11 32.57 set-connection-handler-prop --handler-name https --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:17:00,270 ERROR #11 32.83 2024-04-25 17:17:00,270 ERROR #11 32.83 set-connection-handler-prop --handler-name ldap --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:17:00,270 ERROR #11 33.05 2024-04-25 17:17:00,270 ERROR #11 33.05 set-connection-handler-prop --handler-name ldaps --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:17:00,270 ERROR #11 33.19 2024-04-25 17:17:00,270 ERROR #11 33.19 set-synchronization-provider-prop --provider-name "Multimaster Synchronization" --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:17:00,270 ERROR #11 33.38 2024-04-25 17:17:00,270 ERROR #11 33.38 set-administration-connector-prop --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:17:00,270 ERROR #11 33.56 2024-04-25 17:17:00,270 ERROR #11 33.56 delete-trust-manager-provider --provider-name "PKCS12" 2024-04-25 17:17:00,270 ERROR #11 34.01 2024-04-25 17:17:00,270 ERROR #11 34.01 The Trust Manager Provider was deleted successfully 2024-04-25 17:17:00,270 ERROR #11 34.02 2024-04-25 17:17:00,270 ERROR #11 34.02 create-key-manager-provider --provider-name "PEM Key Manager" --type pem --set enabled:true --set pem-directory:pem-keys-directory 2024-04-25 17:17:00,270 ERROR #11 34.15 2024-04-25 17:17:00,270 ERROR #11 34.16 The Pem Key Manager Provider was created successfully 2024-04-25 17:17:00,270 ERROR #11 34.16 2024-04-25 17:17:00,270 ERROR #11 34.16 set-connection-handler-prop --handler-name https --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:17:00,270 ERROR #11 34.29 2024-04-25 17:17:00,270 ERROR #11 34.29 set-connection-handler-prop --handler-name ldap --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:17:00,270 ERROR #11 34.44 2024-04-25 17:17:00,270 ERROR #11 34.44 set-connection-handler-prop --handler-name ldaps --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:17:00,270 ERROR #11 34.52 2024-04-25 17:17:00,270 ERROR #11 34.52 set-synchronization-provider-prop --provider-name "Multimaster Synchronization" --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:17:00,271 ERROR #11 34.61 2024-04-25 17:17:00,271 ERROR #11 34.61 set-crypto-manager-prop --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:17:00,271 ERROR #11 34.72 2024-04-25 17:17:00,271 ERROR #11 34.72 set-administration-connector-prop --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:17:00,271 ERROR #11 34.82 2024-04-25 17:17:00,271 ERROR #11 34.82 delete-key-manager-provider --provider-name "PKCS12" 2024-04-25 17:17:00,271 ERROR #11 35.03 2024-04-25 17:17:00,271 ERROR #11 35.03 The Key Manager Provider was deleted successfully 2024-04-25 17:17:00,271 ERROR #11 35.03 2024-04-25 17:17:00,271 ERROR #11 35.09 + dsconfig --offline --no-prompt --batch 2024-04-25 17:17:00,271 ERROR #11 36.77 set-global-configuration-prop --set "unauthenticated-requests-policy:allow" 2024-04-25 17:17:00,271 ERROR #11 38.01 2024-04-25 17:17:00,271 ERROR #11 38.02 set-password-policy-prop --policy-name "Default Password Policy" --set "require-secure-authentication:false" --set "require-secure-password-changes:false" --reset "password-validator" 2024-04-25 17:17:00,271 ERROR #11 38.29 2024-04-25 17:17:00,271 ERROR #11 38.29 set-password-policy-prop --policy-name "Root Password Policy" --set "require-secure-authentication:false" --set "require-secure-password-changes:false" --reset "password-validator" 2024-04-25 17:17:00,271 ERROR #11 38.55 2024-04-25 17:17:00,271 ERROR #11 DONE 38.6s 2024-04-25 17:17:00,271 ERROR 2024-04-25 17:17:00,271 ERROR #12 exporting to image 2024-04-25 17:17:00,271 ERROR #12 exporting layers 0.1s done 2024-04-25 17:17:00,271 ERROR #12 writing image sha256:b26f38633d0f228739f093d53531362a6627e1accf081dd1e85edb421a8e60fd 0.0s done 2024-04-25 17:17:00,271 ERROR #12 naming to gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 0.0s done 2024-04-25 17:17:00,271 ERROR #12 DONE 0.1s 2024-04-25 17:17:00,444 INFO 2024-04-25 17:17:00,444 INFO [run_command]: kubectl config current-context 2024-04-25 17:17:00,518 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:17:00,518 DEBUG --- stdout --- 2024-04-25 17:17:00,519 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm 2024-04-25 17:17:00,519 DEBUG --- stderr --- 2024-04-25 17:17:00,519 DEBUG 2024-04-25 17:17:00,519 INFO 2024-04-25 17:17:00,519 INFO 2024-04-25 17:17:00,519 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build ds-idrepo --config-profile=default --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 2024-04-25 17:17:00,519 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'} 2024-04-25 17:18:28,126 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/ds-idrepo] 2024-04-25 17:18:28,227 INFO fe73c8bb682e: Preparing 2024-04-25 17:18:28,327 INFO c18d3f670b15: Preparing 2024-04-25 17:18:28,440 INFO 5051d66786fc: Preparing 2024-04-25 17:18:28,541 INFO 519d35afbb42: Preparing 2024-04-25 17:18:28,641 INFO a34d4198e4dc: Preparing 2024-04-25 17:18:28,742 INFO c7d5e96fadce: Preparing 2024-04-25 17:18:28,842 INFO 297a2fe49b1c: Preparing 2024-04-25 17:18:28,943 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:29,043 INFO 242789162e90: Preparing 2024-04-25 17:18:29,144 INFO a3b89d8e4ee1: Preparing 2024-04-25 17:18:29,244 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:29,345 INFO 4157912709d4: Preparing 2024-04-25 17:18:29,445 INFO 181f0c62b19f: Preparing 2024-04-25 17:18:29,546 INFO 54695949bfe7: Preparing 2024-04-25 17:18:29,647 INFO 4576b7e2f70a: Preparing 2024-04-25 17:18:29,747 INFO bcc69cc8293b: Preparing 2024-04-25 17:18:29,847 INFO 420179ad2efa: Preparing 2024-04-25 17:18:29,948 INFO c7d5e96fadce: Waiting 2024-04-25 17:18:30,048 INFO 297a2fe49b1c: Waiting 2024-04-25 17:18:30,149 INFO 5f70bf18a086: Waiting 2024-04-25 17:18:30,249 INFO 242789162e90: Waiting 2024-04-25 17:18:30,350 INFO a3b89d8e4ee1: Waiting 2024-04-25 17:18:30,450 INFO 4157912709d4: Waiting 2024-04-25 17:18:30,551 INFO 181f0c62b19f: Waiting 2024-04-25 17:18:30,651 INFO 54695949bfe7: Waiting 2024-04-25 17:18:30,752 INFO 4576b7e2f70a: Waiting 2024-04-25 17:18:30,852 INFO bcc69cc8293b: Waiting 2024-04-25 17:18:30,953 INFO 420179ad2efa: Waiting 2024-04-25 17:18:31,053 INFO 519d35afbb42: Pushed 2024-04-25 17:18:31,154 INFO c18d3f670b15: Pushed 2024-04-25 17:18:31,254 INFO a34d4198e4dc: Pushed 2024-04-25 17:18:31,355 INFO c7d5e96fadce: Layer already exists 2024-04-25 17:18:31,455 INFO 297a2fe49b1c: Layer already exists 2024-04-25 17:18:31,556 INFO 5f70bf18a086: Layer already exists 2024-04-25 17:18:31,656 INFO 242789162e90: Layer already exists 2024-04-25 17:18:31,757 INFO 5051d66786fc: Pushed 2024-04-25 17:18:31,857 INFO a3b89d8e4ee1: Layer already exists 2024-04-25 17:18:31,958 INFO fe73c8bb682e: Pushed 2024-04-25 17:18:32,058 INFO 54695949bfe7: Layer already exists 2024-04-25 17:18:32,159 INFO 181f0c62b19f: Layer already exists 2024-04-25 17:18:32,259 INFO 4157912709d4: Layer already exists 2024-04-25 17:18:32,360 INFO 4576b7e2f70a: Layer already exists 2024-04-25 17:18:32,460 INFO bcc69cc8293b: Layer already exists 2024-04-25 17:18:32,561 INFO 420179ad2efa: Layer already exists 2024-04-25 17:18:32,962 INFO xlou-7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4: digest: sha256:39c4865dbeaf9377b23051db99b216575f166315deed56f795cfd618af048720 size: 3869 2024-04-25 17:18:33,063 INFO Updated the image_defaulter with your new image for ds-idrepo: "gcr.io/engineeringpit/lodestar-images/ds-idrepo:xlou-7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4". 2024-04-25 17:18:33,164 ERROR #0 building with "default" instance using docker driver 2024-04-25 17:18:33,164 ERROR 2024-04-25 17:18:33,164 ERROR #1 [internal] load build definition from Dockerfile 2024-04-25 17:18:33,164 ERROR #1 transferring dockerfile: 2.45kB done 2024-04-25 17:18:33,164 ERROR #1 DONE 0.0s 2024-04-25 17:18:33,164 ERROR 2024-04-25 17:18:33,164 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 2024-04-25 17:18:33,164 ERROR #2 DONE 0.4s 2024-04-25 17:18:33,164 ERROR 2024-04-25 17:18:33,164 ERROR #3 [internal] load .dockerignore 2024-04-25 17:18:33,164 ERROR #3 transferring context: 2B done 2024-04-25 17:18:33,164 ERROR #3 DONE 0.0s 2024-04-25 17:18:33,164 ERROR 2024-04-25 17:18:33,164 ERROR #4 [ 1/10] FROM gcr.io/forgerock-io/ds/pit1:7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4@sha256:b76eac17d4efc6b7f4a51f35a11e913376232ca9041687ffb75726afdb8647c2 2024-04-25 17:18:33,164 ERROR #4 DONE 0.0s 2024-04-25 17:18:33,164 ERROR 2024-04-25 17:18:33,164 ERROR #5 [internal] load build context 2024-04-25 17:18:33,164 ERROR #5 transferring context: 38.50kB done 2024-04-25 17:18:33,165 ERROR #5 DONE 0.0s 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #6 [ 2/10] COPY debian-buster-sources.list /etc/apt/sources.list 2024-04-25 17:18:33,165 ERROR #6 CACHED 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #7 [ 3/10] WORKDIR /opt/opendj 2024-04-25 17:18:33,165 ERROR #7 CACHED 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #8 [ 4/10] COPY --chown=forgerock:root common /opt/opendj/ 2024-04-25 17:18:33,165 ERROR #8 CACHED 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #9 [ 5/10] COPY --chown=forgerock:root idrepo /opt/opendj/ 2024-04-25 17:18:33,165 ERROR #9 CACHED 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #10 [ 6/10] COPY --chown=forgerock:root scripts /opt/opendj/scripts 2024-04-25 17:18:33,165 ERROR #10 DONE 0.1s 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #11 [ 7/10] COPY --chown=forgerock:root uma /opt/opendj/uma 2024-04-25 17:18:33,165 ERROR #11 DONE 0.1s 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #12 [ 8/10] COPY --chown=forgerock:root idrepo/*.ldif /var/tmp/ 2024-04-25 17:18:33,165 ERROR #12 DONE 0.1s 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #13 [ 9/10] RUN chmod +w template/setup-profiles/AM/config/6.5/base-entries.ldif && cat scripts/external-am-datastore.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat uma/opendj_uma_audit.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat uma/opendj_uma_pending_requests.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat uma/opendj_uma_resource_set_labels.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat uma/opendj_uma_resource_sets.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && cat /var/tmp/alpha_bravo.ldif >> template/setup-profiles/AM/config/6.5/base-entries.ldif && chmod +w template/setup-profiles/AM/identity-store/7.0/base-entries.ldif && cat /var/tmp/orgs.ldif >> template/setup-profiles/AM/identity-store/7.0/base-entries.ldif && rm /var/tmp/*ldif 2024-04-25 17:18:33,165 ERROR #13 DONE 0.4s 2024-04-25 17:18:33,165 ERROR 2024-04-25 17:18:33,165 ERROR #14 [10/10] RUN bin/setup.sh && bin/relax-security-settings.sh && rm bin/setup.sh bin/relax-security-settings.sh 2024-04-25 17:18:33,165 ERROR #14 5.032 2024-04-25 17:18:33,165 ERROR #14 5.033 Configuring profile AM configuration data store........ Done 2024-04-25 17:18:33,165 ERROR #14 19.24 2024-04-25 17:18:33,165 ERROR #14 19.24 Configuring profile AM identity data store....... Done 2024-04-25 17:18:33,165 ERROR #14 32.24 2024-04-25 17:18:33,166 ERROR #14 32.24 Configuring profile IDM external repository......... Done 2024-04-25 17:18:33,166 ERROR #14 51.41 2024-04-25 17:18:33,166 ERROR #14 51.41 Configuring profile AM CTS data store........ Done 2024-04-25 17:18:33,166 ERROR #14 67.20 2024-04-25 17:18:33,166 ERROR #14 67.20 Configuring profile DS proxied server...... Done 2024-04-25 17:18:33,166 ERROR #14 74.74 create-trust-manager-provider --provider-name "PEM Trust Manager" --type pem --set enabled:true --set pem-directory:pem-trust-directory 2024-04-25 17:18:33,166 ERROR #14 75.98 2024-04-25 17:18:33,166 ERROR #14 75.99 The Pem Trust Manager Provider was created successfully 2024-04-25 17:18:33,166 ERROR #14 75.99 2024-04-25 17:18:33,166 ERROR #14 75.99 set-connection-handler-prop --handler-name https --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:18:33,166 ERROR #14 76.32 2024-04-25 17:18:33,166 ERROR #14 76.33 set-connection-handler-prop --handler-name ldap --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:18:33,166 ERROR #14 76.63 2024-04-25 17:18:33,166 ERROR #14 76.63 set-connection-handler-prop --handler-name ldaps --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:18:33,166 ERROR #14 76.86 2024-04-25 17:18:33,166 ERROR #14 76.86 set-synchronization-provider-prop --provider-name "Multimaster Synchronization" --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:18:33,166 ERROR #14 77.02 2024-04-25 17:18:33,166 ERROR #14 77.02 set-administration-connector-prop --set trust-manager-provider:"PEM Trust Manager" 2024-04-25 17:18:33,166 ERROR #14 77.14 2024-04-25 17:18:33,166 ERROR #14 77.14 delete-trust-manager-provider --provider-name "PKCS12" 2024-04-25 17:18:33,166 ERROR #14 77.49 2024-04-25 17:18:33,166 ERROR #14 77.49 The Trust Manager Provider was deleted successfully 2024-04-25 17:18:33,166 ERROR #14 77.49 2024-04-25 17:18:33,166 ERROR #14 77.49 create-key-manager-provider --provider-name "PEM Key Manager" --type pem --set enabled:true --set pem-directory:pem-keys-directory 2024-04-25 17:18:33,166 ERROR #14 77.67 2024-04-25 17:18:33,166 ERROR #14 77.67 The Pem Key Manager Provider was created successfully 2024-04-25 17:18:33,166 ERROR #14 77.68 2024-04-25 17:18:33,166 ERROR #14 77.68 set-connection-handler-prop --handler-name https --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:18:33,166 ERROR #14 77.86 2024-04-25 17:18:33,166 ERROR #14 77.86 set-connection-handler-prop --handler-name ldap --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:18:33,166 ERROR #14 78.07 2024-04-25 17:18:33,166 ERROR #14 78.07 set-connection-handler-prop --handler-name ldaps --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:18:33,166 ERROR #14 78.22 2024-04-25 17:18:33,166 ERROR #14 78.22 set-synchronization-provider-prop --provider-name "Multimaster Synchronization" --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:18:33,167 ERROR #14 78.43 2024-04-25 17:18:33,167 ERROR #14 78.43 set-crypto-manager-prop --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:18:33,167 ERROR #14 78.56 2024-04-25 17:18:33,167 ERROR #14 78.56 set-administration-connector-prop --set key-manager-provider:"PEM Key Manager" 2024-04-25 17:18:33,167 ERROR #14 78.68 2024-04-25 17:18:33,167 ERROR #14 78.68 delete-key-manager-provider --provider-name "PKCS12" 2024-04-25 17:18:33,167 ERROR #14 79.05 2024-04-25 17:18:33,167 ERROR #14 79.05 The Key Manager Provider was deleted successfully 2024-04-25 17:18:33,167 ERROR #14 79.05 2024-04-25 17:18:33,167 ERROR #14 79.05 create-backend-index --backend-name amIdentityStore --set index-type:equality --type generic --index-name fr-idm-uuid 2024-04-25 17:18:33,167 ERROR #14 79.16 2024-04-25 17:18:33,167 ERROR #14 79.16 The Backend Index was created successfully 2024-04-25 17:18:33,167 ERROR #14 79.16 2024-04-25 17:18:33,167 ERROR #14 79.16 create-backend-index --backend-name amIdentityStore --set index-type:equality --index-name fr-idm-effectiveApplications 2024-04-25 17:18:33,167 ERROR #14 79.26 2024-04-25 17:18:33,167 ERROR #14 79.26 The Backend Index was created successfully 2024-04-25 17:18:33,167 ERROR #14 79.26 2024-04-25 17:18:33,167 ERROR #14 79.26 create-backend-index --backend-name amIdentityStore --set index-type:equality --index-name fr-idm-effectiveGroup 2024-04-25 17:18:33,167 ERROR #14 79.37 2024-04-25 17:18:33,167 ERROR #14 79.37 The Backend Index was created successfully 2024-04-25 17:18:33,167 ERROR #14 79.37 2024-04-25 17:18:33,167 ERROR #14 79.37 create-backend-index --backend-name amIdentityStore --set index-type:presence --index-name fr-idm-lastSync 2024-04-25 17:18:33,167 ERROR #14 79.50 2024-04-25 17:18:33,167 ERROR #14 79.50 The Backend Index was created successfully 2024-04-25 17:18:33,167 ERROR #14 79.50 2024-04-25 17:18:33,167 ERROR #14 79.50 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-user-manager --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,167 ERROR #14 79.60 2024-04-25 17:18:33,167 ERROR #14 79.60 The Backend Index was created successfully 2024-04-25 17:18:33,167 ERROR #14 79.60 2024-04-25 17:18:33,167 ERROR #14 79.60 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-user-meta --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,167 ERROR #14 79.69 2024-04-25 17:18:33,167 ERROR #14 79.69 The Backend Index was created successfully 2024-04-25 17:18:33,167 ERROR #14 79.69 2024-04-25 17:18:33,167 ERROR #14 79.69 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-user-notifications --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,167 ERROR #14 79.78 2024-04-25 17:18:33,167 ERROR #14 79.78 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 79.78 2024-04-25 17:18:33,168 ERROR #14 79.78 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-user-roles --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,168 ERROR #14 79.88 2024-04-25 17:18:33,168 ERROR #14 79.89 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 79.89 2024-04-25 17:18:33,168 ERROR #14 79.89 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-user-authzroles-internal-role --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,168 ERROR #14 79.97 2024-04-25 17:18:33,168 ERROR #14 79.97 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 79.97 2024-04-25 17:18:33,168 ERROR #14 79.97 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-user-authzroles-managed-role --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,168 ERROR #14 80.05 2024-04-25 17:18:33,168 ERROR #14 80.05 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 80.05 2024-04-25 17:18:33,168 ERROR #14 80.05 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-organization-owner --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,168 ERROR #14 80.13 2024-04-25 17:18:33,168 ERROR #14 80.13 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 80.13 2024-04-25 17:18:33,168 ERROR #14 80.14 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-organization-admin --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,168 ERROR #14 80.22 2024-04-25 17:18:33,168 ERROR #14 80.22 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 80.22 2024-04-25 17:18:33,168 ERROR #14 80.22 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-organization-member --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,168 ERROR #14 80.32 2024-04-25 17:18:33,168 ERROR #14 80.32 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 80.32 2024-04-25 17:18:33,168 ERROR #14 80.32 create-backend-index --backend-name amIdentityStore --set index-type:ordering --type generic --index-name fr-idm-managed-user-active-date 2024-04-25 17:18:33,168 ERROR #14 80.40 2024-04-25 17:18:33,168 ERROR #14 80.40 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 80.40 2024-04-25 17:18:33,168 ERROR #14 80.40 create-backend-index --backend-name amIdentityStore --set index-type:ordering --type generic --index-name fr-idm-managed-user-inactive-date 2024-04-25 17:18:33,168 ERROR #14 80.48 2024-04-25 17:18:33,168 ERROR #14 80.49 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 80.49 2024-04-25 17:18:33,168 ERROR #14 80.49 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-user-groups --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,168 ERROR #14 80.57 2024-04-25 17:18:33,168 ERROR #14 80.57 The Backend Index was created successfully 2024-04-25 17:18:33,168 ERROR #14 80.57 2024-04-25 17:18:33,168 ERROR #14 80.57 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-assignment-member --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,169 ERROR #14 80.65 2024-04-25 17:18:33,169 ERROR #14 80.65 The Backend Index was created successfully 2024-04-25 17:18:33,169 ERROR #14 80.65 2024-04-25 17:18:33,169 ERROR #14 80.65 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-application-member --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,169 ERROR #14 80.75 2024-04-25 17:18:33,169 ERROR #14 80.75 The Backend Index was created successfully 2024-04-25 17:18:33,169 ERROR #14 80.75 2024-04-25 17:18:33,169 ERROR #14 80.75 create-backend-index --backend-name amIdentityStore --set index-type:extensible --index-name fr-idm-managed-application-owner --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.7 --set index-extensible-matching-rule:1.3.6.1.4.1.36733.2.1.4.9 2024-04-25 17:18:33,169 ERROR #14 80.83 2024-04-25 17:18:33,169 ERROR #14 80.83 The Backend Index was created successfully 2024-04-25 17:18:33,169 ERROR #14 80.83 2024-04-25 17:18:33,169 ERROR #14 80.90 + dsconfig --offline --no-prompt --batch 2024-04-25 17:18:33,169 ERROR #14 82.46 set-global-configuration-prop --set "unauthenticated-requests-policy:allow" 2024-04-25 17:18:33,169 ERROR #14 83.69 2024-04-25 17:18:33,169 ERROR #14 83.69 set-password-policy-prop --policy-name "Default Password Policy" --set "require-secure-authentication:false" --set "require-secure-password-changes:false" --reset "password-validator" 2024-04-25 17:18:33,169 ERROR #14 84.01 2024-04-25 17:18:33,169 ERROR #14 84.01 set-password-policy-prop --policy-name "Root Password Policy" --set "require-secure-authentication:false" --set "require-secure-password-changes:false" --reset "password-validator" 2024-04-25 17:18:33,169 ERROR #14 84.26 2024-04-25 17:18:33,169 ERROR #14 DONE 84.3s 2024-04-25 17:18:33,169 ERROR 2024-04-25 17:18:33,169 ERROR #15 exporting to image 2024-04-25 17:18:33,169 ERROR #15 exporting layers 0.1s done 2024-04-25 17:18:33,169 ERROR #15 writing image sha256:5b86c499bcab0505ffc2e893bf76561ab79ab17e62485247600b0dafb165ccec done 2024-04-25 17:18:33,169 ERROR #15 naming to gcr.io/engineeringpit/lodestar-images/ds-idrepo:xlou-7.6.0-7e0436f7626375c00baee240ad259d6a2b07d5f4 done 2024-04-25 17:18:33,169 ERROR #15 DONE 0.2s 2024-04-25 17:18:33,292 INFO 2024-04-25 17:18:33,292 INFO [run_command]: kubectl config current-context 2024-04-25 17:18:33,367 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:18:33,367 DEBUG --- stdout --- 2024-04-25 17:18:33,367 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm 2024-04-25 17:18:33,367 DEBUG --- stderr --- 2024-04-25 17:18:33,367 DEBUG 2024-04-25 17:18:33,367 INFO 2024-04-25 17:18:33,367 INFO 2024-04-25 17:18:33,368 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build am --config-profile=default --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-1ea0b707baef4b0816b74795e83665828894daed 2024-04-25 17:18:33,368 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'} 2024-04-25 17:18:36,083 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/am] 2024-04-25 17:18:36,183 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:36,284 INFO a3a1095350db: Preparing 2024-04-25 17:18:36,384 INFO 1c3f21bc3004: Preparing 2024-04-25 17:18:36,485 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:36,585 INFO 017f692bade5: Preparing 2024-04-25 17:18:36,686 INFO 13ce73dd56a6: Preparing 2024-04-25 17:18:36,787 INFO dcd0b48a2e92: Preparing 2024-04-25 17:18:36,887 INFO 021ecfe5056d: Preparing 2024-04-25 17:18:36,988 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:37,088 INFO c5bf6ede4243: Preparing 2024-04-25 17:18:37,188 INFO f9b1f7999d91: Preparing 2024-04-25 17:18:37,289 INFO be6643d466e8: Preparing 2024-04-25 17:18:37,389 INFO 196d528c532c: Preparing 2024-04-25 17:18:37,490 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:37,590 INFO d297f66f12de: Preparing 2024-04-25 17:18:37,691 INFO 60ea9a9fb12f: Preparing 2024-04-25 17:18:37,791 INFO 0fd8db4b3e1a: Preparing 2024-04-25 17:18:37,892 INFO d2d6c23ac971: Preparing 2024-04-25 17:18:37,992 INFO 2e4d6aaebd90: Preparing 2024-04-25 17:18:38,093 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:38,193 INFO 00c4270cdafe: Preparing 2024-04-25 17:18:38,294 INFO e198a70c9f59: Preparing 2024-04-25 17:18:38,394 INFO 8a7e7a40c94d: Preparing 2024-04-25 17:18:38,495 INFO 54e8400c498f: Preparing 2024-04-25 17:18:38,595 INFO ff66d720b473: Preparing 2024-04-25 17:18:38,696 INFO 24de26986db8: Preparing 2024-04-25 17:18:38,796 INFO 0d97ea962e23: Preparing 2024-04-25 17:18:38,897 INFO 3cf89158a79a: Preparing 2024-04-25 17:18:38,997 INFO d61deca045a3: Preparing 2024-04-25 17:18:39,098 INFO 833a5270a0d4: Preparing 2024-04-25 17:18:39,198 INFO 6613f163df28: Preparing 2024-04-25 17:18:39,299 INFO b94dd8bf4842: Preparing 2024-04-25 17:18:39,399 INFO 96631afab955: Preparing 2024-04-25 17:18:39,500 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:39,600 INFO 2bba76ff7ecb: Preparing 2024-04-25 17:18:39,701 INFO 0b1abb92234a: Preparing 2024-04-25 17:18:39,801 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:39,902 INFO f7dc9ed7563b: Preparing 2024-04-25 17:18:40,002 INFO 50e32496fe9e: Preparing 2024-04-25 17:18:40,103 INFO 21848dddb6a0: Preparing 2024-04-25 17:18:40,204 INFO c7eb95ea689b: Preparing 2024-04-25 17:18:40,304 INFO 7b1a6e0adacf: Preparing 2024-04-25 17:18:40,405 INFO 9ef2138414ae: Preparing 2024-04-25 17:18:40,506 INFO 9eea9d12ed00: Preparing 2024-04-25 17:18:40,606 INFO 2ba3b7003b69: Preparing 2024-04-25 17:18:40,707 INFO 93a3968280cc: Preparing 2024-04-25 17:18:40,807 INFO e0ab8fa39aa2: Preparing 2024-04-25 17:18:40,908 INFO e0a9f5911802: Preparing 2024-04-25 17:18:41,009 INFO f9b1f7999d91: Waiting 2024-04-25 17:18:41,109 INFO be6643d466e8: Waiting 2024-04-25 17:18:41,210 INFO 196d528c532c: Waiting 2024-04-25 17:18:41,310 INFO d297f66f12de: Waiting 2024-04-25 17:18:41,411 INFO 60ea9a9fb12f: Waiting 2024-04-25 17:18:41,512 INFO 0fd8db4b3e1a: Waiting 2024-04-25 17:18:41,612 INFO d2d6c23ac971: Waiting 2024-04-25 17:18:41,713 INFO 2e4d6aaebd90: Waiting 2024-04-25 17:18:41,814 INFO 00c4270cdafe: Waiting 2024-04-25 17:18:41,914 INFO e198a70c9f59: Waiting 2024-04-25 17:18:42,015 INFO 8a7e7a40c94d: Waiting 2024-04-25 17:18:42,116 INFO 54e8400c498f: Waiting 2024-04-25 17:18:42,216 INFO ff66d720b473: Waiting 2024-04-25 17:18:42,317 INFO 24de26986db8: Waiting 2024-04-25 17:18:42,417 INFO 0d97ea962e23: Waiting 2024-04-25 17:18:42,519 INFO 3cf89158a79a: Waiting 2024-04-25 17:18:42,620 INFO d61deca045a3: Waiting 2024-04-25 17:18:42,721 INFO 833a5270a0d4: Waiting 2024-04-25 17:18:42,821 INFO 6613f163df28: Waiting 2024-04-25 17:18:42,922 INFO b94dd8bf4842: Waiting 2024-04-25 17:18:43,022 INFO 96631afab955: Waiting 2024-04-25 17:18:43,123 INFO 2bba76ff7ecb: Waiting 2024-04-25 17:18:43,224 INFO 0b1abb92234a: Waiting 2024-04-25 17:18:43,324 INFO f7dc9ed7563b: Waiting 2024-04-25 17:18:43,425 INFO 50e32496fe9e: Waiting 2024-04-25 17:18:43,526 INFO 21848dddb6a0: Waiting 2024-04-25 17:18:43,626 INFO c7eb95ea689b: Waiting 2024-04-25 17:18:43,727 INFO 7b1a6e0adacf: Waiting 2024-04-25 17:18:43,827 INFO 9ef2138414ae: Waiting 2024-04-25 17:18:43,928 INFO 9eea9d12ed00: Waiting 2024-04-25 17:18:44,029 INFO 2ba3b7003b69: Waiting 2024-04-25 17:18:44,129 INFO 93a3968280cc: Waiting 2024-04-25 17:18:44,230 INFO e0ab8fa39aa2: Waiting 2024-04-25 17:18:44,331 INFO e0a9f5911802: Waiting 2024-04-25 17:18:44,431 INFO dcd0b48a2e92: Waiting 2024-04-25 17:18:44,532 INFO 021ecfe5056d: Waiting 2024-04-25 17:18:44,632 INFO c5bf6ede4243: Waiting 2024-04-25 17:18:44,733 INFO 13ce73dd56a6: Layer already exists 2024-04-25 17:18:44,834 INFO 5f70bf18a086: Layer already exists 2024-04-25 17:18:44,934 INFO 017f692bade5: Layer already exists 2024-04-25 17:18:45,035 INFO dcd0b48a2e92: Layer already exists 2024-04-25 17:18:45,136 INFO 021ecfe5056d: Layer already exists 2024-04-25 17:18:45,236 INFO c5bf6ede4243: Layer already exists 2024-04-25 17:18:45,337 INFO f9b1f7999d91: Layer already exists 2024-04-25 17:18:45,437 INFO be6643d466e8: Layer already exists 2024-04-25 17:18:45,538 INFO 196d528c532c: Layer already exists 2024-04-25 17:18:45,639 INFO d297f66f12de: Layer already exists 2024-04-25 17:18:45,739 INFO d2d6c23ac971: Layer already exists 2024-04-25 17:18:45,840 INFO 0fd8db4b3e1a: Layer already exists 2024-04-25 17:18:45,941 INFO 60ea9a9fb12f: Layer already exists 2024-04-25 17:18:46,041 INFO 2e4d6aaebd90: Layer already exists 2024-04-25 17:18:46,142 INFO e198a70c9f59: Layer already exists 2024-04-25 17:18:46,242 INFO 00c4270cdafe: Layer already exists 2024-04-25 17:18:46,343 INFO 54e8400c498f: Layer already exists 2024-04-25 17:18:46,444 INFO ff66d720b473: Layer already exists 2024-04-25 17:18:46,544 INFO 8a7e7a40c94d: Layer already exists 2024-04-25 17:18:46,645 INFO 24de26986db8: Layer already exists 2024-04-25 17:18:46,745 INFO 0d97ea962e23: Layer already exists 2024-04-25 17:18:46,846 INFO 3cf89158a79a: Layer already exists 2024-04-25 17:18:46,947 INFO d61deca045a3: Layer already exists 2024-04-25 17:18:47,047 INFO 833a5270a0d4: Layer already exists 2024-04-25 17:18:47,148 INFO 6613f163df28: Layer already exists 2024-04-25 17:18:47,249 INFO b94dd8bf4842: Layer already exists 2024-04-25 17:18:47,349 INFO 96631afab955: Layer already exists 2024-04-25 17:18:47,450 INFO 2bba76ff7ecb: Layer already exists 2024-04-25 17:18:47,551 INFO 0b1abb92234a: Layer already exists 2024-04-25 17:18:47,652 INFO f7dc9ed7563b: Layer already exists 2024-04-25 17:18:47,752 INFO 50e32496fe9e: Layer already exists 2024-04-25 17:18:47,853 INFO 21848dddb6a0: Layer already exists 2024-04-25 17:18:47,953 INFO c7eb95ea689b: Layer already exists 2024-04-25 17:18:48,054 INFO 7b1a6e0adacf: Layer already exists 2024-04-25 17:18:48,154 INFO 9ef2138414ae: Layer already exists 2024-04-25 17:18:48,255 INFO 9eea9d12ed00: Layer already exists 2024-04-25 17:18:48,355 INFO 2ba3b7003b69: Layer already exists 2024-04-25 17:18:48,456 INFO 93a3968280cc: Layer already exists 2024-04-25 17:18:48,556 INFO e0ab8fa39aa2: Layer already exists 2024-04-25 17:18:48,657 INFO e0a9f5911802: Layer already exists 2024-04-25 17:18:48,757 INFO a3a1095350db: Pushed 2024-04-25 17:18:48,858 INFO 1c3f21bc3004: Pushed 2024-04-25 17:18:48,958 INFO xlou-7.6.0-1ea0b707baef4b0816b74795e83665828894daed: digest: sha256:9916ab2c751329ff286f23571ae201ed5fc07e069331bc8833d8c23609fc53a9 size: 10325 2024-04-25 17:18:49,059 INFO Updated the image_defaulter with your new image for am: "gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-1ea0b707baef4b0816b74795e83665828894daed". 2024-04-25 17:18:49,159 ERROR #0 building with "default" instance using docker driver 2024-04-25 17:18:49,160 ERROR 2024-04-25 17:18:49,160 ERROR #1 [internal] load build definition from Dockerfile 2024-04-25 17:18:49,160 ERROR #1 transferring dockerfile: 493B done 2024-04-25 17:18:49,160 ERROR #1 DONE 0.0s 2024-04-25 17:18:49,160 ERROR 2024-04-25 17:18:49,160 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/am-cdk/pit1:7.6.0-1ea0b707baef4b0816b74795e83665828894daed 2024-04-25 17:18:49,160 ERROR #2 DONE 0.4s 2024-04-25 17:18:49,160 ERROR 2024-04-25 17:18:49,160 ERROR #3 [internal] load .dockerignore 2024-04-25 17:18:49,160 ERROR #3 transferring context: 2B done 2024-04-25 17:18:49,160 ERROR #3 DONE 0.0s 2024-04-25 17:18:49,160 ERROR 2024-04-25 17:18:49,160 ERROR #4 [1/5] FROM gcr.io/forgerock-io/am-cdk/pit1:7.6.0-1ea0b707baef4b0816b74795e83665828894daed@sha256:9756fe966663165e7ad9d0deb547c7658f01325262447a3ea2b24d2598a334e5 2024-04-25 17:18:49,160 ERROR #4 DONE 0.0s 2024-04-25 17:18:49,160 ERROR 2024-04-25 17:18:49,160 ERROR #5 [internal] load build context 2024-04-25 17:18:49,160 ERROR #5 transferring context: 4.98kB done 2024-04-25 17:18:49,160 ERROR #5 DONE 0.0s 2024-04-25 17:18:49,160 ERROR 2024-04-25 17:18:49,160 ERROR #6 [2/5] RUN echo "\033[0;36m*** Building 'default' profile ***\033[0m" 2024-04-25 17:18:49,160 ERROR #6 CACHED 2024-04-25 17:18:49,160 ERROR 2024-04-25 17:18:49,160 ERROR #7 [3/5] COPY --chown=forgerock:root config-profiles/default/ /home/forgerock/openam/ 2024-04-25 17:18:49,160 ERROR #7 DONE 0.0s 2024-04-25 17:18:49,160 ERROR 2024-04-25 17:18:49,160 ERROR #8 [4/5] COPY --chown=forgerock:root *.sh /home/forgerock/ 2024-04-25 17:18:49,160 ERROR #8 DONE 0.1s 2024-04-25 17:18:49,161 ERROR 2024-04-25 17:18:49,161 ERROR #9 [5/5] WORKDIR /home/forgerock 2024-04-25 17:18:49,161 ERROR #9 DONE 0.0s 2024-04-25 17:18:49,161 ERROR 2024-04-25 17:18:49,161 ERROR #10 exporting to image 2024-04-25 17:18:49,161 ERROR #10 exporting layers 0.1s done 2024-04-25 17:18:49,161 ERROR #10 writing image sha256:4216563d4b70fea3a32baf87dc7996fd725063ea669f1142134721a13ecf8077 done 2024-04-25 17:18:49,161 ERROR #10 naming to gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-1ea0b707baef4b0816b74795e83665828894daed done 2024-04-25 17:18:49,161 ERROR #10 DONE 0.1s 2024-04-25 17:18:49,279 INFO 2024-04-25 17:18:49,279 INFO [run_command]: kubectl config current-context 2024-04-25 17:18:49,346 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:18:49,346 DEBUG --- stdout --- 2024-04-25 17:18:49,346 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm 2024-04-25 17:18:49,346 DEBUG --- stderr --- 2024-04-25 17:18:49,346 DEBUG 2024-04-25 17:18:49,346 INFO 2024-04-25 17:18:49,346 INFO 2024-04-25 17:18:49,346 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build amster --config-profile=default --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-1ea0b707baef4b0816b74795e83665828894daed 2024-04-25 17:18:49,347 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'} 2024-04-25 17:18:51,859 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/amster] 2024-04-25 17:18:51,960 INFO 859b1e93398a: Preparing 2024-04-25 17:18:52,060 INFO 072a4048aeff: Preparing 2024-04-25 17:18:52,161 INFO cdef274bd97a: Preparing 2024-04-25 17:18:52,261 INFO e9a1a0424615: Preparing 2024-04-25 17:18:52,362 INFO 141f4d88613d: Preparing 2024-04-25 17:18:52,462 INFO 5f70bf18a086: Preparing 2024-04-25 17:18:52,563 INFO eff8daa60fd4: Preparing 2024-04-25 17:18:52,663 INFO 552b1c7c03b0: Preparing 2024-04-25 17:18:52,764 INFO 33c6ea69bc4d: Preparing 2024-04-25 17:18:52,864 INFO 8515e8ca25cd: Preparing 2024-04-25 17:18:52,965 INFO 361f2767453d: Preparing 2024-04-25 17:18:53,065 INFO 009d6a8f4228: Preparing 2024-04-25 17:18:53,166 INFO d8a7a053f1c9: Preparing 2024-04-25 17:18:53,266 INFO 61feacee606e: Preparing 2024-04-25 17:18:53,367 INFO 47cb0a6aaa03: Preparing 2024-04-25 17:18:53,467 INFO 420179ad2efa: Preparing 2024-04-25 17:18:53,568 INFO 552b1c7c03b0: Waiting 2024-04-25 17:18:53,668 INFO 33c6ea69bc4d: Waiting 2024-04-25 17:18:53,769 INFO 8515e8ca25cd: Waiting 2024-04-25 17:18:53,869 INFO 361f2767453d: Waiting 2024-04-25 17:18:53,970 INFO 009d6a8f4228: Waiting 2024-04-25 17:18:54,070 INFO d8a7a053f1c9: Waiting 2024-04-25 17:18:54,171 INFO 61feacee606e: Waiting 2024-04-25 17:18:54,271 INFO 47cb0a6aaa03: Waiting 2024-04-25 17:18:54,372 INFO 420179ad2efa: Waiting 2024-04-25 17:18:54,473 INFO 5f70bf18a086: Waiting 2024-04-25 17:18:54,573 INFO eff8daa60fd4: Waiting 2024-04-25 17:18:54,674 INFO 859b1e93398a: Layer already exists 2024-04-25 17:18:54,775 INFO 072a4048aeff: Layer already exists 2024-04-25 17:18:54,875 INFO cdef274bd97a: Layer already exists 2024-04-25 17:18:54,976 INFO 141f4d88613d: Layer already exists 2024-04-25 17:18:55,076 INFO e9a1a0424615: Layer already exists 2024-04-25 17:18:55,177 INFO 5f70bf18a086: Layer already exists 2024-04-25 17:18:55,278 INFO eff8daa60fd4: Layer already exists 2024-04-25 17:18:55,378 INFO 552b1c7c03b0: Layer already exists 2024-04-25 17:18:55,479 INFO 33c6ea69bc4d: Layer already exists 2024-04-25 17:18:55,579 INFO 8515e8ca25cd: Layer already exists 2024-04-25 17:18:55,680 INFO 361f2767453d: Layer already exists 2024-04-25 17:18:55,781 INFO d8a7a053f1c9: Layer already exists 2024-04-25 17:18:55,881 INFO 61feacee606e: Layer already exists 2024-04-25 17:18:55,982 INFO 47cb0a6aaa03: Layer already exists 2024-04-25 17:18:56,082 INFO 420179ad2efa: Layer already exists 2024-04-25 17:18:56,183 INFO 009d6a8f4228: Layer already exists 2024-04-25 17:18:56,283 INFO xlou-7.6.0-1ea0b707baef4b0816b74795e83665828894daed: digest: sha256:0b578f09dce2598da6785247d729628e2dfa97893cec90b04e54d75f756377ae size: 3666 2024-04-25 17:18:56,384 INFO Embedding AM dynamic configs in the amster image is deprecated. Manage AM dynamic config with the bin/amster cmd instead. 2024-04-25 17:18:56,484 INFO Updated the image_defaulter with your new image for amster: "gcr.io/engineeringpit/lodestar-images/amster:xlou-7.6.0-1ea0b707baef4b0816b74795e83665828894daed". 2024-04-25 17:18:56,585 ERROR #0 building with "default" instance using docker driver 2024-04-25 17:18:56,585 ERROR 2024-04-25 17:18:56,585 ERROR #1 [internal] load build definition from Dockerfile 2024-04-25 17:18:56,585 ERROR #1 transferring dockerfile: 806B done 2024-04-25 17:18:56,585 ERROR #1 DONE 0.0s 2024-04-25 17:18:56,585 ERROR 2024-04-25 17:18:56,585 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/amster/pit1:7.6.0-1ea0b707baef4b0816b74795e83665828894daed 2024-04-25 17:18:56,585 ERROR #2 DONE 0.4s 2024-04-25 17:18:56,585 ERROR 2024-04-25 17:18:56,585 ERROR #3 [internal] load .dockerignore 2024-04-25 17:18:56,585 ERROR #3 transferring context: 2B done 2024-04-25 17:18:56,585 ERROR #3 DONE 0.0s 2024-04-25 17:18:56,585 ERROR 2024-04-25 17:18:56,585 ERROR #4 [1/6] FROM gcr.io/forgerock-io/amster/pit1:7.6.0-1ea0b707baef4b0816b74795e83665828894daed@sha256:79e91065a3cb6f77245509385767e7ba6a38b472426528d638cbb79ad081aa9e 2024-04-25 17:18:56,585 ERROR #4 DONE 0.0s 2024-04-25 17:18:56,585 ERROR 2024-04-25 17:18:56,586 ERROR #5 [internal] load build context 2024-04-25 17:18:56,586 ERROR #5 transferring context: 41.55kB done 2024-04-25 17:18:56,586 ERROR #5 DONE 0.0s 2024-04-25 17:18:56,586 ERROR 2024-04-25 17:18:56,586 ERROR #6 [2/6] RUN apt-get update && apt-get install -y openldap-utils jq inotify-tools && apt-get clean && rm -r /var/lib/apt/lists /var/cache/apt/archives 2024-04-25 17:18:56,586 ERROR #6 CACHED 2024-04-25 17:18:56,586 ERROR 2024-04-25 17:18:56,586 ERROR #7 [4/6] COPY --chown=forgerock:root config-profiles/default/ /opt/amster 2024-04-25 17:18:56,586 ERROR #7 CACHED 2024-04-25 17:18:56,586 ERROR 2024-04-25 17:18:56,586 ERROR #8 [5/6] COPY --chown=forgerock:root scripts /opt/amster 2024-04-25 17:18:56,586 ERROR #8 CACHED 2024-04-25 17:18:56,586 ERROR 2024-04-25 17:18:56,586 ERROR #9 [3/6] RUN echo "\033[0;36m*** Building 'default' profile ***\033[0m" 2024-04-25 17:18:56,586 ERROR #9 CACHED 2024-04-25 17:18:56,586 ERROR 2024-04-25 17:18:56,586 ERROR #10 [6/6] RUN chmod 777 /opt/amster 2024-04-25 17:18:56,586 ERROR #10 CACHED 2024-04-25 17:18:56,586 ERROR 2024-04-25 17:18:56,586 ERROR #11 exporting to image 2024-04-25 17:18:56,586 ERROR #11 exporting layers done 2024-04-25 17:18:56,586 ERROR #11 writing image sha256:a75d5c9fa9dccba967e5530863ec44a0bd5b269e2fa7ab33f646f7cc7d64f09f done 2024-04-25 17:18:56,586 ERROR #11 naming to gcr.io/engineeringpit/lodestar-images/amster:xlou-7.6.0-1ea0b707baef4b0816b74795e83665828894daed done 2024-04-25 17:18:56,586 ERROR #11 DONE 0.0s 2024-04-25 17:18:56,700 INFO 2024-04-25 17:18:56,701 INFO [run_command]: kubectl config current-context 2024-04-25 17:18:56,772 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:18:56,772 DEBUG --- stdout --- 2024-04-25 17:18:56,773 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm 2024-04-25 17:18:56,773 DEBUG --- stderr --- 2024-04-25 17:18:56,773 DEBUG 2024-04-25 17:18:56,773 INFO 2024-04-25 17:18:56,773 INFO 2024-04-25 17:18:56,773 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops build idm --config-profile=default --push-to gcr.io/engineeringpit/lodestar-images --tag=xlou-7.6.0-2167d6704389428c732eacc70a8214428266f312 2024-04-25 17:18:56,773 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'} 2024-04-25 17:18:59,588 INFO The push refers to repository [gcr.io/engineeringpit/lodestar-images/idm] 2024-04-25 17:18:59,689 INFO 9a1d28138c1b: Preparing 2024-04-25 17:18:59,789 INFO 668f4295c102: Preparing 2024-04-25 17:18:59,889 INFO ed26b349ae92: Preparing 2024-04-25 17:18:59,990 INFO be4e670f409e: Preparing 2024-04-25 17:19:00,090 INFO 74e5ad5842c6: Preparing 2024-04-25 17:19:00,191 INFO 94eebedc4407: Preparing 2024-04-25 17:19:00,291 INFO 5f70bf18a086: Preparing 2024-04-25 17:19:00,392 INFO 6aba945837b9: Preparing 2024-04-25 17:19:00,492 INFO 8245997b0a99: Preparing 2024-04-25 17:19:00,593 INFO cbd5cc613af6: Preparing 2024-04-25 17:19:00,693 INFO 1a2f2d8ac864: Preparing 2024-04-25 17:19:00,794 INFO b0c52305aecf: Preparing 2024-04-25 17:19:00,894 INFO baed3ac07ac0: Preparing 2024-04-25 17:19:00,995 INFO 420179ad2efa: Preparing 2024-04-25 17:19:01,095 INFO 94eebedc4407: Waiting 2024-04-25 17:19:01,196 INFO 5f70bf18a086: Waiting 2024-04-25 17:19:01,296 INFO 6aba945837b9: Waiting 2024-04-25 17:19:01,397 INFO 8245997b0a99: Waiting 2024-04-25 17:19:01,497 INFO cbd5cc613af6: Waiting 2024-04-25 17:19:01,598 INFO 1a2f2d8ac864: Waiting 2024-04-25 17:19:01,698 INFO b0c52305aecf: Waiting 2024-04-25 17:19:01,799 INFO baed3ac07ac0: Waiting 2024-04-25 17:19:01,899 INFO 420179ad2efa: Waiting 2024-04-25 17:19:02,000 INFO 74e5ad5842c6: Layer already exists 2024-04-25 17:19:02,100 INFO be4e670f409e: Layer already exists 2024-04-25 17:19:02,201 INFO 94eebedc4407: Layer already exists 2024-04-25 17:19:02,301 INFO 5f70bf18a086: Layer already exists 2024-04-25 17:19:02,402 INFO 6aba945837b9: Layer already exists 2024-04-25 17:19:02,502 INFO 8245997b0a99: Layer already exists 2024-04-25 17:19:02,603 INFO cbd5cc613af6: Layer already exists 2024-04-25 17:19:02,703 INFO 1a2f2d8ac864: Layer already exists 2024-04-25 17:19:02,804 INFO b0c52305aecf: Layer already exists 2024-04-25 17:19:02,904 INFO baed3ac07ac0: Layer already exists 2024-04-25 17:19:03,005 INFO 420179ad2efa: Layer already exists 2024-04-25 17:19:03,105 INFO 668f4295c102: Pushed 2024-04-25 17:19:03,206 INFO ed26b349ae92: Pushed 2024-04-25 17:19:03,306 INFO 9a1d28138c1b: Pushed 2024-04-25 17:19:03,808 INFO xlou-7.6.0-2167d6704389428c732eacc70a8214428266f312: digest: sha256:31057bae1669339724007dd4ee95e03bcca389bcbd5b2e1cef4a1f892e2c1f09 size: 3241 2024-04-25 17:19:03,908 INFO Updated the image_defaulter with your new image for idm: "gcr.io/engineeringpit/lodestar-images/idm:xlou-7.6.0-2167d6704389428c732eacc70a8214428266f312". 2024-04-25 17:19:04,009 ERROR #0 building with "default" instance using docker driver 2024-04-25 17:19:04,009 ERROR 2024-04-25 17:19:04,009 ERROR #1 [internal] load build definition from Dockerfile 2024-04-25 17:19:04,009 ERROR #1 transferring dockerfile: 1.09kB done 2024-04-25 17:19:04,009 ERROR #1 DONE 0.0s 2024-04-25 17:19:04,009 ERROR 2024-04-25 17:19:04,009 ERROR #2 [internal] load metadata for gcr.io/forgerock-io/idm-cdk/pit1:7.6.0-2167d6704389428c732eacc70a8214428266f312 2024-04-25 17:19:04,009 ERROR #2 DONE 0.4s 2024-04-25 17:19:04,009 ERROR 2024-04-25 17:19:04,009 ERROR #3 [internal] load .dockerignore 2024-04-25 17:19:04,009 ERROR #3 transferring context: 2B done 2024-04-25 17:19:04,009 ERROR #3 DONE 0.0s 2024-04-25 17:19:04,009 ERROR 2024-04-25 17:19:04,010 ERROR #4 [1/7] FROM gcr.io/forgerock-io/idm-cdk/pit1:7.6.0-2167d6704389428c732eacc70a8214428266f312@sha256:210ac138d51a276ab460e845115448eb7ea2de3dd8c716138c18213c2c2ea3d2 2024-04-25 17:19:04,010 ERROR #4 DONE 0.0s 2024-04-25 17:19:04,010 ERROR 2024-04-25 17:19:04,010 ERROR #5 [internal] load build context 2024-04-25 17:19:04,010 ERROR #5 transferring context: 282.12kB 0.0s done 2024-04-25 17:19:04,010 ERROR #5 DONE 0.0s 2024-04-25 17:19:04,010 ERROR 2024-04-25 17:19:04,010 ERROR #6 [2/7] COPY debian-buster-sources.list /etc/apt/sources.list 2024-04-25 17:19:04,010 ERROR #6 CACHED 2024-04-25 17:19:04,010 ERROR 2024-04-25 17:19:04,010 ERROR #7 [3/7] RUN rm -f bundle/org.apache.felix.webconsole*.jar && rm -f bundle/openidm-felix-webconsole-*.jar 2024-04-25 17:19:04,010 ERROR #7 CACHED 2024-04-25 17:19:04,010 ERROR 2024-04-25 17:19:04,010 ERROR #8 [4/7] RUN echo "\033[0;36m*** Building 'default' profile ***\033[0m" 2024-04-25 17:19:04,010 ERROR #8 CACHED 2024-04-25 17:19:04,010 ERROR 2024-04-25 17:19:04,010 ERROR #9 [5/7] COPY --chown=forgerock:root config-profiles/default/ /opt/openidm 2024-04-25 17:19:04,010 ERROR #9 DONE 0.1s 2024-04-25 17:19:04,010 ERROR 2024-04-25 17:19:04,010 ERROR #10 [6/7] COPY --chown=forgerock:root bin/import-pem-certs.sh /opt/openidm/bin 2024-04-25 17:19:04,010 ERROR #10 DONE 0.1s 2024-04-25 17:19:04,010 ERROR 2024-04-25 17:19:04,010 ERROR #11 [7/7] COPY --chown=forgerock:root . /opt/openidm 2024-04-25 17:19:04,010 ERROR #11 DONE 0.1s 2024-04-25 17:19:04,010 ERROR 2024-04-25 17:19:04,010 ERROR #12 exporting to image 2024-04-25 17:19:04,010 ERROR #12 exporting layers 0.0s done 2024-04-25 17:19:04,010 ERROR #12 writing image sha256:a563f812cec2b2c91a4f3c0af9974f85c06d96ca8009e767e6c9001c31286693 done 2024-04-25 17:19:04,010 ERROR #12 naming to gcr.io/engineeringpit/lodestar-images/idm:xlou-7.6.0-2167d6704389428c732eacc70a8214428266f312 done 2024-04-25 17:19:04,010 ERROR #12 DONE 0.1s 2024-04-25 17:19:04,011 INFO 2024-04-25 17:19:04,011 INFO -------- Deploy product images using forgeops install command -------- 2024-04-25 17:19:04,123 INFO 2024-04-25 17:19:04,124 INFO [run_command]: kubectl config current-context 2024-04-25 17:19:04,196 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:19:04,196 DEBUG --- stdout --- 2024-04-25 17:19:04,196 DEBUG gke_engineeringpit_us-east1-d_xlou-cdm 2024-04-25 17:19:04,196 DEBUG --- stderr --- 2024-04-25 17:19:04,196 DEBUG 2024-04-25 17:19:04,196 INFO 2024-04-25 17:19:04,196 INFO 2024-04-25 17:19:04,197 INFO [run_command]: /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/bin/forgeops install --namespace=xlou --fqdn xlou.iam.xlou-cdm.engineeringpit.com --custom /mnt/disks/data/xslou/lodestar-fork/ext/forgeops_stack/kustomize/overlay/internal-profiles/medium-old --legacy all 2024-04-25 17:19:04,197 DEBUG [run_command]: env={'HOME': '/home/xslou', 'PATH': '/mnt/disks/data/xslou/lodestar-fork/ext/bin:/home/xslou/.local/bin:/home/xslou/bin:~/bin:~/workshop/lodestar-fork/ext/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin', 'DOCKER_SCAN_SUGGEST': 'false'} 2024-04-25 17:19:08,213 INFO customresourcedefinition.apiextensions.k8s.io/secretagentconfigurations.secret-agent.secrets.forgerock.io condition met 2024-04-25 17:19:08,716 INFO deployment.apps/secret-agent-controller-manager condition met 2024-04-25 17:19:09,018 INFO NAME READY STATUS RESTARTS AGE 2024-04-25 17:19:09,118 INFO secret-agent-controller-manager-85df555854-f8swq 2/2 Running 0 43h 2024-04-25 17:19:10,923 INFO configmap/platform-config created 2024-04-25 17:19:11,324 INFO ingress.networking.k8s.io/forgerock created 2024-04-25 17:19:11,525 INFO ingress.networking.k8s.io/ig created 2024-04-25 17:19:12,929 INFO certificate.cert-manager.io/ds-master-cert created 2024-04-25 17:19:13,130 INFO certificate.cert-manager.io/ds-ssl-cert created 2024-04-25 17:19:13,431 INFO issuer.cert-manager.io/selfsigned-issuer created 2024-04-25 17:19:13,833 INFO secretagentconfiguration.secret-agent.secrets.forgerock.io/forgerock-sac created 2024-04-25 17:19:13,934 INFO Checking cert-manager and related CRDs: cert-manager CRD found in cluster. 2024-04-25 17:19:14,035 INFO Checking secret-agent operator and related CRDs: secret-agent CRD found in cluster. 2024-04-25 17:19:14,135 INFO  2024-04-25 17:19:14,236 INFO Checking secret-agent operator is running... 2024-04-25 17:19:14,336 INFO secret-agent operator is running 2024-04-25 17:19:14,437 INFO 2024-04-25 17:19:14,538 INFO Installing component(s): ['all'] platform: "custom-old" in namespace: "xlou" from deployment manifests in "None". 2024-04-25 17:19:14,638 INFO  2024-04-25 17:19:14,739 INFO Deploying base.yaml. This is a one time activity. 2024-04-25 17:19:14,840 INFO  2024-04-25 17:19:14,940 INFO Waiting for K8s secrets. 2024-04-25 17:19:15,543 INFO Waiting for secret "am-env-secrets" to exist in the cluster: .done 2024-04-25 17:19:20,057 INFO Waiting for secret "idm-env-secrets" to exist in the cluster: ...done 2024-04-25 17:19:20,358 INFO Waiting for secret "ds-passwords" to exist in the cluster: done 2024-04-25 17:19:22,463 INFO Waiting for secret "ds-env-secrets" to exist in the cluster: secret/cloud-storage-credentials-cts created 2024-04-25 17:19:22,664 INFO secret/cloud-storage-credentials-idrepo created 2024-04-25 17:19:22,965 INFO service/ds-cts created 2024-04-25 17:19:23,266 INFO service/ds-idrepo created 2024-04-25 17:19:23,567 INFO statefulset.apps/ds-cts created 2024-04-25 17:19:23,768 INFO statefulset.apps/ds-idrepo created 2024-04-25 17:19:24,069 INFO job.batch/ldif-importer created 2024-04-25 17:19:24,170 INFO done 2024-04-25 17:19:24,270 INFO  2024-04-25 17:19:24,371 INFO Deploying ds.yaml. This includes all directory resources. 2024-04-25 17:19:24,471 INFO  2024-04-25 17:19:24,572 INFO Waiting for DS deployment. This can take a few minutes. First installation takes longer. 2024-04-25 17:19:24,973 INFO Waiting for statefulset "ds-idrepo" to exist in the cluster: Waiting for 3 pods to be ready... 2024-04-25 17:20:00,275 INFO Waiting for 2 pods to be ready... 2024-04-25 17:20:00,375 INFO Waiting for 2 pods to be ready... 2024-04-25 17:20:40,398 INFO Waiting for 1 pods to be ready... 2024-04-25 17:20:40,499 INFO Waiting for 1 pods to be ready... 2024-04-25 17:21:17,409 INFO statefulset rolling update complete 3 pods at revision ds-idrepo-84d87f67... 2024-04-25 17:21:17,510 INFO done 2024-04-25 17:21:18,312 INFO Waiting for Service Account Password Update: done 2024-04-25 17:21:19,216 INFO Waiting for statefulset "ds-cts" to exist in the cluster: statefulset rolling update complete 3 pods at revision ds-cts-74dbbcfd7... 2024-04-25 17:21:19,317 INFO done 2024-04-25 17:21:23,831 INFO Waiting for Service Account Password Update: configmap/am-logback created 2024-04-25 17:21:24,032 INFO configmap/amster-files created 2024-04-25 17:21:24,333 INFO configmap/idm created 2024-04-25 17:21:24,534 INFO configmap/idm-logging-properties created 2024-04-25 17:21:24,835 INFO service/am created 2024-04-25 17:21:25,036 INFO service/idm created 2024-04-25 17:21:25,337 INFO deployment.apps/am created 2024-04-25 17:21:25,538 INFO deployment.apps/idm created 2024-04-25 17:21:25,839 INFO job.batch/amster created 2024-04-25 17:21:27,846 INFO done 2024-04-25 17:21:27,946 INFO Cleaning up amster components. 2024-04-25 17:21:28,047 INFO  2024-04-25 17:21:28,147 INFO Deploying apps. 2024-04-25 17:21:28,249 INFO  2024-04-25 17:21:28,349 INFO Waiting for AM deployment. This can take a few minutes. First installation takes longer. 2024-04-25 17:21:55,931 INFO Waiting for deployment "am" to exist in the cluster: deployment.apps/am condition met 2024-04-25 17:21:56,232 INFO configmap/amster-retain created 2024-04-25 17:21:56,333 INFO done 2024-04-25 17:21:56,434 INFO  2024-04-25 17:21:56,535 INFO Waiting for amster job to complete. This can take several minutes. 2024-04-25 17:22:20,706 INFO Waiting for job "amster" to exist in the cluster: job.batch/amster condition met 2024-04-25 17:22:20,806 INFO done 2024-04-25 17:22:20,907 INFO  2024-04-25 17:22:21,007 INFO Waiting for IDM deployment. This can take a few minutes. First installation takes longer. 2024-04-25 17:22:26,023 INFO Waiting for deployment "idm" to exist in the cluster: pod/idm-6c95d7588f-lrdb9 condition met 2024-04-25 17:22:27,629 INFO pod/idm-6c95d7588f-n2wtz condition met 2024-04-25 17:22:29,233 INFO service/admin-ui created 2024-04-25 17:22:29,434 INFO service/end-user-ui created 2024-04-25 17:22:29,735 INFO service/login-ui created 2024-04-25 17:22:29,936 INFO deployment.apps/admin-ui created 2024-04-25 17:22:30,237 INFO deployment.apps/end-user-ui created 2024-04-25 17:22:30,438 INFO deployment.apps/login-ui created 2024-04-25 17:22:30,538 INFO done 2024-04-25 17:22:30,638 INFO  2024-04-25 17:22:30,739 INFO Deploying UI. 2024-04-25 17:22:30,839 INFO  2024-04-25 17:22:30,940 INFO Waiting for K8s secrets. 2024-04-25 17:22:31,040 INFO Waiting for secret "am-env-secrets" to exist in the cluster: done 2024-04-25 17:22:31,141 INFO Waiting for secret "idm-env-secrets" to exist in the cluster: done 2024-04-25 17:22:31,442 INFO Waiting for secret "ds-passwords" to exist in the cluster: done 2024-04-25 17:22:33,849 INFO Waiting for secret "ds-env-secrets" to exist in the cluster: done 2024-04-25 17:22:33,949 INFO  2024-04-25 17:22:34,050 INFO Relevant passwords: 2024-04-25 17:22:34,150 INFO vnUO2uOtzkm4Jfw9ZDvDqbVZ (amadmin user) 2024-04-25 17:22:34,251 INFO Te3hvGVKgyQ3Y4m0fbG16hKkzkr9FMrw (uid=admin user) 2024-04-25 17:22:34,351 INFO hy7r78vtkoQApRLxNE5FiKg1SySTOlrT (App str svc acct (uid=am-config,ou=admins,ou=am-config)) 2024-04-25 17:22:34,452 INFO H72zcexAZwYTodD76lwgcAZxlq2xfGv6 (CTS svc acct (uid=openam_cts,ou=admins,ou=famrecords,ou=openam-session,ou=tokens)) 2024-04-25 17:22:34,552 INFO rVsUMzJobbtRzBwOHEKyDCMBGlwtoVOP (ID repo svc acct (uid=am-identity-bind-account,ou=admins,ou=identities)) 2024-04-25 17:22:34,653 INFO  2024-04-25 17:22:34,753 INFO Relevant URLs: 2024-04-25 17:22:34,854 INFO https://xlou.iam.xlou-cdm.engineeringpit.com/platform 2024-04-25 17:22:34,954 INFO https://xlou.iam.xlou-cdm.engineeringpit.com/admin 2024-04-25 17:22:35,055 INFO https://xlou.iam.xlou-cdm.engineeringpit.com/am 2024-04-25 17:22:35,155 INFO https://xlou.iam.xlou-cdm.engineeringpit.com/enduser 2024-04-25 17:22:35,256 INFO  2024-04-25 17:22:35,356 INFO Enjoy your deployment! 2024-04-25 17:22:35,457 ERROR # Warning: 'vars' is deprecated. Please use 'replacements' instead. [EXPERIMENTAL] Run 'kustomize edit fix' to update your Kustomization automatically. 2024-04-25 17:22:35,457 ERROR # Warning: 'patchesJson6902' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. 2024-04-25 17:22:35,457 ERROR # Warning: 'patchesStrategicMerge' is deprecated. Please use 'patches' instead. Run 'kustomize edit fix' to update your Kustomization automatically. 2024-04-25 17:22:35,457 INFO Setting context for components to: gke_engineeringpit_us-east1-d_xlou-cdm 2024-04-25 17:22:35,458 INFO 2024-04-25 17:22:35,458 INFO **************************** Initializing component pods for DS-CTS **************************** 2024-04-25 17:22:35,458 INFO 2024-04-25 17:22:35,458 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:22:35,458 INFO 2024-04-25 17:22:35,458 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-cts --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:22:35,458 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:35,843 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:35,843 DEBUG --- stdout --- 2024-04-25 17:22:35,843 DEBUG 3 2024-04-25 17:22:35,843 DEBUG --- stderr --- 2024-04-25 17:22:35,843 DEBUG 2024-04-25 17:22:35,843 INFO 2024-04-25 17:22:35,843 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:22:35,843 INFO 2024-04-25 17:22:35,844 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=ds-cts --output jsonpath={.items[*].metadata.name}` | grep 3 2024-04-25 17:22:35,844 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:22:36,282 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-25 17:22:36,283 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:36,283 DEBUG --- stdout --- 2024-04-25 17:22:36,283 DEBUG ds-cts-0 ds-cts-1 ds-cts-2 2024-04-25 17:22:36,283 DEBUG --- stderr --- 2024-04-25 17:22:36,283 DEBUG 2024-04-25 17:22:36,283 INFO 2024-04-25 17:22:36,283 INFO -------------------- Check pod ds-cts-0 is running -------------------- 2024-04-25 17:22:36,283 INFO 2024-04-25 17:22:36,283 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-0 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:36,283 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:36,638 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:36,638 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:36,638 DEBUG --- stdout --- 2024-04-25 17:22:36,638 DEBUG Running 2024-04-25 17:22:36,638 DEBUG --- stderr --- 2024-04-25 17:22:36,638 DEBUG 2024-04-25 17:22:36,639 INFO 2024-04-25 17:22:36,639 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-0 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:36,639 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:37,000 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:37,000 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:37,000 DEBUG --- stdout --- 2024-04-25 17:22:37,000 DEBUG true 2024-04-25 17:22:37,000 DEBUG --- stderr --- 2024-04-25 17:22:37,000 DEBUG 2024-04-25 17:22:37,001 INFO 2024-04-25 17:22:37,001 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-0 --output jsonpath={.status.startTime} 2024-04-25 17:22:37,001 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:37,362 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:37,362 DEBUG --- stdout --- 2024-04-25 17:22:37,362 DEBUG 2024-04-25T17:19:27Z 2024-04-25 17:22:37,362 DEBUG --- stderr --- 2024-04-25 17:22:37,362 DEBUG 2024-04-25 17:22:37,363 INFO 2024-04-25 17:22:37,363 INFO ------------- Check pod ds-cts-0 filesystem is accessible ------------- 2024-04-25 17:22:38,193 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:38,193 INFO 2024-04-25 17:22:38,193 INFO ------------------ Check pod ds-cts-0 restart count ------------------ 2024-04-25 17:22:38,194 INFO 2024-04-25 17:22:38,194 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-0 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:38,194 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:38,546 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:38,548 DEBUG --- stdout --- 2024-04-25 17:22:38,548 DEBUG 0 2024-04-25 17:22:38,548 DEBUG --- stderr --- 2024-04-25 17:22:38,548 DEBUG 2024-04-25 17:22:38,548 INFO Pod ds-cts-0 has been restarted 0 times. 2024-04-25 17:22:38,548 INFO 2024-04-25 17:22:38,549 INFO -------------------- Check pod ds-cts-1 is running -------------------- 2024-04-25 17:22:38,549 INFO 2024-04-25 17:22:38,549 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-1 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:38,549 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:38,904 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:38,905 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:38,905 DEBUG --- stdout --- 2024-04-25 17:22:38,905 DEBUG Running 2024-04-25 17:22:38,905 DEBUG --- stderr --- 2024-04-25 17:22:38,905 DEBUG 2024-04-25 17:22:38,905 INFO 2024-04-25 17:22:38,905 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-1 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:38,905 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:39,261 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:39,261 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:39,261 DEBUG --- stdout --- 2024-04-25 17:22:39,261 DEBUG true 2024-04-25 17:22:39,261 DEBUG --- stderr --- 2024-04-25 17:22:39,261 DEBUG 2024-04-25 17:22:39,261 INFO 2024-04-25 17:22:39,262 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-1 --output jsonpath={.status.startTime} 2024-04-25 17:22:39,262 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:39,626 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:39,626 DEBUG --- stdout --- 2024-04-25 17:22:39,626 DEBUG 2024-04-25T17:19:53Z 2024-04-25 17:22:39,626 DEBUG --- stderr --- 2024-04-25 17:22:39,626 DEBUG 2024-04-25 17:22:39,627 INFO 2024-04-25 17:22:39,627 INFO ------------- Check pod ds-cts-1 filesystem is accessible ------------- 2024-04-25 17:22:40,460 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:40,461 INFO 2024-04-25 17:22:40,461 INFO ------------------ Check pod ds-cts-1 restart count ------------------ 2024-04-25 17:22:40,461 INFO 2024-04-25 17:22:40,461 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-1 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:40,461 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:40,821 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:40,821 DEBUG --- stdout --- 2024-04-25 17:22:40,821 DEBUG 0 2024-04-25 17:22:40,821 DEBUG --- stderr --- 2024-04-25 17:22:40,821 DEBUG 2024-04-25 17:22:40,821 INFO Pod ds-cts-1 has been restarted 0 times. 2024-04-25 17:22:40,821 INFO 2024-04-25 17:22:40,821 INFO -------------------- Check pod ds-cts-2 is running -------------------- 2024-04-25 17:22:40,822 INFO 2024-04-25 17:22:40,822 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-2 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:40,822 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:41,180 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:41,180 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:41,180 DEBUG --- stdout --- 2024-04-25 17:22:41,180 DEBUG Running 2024-04-25 17:22:41,180 DEBUG --- stderr --- 2024-04-25 17:22:41,180 DEBUG 2024-04-25 17:22:41,181 INFO 2024-04-25 17:22:41,181 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-cts-2 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:41,181 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:41,536 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:41,537 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:41,537 DEBUG --- stdout --- 2024-04-25 17:22:41,537 DEBUG true 2024-04-25 17:22:41,537 DEBUG --- stderr --- 2024-04-25 17:22:41,537 DEBUG 2024-04-25 17:22:41,537 INFO 2024-04-25 17:22:41,537 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-2 --output jsonpath={.status.startTime} 2024-04-25 17:22:41,537 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:41,897 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:41,897 DEBUG --- stdout --- 2024-04-25 17:22:41,897 DEBUG 2024-04-25T17:20:20Z 2024-04-25 17:22:41,897 DEBUG --- stderr --- 2024-04-25 17:22:41,897 DEBUG 2024-04-25 17:22:41,898 INFO 2024-04-25 17:22:41,898 INFO ------------- Check pod ds-cts-2 filesystem is accessible ------------- 2024-04-25 17:22:42,720 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:42,720 INFO 2024-04-25 17:22:42,720 INFO ------------------ Check pod ds-cts-2 restart count ------------------ 2024-04-25 17:22:42,720 INFO 2024-04-25 17:22:42,720 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-cts-2 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:42,720 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:43,079 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:43,079 DEBUG --- stdout --- 2024-04-25 17:22:43,080 DEBUG 0 2024-04-25 17:22:43,080 DEBUG --- stderr --- 2024-04-25 17:22:43,080 DEBUG 2024-04-25 17:22:43,080 INFO Pod ds-cts-2 has been restarted 0 times. 2024-04-25 17:22:43,080 INFO 2024-04-25 17:22:43,080 INFO ************************** Initializing component pods for DS-IDREPO ************************** 2024-04-25 17:22:43,080 INFO 2024-04-25 17:22:43,080 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:22:43,081 INFO 2024-04-25 17:22:43,081 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-idrepo --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:22:43,081 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:43,447 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:43,447 DEBUG --- stdout --- 2024-04-25 17:22:43,447 DEBUG 3 2024-04-25 17:22:43,447 DEBUG --- stderr --- 2024-04-25 17:22:43,447 DEBUG 2024-04-25 17:22:43,447 INFO 2024-04-25 17:22:43,447 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:22:43,448 INFO 2024-04-25 17:22:43,448 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=ds-idrepo --output jsonpath={.items[*].metadata.name}` | grep 3 2024-04-25 17:22:43,448 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:22:43,883 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-25 17:22:43,884 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:43,884 DEBUG --- stdout --- 2024-04-25 17:22:43,884 DEBUG ds-idrepo-0 ds-idrepo-1 ds-idrepo-2 2024-04-25 17:22:43,884 DEBUG --- stderr --- 2024-04-25 17:22:43,884 DEBUG 2024-04-25 17:22:43,884 INFO 2024-04-25 17:22:43,884 INFO ------------------ Check pod ds-idrepo-0 is running ------------------ 2024-04-25 17:22:43,884 INFO 2024-04-25 17:22:43,884 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-0 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:43,884 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:44,248 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:44,248 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:44,248 DEBUG --- stdout --- 2024-04-25 17:22:44,248 DEBUG Running 2024-04-25 17:22:44,248 DEBUG --- stderr --- 2024-04-25 17:22:44,248 DEBUG 2024-04-25 17:22:44,248 INFO 2024-04-25 17:22:44,248 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-0 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:44,249 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:44,602 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:44,603 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:44,603 DEBUG --- stdout --- 2024-04-25 17:22:44,603 DEBUG true 2024-04-25 17:22:44,603 DEBUG --- stderr --- 2024-04-25 17:22:44,603 DEBUG 2024-04-25 17:22:44,603 INFO 2024-04-25 17:22:44,603 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-0 --output jsonpath={.status.startTime} 2024-04-25 17:22:44,603 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:44,960 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:44,961 DEBUG --- stdout --- 2024-04-25 17:22:44,961 DEBUG 2024-04-25T17:19:27Z 2024-04-25 17:22:44,961 DEBUG --- stderr --- 2024-04-25 17:22:44,961 DEBUG 2024-04-25 17:22:44,962 INFO 2024-04-25 17:22:44,962 INFO ----------- Check pod ds-idrepo-0 filesystem is accessible ----------- 2024-04-25 17:22:45,784 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:45,784 INFO 2024-04-25 17:22:45,784 INFO ----------------- Check pod ds-idrepo-0 restart count ----------------- 2024-04-25 17:22:45,785 INFO 2024-04-25 17:22:45,785 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-0 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:45,785 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:46,139 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:46,140 DEBUG --- stdout --- 2024-04-25 17:22:46,140 DEBUG 0 2024-04-25 17:22:46,140 DEBUG --- stderr --- 2024-04-25 17:22:46,140 DEBUG 2024-04-25 17:22:46,140 INFO Pod ds-idrepo-0 has been restarted 0 times. 2024-04-25 17:22:46,140 INFO 2024-04-25 17:22:46,140 INFO ------------------ Check pod ds-idrepo-1 is running ------------------ 2024-04-25 17:22:46,140 INFO 2024-04-25 17:22:46,140 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-1 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:46,140 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:46,500 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:46,501 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:46,501 DEBUG --- stdout --- 2024-04-25 17:22:46,501 DEBUG Running 2024-04-25 17:22:46,501 DEBUG --- stderr --- 2024-04-25 17:22:46,501 DEBUG 2024-04-25 17:22:46,501 INFO 2024-04-25 17:22:46,501 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-1 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:46,501 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:46,863 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:46,863 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:46,863 DEBUG --- stdout --- 2024-04-25 17:22:46,863 DEBUG true 2024-04-25 17:22:46,863 DEBUG --- stderr --- 2024-04-25 17:22:46,863 DEBUG 2024-04-25 17:22:46,864 INFO 2024-04-25 17:22:46,864 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-1 --output jsonpath={.status.startTime} 2024-04-25 17:22:46,864 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:47,224 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:47,225 DEBUG --- stdout --- 2024-04-25 17:22:47,225 DEBUG 2024-04-25T17:20:04Z 2024-04-25 17:22:47,225 DEBUG --- stderr --- 2024-04-25 17:22:47,225 DEBUG 2024-04-25 17:22:47,225 INFO 2024-04-25 17:22:47,226 INFO ----------- Check pod ds-idrepo-1 filesystem is accessible ----------- 2024-04-25 17:22:48,054 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:48,054 INFO 2024-04-25 17:22:48,054 INFO ----------------- Check pod ds-idrepo-1 restart count ----------------- 2024-04-25 17:22:48,054 INFO 2024-04-25 17:22:48,054 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-1 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:48,054 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:48,416 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:48,416 DEBUG --- stdout --- 2024-04-25 17:22:48,416 DEBUG 0 2024-04-25 17:22:48,416 DEBUG --- stderr --- 2024-04-25 17:22:48,416 DEBUG 2024-04-25 17:22:48,416 INFO Pod ds-idrepo-1 has been restarted 0 times. 2024-04-25 17:22:48,416 INFO 2024-04-25 17:22:48,416 INFO ------------------ Check pod ds-idrepo-2 is running ------------------ 2024-04-25 17:22:48,417 INFO 2024-04-25 17:22:48,417 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-2 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:48,417 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:48,779 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:48,779 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:48,779 DEBUG --- stdout --- 2024-04-25 17:22:48,780 DEBUG Running 2024-04-25 17:22:48,780 DEBUG --- stderr --- 2024-04-25 17:22:48,780 DEBUG 2024-04-25 17:22:48,780 INFO 2024-04-25 17:22:48,780 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods ds-idrepo-2 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:48,780 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:49,137 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:49,138 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:49,138 DEBUG --- stdout --- 2024-04-25 17:22:49,139 DEBUG true 2024-04-25 17:22:49,139 DEBUG --- stderr --- 2024-04-25 17:22:49,139 DEBUG 2024-04-25 17:22:49,139 INFO 2024-04-25 17:22:49,139 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-2 --output jsonpath={.status.startTime} 2024-04-25 17:22:49,139 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:49,495 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:49,495 DEBUG --- stdout --- 2024-04-25 17:22:49,495 DEBUG 2024-04-25T17:20:44Z 2024-04-25 17:22:49,495 DEBUG --- stderr --- 2024-04-25 17:22:49,495 DEBUG 2024-04-25 17:22:49,496 INFO 2024-04-25 17:22:49,496 INFO ----------- Check pod ds-idrepo-2 filesystem is accessible ----------- 2024-04-25 17:22:50,315 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:50,315 INFO 2024-04-25 17:22:50,315 INFO ----------------- Check pod ds-idrepo-2 restart count ----------------- 2024-04-25 17:22:50,316 INFO 2024-04-25 17:22:50,316 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod ds-idrepo-2 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:50,316 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:50,679 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:50,680 DEBUG --- stdout --- 2024-04-25 17:22:50,680 DEBUG 0 2024-04-25 17:22:50,680 DEBUG --- stderr --- 2024-04-25 17:22:50,680 DEBUG 2024-04-25 17:22:50,680 INFO Pod ds-idrepo-2 has been restarted 0 times. 2024-04-25 17:22:50,680 INFO 2024-04-25 17:22:50,680 INFO ****************************** Initializing component pods for AM ****************************** 2024-04-25 17:22:50,680 INFO 2024-04-25 17:22:50,680 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:22:50,680 INFO 2024-04-25 17:22:50,680 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app=am --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:22:50,680 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:51,053 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:51,054 DEBUG --- stdout --- 2024-04-25 17:22:51,054 DEBUG 3 2024-04-25 17:22:51,054 DEBUG --- stderr --- 2024-04-25 17:22:51,054 DEBUG 2024-04-25 17:22:51,054 INFO 2024-04-25 17:22:51,054 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:22:51,054 INFO 2024-04-25 17:22:51,054 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=am --output jsonpath={.items[*].metadata.name}` | grep 3 2024-04-25 17:22:51,054 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:22:51,491 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-25 17:22:51,491 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:51,491 DEBUG --- stdout --- 2024-04-25 17:22:51,491 DEBUG am-769b98f8d5-4ftrv am-769b98f8d5-phmxx am-769b98f8d5-zbtk2 2024-04-25 17:22:51,491 DEBUG --- stderr --- 2024-04-25 17:22:51,491 DEBUG 2024-04-25 17:22:51,492 INFO 2024-04-25 17:22:51,492 INFO -------------- Check pod am-769b98f8d5-4ftrv is running -------------- 2024-04-25 17:22:51,492 INFO 2024-04-25 17:22:51,492 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-769b98f8d5-4ftrv -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:51,492 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:51,874 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:51,874 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:51,874 DEBUG --- stdout --- 2024-04-25 17:22:51,874 DEBUG Running 2024-04-25 17:22:51,874 DEBUG --- stderr --- 2024-04-25 17:22:51,874 DEBUG 2024-04-25 17:22:51,874 INFO 2024-04-25 17:22:51,874 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-769b98f8d5-4ftrv -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:51,874 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:52,247 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:52,248 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:52,248 DEBUG --- stdout --- 2024-04-25 17:22:52,248 DEBUG true 2024-04-25 17:22:52,248 DEBUG --- stderr --- 2024-04-25 17:22:52,248 DEBUG 2024-04-25 17:22:52,248 INFO 2024-04-25 17:22:52,248 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-769b98f8d5-4ftrv --output jsonpath={.status.startTime} 2024-04-25 17:22:52,248 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:52,614 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:52,615 DEBUG --- stdout --- 2024-04-25 17:22:52,615 DEBUG 2024-04-25T17:21:25Z 2024-04-25 17:22:52,615 DEBUG --- stderr --- 2024-04-25 17:22:52,615 DEBUG 2024-04-25 17:22:52,616 INFO 2024-04-25 17:22:52,616 INFO ------- Check pod am-769b98f8d5-4ftrv filesystem is accessible ------- 2024-04-25 17:22:53,446 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:53,447 INFO 2024-04-25 17:22:53,447 INFO ------------- Check pod am-769b98f8d5-4ftrv restart count ------------- 2024-04-25 17:22:53,447 INFO 2024-04-25 17:22:53,447 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-769b98f8d5-4ftrv --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:53,447 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:53,802 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:53,802 DEBUG --- stdout --- 2024-04-25 17:22:53,802 DEBUG 0 2024-04-25 17:22:53,802 DEBUG --- stderr --- 2024-04-25 17:22:53,803 DEBUG 2024-04-25 17:22:53,803 INFO Pod am-769b98f8d5-4ftrv has been restarted 0 times. 2024-04-25 17:22:53,803 INFO 2024-04-25 17:22:53,803 INFO -------------- Check pod am-769b98f8d5-phmxx is running -------------- 2024-04-25 17:22:53,803 INFO 2024-04-25 17:22:53,803 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-769b98f8d5-phmxx -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:53,803 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:54,167 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:54,167 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:54,168 DEBUG --- stdout --- 2024-04-25 17:22:54,168 DEBUG Running 2024-04-25 17:22:54,168 DEBUG --- stderr --- 2024-04-25 17:22:54,169 DEBUG 2024-04-25 17:22:54,169 INFO 2024-04-25 17:22:54,169 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-769b98f8d5-phmxx -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:54,169 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:54,530 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:54,530 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:54,530 DEBUG --- stdout --- 2024-04-25 17:22:54,530 DEBUG true 2024-04-25 17:22:54,530 DEBUG --- stderr --- 2024-04-25 17:22:54,530 DEBUG 2024-04-25 17:22:54,530 INFO 2024-04-25 17:22:54,530 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-769b98f8d5-phmxx --output jsonpath={.status.startTime} 2024-04-25 17:22:54,530 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:54,887 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:54,887 DEBUG --- stdout --- 2024-04-25 17:22:54,887 DEBUG 2024-04-25T17:21:25Z 2024-04-25 17:22:54,887 DEBUG --- stderr --- 2024-04-25 17:22:54,887 DEBUG 2024-04-25 17:22:54,888 INFO 2024-04-25 17:22:54,888 INFO ------- Check pod am-769b98f8d5-phmxx filesystem is accessible ------- 2024-04-25 17:22:55,721 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:55,721 INFO 2024-04-25 17:22:55,721 INFO ------------- Check pod am-769b98f8d5-phmxx restart count ------------- 2024-04-25 17:22:55,721 INFO 2024-04-25 17:22:55,721 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-769b98f8d5-phmxx --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:55,721 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:56,075 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:56,075 DEBUG --- stdout --- 2024-04-25 17:22:56,075 DEBUG 0 2024-04-25 17:22:56,075 DEBUG --- stderr --- 2024-04-25 17:22:56,075 DEBUG 2024-04-25 17:22:56,075 INFO Pod am-769b98f8d5-phmxx has been restarted 0 times. 2024-04-25 17:22:56,075 INFO 2024-04-25 17:22:56,075 INFO -------------- Check pod am-769b98f8d5-zbtk2 is running -------------- 2024-04-25 17:22:56,076 INFO 2024-04-25 17:22:56,076 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-769b98f8d5-zbtk2 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:56,076 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:56,436 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:56,436 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:56,436 DEBUG --- stdout --- 2024-04-25 17:22:56,436 DEBUG Running 2024-04-25 17:22:56,436 DEBUG --- stderr --- 2024-04-25 17:22:56,436 DEBUG 2024-04-25 17:22:56,436 INFO 2024-04-25 17:22:56,436 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods am-769b98f8d5-zbtk2 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:56,437 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:56,801 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:56,801 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:56,801 DEBUG --- stdout --- 2024-04-25 17:22:56,801 DEBUG true 2024-04-25 17:22:56,801 DEBUG --- stderr --- 2024-04-25 17:22:56,801 DEBUG 2024-04-25 17:22:56,802 INFO 2024-04-25 17:22:56,802 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-769b98f8d5-zbtk2 --output jsonpath={.status.startTime} 2024-04-25 17:22:56,802 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:57,159 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:57,159 DEBUG --- stdout --- 2024-04-25 17:22:57,160 DEBUG 2024-04-25T17:21:25Z 2024-04-25 17:22:57,160 DEBUG --- stderr --- 2024-04-25 17:22:57,160 DEBUG 2024-04-25 17:22:57,160 INFO 2024-04-25 17:22:57,160 INFO ------- Check pod am-769b98f8d5-zbtk2 filesystem is accessible ------- 2024-04-25 17:22:57,976 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:57,976 INFO 2024-04-25 17:22:57,976 INFO ------------- Check pod am-769b98f8d5-zbtk2 restart count ------------- 2024-04-25 17:22:57,977 INFO 2024-04-25 17:22:57,977 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod am-769b98f8d5-zbtk2 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:22:57,977 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:58,335 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:58,335 DEBUG --- stdout --- 2024-04-25 17:22:58,335 DEBUG 0 2024-04-25 17:22:58,335 DEBUG --- stderr --- 2024-04-25 17:22:58,335 DEBUG 2024-04-25 17:22:58,335 INFO Pod am-769b98f8d5-zbtk2 has been restarted 0 times. 2024-04-25 17:22:58,335 INFO 2024-04-25 17:22:58,335 INFO **************************** Initializing component pods for AMSTER **************************** 2024-04-25 17:22:58,335 INFO 2024-04-25 17:22:58,335 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:22:58,336 INFO 2024-04-25 17:22:58,336 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm --field-selector status.phase!=Failed get pods --selector app=amster --output jsonpath={.items[*].metadata.name} 2024-04-25 17:22:58,336 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:22:58,696 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:58,696 DEBUG --- stdout --- 2024-04-25 17:22:58,696 DEBUG amster-glrw8 2024-04-25 17:22:58,696 DEBUG --- stderr --- 2024-04-25 17:22:58,696 DEBUG 2024-04-25 17:22:58,697 INFO 2024-04-25 17:22:58,697 INFO ***************************** Initializing component pods for IDM ***************************** 2024-04-25 17:22:58,697 INFO 2024-04-25 17:22:58,697 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:22:58,697 INFO 2024-04-25 17:22:58,697 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployment --selector app=idm --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:22:58,697 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:22:59,064 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:59,064 DEBUG --- stdout --- 2024-04-25 17:22:59,064 DEBUG 2 2024-04-25 17:22:59,064 DEBUG --- stderr --- 2024-04-25 17:22:59,064 DEBUG 2024-04-25 17:22:59,064 INFO 2024-04-25 17:22:59,064 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:22:59,065 INFO 2024-04-25 17:22:59,065 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=idm --output jsonpath={.items[*].metadata.name}` | grep 2 2024-04-25 17:22:59,065 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:22:59,437 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-25 17:22:59,437 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:59,438 DEBUG --- stdout --- 2024-04-25 17:22:59,438 DEBUG idm-6c95d7588f-lrdb9 idm-6c95d7588f-n2wtz 2024-04-25 17:22:59,438 DEBUG --- stderr --- 2024-04-25 17:22:59,438 DEBUG 2024-04-25 17:22:59,439 INFO 2024-04-25 17:22:59,439 INFO -------------- Check pod idm-6c95d7588f-lrdb9 is running -------------- 2024-04-25 17:22:59,439 INFO 2024-04-25 17:22:59,439 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods idm-6c95d7588f-lrdb9 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:22:59,439 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:22:59,797 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:22:59,797 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:22:59,797 DEBUG --- stdout --- 2024-04-25 17:22:59,797 DEBUG Running 2024-04-25 17:22:59,797 DEBUG --- stderr --- 2024-04-25 17:22:59,797 DEBUG 2024-04-25 17:22:59,798 INFO 2024-04-25 17:22:59,798 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods idm-6c95d7588f-lrdb9 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:22:59,798 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:00,151 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:00,151 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:00,151 DEBUG --- stdout --- 2024-04-25 17:23:00,151 DEBUG true 2024-04-25 17:23:00,151 DEBUG --- stderr --- 2024-04-25 17:23:00,151 DEBUG 2024-04-25 17:23:00,151 INFO 2024-04-25 17:23:00,151 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod idm-6c95d7588f-lrdb9 --output jsonpath={.status.startTime} 2024-04-25 17:23:00,151 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:00,507 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:00,507 DEBUG --- stdout --- 2024-04-25 17:23:00,507 DEBUG 2024-04-25T17:21:25Z 2024-04-25 17:23:00,507 DEBUG --- stderr --- 2024-04-25 17:23:00,508 DEBUG 2024-04-25 17:23:00,508 INFO 2024-04-25 17:23:00,508 INFO ------- Check pod idm-6c95d7588f-lrdb9 filesystem is accessible ------- 2024-04-25 17:23:01,330 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:01,331 INFO 2024-04-25 17:23:01,331 INFO ------------ Check pod idm-6c95d7588f-lrdb9 restart count ------------ 2024-04-25 17:23:01,331 INFO 2024-04-25 17:23:01,331 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod idm-6c95d7588f-lrdb9 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:23:01,331 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:01,704 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:01,704 DEBUG --- stdout --- 2024-04-25 17:23:01,705 DEBUG 0 2024-04-25 17:23:01,705 DEBUG --- stderr --- 2024-04-25 17:23:01,705 DEBUG 2024-04-25 17:23:01,705 INFO Pod idm-6c95d7588f-lrdb9 has been restarted 0 times. 2024-04-25 17:23:01,705 INFO 2024-04-25 17:23:01,705 INFO -------------- Check pod idm-6c95d7588f-n2wtz is running -------------- 2024-04-25 17:23:01,705 INFO 2024-04-25 17:23:01,705 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods idm-6c95d7588f-n2wtz -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:23:01,705 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:02,132 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:02,133 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:02,133 DEBUG --- stdout --- 2024-04-25 17:23:02,133 DEBUG Running 2024-04-25 17:23:02,133 DEBUG --- stderr --- 2024-04-25 17:23:02,133 DEBUG 2024-04-25 17:23:02,133 INFO 2024-04-25 17:23:02,133 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods idm-6c95d7588f-n2wtz -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:23:02,133 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:02,504 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:02,504 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:02,504 DEBUG --- stdout --- 2024-04-25 17:23:02,504 DEBUG true 2024-04-25 17:23:02,504 DEBUG --- stderr --- 2024-04-25 17:23:02,504 DEBUG 2024-04-25 17:23:02,505 INFO 2024-04-25 17:23:02,505 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod idm-6c95d7588f-n2wtz --output jsonpath={.status.startTime} 2024-04-25 17:23:02,505 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:02,876 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:02,876 DEBUG --- stdout --- 2024-04-25 17:23:02,876 DEBUG 2024-04-25T17:21:25Z 2024-04-25 17:23:02,877 DEBUG --- stderr --- 2024-04-25 17:23:02,877 DEBUG 2024-04-25 17:23:02,877 INFO 2024-04-25 17:23:02,877 INFO ------- Check pod idm-6c95d7588f-n2wtz filesystem is accessible ------- 2024-04-25 17:23:03,701 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:03,701 INFO 2024-04-25 17:23:03,701 INFO ------------ Check pod idm-6c95d7588f-n2wtz restart count ------------ 2024-04-25 17:23:03,702 INFO 2024-04-25 17:23:03,702 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod idm-6c95d7588f-n2wtz --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:23:03,702 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:04,059 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:04,059 DEBUG --- stdout --- 2024-04-25 17:23:04,059 DEBUG 0 2024-04-25 17:23:04,059 DEBUG --- stderr --- 2024-04-25 17:23:04,059 DEBUG 2024-04-25 17:23:04,059 INFO Pod idm-6c95d7588f-n2wtz has been restarted 0 times. 2024-04-25 17:23:04,059 INFO 2024-04-25 17:23:04,059 INFO ************************* Initializing component pods for END-USER-UI ************************* 2024-04-25 17:23:04,059 INFO 2024-04-25 17:23:04,059 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:04,060 INFO 2024-04-25 17:23:04,060 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:04,060 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:04,361 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:04,361 DEBUG --- stdout --- 2024-04-25 17:23:04,361 DEBUG 1 2024-04-25 17:23:04,361 DEBUG --- stderr --- 2024-04-25 17:23:04,362 DEBUG 2024-04-25 17:23:04,362 INFO 2024-04-25 17:23:04,362 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:04,362 INFO 2024-04-25 17:23:04,362 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-25 17:23:04,362 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:04,665 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-25 17:23:04,665 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:04,665 DEBUG --- stdout --- 2024-04-25 17:23:04,665 DEBUG end-user-ui-58878d7668-l6f8k 2024-04-25 17:23:04,665 DEBUG --- stderr --- 2024-04-25 17:23:04,665 DEBUG 2024-04-25 17:23:04,665 INFO 2024-04-25 17:23:04,666 INFO ---------- Check pod end-user-ui-58878d7668-l6f8k is running ---------- 2024-04-25 17:23:04,666 INFO 2024-04-25 17:23:04,666 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods end-user-ui-58878d7668-l6f8k -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:23:04,666 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:04,978 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:04,978 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:04,978 DEBUG --- stdout --- 2024-04-25 17:23:04,978 DEBUG Running 2024-04-25 17:23:04,978 DEBUG --- stderr --- 2024-04-25 17:23:04,978 DEBUG 2024-04-25 17:23:04,979 INFO 2024-04-25 17:23:04,979 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods end-user-ui-58878d7668-l6f8k -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:23:04,979 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:05,278 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:05,278 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:05,278 DEBUG --- stdout --- 2024-04-25 17:23:05,278 DEBUG true 2024-04-25 17:23:05,278 DEBUG --- stderr --- 2024-04-25 17:23:05,278 DEBUG 2024-04-25 17:23:05,278 INFO 2024-04-25 17:23:05,278 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod end-user-ui-58878d7668-l6f8k --output jsonpath={.status.startTime} 2024-04-25 17:23:05,278 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:05,571 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:05,571 DEBUG --- stdout --- 2024-04-25 17:23:05,572 DEBUG 2024-04-25T17:22:30Z 2024-04-25 17:23:05,572 DEBUG --- stderr --- 2024-04-25 17:23:05,572 DEBUG 2024-04-25 17:23:05,572 INFO 2024-04-25 17:23:05,572 INFO --- Check pod end-user-ui-58878d7668-l6f8k filesystem is accessible --- 2024-04-25 17:23:06,331 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:06,332 INFO 2024-04-25 17:23:06,332 INFO -------- Check pod end-user-ui-58878d7668-l6f8k restart count -------- 2024-04-25 17:23:06,332 INFO 2024-04-25 17:23:06,332 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod end-user-ui-58878d7668-l6f8k --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:23:06,332 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:06,628 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:06,628 DEBUG --- stdout --- 2024-04-25 17:23:06,628 DEBUG 0 2024-04-25 17:23:06,628 DEBUG --- stderr --- 2024-04-25 17:23:06,628 DEBUG 2024-04-25 17:23:06,628 INFO Pod end-user-ui-58878d7668-l6f8k has been restarted 0 times. 2024-04-25 17:23:06,628 INFO 2024-04-25 17:23:06,628 INFO *************************** Initializing component pods for LOGIN-UI *************************** 2024-04-25 17:23:06,628 INFO 2024-04-25 17:23:06,628 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:06,629 INFO 2024-04-25 17:23:06,629 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:06,629 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:06,927 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:06,927 DEBUG --- stdout --- 2024-04-25 17:23:06,927 DEBUG 1 2024-04-25 17:23:06,927 DEBUG --- stderr --- 2024-04-25 17:23:06,927 DEBUG 2024-04-25 17:23:06,927 INFO 2024-04-25 17:23:06,927 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:06,928 INFO 2024-04-25 17:23:06,928 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-25 17:23:06,928 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:07,228 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-25 17:23:07,229 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:07,229 DEBUG --- stdout --- 2024-04-25 17:23:07,229 DEBUG login-ui-5fdf49fc66-rzjdb 2024-04-25 17:23:07,229 DEBUG --- stderr --- 2024-04-25 17:23:07,229 DEBUG 2024-04-25 17:23:07,229 INFO 2024-04-25 17:23:07,229 INFO ----------- Check pod login-ui-5fdf49fc66-rzjdb is running ----------- 2024-04-25 17:23:07,229 INFO 2024-04-25 17:23:07,229 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods login-ui-5fdf49fc66-rzjdb -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:23:07,229 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:07,547 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:07,547 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:07,547 DEBUG --- stdout --- 2024-04-25 17:23:07,547 DEBUG Running 2024-04-25 17:23:07,547 DEBUG --- stderr --- 2024-04-25 17:23:07,547 DEBUG 2024-04-25 17:23:07,547 INFO 2024-04-25 17:23:07,547 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods login-ui-5fdf49fc66-rzjdb -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:23:07,547 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:07,845 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:07,845 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:07,845 DEBUG --- stdout --- 2024-04-25 17:23:07,846 DEBUG true 2024-04-25 17:23:07,846 DEBUG --- stderr --- 2024-04-25 17:23:07,846 DEBUG 2024-04-25 17:23:07,846 INFO 2024-04-25 17:23:07,846 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod login-ui-5fdf49fc66-rzjdb --output jsonpath={.status.startTime} 2024-04-25 17:23:07,846 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:08,144 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:08,145 DEBUG --- stdout --- 2024-04-25 17:23:08,145 DEBUG 2024-04-25T17:22:30Z 2024-04-25 17:23:08,145 DEBUG --- stderr --- 2024-04-25 17:23:08,145 DEBUG 2024-04-25 17:23:08,145 INFO 2024-04-25 17:23:08,146 INFO ---- Check pod login-ui-5fdf49fc66-rzjdb filesystem is accessible ---- 2024-04-25 17:23:08,902 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:08,903 INFO 2024-04-25 17:23:08,903 INFO ---------- Check pod login-ui-5fdf49fc66-rzjdb restart count ---------- 2024-04-25 17:23:08,903 INFO 2024-04-25 17:23:08,903 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod login-ui-5fdf49fc66-rzjdb --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:23:08,903 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:09,198 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:09,198 DEBUG --- stdout --- 2024-04-25 17:23:09,198 DEBUG 0 2024-04-25 17:23:09,198 DEBUG --- stderr --- 2024-04-25 17:23:09,198 DEBUG 2024-04-25 17:23:09,198 INFO Pod login-ui-5fdf49fc66-rzjdb has been restarted 0 times. 2024-04-25 17:23:09,199 INFO 2024-04-25 17:23:09,199 INFO *************************** Initializing component pods for ADMIN-UI *************************** 2024-04-25 17:23:09,199 INFO 2024-04-25 17:23:09,199 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:09,199 INFO 2024-04-25 17:23:09,199 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:09,199 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:09,497 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:09,497 DEBUG --- stdout --- 2024-04-25 17:23:09,497 DEBUG 1 2024-04-25 17:23:09,497 DEBUG --- stderr --- 2024-04-25 17:23:09,497 DEBUG 2024-04-25 17:23:09,497 INFO 2024-04-25 17:23:09,497 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:09,498 INFO 2024-04-25 17:23:09,498 INFO [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].metadata.name}` | grep 1 2024-04-25 17:23:09,498 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:09,802 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found 2024-04-25 17:23:09,803 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:09,803 DEBUG --- stdout --- 2024-04-25 17:23:09,803 DEBUG admin-ui-c4c7bf584-gwjx6 2024-04-25 17:23:09,803 DEBUG --- stderr --- 2024-04-25 17:23:09,804 DEBUG 2024-04-25 17:23:09,804 INFO 2024-04-25 17:23:09,804 INFO ------------ Check pod admin-ui-c4c7bf584-gwjx6 is running ------------ 2024-04-25 17:23:09,804 INFO 2024-04-25 17:23:09,804 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods admin-ui-c4c7bf584-gwjx6 -o=jsonpath={.status.phase} | grep "Running" 2024-04-25 17:23:09,804 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:10,123 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:10,123 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:10,123 DEBUG --- stdout --- 2024-04-25 17:23:10,123 DEBUG Running 2024-04-25 17:23:10,123 DEBUG --- stderr --- 2024-04-25 17:23:10,123 DEBUG 2024-04-25 17:23:10,123 INFO 2024-04-25 17:23:10,123 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods admin-ui-c4c7bf584-gwjx6 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" 2024-04-25 17:23:10,123 INFO [loop_until]: (max_time=360, interval=5, expected_rc=[0] 2024-04-25 17:23:10,419 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:10,419 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:10,419 DEBUG --- stdout --- 2024-04-25 17:23:10,419 DEBUG true 2024-04-25 17:23:10,419 DEBUG --- stderr --- 2024-04-25 17:23:10,419 DEBUG 2024-04-25 17:23:10,420 INFO 2024-04-25 17:23:10,420 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod admin-ui-c4c7bf584-gwjx6 --output jsonpath={.status.startTime} 2024-04-25 17:23:10,420 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:10,716 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:10,717 DEBUG --- stdout --- 2024-04-25 17:23:10,717 DEBUG 2024-04-25T17:22:29Z 2024-04-25 17:23:10,717 DEBUG --- stderr --- 2024-04-25 17:23:10,717 DEBUG 2024-04-25 17:23:10,717 INFO 2024-04-25 17:23:10,717 INFO ----- Check pod admin-ui-c4c7bf584-gwjx6 filesystem is accessible ----- 2024-04-25 17:23:11,475 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:11,475 INFO 2024-04-25 17:23:11,476 INFO ---------- Check pod admin-ui-c4c7bf584-gwjx6 restart count ---------- 2024-04-25 17:23:11,476 INFO 2024-04-25 17:23:11,476 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod admin-ui-c4c7bf584-gwjx6 --output jsonpath={.status.containerStatuses[*].restartCount} 2024-04-25 17:23:11,476 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:11,770 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:11,771 DEBUG --- stdout --- 2024-04-25 17:23:11,771 DEBUG 0 2024-04-25 17:23:11,771 DEBUG --- stderr --- 2024-04-25 17:23:11,771 DEBUG 2024-04-25 17:23:11,771 INFO Pod admin-ui-c4c7bf584-gwjx6 has been restarted 0 times. 2024-04-25 17:23:11,771 INFO 2024-04-25 17:23:11,771 INFO ***************************** Checking DS-CTS component is running ***************************** 2024-04-25 17:23:11,771 INFO 2024-04-25 17:23:11,771 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:11,771 INFO 2024-04-25 17:23:11,771 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-cts --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:11,771 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:12,139 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:12,140 DEBUG --- stdout --- 2024-04-25 17:23:12,140 DEBUG 3 2024-04-25 17:23:12,140 DEBUG --- stderr --- 2024-04-25 17:23:12,140 DEBUG 2024-04-25 17:23:12,140 INFO 2024-04-25 17:23:12,140 INFO -------------- Waiting for 3 expected pod(s) to be ready -------------- 2024-04-25 17:23:12,140 INFO 2024-04-25 17:23:12,140 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets ds-cts --output jsonpath="current:{.status.currentReplicas} ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "current:3 ready:3 replicas:3" 2024-04-25 17:23:12,140 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0] 2024-04-25 17:23:12,506 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:12,507 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:12,507 DEBUG --- stdout --- 2024-04-25 17:23:12,507 DEBUG current:3 ready:3 replicas:3 2024-04-25 17:23:12,507 DEBUG --- stderr --- 2024-04-25 17:23:12,507 DEBUG 2024-04-25 17:23:12,507 INFO 2024-04-25 17:23:12,507 INFO *************************** Checking DS-IDREPO component is running *************************** 2024-04-25 17:23:12,507 INFO 2024-04-25 17:23:12,507 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:12,507 INFO 2024-04-25 17:23:12,507 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-idrepo --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:12,507 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:12,932 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:12,932 DEBUG --- stdout --- 2024-04-25 17:23:12,932 DEBUG 3 2024-04-25 17:23:12,932 DEBUG --- stderr --- 2024-04-25 17:23:12,932 DEBUG 2024-04-25 17:23:12,932 INFO 2024-04-25 17:23:12,932 INFO -------------- Waiting for 3 expected pod(s) to be ready -------------- 2024-04-25 17:23:12,933 INFO 2024-04-25 17:23:12,933 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets ds-idrepo --output jsonpath="current:{.status.currentReplicas} ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "current:3 ready:3 replicas:3" 2024-04-25 17:23:12,933 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0] 2024-04-25 17:23:13,300 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:13,300 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:13,300 DEBUG --- stdout --- 2024-04-25 17:23:13,301 DEBUG current:3 ready:3 replicas:3 2024-04-25 17:23:13,301 DEBUG --- stderr --- 2024-04-25 17:23:13,301 DEBUG 2024-04-25 17:23:13,301 INFO 2024-04-25 17:23:13,301 INFO ******************************* Checking AM component is running ******************************* 2024-04-25 17:23:13,301 INFO 2024-04-25 17:23:13,301 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:13,301 INFO 2024-04-25 17:23:13,301 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app=am --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:13,301 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:13,671 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:13,671 DEBUG --- stdout --- 2024-04-25 17:23:13,671 DEBUG 3 2024-04-25 17:23:13,671 DEBUG --- stderr --- 2024-04-25 17:23:13,671 DEBUG 2024-04-25 17:23:13,672 INFO 2024-04-25 17:23:13,672 INFO -------------- Waiting for 3 expected pod(s) to be ready -------------- 2024-04-25 17:23:13,672 INFO 2024-04-25 17:23:13,672 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments am --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:3 replicas:3" 2024-04-25 17:23:13,672 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0] 2024-04-25 17:23:14,039 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:14,039 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:14,039 DEBUG --- stdout --- 2024-04-25 17:23:14,039 DEBUG ready:3 replicas:3 2024-04-25 17:23:14,039 DEBUG --- stderr --- 2024-04-25 17:23:14,039 DEBUG 2024-04-25 17:23:14,039 INFO 2024-04-25 17:23:14,039 INFO ***************************** Checking AMSTER component is running ***************************** 2024-04-25 17:23:14,039 INFO 2024-04-25 17:23:14,039 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:14,040 INFO 2024-04-25 17:23:14,040 INFO -------------- Waiting for 1 expected pod(s) to be ready -------------- 2024-04-25 17:23:14,040 INFO 2024-04-25 17:23:14,040 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get jobs amster --output jsonpath="{.status.succeeded}" | grep "1" 2024-04-25 17:23:14,040 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0] 2024-04-25 17:23:14,397 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:14,397 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:14,397 DEBUG --- stdout --- 2024-04-25 17:23:14,397 DEBUG 1 2024-04-25 17:23:14,397 DEBUG --- stderr --- 2024-04-25 17:23:14,397 DEBUG 2024-04-25 17:23:14,397 INFO 2024-04-25 17:23:14,397 INFO ****************************** Checking IDM component is running ****************************** 2024-04-25 17:23:14,397 INFO 2024-04-25 17:23:14,397 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:14,397 INFO 2024-04-25 17:23:14,397 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployment --selector app=idm --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:14,397 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:14,768 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:14,768 DEBUG --- stdout --- 2024-04-25 17:23:14,768 DEBUG 2 2024-04-25 17:23:14,768 DEBUG --- stderr --- 2024-04-25 17:23:14,768 DEBUG 2024-04-25 17:23:14,768 INFO 2024-04-25 17:23:14,768 INFO -------------- Waiting for 2 expected pod(s) to be ready -------------- 2024-04-25 17:23:14,768 INFO 2024-04-25 17:23:14,768 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployment idm --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:2 replicas:2" 2024-04-25 17:23:14,768 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0] 2024-04-25 17:23:15,128 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:15,129 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:15,130 DEBUG --- stdout --- 2024-04-25 17:23:15,130 DEBUG ready:2 replicas:2 2024-04-25 17:23:15,130 DEBUG --- stderr --- 2024-04-25 17:23:15,130 DEBUG 2024-04-25 17:23:15,130 INFO 2024-04-25 17:23:15,130 INFO ************************** Checking END-USER-UI component is running ************************** 2024-04-25 17:23:15,130 INFO 2024-04-25 17:23:15,130 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:15,130 INFO 2024-04-25 17:23:15,130 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:15,130 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:15,432 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:15,433 DEBUG --- stdout --- 2024-04-25 17:23:15,433 DEBUG 1 2024-04-25 17:23:15,433 DEBUG --- stderr --- 2024-04-25 17:23:15,433 DEBUG 2024-04-25 17:23:15,433 INFO 2024-04-25 17:23:15,433 INFO -------------- Waiting for 1 expected pod(s) to be ready -------------- 2024-04-25 17:23:15,433 INFO 2024-04-25 17:23:15,433 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments end-user-ui --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1" 2024-04-25 17:23:15,433 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0] 2024-04-25 17:23:15,729 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:15,729 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:15,729 DEBUG --- stdout --- 2024-04-25 17:23:15,729 DEBUG ready:1 replicas:1 2024-04-25 17:23:15,729 DEBUG --- stderr --- 2024-04-25 17:23:15,729 DEBUG 2024-04-25 17:23:15,730 INFO 2024-04-25 17:23:15,730 INFO **************************** Checking LOGIN-UI component is running **************************** 2024-04-25 17:23:15,730 INFO 2024-04-25 17:23:15,730 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:15,730 INFO 2024-04-25 17:23:15,730 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:15,730 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:16,036 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:16,036 DEBUG --- stdout --- 2024-04-25 17:23:16,036 DEBUG 1 2024-04-25 17:23:16,036 DEBUG --- stderr --- 2024-04-25 17:23:16,036 DEBUG 2024-04-25 17:23:16,037 INFO 2024-04-25 17:23:16,037 INFO -------------- Waiting for 1 expected pod(s) to be ready -------------- 2024-04-25 17:23:16,037 INFO 2024-04-25 17:23:16,037 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments login-ui --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1" 2024-04-25 17:23:16,037 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0] 2024-04-25 17:23:16,343 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:16,343 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:16,343 DEBUG --- stdout --- 2024-04-25 17:23:16,343 DEBUG ready:1 replicas:1 2024-04-25 17:23:16,343 DEBUG --- stderr --- 2024-04-25 17:23:16,343 DEBUG 2024-04-25 17:23:16,343 INFO 2024-04-25 17:23:16,343 INFO **************************** Checking ADMIN-UI component is running **************************** 2024-04-25 17:23:16,343 INFO 2024-04-25 17:23:16,343 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:16,344 INFO 2024-04-25 17:23:16,344 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:16,344 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:16,693 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:16,693 DEBUG --- stdout --- 2024-04-25 17:23:16,693 DEBUG 1 2024-04-25 17:23:16,693 DEBUG --- stderr --- 2024-04-25 17:23:16,693 DEBUG 2024-04-25 17:23:16,693 INFO 2024-04-25 17:23:16,694 INFO -------------- Waiting for 1 expected pod(s) to be ready -------------- 2024-04-25 17:23:16,694 INFO 2024-04-25 17:23:16,694 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments admin-ui --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1" 2024-04-25 17:23:16,694 INFO [loop_until]: (max_time=900, interval=30, expected_rc=[0] 2024-04-25 17:23:17,010 INFO [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found 2024-04-25 17:23:17,011 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:17,011 DEBUG --- stdout --- 2024-04-25 17:23:17,011 DEBUG ready:1 replicas:1 2024-04-25 17:23:17,011 DEBUG --- stderr --- 2024-04-25 17:23:17,011 DEBUG 2024-04-25 17:23:17,011 INFO 2024-04-25 17:23:17,011 INFO ****************************** Livecheck stage: After deployment ****************************** 2024-04-25 17:23:17,011 INFO 2024-04-25 17:23:17,011 INFO ---------------------- Running DS-CTS livecheck ---------------------- 2024-04-25 17:23:17,011 INFO Livecheck to ds-cts-0 2024-04-25 17:23:17,011 INFO 2024-04-25 17:23:17,012 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get secret **** --output jsonpath="{.data.dirmanager\.pw}" 2024-04-25 17:23:17,012 INFO [loop_until]: (max_time=60, interval=5, expected_rc=[0] 2024-04-25 17:23:17,320 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:17,320 DEBUG --- stdout --- 2024-04-25 17:23:17,320 DEBUG VGUzaHZHVktneVEzWTRtMGZiRzE2aEtremtyOUZNcnc= 2024-04-25 17:23:17,320 DEBUG --- stderr --- 2024-04-25 17:23:17,320 DEBUG 2024-04-25 17:23:17,320 INFO 2024-04-25 17:23:17,321 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive 2024-04-25 17:23:19,117 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:23:19,117 DEBUG --- stdout --- 2024-04-25 17:23:19,118 DEBUG dn: alive: true 2024-04-25 17:23:19,118 DEBUG --- stderr --- 2024-04-25 17:23:19,118 DEBUG 2024-04-25 17:23:19,118 INFO 2024-04-25 17:23:19,118 INFO Livecheck to ds-cts-1 2024-04-25 17:23:19,118 INFO 2024-04-25 17:23:19,118 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive 2024-04-25 17:23:20,873 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:23:20,873 DEBUG --- stdout --- 2024-04-25 17:23:20,874 DEBUG dn: alive: true 2024-04-25 17:23:20,874 DEBUG --- stderr --- 2024-04-25 17:23:20,874 DEBUG 2024-04-25 17:23:20,874 INFO 2024-04-25 17:23:20,874 INFO Livecheck to ds-cts-2 2024-04-25 17:23:20,874 INFO 2024-04-25 17:23:20,874 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive 2024-04-25 17:23:22,596 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:23:22,596 DEBUG --- stdout --- 2024-04-25 17:23:22,596 DEBUG dn: alive: true 2024-04-25 17:23:22,596 DEBUG --- stderr --- 2024-04-25 17:23:22,596 DEBUG 2024-04-25 17:23:22,596 INFO 2024-04-25 17:23:22,597 INFO 2024-04-25 17:23:22,597 INFO --------------------- Running DS-IDREPO livecheck --------------------- 2024-04-25 17:23:22,597 INFO Livecheck to ds-idrepo-0 2024-04-25 17:23:22,597 INFO 2024-04-25 17:23:22,597 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get secret **** --output jsonpath="{.data.dirmanager\.pw}" 2024-04-25 17:23:22,597 INFO [loop_until]: (max_time=60, interval=5, expected_rc=[0] 2024-04-25 17:23:22,959 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:22,959 DEBUG --- stdout --- 2024-04-25 17:23:22,959 DEBUG VGUzaHZHVktneVEzWTRtMGZiRzE2aEtremtyOUZNcnc= 2024-04-25 17:23:22,959 DEBUG --- stderr --- 2024-04-25 17:23:22,959 DEBUG 2024-04-25 17:23:22,959 INFO 2024-04-25 17:23:22,960 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-idrepo-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive 2024-04-25 17:23:24,756 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:23:24,756 DEBUG --- stdout --- 2024-04-25 17:23:24,756 DEBUG dn: alive: true 2024-04-25 17:23:24,757 DEBUG --- stderr --- 2024-04-25 17:23:24,757 DEBUG 2024-04-25 17:23:24,757 INFO 2024-04-25 17:23:24,757 INFO Livecheck to ds-idrepo-1 2024-04-25 17:23:24,757 INFO 2024-04-25 17:23:24,757 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-idrepo-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive 2024-04-25 17:23:26,696 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:23:26,696 DEBUG --- stdout --- 2024-04-25 17:23:26,696 DEBUG dn: alive: true 2024-04-25 17:23:26,696 DEBUG --- stderr --- 2024-04-25 17:23:26,696 DEBUG 2024-04-25 17:23:26,697 INFO 2024-04-25 17:23:26,697 INFO Livecheck to ds-idrepo-2 2024-04-25 17:23:26,697 INFO 2024-04-25 17:23:26,697 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-idrepo-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "" --searchScope base "(&)" alive 2024-04-25 17:23:28,521 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:23:28,522 DEBUG --- stdout --- 2024-04-25 17:23:28,522 DEBUG dn: alive: true 2024-04-25 17:23:28,522 DEBUG --- stderr --- 2024-04-25 17:23:28,522 DEBUG 2024-04-25 17:23:28,522 INFO 2024-04-25 17:23:28,522 INFO 2024-04-25 17:23:28,522 INFO ------------------------ Running AM livecheck ------------------------ 2024-04-25 17:23:28,522 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/health/ready 2024-04-25 17:23:28,523 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/health/ready" 2024-04-25 17:23:28,801 INFO [http_cmd]: http status code OK 2024-04-25 17:23:28,801 DEBUG --- status code --- 2024-04-25 17:23:28,801 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:28,801 DEBUG --- http response --- 2024-04-25 17:23:28,801 DEBUG 2024-04-25 17:23:28,802 INFO 2024-04-25 17:23:28,802 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get secret **** --output jsonpath="{.data.AM_PASSWORDS_AMADMIN_CLEAR}" 2024-04-25 17:23:28,802 INFO [loop_until]: (max_time=60, interval=5, expected_rc=[0] 2024-04-25 17:23:29,130 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:29,130 DEBUG --- stdout --- 2024-04-25 17:23:29,130 DEBUG dm5VTzJ1T3R6a200SmZ3OVpEdkRxYlZa 2024-04-25 17:23:29,130 DEBUG --- stderr --- 2024-04-25 17:23:29,130 DEBUG 2024-04-25 17:23:29,131 INFO Authenticate user amadmin via REST 2024-04-25 17:23:29,131 INFO [http_cmd]: curl -L --request POST "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/authenticate?realm=/" 2024-04-25 17:23:29,871 INFO [http_cmd]: http status code OK 2024-04-25 17:23:29,871 DEBUG --- status code --- 2024-04-25 17:23:29,871 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:29,871 DEBUG --- http response --- 2024-04-25 17:23:29,872 DEBUG { "tokenId": "gzfeD8V-FJSN_5vbkAosgvZuJcU.*AAJTSQACMDIAAlNLABxQK2ZwK1E0blcrUUM3NlowRjhOY0hOU2s4WEk9AAR0eXBlAANDVFMAAlMxAAIwMQ..*", "successUrl": "/am/console", "realm": "/" } 2024-04-25 17:23:29,875 INFO 2024-04-25 17:23:29,876 INFO ---------------------- Running AMSTER livecheck ---------------------- 2024-04-25 17:23:29,876 INFO 2024-04-25 17:23:29,876 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:29,876 INFO 2024-04-25 17:23:29,876 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm --field-selector status.phase!=Failed get pods --selector app=amster --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:29,876 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:30,251 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:30,251 DEBUG --- stdout --- 2024-04-25 17:23:30,251 DEBUG amster-glrw8 2024-04-25 17:23:30,251 DEBUG --- stderr --- 2024-04-25 17:23:30,251 DEBUG 2024-04-25 17:23:30,874 INFO Amster livecheck is passed 2024-04-25 17:23:30,875 INFO 2024-04-25 17:23:30,875 INFO ------------------------ Running IDM livecheck ------------------------ 2024-04-25 17:23:30,875 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/info/ping 2024-04-25 17:23:30,875 INFO 2024-04-25 17:23:30,875 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get secret **** --output jsonpath="{.data.OPENIDM_ADMIN_PASSWORD}" 2024-04-25 17:23:30,875 INFO [loop_until]: (max_time=60, interval=5, expected_rc=[0] 2024-04-25 17:23:31,195 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:31,196 DEBUG --- stdout --- 2024-04-25 17:23:31,196 DEBUG NW1KUHVCeTVTS1FBckJBV3N5ZUFGcDFs 2024-04-25 17:23:31,196 DEBUG --- stderr --- 2024-04-25 17:23:31,196 DEBUG 2024-04-25 17:23:31,196 INFO Set admin password: 5mJPuBy5SKQArBAWsyeAFp1l 2024-04-25 17:23:31,197 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/info/ping" 2024-04-25 17:23:31,419 INFO [http_cmd]: http status code OK 2024-04-25 17:23:31,419 DEBUG --- status code --- 2024-04-25 17:23:31,419 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:31,419 DEBUG --- http response --- 2024-04-25 17:23:31,419 DEBUG { "_id": "", "_rev": "", "shortDesc": "OpenIDM ready", "state": "ACTIVE_READY" } 2024-04-25 17:23:31,420 INFO Create new LoginSession for user "amadmin" 2024-04-25 17:23:31,420 INFO [LoginSession] Get "access_token" token for user "amadmin" 2024-04-25 17:23:31,420 INFO [LoginSession] Obtaining new "access_token" token from server because it was not obtained yet for the user 2024-04-25 17:23:31,420 INFO [LoginSession] Get "token_id" token for user "amadmin" 2024-04-25 17:23:31,420 INFO [LoginSession] Obtaining new "token_id" token from server because it was not obtained yet for the user 2024-04-25 17:23:31,420 INFO Authenticate user amadmin via REST 2024-04-25 17:23:31,420 INFO [http_cmd]: curl -L --request POST "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/authenticate?realm=/" 2024-04-25 17:23:31,717 INFO [http_cmd]: http status code OK 2024-04-25 17:23:31,718 DEBUG --- status code --- 2024-04-25 17:23:31,718 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:31,718 DEBUG --- http response --- 2024-04-25 17:23:31,719 DEBUG { "tokenId": "_wi-svFHfAlPepxky07g0inJgS8.*AAJTSQACMDIAAlNLABxKNkdVRGtSNmYxSDUwYzlNZlFNNDdtSSsyS3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*", "successUrl": "/am/console", "realm": "/" } 2024-04-25 17:23:31,719 INFO [LoginSession] Obtaining session info 2024-04-25 17:23:31,719 INFO [http_cmd]: curl -L --request POST "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/realms/root/sessions?_action=getSessionInfo" 2024-04-25 17:23:31,954 INFO [http_cmd]: http status code OK 2024-04-25 17:23:31,955 DEBUG --- status code --- 2024-04-25 17:23:31,955 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:31,955 DEBUG --- http response --- 2024-04-25 17:23:31,955 DEBUG { "username": "amadmin", "universalId": "id=amadmin,ou=user,ou=am-config", "realm": "/", "latestAccessTime": "2024-04-25T17:23:31Z", "maxIdleExpirationTime": "2024-04-25T17:26:31Z", "maxSessionExpirationTime": "2024-04-25T17:26:30Z", "properties": { "AMCtxId": "0fe231b0-7e3e-4f09-90b1-0be042b20466-133" } } 2024-04-25 17:23:31,959 INFO Obtain Oauth2 authz code via REST 2024-04-25 17:23:31,959 DEBUG Oauth2 authorize for access token 2024-04-25 17:23:31,959 INFO [http_cmd]: curl --request POST --cookie "amlbcookie=01" --cookie "iPlanetDirectoryPro=_wi-svFHfAlPepxky07g0inJgS8.*AAJTSQACMDIAAlNLABxKNkdVRGtSNmYxSDUwYzlNZlFNNDdtSSsyS3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "route=1714065812.596.9388.636255|f60edb382037eb2df1e800d563ad78a7" --data '{"decision": "Allow", "csrf": "_wi-svFHfAlPepxky07g0inJgS8.*AAJTSQACMDIAAlNLABxKNkdVRGtSNmYxSDUwYzlNZlFNNDdtSSsyS3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*"}' "https://xlou.iam.xlou-cdm.engineeringpit.com/am/oauth2/authorize?client_id=smokeclient&scope=fr:idm:*&redirect_uri=https://fake.com&response_type=code&realm=/" 2024-04-25 17:23:32,256 INFO [http_cmd]: http status code OK 2024-04-25 17:23:32,256 DEBUG --- status code --- 2024-04-25 17:23:32,256 DEBUG http status code is 302 (expected 302) 2024-04-25 17:23:32,256 DEBUG --- http response --- 2024-04-25 17:23:32,256 DEBUG {'Date': 'Thu, 25 Apr 2024 17:23:32 GMT', 'Content-Length': '0', 'Connection': 'keep-alive', 'X-Frame-Options': 'SAMEORIGIN', 'X-Content-Type-Options': 'nosniff', 'Cache-Control': 'no-store', 'Location': 'https://fake.com?code=oz6sC160eNyzufvAlp-lZGAdYPg&iss=https%3A%2F%2Fxlou.iam.xlou-cdm.engineeringpit.com%2Fam%2Foauth2&client_id=smokeclient', 'Pragma': 'no-cache', 'Set-Cookie': 'OAUTH_REQUEST_ATTRIBUTES=DELETED; Expires=Thu, 01 Jan 1970 00:00:00 GMT; Path=/; Secure; HttpOnly; SameSite=none', 'Strict-Transport-Security': 'max-age=15724800; includeSubDomains'} 2024-04-25 17:23:32,256 DEBUG Oauth2 exchange authorize code for access token 2024-04-25 17:23:32,256 INFO [http_cmd]: curl -L --request POST --data '{"grant_type": "authorization_code", "redirect_uri": "https://fake.com", "client_id": "smokeclient", "code": "oz6sC160eNyzufvAlp-lZGAdYPg"}' "https://xlou.iam.xlou-cdm.engineeringpit.com/am/oauth2/access_token?realm=/" 2024-04-25 17:23:32,557 INFO [http_cmd]: http status code OK 2024-04-25 17:23:32,558 DEBUG --- status code --- 2024-04-25 17:23:32,558 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:32,558 DEBUG --- http response --- 2024-04-25 17:23:32,558 DEBUG { "access_token": "tS2OTAXTi0UAOEc_g9j8Wex-PGA", "scope": "fr:idm:*", "token_type": "Bearer", "expires_in": 3599 } 2024-04-25 17:23:32,560 INFO Additional check to sync/queue to ensure sync with DS is ok (see LODESTAR-1245) 2024-04-25 17:23:32,561 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/sync/queue?_queryFilter=true&_pageSize=1" 2024-04-25 17:23:32,994 INFO [http_cmd]: http status code OK 2024-04-25 17:23:32,995 DEBUG --- status code --- 2024-04-25 17:23:32,995 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:32,995 DEBUG --- http response --- 2024-04-25 17:23:32,995 DEBUG { "result": [], "resultCount": 0, "pagedResultsCookie": null, "totalPagedResultsPolicy": "NONE", "totalPagedResults": -1, "remainingPagedResults": -1 } 2024-04-25 17:23:32,997 INFO Try to create, query and delete a user 2024-04-25 17:23:32,998 INFO Create user idm_bczxj00rtg in IDM 2024-04-25 17:23:32,998 INFO [http_cmd]: curl --header "Authorization: Bearer tS2OTAXTi0UAOEc_g9j8Wex-PGA" --header "Content-Type: application/json" --insecure -L --request POST --data '{"userName": "idm_bczxj00rtg", "givenName": "Peter", "sn": "Parker", "password": "T35tr0ck123", "telephoneNumber": "6669876987", "description": "IDM Test User", "roles": [], "mail": "idm_bczxj00rtg@forgerock.com"}' "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/managed/user?_action=create" 2024-04-25 17:23:33,410 INFO [http_cmd]: http status code OK 2024-04-25 17:23:33,411 DEBUG --- status code --- 2024-04-25 17:23:33,411 DEBUG http status code is 201 (expected [200, 201]) 2024-04-25 17:23:33,411 DEBUG --- http response --- 2024-04-25 17:23:33,411 DEBUG [print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (34 lines): 2024-04-25 17:23:33,411 DEBUG ----- output ----- 2024-04-25 17:23:33,411 DEBUG { 2024-04-25 17:23:33,411 DEBUG "_id": "2d9492bb-5c89-4740-b2f7-ec5b6616249f", 2024-04-25 17:23:33,411 DEBUG "_rev": "6f54a19c-d22f-42df-9991-6dcd72f78ec4-69", 2024-04-25 17:23:33,411 DEBUG "country": null, 2024-04-25 17:23:33,411 DEBUG "mail": "idm_bczxj00rtg@forgerock.com", 2024-04-25 17:23:33,411 DEBUG "memberOfOrgIDs": [], 2024-04-25 17:23:33,411 DEBUG "postalCode": null, 2024-04-25 17:23:33,411 DEBUG "profileImage": null, 2024-04-25 17:23:33,411 DEBUG "expireAccount": null, 2024-04-25 17:23:33,411 DEBUG "activeDate": null, 2024-04-25 17:23:33,411 DEBUG 2024-04-25 17:23:33,411 DEBUG 2024-04-25 17:23:33,411 DEBUG 2024-04-25 17:23:33,411 DEBUG [...] 2024-04-25 17:23:33,411 DEBUG 2024-04-25 17:23:33,411 DEBUG 2024-04-25 17:23:33,412 DEBUG 2024-04-25 17:23:33,412 DEBUG "aliasList": [], 2024-04-25 17:23:33,412 DEBUG "kbaInfo": [], 2024-04-25 17:23:33,412 DEBUG "inactiveDate": null, 2024-04-25 17:23:33,412 DEBUG "sn": "Parker", 2024-04-25 17:23:33,412 DEBUG "preferences": null, 2024-04-25 17:23:33,412 DEBUG "userName": "idm_bczxj00rtg", 2024-04-25 17:23:33,412 DEBUG "passwordLastChangedTime": "2024-04-25T17:23:33.238Z", 2024-04-25 17:23:33,412 DEBUG "effectiveRoles": [], 2024-04-25 17:23:33,412 DEBUG "activateAccount": null 2024-04-25 17:23:33,412 DEBUG } 2024-04-25 17:23:33,412 INFO Query IDM to verify UserID 2d9492bb-5c89-4740-b2f7-ec5b6616249f is visible 2024-04-25 17:23:33,412 INFO [http_cmd]: curl --insecure -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/managed/user/2d9492bb-5c89-4740-b2f7-ec5b6616249f" 2024-04-25 17:23:33,632 INFO [http_cmd]: http status code OK 2024-04-25 17:23:33,632 DEBUG --- status code --- 2024-04-25 17:23:33,632 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:33,632 DEBUG --- http response --- 2024-04-25 17:23:33,632 DEBUG [print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (34 lines): 2024-04-25 17:23:33,632 DEBUG ----- output ----- 2024-04-25 17:23:33,632 DEBUG { 2024-04-25 17:23:33,632 DEBUG "_id": "2d9492bb-5c89-4740-b2f7-ec5b6616249f", 2024-04-25 17:23:33,633 DEBUG "_rev": "6f54a19c-d22f-42df-9991-6dcd72f78ec4-69", 2024-04-25 17:23:33,633 DEBUG "country": null, 2024-04-25 17:23:33,633 DEBUG "mail": "idm_bczxj00rtg@forgerock.com", 2024-04-25 17:23:33,633 DEBUG "memberOfOrgIDs": [], 2024-04-25 17:23:33,633 DEBUG "postalCode": null, 2024-04-25 17:23:33,633 DEBUG "profileImage": null, 2024-04-25 17:23:33,633 DEBUG "expireAccount": null, 2024-04-25 17:23:33,633 DEBUG "activeDate": null, 2024-04-25 17:23:33,633 DEBUG 2024-04-25 17:23:33,633 DEBUG 2024-04-25 17:23:33,633 DEBUG 2024-04-25 17:23:33,633 DEBUG [...] 2024-04-25 17:23:33,633 DEBUG 2024-04-25 17:23:33,633 DEBUG 2024-04-25 17:23:33,633 DEBUG 2024-04-25 17:23:33,633 DEBUG "aliasList": [], 2024-04-25 17:23:33,633 DEBUG "kbaInfo": [], 2024-04-25 17:23:33,633 DEBUG "inactiveDate": null, 2024-04-25 17:23:33,633 DEBUG "sn": "Parker", 2024-04-25 17:23:33,633 DEBUG "preferences": null, 2024-04-25 17:23:33,633 DEBUG "userName": "idm_bczxj00rtg", 2024-04-25 17:23:33,633 DEBUG "passwordLastChangedTime": "2024-04-25T17:23:33.238Z", 2024-04-25 17:23:33,633 DEBUG "effectiveRoles": [], 2024-04-25 17:23:33,633 DEBUG "activateAccount": null 2024-04-25 17:23:33,633 DEBUG } 2024-04-25 17:23:33,634 INFO Authenticate as user idm_bczxj00rtg 2024-04-25 17:23:33,634 INFO [http_cmd]: curl --insecure -L --request POST "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/authentication?_action=login" 2024-04-25 17:23:33,851 INFO [http_cmd]: http status code OK 2024-04-25 17:23:33,851 DEBUG --- status code --- 2024-04-25 17:23:33,851 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:33,852 DEBUG --- http response --- 2024-04-25 17:23:33,852 DEBUG { "_id": "login", "authorization": { "id": "anonymous", "roles": [ "internal/role/openidm-reg" ], "component": "internal/user" }, "authenticationId": "anonymous" } 2024-04-25 17:23:33,854 INFO [http_cmd]: curl --insecure -L --request DELETE "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/managed/user/2d9492bb-5c89-4740-b2f7-ec5b6616249f" 2024-04-25 17:23:34,227 INFO [http_cmd]: http status code OK 2024-04-25 17:23:34,227 DEBUG --- status code --- 2024-04-25 17:23:34,227 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:34,227 DEBUG --- http response --- 2024-04-25 17:23:34,227 DEBUG [print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (34 lines): 2024-04-25 17:23:34,227 DEBUG ----- output ----- 2024-04-25 17:23:34,227 DEBUG { 2024-04-25 17:23:34,227 DEBUG "_id": "2d9492bb-5c89-4740-b2f7-ec5b6616249f", 2024-04-25 17:23:34,227 DEBUG "_rev": "6f54a19c-d22f-42df-9991-6dcd72f78ec4-69", 2024-04-25 17:23:34,227 DEBUG "country": null, 2024-04-25 17:23:34,228 DEBUG "mail": "idm_bczxj00rtg@forgerock.com", 2024-04-25 17:23:34,228 DEBUG "memberOfOrgIDs": [], 2024-04-25 17:23:34,228 DEBUG "postalCode": null, 2024-04-25 17:23:34,228 DEBUG "profileImage": null, 2024-04-25 17:23:34,228 DEBUG "expireAccount": null, 2024-04-25 17:23:34,228 DEBUG "activeDate": null, 2024-04-25 17:23:34,228 DEBUG 2024-04-25 17:23:34,228 DEBUG 2024-04-25 17:23:34,228 DEBUG 2024-04-25 17:23:34,228 DEBUG [...] 2024-04-25 17:23:34,228 DEBUG 2024-04-25 17:23:34,228 DEBUG 2024-04-25 17:23:34,228 DEBUG 2024-04-25 17:23:34,228 DEBUG "aliasList": [], 2024-04-25 17:23:34,228 DEBUG "kbaInfo": [], 2024-04-25 17:23:34,228 DEBUG "inactiveDate": null, 2024-04-25 17:23:34,228 DEBUG "sn": "Parker", 2024-04-25 17:23:34,228 DEBUG "preferences": null, 2024-04-25 17:23:34,228 DEBUG "userName": "idm_bczxj00rtg", 2024-04-25 17:23:34,228 DEBUG "passwordLastChangedTime": "2024-04-25T17:23:33.238Z", 2024-04-25 17:23:34,228 DEBUG "effectiveRoles": [], 2024-04-25 17:23:34,228 DEBUG "activateAccount": null 2024-04-25 17:23:34,228 DEBUG } 2024-04-25 17:23:34,230 INFO 2024-04-25 17:23:34,230 INFO -------------------- Running END-USER-UI livecheck -------------------- 2024-04-25 17:23:34,231 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/enduser 2024-04-25 17:23:34,231 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/enduser" 2024-04-25 17:23:34,517 INFO [http_cmd]: http status code OK 2024-04-25 17:23:34,518 DEBUG --- status code --- 2024-04-25 17:23:34,518 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:34,518 DEBUG --- http response --- 2024-04-25 17:23:34,518 DEBUG Identity Management
[] 2024-04-25 17:23:34,521 INFO 2024-04-25 17:23:34,522 INFO --------------------- Running LOGIN-UI livecheck --------------------- 2024-04-25 17:23:34,522 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/am/XUI 2024-04-25 17:23:34,523 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/am/XUI" 2024-04-25 17:23:34,803 INFO [http_cmd]: http status code OK 2024-04-25 17:23:34,803 DEBUG --- status code --- 2024-04-25 17:23:34,803 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:34,803 DEBUG --- http response --- 2024-04-25 17:23:34,803 DEBUG Login
[] 2024-04-25 17:23:34,804 INFO 2024-04-25 17:23:34,805 INFO --------------------- Running ADMIN-UI livecheck --------------------- 2024-04-25 17:23:34,805 INFO Livecheck to https://xlou.iam.xlou-cdm.engineeringpit.com/platform 2024-04-25 17:23:34,805 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/platform" 2024-04-25 17:23:35,084 INFO [http_cmd]: http status code OK 2024-04-25 17:23:35,084 DEBUG --- status code --- 2024-04-25 17:23:35,084 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:35,084 DEBUG --- http response --- 2024-04-25 17:23:35,084 DEBUG Platform Admin
[] 2024-04-25 17:23:35,086 INFO LIVECHECK SUCCEEDED 2024-04-25 17:23:35,087 INFO 2024-04-25 17:23:35,087 INFO **************************** Initializing component pods for DS-CTS **************************** 2024-04-25 17:23:35,087 INFO 2024-04-25 17:23:35,087 INFO --------------------- Get DS-CTS software version --------------------- 2024-04-25 17:23:35,087 INFO 2024-04-25 17:23:35,087 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- find /opt/opendj -name opendj-core.jar 2024-04-25 17:23:35,087 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0] 2024-04-25 17:23:35,895 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:35,896 DEBUG --- stdout --- 2024-04-25 17:23:35,896 DEBUG /opt/opendj/lib/opendj-core.jar 2024-04-25 17:23:35,896 DEBUG --- stderr --- 2024-04-25 17:23:35,896 DEBUG 2024-04-25 17:23:35,896 INFO 2024-04-25 17:23:35,896 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp ds-cts-0:/opt/opendj/lib/opendj-core.jar /tmp/ds-cts_info/opendj-core.jar --container ds 2024-04-25 17:23:35,896 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:37,134 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:37,134 DEBUG --- stdout --- 2024-04-25 17:23:37,136 DEBUG tar: Removing leading `/' from member names 2024-04-25 17:23:37,136 DEBUG --- stderr --- 2024-04-25 17:23:37,136 DEBUG 2024-04-25 17:23:37,144 INFO 2024-04-25 17:23:37,144 INFO ************************** Initializing component pods for DS-IDREPO ************************** 2024-04-25 17:23:37,144 INFO 2024-04-25 17:23:37,144 INFO ------------------- Get DS-IDREPO software version ------------------- 2024-04-25 17:23:37,144 INFO 2024-04-25 17:23:37,144 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-idrepo-0 --container ds -- find /opt/opendj -name opendj-core.jar 2024-04-25 17:23:37,144 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0] 2024-04-25 17:23:37,941 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:37,941 DEBUG --- stdout --- 2024-04-25 17:23:37,941 DEBUG /opt/opendj/lib/opendj-core.jar 2024-04-25 17:23:37,941 DEBUG --- stderr --- 2024-04-25 17:23:37,941 DEBUG 2024-04-25 17:23:37,942 INFO 2024-04-25 17:23:37,942 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp ds-idrepo-0:/opt/opendj/lib/opendj-core.jar /tmp/ds-idrepo_info/opendj-core.jar --container ds 2024-04-25 17:23:37,942 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:39,172 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:39,172 DEBUG --- stdout --- 2024-04-25 17:23:39,172 DEBUG tar: Removing leading `/' from member names 2024-04-25 17:23:39,172 DEBUG --- stderr --- 2024-04-25 17:23:39,172 DEBUG 2024-04-25 17:23:39,180 INFO 2024-04-25 17:23:39,180 INFO ****************************** Initializing component pods for AM ****************************** 2024-04-25 17:23:39,180 INFO 2024-04-25 17:23:39,180 INFO ----------------------- Get AM software version ----------------------- 2024-04-25 17:23:39,180 INFO Getting product version from https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/serverinfo/version 2024-04-25 17:23:39,180 INFO [LoginSession] Get "token_id" token for user "amadmin" 2024-04-25 17:23:39,180 DEBUG [LoginSession] re-using "token_id" token that remains valid for 2m 41s 2024-04-25 17:23:39,181 INFO [http_cmd]: curl -L --request GET --cookie "amlbcookie=01" --cookie "iPlanetDirectoryPro=_wi-svFHfAlPepxky07g0inJgS8.*AAJTSQACMDIAAlNLABxKNkdVRGtSNmYxSDUwYzlNZlFNNDdtSSsyS3M9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "route=1714065812.596.9388.636255|f60edb382037eb2df1e800d563ad78a7" "https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/serverinfo/version" 2024-04-25 17:23:39,430 INFO [http_cmd]: http status code OK 2024-04-25 17:23:39,431 DEBUG --- status code --- 2024-04-25 17:23:39,431 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:39,431 DEBUG --- http response --- 2024-04-25 17:23:39,431 DEBUG { "_id": "version", "_rev": "-1467156544", "version": "7.6.0-SNAPSHOT", "fullVersion": "ForgeRock Access Management 7.6.0-SNAPSHOT Build 1ea0b707baef4b0816b74795e83665828894daed (2024-April-23 16:39)", "revision": "1ea0b707baef4b0816b74795e83665828894daed", "date": "2024-April-23 16:39" } 2024-04-25 17:23:39,434 INFO 2024-04-25 17:23:39,434 INFO **************************** Initializing component pods for AMSTER **************************** 2024-04-25 17:23:39,434 INFO 2024-04-25 17:23:39,434 INFO ***************************** Initializing component pods for IDM ***************************** 2024-04-25 17:23:39,434 INFO 2024-04-25 17:23:39,434 INFO ---------------------- Get IDM software version ---------------------- 2024-04-25 17:23:39,434 INFO Getting product version from https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/info/version 2024-04-25 17:23:39,435 INFO [http_cmd]: curl -L --request GET "https://xlou.iam.xlou-cdm.engineeringpit.com/openidm/info/version" 2024-04-25 17:23:39,654 INFO [http_cmd]: http status code OK 2024-04-25 17:23:39,655 DEBUG --- status code --- 2024-04-25 17:23:39,655 DEBUG http status code is 200 (expected 200) 2024-04-25 17:23:39,655 DEBUG --- http response --- 2024-04-25 17:23:39,655 DEBUG { "_id": "version", "productVersion": "7.6.0-SNAPSHOT", "productBuildDate": "20240422163948", "productRevision": "2167d67043" } 2024-04-25 17:23:39,658 INFO 2024-04-25 17:23:39,658 INFO ************************* Initializing component pods for END-USER-UI ************************* 2024-04-25 17:23:39,658 INFO 2024-04-25 17:23:39,658 INFO ------------------ Get END-USER-UI software version ------------------ 2024-04-25 17:23:39,659 INFO 2024-04-25 17:23:39,659 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec end-user-ui-58878d7668-l6f8k --container end-user-ui -- find /usr/share/nginx/html -name chunk-vendors.*.js 2024-04-25 17:23:39,659 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0] 2024-04-25 17:23:40,442 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:40,442 DEBUG --- stdout --- 2024-04-25 17:23:40,442 DEBUG /usr/share/nginx/html/js/chunk-vendors.0380a414.js 2024-04-25 17:23:40,443 DEBUG --- stderr --- 2024-04-25 17:23:40,443 DEBUG 2024-04-25 17:23:40,443 INFO 2024-04-25 17:23:40,443 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp end-user-ui-58878d7668-l6f8k:/usr/share/nginx/html/js/chunk-vendors.0380a414.js /tmp/end-user-ui_info/chunk-vendors.0380a414.js --container end-user-ui 2024-04-25 17:23:40,443 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:41,570 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:41,571 DEBUG --- stdout --- 2024-04-25 17:23:41,571 DEBUG tar: Removing leading `/' from member names 2024-04-25 17:23:41,571 DEBUG --- stderr --- 2024-04-25 17:23:41,571 DEBUG 2024-04-25 17:23:41,604 INFO 2024-04-25 17:23:41,604 INFO *************************** Initializing component pods for LOGIN-UI *************************** 2024-04-25 17:23:41,604 INFO 2024-04-25 17:23:41,604 INFO -------------------- Get LOGIN-UI software version -------------------- 2024-04-25 17:23:41,605 INFO 2024-04-25 17:23:41,605 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec login-ui-5fdf49fc66-rzjdb --container login-ui -- find /usr/share/nginx/html -name chunk-vendors.*.js 2024-04-25 17:23:41,605 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0] 2024-04-25 17:23:42,396 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:42,396 DEBUG --- stdout --- 2024-04-25 17:23:42,396 DEBUG /usr/share/nginx/html/js/chunk-vendors.f2fa5365.js 2024-04-25 17:23:42,396 DEBUG --- stderr --- 2024-04-25 17:23:42,396 DEBUG 2024-04-25 17:23:42,397 INFO 2024-04-25 17:23:42,397 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp login-ui-5fdf49fc66-rzjdb:/usr/share/nginx/html/js/chunk-vendors.f2fa5365.js /tmp/login-ui_info/chunk-vendors.f2fa5365.js --container login-ui 2024-04-25 17:23:42,397 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:43,524 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:43,525 DEBUG --- stdout --- 2024-04-25 17:23:43,525 DEBUG tar: Removing leading `/' from member names 2024-04-25 17:23:43,525 DEBUG --- stderr --- 2024-04-25 17:23:43,525 DEBUG 2024-04-25 17:23:43,543 INFO 2024-04-25 17:23:43,543 INFO *************************** Initializing component pods for ADMIN-UI *************************** 2024-04-25 17:23:43,543 INFO 2024-04-25 17:23:43,543 INFO -------------------- Get ADMIN-UI software version -------------------- 2024-04-25 17:23:43,543 INFO 2024-04-25 17:23:43,543 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec admin-ui-c4c7bf584-gwjx6 --container admin-ui -- find /usr/share/nginx/html -name chunk-vendors.*.js 2024-04-25 17:23:43,544 INFO [loop_until]: (max_time=30, interval=5, expected_rc=[0] 2024-04-25 17:23:44,379 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:44,379 DEBUG --- stdout --- 2024-04-25 17:23:44,379 DEBUG /usr/share/nginx/html/js/chunk-vendors.b3d879ac.js 2024-04-25 17:23:44,379 DEBUG --- stderr --- 2024-04-25 17:23:44,379 DEBUG 2024-04-25 17:23:44,380 INFO 2024-04-25 17:23:44,380 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp admin-ui-c4c7bf584-gwjx6:/usr/share/nginx/html/js/chunk-vendors.b3d879ac.js /tmp/admin-ui_info/chunk-vendors.b3d879ac.js --container admin-ui 2024-04-25 17:23:44,380 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:45,607 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:45,607 DEBUG --- stdout --- 2024-04-25 17:23:45,607 DEBUG tar: Removing leading `/' from member names 2024-04-25 17:23:45,607 DEBUG --- stderr --- 2024-04-25 17:23:45,607 DEBUG 2024-04-25 17:23:45,652 INFO 2024-04-25 17:23:45,652 INFO 2024-04-25 17:23:45,653 INFO ==================================================================================================== 2024-04-25 17:23:45,653 INFO ================ Admin password for DS-CTS is: Te3hvGVKgyQ3Y4m0fbG16hKkzkr9FMrw ================ 2024-04-25 17:23:45,653 INFO ==================================================================================================== 2024-04-25 17:23:45,653 INFO 2024-04-25 17:23:45,653 INFO ==================================================================================================== 2024-04-25 17:23:45,653 INFO ============== Admin password for DS-IDREPO is: Te3hvGVKgyQ3Y4m0fbG16hKkzkr9FMrw ============== 2024-04-25 17:23:45,653 INFO ==================================================================================================== 2024-04-25 17:23:45,653 INFO 2024-04-25 17:23:45,653 INFO ==================================================================================================== 2024-04-25 17:23:45,653 INFO ====================== Admin password for AM is: vnUO2uOtzkm4Jfw9ZDvDqbVZ ====================== 2024-04-25 17:23:45,653 INFO ==================================================================================================== 2024-04-25 17:23:45,653 INFO 2024-04-25 17:23:45,653 INFO ==================================================================================================== 2024-04-25 17:23:45,653 INFO ===================== Admin password for IDM is: 5mJPuBy5SKQArBAWsyeAFp1l ===================== 2024-04-25 17:23:45,653 INFO ==================================================================================================== 2024-04-25 17:23:45,653 INFO 2024-04-25 17:23:45,653 INFO *************************************** Dumping pod list *************************************** 2024-04-25 17:23:45,653 INFO Dumping pod list to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/_pod-list.txt 2024-04-25 17:23:46,148 INFO Dumping platform-config configmap to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/_platform-config_configmap.txt 2024-04-25 17:23:46,469 INFO 2024-04-25 17:23:46,469 INFO **************************** Initializing component pods for DS-CTS **************************** 2024-04-25 17:23:46,469 INFO 2024-04-25 17:23:46,469 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:46,470 INFO 2024-04-25 17:23:46,470 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-cts --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:46,470 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:46,836 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:46,836 DEBUG --- stdout --- 2024-04-25 17:23:46,836 DEBUG 3 2024-04-25 17:23:46,836 DEBUG --- stderr --- 2024-04-25 17:23:46,836 DEBUG 2024-04-25 17:23:46,836 INFO 2024-04-25 17:23:46,836 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:46,837 INFO 2024-04-25 17:23:46,837 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=ds-cts --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:46,837 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:47,274 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:47,275 DEBUG --- stdout --- 2024-04-25 17:23:47,275 DEBUG ds-cts-0 ds-cts-1 ds-cts-2 2024-04-25 17:23:47,275 DEBUG --- stderr --- 2024-04-25 17:23:47,275 DEBUG 2024-04-25 17:23:47,275 INFO 2024-04-25 17:23:47,275 INFO ************************** Initializing component pods for DS-IDREPO ************************** 2024-04-25 17:23:47,275 INFO 2024-04-25 17:23:47,275 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:47,275 INFO 2024-04-25 17:23:47,275 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get statefulsets --selector app=ds-idrepo --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:47,275 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:47,645 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:47,645 DEBUG --- stdout --- 2024-04-25 17:23:47,645 DEBUG 3 2024-04-25 17:23:47,645 DEBUG --- stderr --- 2024-04-25 17:23:47,646 DEBUG 2024-04-25 17:23:47,646 INFO 2024-04-25 17:23:47,646 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:47,646 INFO 2024-04-25 17:23:47,646 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=ds-idrepo --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:47,646 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:48,075 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:48,075 DEBUG --- stdout --- 2024-04-25 17:23:48,075 DEBUG ds-idrepo-0 ds-idrepo-1 ds-idrepo-2 2024-04-25 17:23:48,075 DEBUG --- stderr --- 2024-04-25 17:23:48,075 DEBUG 2024-04-25 17:23:48,075 INFO 2024-04-25 17:23:48,075 INFO ****************************** Initializing component pods for AM ****************************** 2024-04-25 17:23:48,075 INFO 2024-04-25 17:23:48,076 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:48,076 INFO 2024-04-25 17:23:48,076 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app=am --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:48,076 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:48,440 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:48,440 DEBUG --- stdout --- 2024-04-25 17:23:48,440 DEBUG 3 2024-04-25 17:23:48,440 DEBUG --- stderr --- 2024-04-25 17:23:48,440 DEBUG 2024-04-25 17:23:48,440 INFO 2024-04-25 17:23:48,440 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:48,441 INFO 2024-04-25 17:23:48,441 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=am --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:48,441 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:48,885 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:48,885 DEBUG --- stdout --- 2024-04-25 17:23:48,886 DEBUG am-769b98f8d5-4ftrv am-769b98f8d5-phmxx am-769b98f8d5-zbtk2 2024-04-25 17:23:48,886 DEBUG --- stderr --- 2024-04-25 17:23:48,886 DEBUG 2024-04-25 17:23:48,886 INFO 2024-04-25 17:23:48,886 INFO **************************** Initializing component pods for AMSTER **************************** 2024-04-25 17:23:48,886 INFO 2024-04-25 17:23:48,886 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:48,886 INFO 2024-04-25 17:23:48,886 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=amster --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:48,886 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:49,247 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:49,247 DEBUG --- stdout --- 2024-04-25 17:23:49,247 DEBUG amster-glrw8 2024-04-25 17:23:49,247 DEBUG --- stderr --- 2024-04-25 17:23:49,247 DEBUG 2024-04-25 17:23:49,247 INFO 2024-04-25 17:23:49,247 INFO ***************************** Initializing component pods for IDM ***************************** 2024-04-25 17:23:49,248 INFO 2024-04-25 17:23:49,248 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:49,248 INFO 2024-04-25 17:23:49,248 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployment --selector app=idm --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:49,248 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:49,609 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:49,609 DEBUG --- stdout --- 2024-04-25 17:23:49,609 DEBUG 2 2024-04-25 17:23:49,609 DEBUG --- stderr --- 2024-04-25 17:23:49,609 DEBUG 2024-04-25 17:23:49,609 INFO 2024-04-25 17:23:49,609 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:49,610 INFO 2024-04-25 17:23:49,610 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=idm --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:49,610 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:49,981 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:49,981 DEBUG --- stdout --- 2024-04-25 17:23:49,981 DEBUG idm-6c95d7588f-lrdb9 idm-6c95d7588f-n2wtz 2024-04-25 17:23:49,981 DEBUG --- stderr --- 2024-04-25 17:23:49,981 DEBUG 2024-04-25 17:23:49,982 INFO 2024-04-25 17:23:49,982 INFO ************************* Initializing component pods for END-USER-UI ************************* 2024-04-25 17:23:49,982 INFO 2024-04-25 17:23:49,982 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:49,982 INFO 2024-04-25 17:23:49,982 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:49,982 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:50,286 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:50,286 DEBUG --- stdout --- 2024-04-25 17:23:50,286 DEBUG 1 2024-04-25 17:23:50,287 DEBUG --- stderr --- 2024-04-25 17:23:50,287 DEBUG 2024-04-25 17:23:50,287 INFO 2024-04-25 17:23:50,287 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:50,287 INFO 2024-04-25 17:23:50,287 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=end-user-ui --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:50,287 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:50,588 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:50,588 DEBUG --- stdout --- 2024-04-25 17:23:50,588 DEBUG end-user-ui-58878d7668-l6f8k 2024-04-25 17:23:50,588 DEBUG --- stderr --- 2024-04-25 17:23:50,588 DEBUG 2024-04-25 17:23:50,589 INFO 2024-04-25 17:23:50,589 INFO *************************** Initializing component pods for LOGIN-UI *************************** 2024-04-25 17:23:50,589 INFO 2024-04-25 17:23:50,589 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:50,589 INFO 2024-04-25 17:23:50,589 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:50,589 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:50,889 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:50,889 DEBUG --- stdout --- 2024-04-25 17:23:50,889 DEBUG 1 2024-04-25 17:23:50,889 DEBUG --- stderr --- 2024-04-25 17:23:50,889 DEBUG 2024-04-25 17:23:50,889 INFO 2024-04-25 17:23:50,889 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:50,889 INFO 2024-04-25 17:23:50,889 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=login-ui --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:50,889 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:51,194 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:51,194 DEBUG --- stdout --- 2024-04-25 17:23:51,194 DEBUG login-ui-5fdf49fc66-rzjdb 2024-04-25 17:23:51,194 DEBUG --- stderr --- 2024-04-25 17:23:51,194 DEBUG 2024-04-25 17:23:51,195 INFO 2024-04-25 17:23:51,195 INFO *************************** Initializing component pods for ADMIN-UI *************************** 2024-04-25 17:23:51,195 INFO 2024-04-25 17:23:51,195 INFO --------------------- Get expected number of pods --------------------- 2024-04-25 17:23:51,195 INFO 2024-04-25 17:23:51,195 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].spec.replicas} 2024-04-25 17:23:51,195 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:23:51,497 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:51,497 DEBUG --- stdout --- 2024-04-25 17:23:51,497 DEBUG 1 2024-04-25 17:23:51,497 DEBUG --- stderr --- 2024-04-25 17:23:51,497 DEBUG 2024-04-25 17:23:51,497 INFO 2024-04-25 17:23:51,497 INFO ---------------------------- Get pod list ---------------------------- 2024-04-25 17:23:51,497 INFO 2024-04-25 17:23:51,497 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app.kubernetes.io/name=admin-ui --output jsonpath={.items[*].metadata.name} 2024-04-25 17:23:51,497 INFO [loop_until]: (max_time=180, interval=10, expected_rc=[0] 2024-04-25 17:23:51,799 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:23:51,799 DEBUG --- stdout --- 2024-04-25 17:23:51,799 DEBUG admin-ui-c4c7bf584-gwjx6 2024-04-25 17:23:51,799 DEBUG --- stderr --- 2024-04-25 17:23:51,799 DEBUG 2024-04-25 17:23:51,799 INFO 2024-04-25 17:23:51,799 INFO *********************************** Dumping components logs *********************************** 2024-04-25 17:23:51,799 INFO 2024-04-25 17:23:51,799 INFO ----------------------- Dumping logs for DS-CTS ----------------------- 2024-04-25 17:23:52,893 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-cts-0.txt 2024-04-25 17:23:52,895 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-cts-0.txt 2024-04-25 17:23:52,895 INFO Check pod logs for errors 2024-04-25 17:23:53,955 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-cts-1.txt 2024-04-25 17:23:53,955 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-cts-1.txt 2024-04-25 17:23:53,955 INFO Check pod logs for errors 2024-04-25 17:23:55,071 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-cts-2.txt 2024-04-25 17:23:55,072 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-cts-2.txt 2024-04-25 17:23:55,072 INFO Check pod logs for errors 2024-04-25 17:23:55,072 INFO 2024-04-25 17:23:55,072 INFO --------------------- Dumping logs for DS-IDREPO --------------------- 2024-04-25 17:23:56,193 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-idrepo-0.txt 2024-04-25 17:23:56,194 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-idrepo-0.txt 2024-04-25 17:23:56,194 INFO Check pod logs for errors 2024-04-25 17:23:57,263 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-idrepo-1.txt 2024-04-25 17:23:57,263 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-idrepo-1.txt 2024-04-25 17:23:57,264 INFO Check pod logs for errors 2024-04-25 17:23:58,323 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-idrepo-2.txt 2024-04-25 17:23:58,325 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/ds-idrepo-2.txt 2024-04-25 17:23:58,325 INFO Check pod logs for errors 2024-04-25 17:23:58,326 INFO 2024-04-25 17:23:58,326 INFO ------------------------- Dumping logs for AM ------------------------- 2024-04-25 17:23:59,651 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/am-769b98f8d5-4ftrv.txt 2024-04-25 17:23:59,652 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/am-769b98f8d5-4ftrv.txt 2024-04-25 17:23:59,653 INFO Check pod logs for errors 2024-04-25 17:24:00,903 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/am-769b98f8d5-phmxx.txt 2024-04-25 17:24:00,904 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/am-769b98f8d5-phmxx.txt 2024-04-25 17:24:00,904 INFO Check pod logs for errors 2024-04-25 17:24:02,229 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/am-769b98f8d5-zbtk2.txt 2024-04-25 17:24:02,229 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/am-769b98f8d5-zbtk2.txt 2024-04-25 17:24:02,230 INFO Check pod logs for errors 2024-04-25 17:24:02,230 INFO 2024-04-25 17:24:02,230 INFO ----------------------- Dumping logs for AMSTER ----------------------- 2024-04-25 17:24:03,329 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/amster-glrw8.txt 2024-04-25 17:24:03,331 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/amster-glrw8.txt 2024-04-25 17:24:03,331 INFO Check pod logs for errors 2024-04-25 17:24:03,331 INFO 2024-04-25 17:24:03,332 INFO ------------------------ Dumping logs for IDM ------------------------ 2024-04-25 17:24:04,641 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/idm-6c95d7588f-lrdb9.txt 2024-04-25 17:24:04,642 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/idm-6c95d7588f-lrdb9.txt 2024-04-25 17:24:04,643 INFO Check pod logs for errors 2024-04-25 17:24:06,086 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/idm-6c95d7588f-n2wtz.txt 2024-04-25 17:24:06,087 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/idm-6c95d7588f-n2wtz.txt 2024-04-25 17:24:06,088 INFO Check pod logs for errors 2024-04-25 17:24:06,089 INFO 2024-04-25 17:24:06,089 INFO -------------------- Dumping logs for END-USER-UI -------------------- 2024-04-25 17:24:06,947 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/end-user-ui-58878d7668-l6f8k.txt 2024-04-25 17:24:06,947 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/end-user-ui-58878d7668-l6f8k.txt 2024-04-25 17:24:06,948 INFO Check pod logs for errors 2024-04-25 17:24:06,948 INFO 2024-04-25 17:24:06,948 INFO ---------------------- Dumping logs for LOGIN-UI ---------------------- 2024-04-25 17:24:07,807 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/login-ui-5fdf49fc66-rzjdb.txt 2024-04-25 17:24:07,808 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/login-ui-5fdf49fc66-rzjdb.txt 2024-04-25 17:24:07,808 INFO Check pod logs for errors 2024-04-25 17:24:07,808 INFO 2024-04-25 17:24:07,808 INFO ---------------------- Dumping logs for ADMIN-UI ---------------------- 2024-04-25 17:24:08,772 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/admin-ui-c4c7bf584-gwjx6.txt 2024-04-25 17:24:08,772 INFO Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/authn_rest/pod-logs/stack/20240425_172345-after-deployment/admin-ui-c4c7bf584-gwjx6.txt 2024-04-25 17:24:08,773 INFO Check pod logs for errors [2024-04-25 17:24:08] - INFO: Deployment successful ________________________________________________________________________________ [2024-04-25 17:24:08] Deploy_all_forgerock_components post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped