--Task--
name: Deploy_Discover_IDC_tenant
enabled: True
class_name: DeployTenantTask
source_name: controller
source_namespace: >default<
target_name: controller
target_namespace: >default<
start: 0
stop: None
timeout: no timeout
loop: False
interval: None
dependencies: []
wait_for: []
options: {}
group_name: None
Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock
________________________________________________________________________________
[22/Sep/2023 03:43:00] Deploy_Discover_IDC_tenant pre : N/A
________________________________________________________________________________
________________________________________________________________________________
[22/Sep/2023 03:43:00] Deploy_Discover_IDC_tenant step1 : N/A
________________________________________________________________________________
******************************** Cleaning up existing namespace ********************************
------------------ Deleting secret agent controller ------------------
[loop_until]: kubectl --namespace=xlou delete sac --all
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
No resources found
--- stderr ---
----------------------- Deleting all resources -----------------------
[loop_until]: kubectl --namespace=xlou delete all --all --grace-period=0 --force
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
pod "overseer-0-7b587497bb-ft6j5" force deleted
service "overseer-0" force deleted
deployment.apps "overseer-0" force deleted
--- stderr ---
Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
[loop_until]: kubectl --namespace xlou get pods | grep "No resources found"
[loop_until]: (max_time=360, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 21s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 31s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 41s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
No resources found in xlou namespace.
------------------------- Deleting configmap -------------------------
[loop_until]: kubectl --namespace=xlou get configmap --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
kube-root-ca.crt overseer-config-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete configmap kube-root-ca.crt --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
configmap "kube-root-ca.crt" deleted
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete configmap overseer-config-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
configmap "overseer-config-0" deleted
--- stderr ---
--------------------------- Deleting secret ---------------------------
[loop_until]: kubectl --namespace=xlou get secret --output jsonpath='{.items[?(@.type=="Opaque")].metadata.name}'
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
-------------------------- Deleting ingress --------------------------
[loop_until]: kubectl --namespace=xlou get ingress --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete ingress overseer-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
ingress.networking.k8s.io "overseer-0" deleted
--- stderr ---
---------------------------- Deleting pvc ----------------------------
[loop_until]: kubectl --namespace=xlou get pvc --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete pvc overseer-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
persistentvolumeclaim "overseer-0" deleted
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete pv ds-backup-xlou --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
Warning: deleting cluster-scoped resources, not scoped to the provided namespace
----------------- Deleting admin clusterrolebindings -----------------
[loop_until]: kubectl get clusterrolebinding --output jsonpath="{range .items[?(@.subjects[0].namespace=='xlou')]}{.metadata.name} {end}"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
k8s-svc-acct-crb-xlou-0
--- stderr ---
Deleting clusterrolebinding k8s-svc-acct-crb-xlou-0 associated with xlou namespace
[loop_until]: kubectl delete clusterrolebinding k8s-svc-acct-crb-xlou-0
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
clusterrolebinding.rbac.authorization.k8s.io "k8s-svc-acct-crb-xlou-0" deleted
--- stderr ---
------------------------- Deleting namespace -------------------------
[loop_until]: kubectl delete namespaces xlou --ignore-not-found --grace-period=0 --force
[loop_until]: (max_time=360, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
namespace "xlou" force deleted
--- stderr ---
Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl get namespace xlou --ignore-not-found` | grep 0
[loop_until]: (max_time=600, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
************************************* Creating deployment *************************************
Creating IDC type deployment for stack
****************************** Livecheck stage: After deployment ******************************
------------------------ Running AM livecheck ------------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/am/json/health/ready
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/health/ready"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
------------------------ Running IDM livecheck ------------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/ping
[http_cmd]: curl --header "X-OpenIDM-Username: anonymous" --header "X-OpenIDM-Password: ****" --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/ping"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "",
"_rev": "",
"shortDesc": "OpenIDM ready",
"state": "ACTIVE_READY"
}
---------------------- Running DS-CTS livecheck ----------------------
--------------------- Running DS-IDREPO livecheck ---------------------
--------------------- Running ADMIN-UI livecheck ---------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/platform
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/platform"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Platform Admin
[]
-------------------- Running END-USER-UI livecheck --------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/enduser
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/enduser"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Identity Management
[]
--------------------- Running LOGIN-UI livecheck ---------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/am/XUI
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/am/XUI"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Login
[]
LIVECHECK SUCCEEDED
****************************** Initializing component pods for AM ******************************
----------------------- Get AM software version -----------------------
Getting product version from https://openam-ema-perf-benchmark.forgeblocks.com/am/json/realms/alpha/serverinfo/version
Create new LoginSession for user "xiaosong.lou@forgerock.com"
[LoginSession] Get "token_id" token for user "xiaosong.lou@forgerock.com"
[LoginSession] Obtaining new "token_id" token from server because it was not obtained yet for the user
Authenticate user xiaosong.lou@forgerock.com via REST
[http_cmd]: curl --header "X-OpenAM-Username: xiaosong.lou@forgerock.com" --header "X-OpenAM-Password: ****" --header "Content-Type: application/json" --header "Accept-API-Version: resource=2.0, protocol=1.0" --insecure -L --request POST "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/authenticate?realm=/"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
[print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (83 lines):
----- output -----
{
"authId": "eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJvdGsiOiIzc2wzM2MxYzE0cmNuN2E1NmNoNmZobzEyYSIsInJlYWxtIjoiLyIsInNlc3Npb25JZCI6IipBQUpUU1FBQ01ESUFCSFI1Y0dVQUNFcFhWRjlCVlZSSUFBSlRNUUFDTURFLipleUowZVhBaU9pSktWMVFpTENKamRIa2lPaUpLVjFRaUxDSmhiR2NpT2lKSVV6STFOaUo5LlpYbEtNR1ZZUVdsUGFVcExWakZSYVV4RFNteGliVTFwVDJsS1FrMVVTVFJSTUVwRVRGVm9WRTFxVlRKSmFYZHBXVmQ0YmtscWIybGFSMng1U1c0d0xpNDNOVnB5UzJ4c2NEVmlVa05tUTJSdlh6SnJhMmxuTGpkTlVIUlJPVkpQYkZCSFdHZHpaWFJxV0VkbVowZHdUV1Z1UTFGMVpIbFVVbE5UVG5SSmFXbFRUWEpUVTNaWUxWTkhieTB5V2twaE5GVlJSbmxSWjB0NFIzQTRZbWRrTVd4T1VWQlVXbmxWY1VKRU9YbENXVFJmVTNOZlVYbElSRlZhVlVWT1FWTkpjRTVKWDJOSWFEQTFNVFUxYnpSbFdHOURNRU13ZUUxcFJYcHdSelJVY0VWZlMwbEpiamxZVjFoWWIwZEZTMFZJUmpGaWJrWk1ZVEZsTUZwNU9EQm1kbTVJTjBSb1MyOUVSRUUyY0ZGeVZVbG5NR2g2ZERNMFVEWmhWVzE0U2tKM1ZXSlFNbWhUT0dSc09HVldORFF4YzJaSlVHUjVWbmh1ZWxkNmNIUXdlalZpUzB0aVlXWkplVmg0YXpaMVNUZEVjRE5sUWxvMk5WZHliRWxJUzBwT04xbFpVVzVuUld4cFNWUlZlRkZaWm14UE5XVnFUR2R2UVZrMWNtZFdjM2RqVDJvNWRsUlFNbXB5YUhCMlFVVTRiVU5UT1ZwdlVXbzVWVnBEY1Y5MlNVSkNURk5PWDFwYVFXVjFZVlV6VkZOdldtbDZXbU5EUmsxRVUwSnNhR3RFZGtaeVlURk5ZME5VTlVzMk1WUXpaMWRtUjBzdFltNUtNSE5aV1RSV2FXaFBUVkpVYzA0ME9IZHpSVFpZVFZObE1VOTVXRU5vYURSNVRIUkdaako2YkVWU2NFZDJNWE5yY2taRGMzSm5iVTl4ZFZJMlJVUlVaRUZSTjFsc1ZGSmpSR2d4VDJwbmEyVnRVMGRxUkU5eFVGcDRTRU41TFZWWlltUldkMEZ1WTNoVWVrbGtObmR3VFhkM2VYSTFNRUp5TmxGa1QybENkMUpITkd4Zk1GOXpka3BEY0ZwVWNtMUZVbmcyWjJablkzWlVWV05zVFdORlJrZ3dRekJ1ZUhkWFZGazBaVTAzVXkwMFZFRXhjRUp6UW1oSlZ6VmFaMFppZUV4MVpETnNkSGhFZUdKWlJEQjZVVkpQTVVJeU1VOVZNV1V6VWs1dFRqRklhVjgyVkZwSVgxbEpWMVZFZDFkZlJTMW5VRVJaUVRoR2N6bHFMVGd6VmxwaFgxVkJkVjlpZG05SlYwNW9PRVIxU3paWWVYRlhhelp6Wm5WbmJUaDVZMHhoWWtoSllXZFJSakExVmxweVdFcEdlRXhFVTBOaFZuSkpWazVxWDE5NVRuWmZiM0JUU21kYWREbDZTRXRFUjNOM2QwRmlkVjlmTlRSWGVVWmhSRmQwWlVOdFpFaEVMWFJ2VWxOR05tbFRORWQ0YzJSbE9GbGFhek5IV2t4dWNEa3lXVGRmYUhabFNHeEdSMmhTT0VJM1R6QnJWMVZ1U21rNGNWZE1OMFJDV1ZGb1RFRjBlbGxPY3pCTFZrUnhVRkZOTUVzMGRHeEdXRkJJZDBVMk9VNXhRMlYyT1U5U2NEQnBUMXBMTlcxUGJXMU1UV1UwWW5CclprUkVhVVpzWmtKVldVaEtkeloxYzI1c1VVbDBNMmw2Vm1KUVZrOVJObmxLU1cxRFZDMU5Oelp2WjNobGFVSXpiVFE0ZUdKVVZGZFRTRUpOUmtkQ1RrTm1aSEZQV2xrMk5sQjZRV2hsZFVac1owb3lZVUphUW1odFprWkxVbTB5YlhaQ1FUSkZXSFJ2ZWpGT1QyVm1VRVZtVVVaWk4xVlJXREF0ZW01SFRFdEZPRXRqTFdoTlRHb3daVFJQYXkxaU9YSmZkMEZvUTA5SGNIcHFTRzl2UjJFM1YweEdlR3RIVUhOTWFFdzRVRzFWTTB4RWIyZFlURWt4Y2twa1ZtVmFaMmRaWW1WalRuQTJaR1JyZWpOeWNIaENiRUkwVEhOVmVESlFXRnB4Wm5OeFYwRlpVR1Y2VW1sZlpuVk1NVVI1ZFZkVlZYaGlSVnB6TkU4ellYZGZlRTkyVVhGWFlYbHljVGRETm1ka2VTMUtTR3AxYzNSbFEyWnViWFZEZWxBNVJHSnpRamxJZDFWdFVqTXhWR2xXVFhNelFrNW1aMHRaYUVnelozaHZkV2hXZEV0b1JWTlVVRXBGTm1zeVVVRjFaazkxVGxCSWVsRTNTRXBXY2pFeVlrbDViSGxqVDNOVFZHZFVlSFZHVWxkNmRYZHFWVkl5VjAxQ1JVdDZVRUZJZEUxTE1sVlZWRTFHTUZWME9XOUpNMkl0TjNaVFIwRlpPQzA1UWpOR1VGTmFZaloyVURFeGNVMWxTMkpXVGtNM1JGaFlTVEZyWDJWc1ZWUlljSEJRYlVaSWJIUnNVVmM1UXpkWmNXZFBjbXhWWlROWWVVWkhZMGRGUzFsSGVtVjFkMHQ0ZUhwbWRHVlVWSGRPVURSdVExWmlUMGRKYUhKbWJVSmtMVVphZERaRFprSTBVbTQyT0ZZMFZVODBOM1ZrU1RKelpuVjRVV1UxVTJZMGQyazRZWHBvT0djMFdERmtXakZLZUc5SU0zaGxRa2RuVTNrMGVXc3dXVXMyTTFWUmMwUkhVSGhWUldOak56Vmxaalo2ZUROSU16ZEtZemhEWkVabVJtdFpNa3BEYVhWcE1WbzFabE4yWkVaVWIzTkhaMGRRTFRGME5rbERhVjk1ZHk1dlNITjZia0ZTU21wc09GSjJlaTFmWjBaNWJHMW4uTndkSy1BeEF1RXdFSzZydGhfOFUtSjJIdjlPeERoNVk1bmRqWWlFYmMzbyIsImV4cCI6MTY5NTQ0MDY0NiwiaWF0IjoxNjk1MzU0MjQ2fQ.Nbc9CGpvl6W3iMUHu7-7WwffyaLW_uz9dBhJ-wSPkFg",
"callbacks": [
{
"type": "TextOutputCallback",
"output": [
{
"name": "message",
"value": "Loading..."
},
[...]
"value": "var setupPage = function() { var skipInputElem = document.getElementById(\"skip-input-378\"); var messageElem; document.getElementsByClassName(\"callback-component\").forEach( function (e) { var m = e.firstElementChild; if (m.firstChild && m.firstChild.nodeName == \"#text\" && m.firstChild.nodeValue.trim() == \"Loading...\") { messageElem = m; } } ); if (!skipInputElem || !messageElem) { return setTimeout(setupPage, 50); } var skipContainer = document.createElement(\"div\"); skipContainer.style = \"width:100%\"; skipContainer.innerHTML = \"\"; skipInputElem.parentNode.append(skipContainer); messageElem.align = \"center\"; messageElem.innerHTML = \"
Set up 2-step verification
Protect your account by adding a second step after entering your password to verify it's you signing in.
Protect your account by adding a second step after entering your password to verify it's you signing in.
\"; var bindSkipLink = function() { document.getElementById(\"skip-link-378\").onclick = function() { skipInputElem.value = \"Skip\"; document.getElementById(\"loginButton_0\").click(); return false; }; }; setTimeout(bindSkipLink, 100);};setupPage();"}, {"name": "messageType", "value": "4"}]}]}' "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/authenticate?realm=/"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"tokenId": "wxyR8UshHiBmpYmVIXufINmQiXw.*AAJTSQACMDIAAlNLABxuai9yaEhDUVdqcG52MU1HTVpoeklsSFBkS3c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*",
"successUrl": "/platform",
"realm": "/"
}
[LoginSession] Obtaining session info
[http_cmd]: curl --header "0e26551c0104b88: wxyR8UshHiBmpYmVIXufINmQiXw.*AAJTSQACMDIAAlNLABxuai9yaEhDUVdqcG52MU1HTVpoeklsSFBkS3c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --header "Content-Type: application/json" --header "Accept-API-Version: resource=3.0, protocol=2.1" --header "filters_cookie: wxyR8UshHiBmpYmVIXufINmQiXw.*AAJTSQACMDIAAlNLABxuai9yaEhDUVdqcG52MU1HTVpoeklsSFBkS3c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --insecure -L --request POST "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/sessions?_action=getSessionInfo"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"username": "475bc36f-0d1a-4854-be5d-e7f7dc365e78",
"universalId": "id=475bc36f-0d1a-4854-be5d-e7f7dc365e78,ou=user,ou=am-config",
"realm": "/",
"latestAccessTime": "2023-09-22T03:44:07Z",
"maxIdleExpirationTime": "2023-09-22T04:14:07Z",
"maxSessionExpirationTime": "2023-09-22T05:44:06Z",
"properties": {
"AMCtxId": "7def4a90-3989-42e1-99f1-8e332c1a13fe-28454"
}
}
[http_cmd]: curl --insecure -L --request GET --cookie "0e26551c0104b88=wxyR8UshHiBmpYmVIXufINmQiXw.*AAJTSQACMDIAAlNLABxuai9yaEhDUVdqcG52MU1HTVpoeklsSFBkS3c9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "amlbcookie=01" "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/realms/alpha/serverinfo/version"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "version",
"_rev": "-1312479602",
"version": "7.4.0-SNAPSHOT",
"fullVersion": "ForgeRock Access Management 7.4.0-SNAPSHOT Build f0ebc03937c3fd68dc9406de0d5e516850463e04 (2023-September-07 10:30)",
"revision": "f0ebc03937c3fd68dc9406de0d5e516850463e04",
"date": "2023-September-07 10:30"
}
***************************** Initializing component pods for IDM *****************************
---------------------- Get IDM software version ----------------------
Getting product version from https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/version
[http_cmd]: curl --header "X-OpenIDM-Username: anonymous" --header "X-OpenIDM-Password: ****" --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/version"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "version",
"productVersion": "7.4.0-2023-5-0-SNAPSHOT",
"productBuildDate": "20230710182152",
"productRevision": "a58b3d0c3a"
}
**************************** Initializing component pods for DS-CTS ****************************
--------------------- Get DS-CTS software version ---------------------
Component ds-cts is not in Running state so impossible to get software version
************************** Initializing component pods for DS-IDREPO **************************
------------------- Get DS-IDREPO software version -------------------
Component ds-idrepo is not in Running state so impossible to get software version
*************************** Initializing component pods for ADMIN-UI ***************************
-------------------- Get ADMIN-UI software version --------------------
Component admin-ui is running in tenant so impossible to get software version
************************* Initializing component pods for END-USER-UI *************************
------------------ Get END-USER-UI software version ------------------
Component end-user-ui is running in tenant so impossible to get software version
*************************** Initializing component pods for LOGIN-UI ***************************
-------------------- Get LOGIN-UI software version --------------------
Component login-ui is running in tenant so impossible to get software version
[22/Sep/2023 03:44:07] - INFO: Deployment successful
________________________________________________________________________________
[22/Sep/2023 03:44:07] Deploy_Discover_IDC_tenant post : Post method
________________________________________________________________________________
Setting result to PASS
Task has been successfully stopped