--Task--
name: Deploy_Discover_IDC_tenant
enabled: True
class_name: DeployTenantTask
source_name: controller
source_namespace: >default<
target_name: controller
target_namespace: >default<
start: 0
stop: None
timeout: no timeout
loop: False
interval: None
dependencies: []
wait_for: []
options: {}
group_name: None
Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock
________________________________________________________________________________
[24/Sep/2023 23:04:11] Deploy_Discover_IDC_tenant pre : N/A
________________________________________________________________________________
________________________________________________________________________________
[24/Sep/2023 23:04:11] Deploy_Discover_IDC_tenant step1 : N/A
________________________________________________________________________________
******************************** Cleaning up existing namespace ********************************
------------------ Deleting secret agent controller ------------------
[loop_until]: kubectl --namespace=xlou delete sac --all
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
No resources found
--- stderr ---
----------------------- Deleting all resources -----------------------
[loop_until]: kubectl --namespace=xlou delete all --all --grace-period=0 --force
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
pod "overseer-0-bb64547c8-h4wt5" force deleted
service "overseer-0" force deleted
deployment.apps "overseer-0" force deleted
--- stderr ---
Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
[loop_until]: kubectl --namespace xlou get pods | grep "No resources found"
[loop_until]: (max_time=360, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 20s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 31s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 41s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
No resources found in xlou namespace.
------------------------- Deleting configmap -------------------------
[loop_until]: kubectl --namespace=xlou get configmap --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
kube-root-ca.crt overseer-config-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete configmap kube-root-ca.crt --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
configmap "kube-root-ca.crt" deleted
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete configmap overseer-config-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
configmap "overseer-config-0" deleted
--- stderr ---
--------------------------- Deleting secret ---------------------------
[loop_until]: kubectl --namespace=xlou get secret --output jsonpath='{.items[?(@.type=="Opaque")].metadata.name}'
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
-------------------------- Deleting ingress --------------------------
[loop_until]: kubectl --namespace=xlou get ingress --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete ingress overseer-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
ingress.networking.k8s.io "overseer-0" deleted
--- stderr ---
---------------------------- Deleting pvc ----------------------------
[loop_until]: kubectl --namespace=xlou get pvc --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete pvc overseer-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
persistentvolumeclaim "overseer-0" deleted
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete pv ds-backup-xlou --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
Warning: deleting cluster-scoped resources, not scoped to the provided namespace
----------------- Deleting admin clusterrolebindings -----------------
[loop_until]: kubectl get clusterrolebinding --output jsonpath="{range .items[?(@.subjects[0].namespace=='xlou')]}{.metadata.name} {end}"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
k8s-svc-acct-crb-xlou-0
--- stderr ---
Deleting clusterrolebinding k8s-svc-acct-crb-xlou-0 associated with xlou namespace
[loop_until]: kubectl delete clusterrolebinding k8s-svc-acct-crb-xlou-0
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
clusterrolebinding.rbac.authorization.k8s.io "k8s-svc-acct-crb-xlou-0" deleted
--- stderr ---
------------------------- Deleting namespace -------------------------
[loop_until]: kubectl delete namespaces xlou --ignore-not-found --grace-period=0 --force
[loop_until]: (max_time=360, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
namespace "xlou" force deleted
--- stderr ---
Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl get namespace xlou --ignore-not-found` | grep 0
[loop_until]: (max_time=600, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
************************************* Creating deployment *************************************
Creating IDC type deployment for stack
****************************** Livecheck stage: After deployment ******************************
------------------------ Running AM livecheck ------------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/am/json/health/ready
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/health/ready"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
------------------------ Running IDM livecheck ------------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/ping
[http_cmd]: curl --header "X-OpenIDM-Username: anonymous" --header "X-OpenIDM-Password: ****" --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/ping"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "",
"_rev": "",
"shortDesc": "OpenIDM ready",
"state": "ACTIVE_READY"
}
---------------------- Running DS-CTS livecheck ----------------------
--------------------- Running DS-IDREPO livecheck ---------------------
--------------------- Running ADMIN-UI livecheck ---------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/platform
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/platform"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Platform Admin
[]
-------------------- Running END-USER-UI livecheck --------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/enduser
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/enduser"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Identity Management
[]
--------------------- Running LOGIN-UI livecheck ---------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/am/XUI
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/am/XUI"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Login
[]
LIVECHECK SUCCEEDED
****************************** Initializing component pods for AM ******************************
----------------------- Get AM software version -----------------------
Getting product version from https://openam-ema-perf-benchmark.forgeblocks.com/am/json/realms/alpha/serverinfo/version
Create new LoginSession for user "xiaosong.lou@forgerock.com"
[LoginSession] Get "token_id" token for user "xiaosong.lou@forgerock.com"
[LoginSession] Obtaining new "token_id" token from server because it was not obtained yet for the user
Authenticate user xiaosong.lou@forgerock.com via REST
[http_cmd]: curl --header "X-OpenAM-Username: xiaosong.lou@forgerock.com" --header "X-OpenAM-Password: ****" --header "Content-Type: application/json" --header "Accept-API-Version: resource=2.0, protocol=1.0" --insecure -L --request POST "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/authenticate?realm=/"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
[print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (83 lines):
----- output -----
{
"authId": "eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJvdGsiOiIzMWZlb2VoOGI0Y3JoOTdoc3RrdG5hcDJtdiIsInJlYWxtIjoiLyIsInNlc3Npb25JZCI6IipBQUpUU1FBQ01ESUFCSFI1Y0dVQUNFcFhWRjlCVlZSSUFBSlRNUUFDTURFLipleUowZVhBaU9pSktWMVFpTENKamRIa2lPaUpLVjFRaUxDSmhiR2NpT2lKSVV6STFOaUo5LlpYbEtNR1ZZUVdsUGFVcExWakZSYVV4RFNteGliVTFwVDJsS1FrMVVTVFJSTUVwRVRGVm9WRTFxVlRKSmFYZHBXVmQ0YmtscWIybGFSMng1U1c0d0xpNVpUM1ZpY0RkV00wOHpOM2hMZVVWRk9VOTBaVkIzTG1scVNWUXRkRlZMWDE5eWRqYzJXVFJXZG1GWFUzcGxZMGR2TTNGMWIyWm5UMWROTFVKbGFTMUtSVjlIVW0xU1lWaDNaRlEwWTBoR1NVczNTWE5oZEhWNFZFOXJiemR5VlRJMFlYRTNZVTlZZFc5S1JEbGlaa0Y1ZEZOR2NWYzJNbVZXTmxCSlkxTjVXVkpqYUhacGVITjRlRU0wVGtWdWJFcHllbDlRVDB4YVJXbDJZbGwxY2pScWNURnFRMVp4TjNkWVNITmhRekJSTWxOTGNHaGxXRlZqUjJabFRDMU5WSGRHWVVrM2JrcHBNemMyY1cwMlozTkhjemRDYkZwbVVqRnBUMmRWWVRsSllXVlZZVTFCYjBaUlJIcGlkRWxQUVVsRlNXZFZMVU51Y25aTVUzTkNPSEZOUTFZMlpucGxPR2x3VjBGMlpFeFNVSGgyVUdRMFpYbDJiR2hZZVZKS1JYRnJkbVZ0ZDJwM1RXNVVlRFpMT1dkR1dsRkViVFpXVmtkdVVGUkhkRFZhZG5BNFJuVm1UVEZKWDIxRVpWUkJaRXMxVVdJNFFUTTNXVVJGWDBKT1dtVTNiV0puTm5WdU4ySktTMVp3YW14V1gyOXViRFEwVWt0UE5GRnFVRTh6ZHpWMVRtRnRWV0ZUUzIxU1NXTkpjVjh3ZWtoTk1HWmpRMjkyWlZCWE55MXZkVkZpTUZOeVQyUmxTM1J3WlhwbFVXWnJjbk5QVWtaR1VVVk9OM1ZIYjFoM2FuWkZSWGRrY21oWFQySm5Wa2hoTTNkNlNuaHpZWE5FY2tkdWJXSnBTMk55ZGxKdGRrMVhaRmczTXkxZmFFVktaVkJoTW5OSVUwZFpaWFpNVjI0dFNYSkdkMnhFUVZWeVFWTk1OMnhvVVdSWFdsZGZXV1IyUkdrNFpGWkZiVll5YVhabU5FZExaVVo0ZW1WNldYWjNaVUZyTWpSYWRESlJOakkxUldac1gxY3hUM1ZhVW04MGQxWkxjSFoyTUc1T2QyWTFRbEJJUkVGS2RuSkJYMFpqVW5CdVluSjVOM3BMUTBsdVFtc3lNVFJLTmxKMWMyRnRVWG8wWTFBelpUTXlWM2xLT0RWcU9YbEtSR3RaTlZsNWNUbDZPSEZWY2tsbmFtOTZWemxoVVVRd2FsUnVWVWg1V2xKR2RXUkZYMTh0WW5RM1UzWTRTM2xFYVZodmNYQlFTbGcwU1hWYVYwa3dlR1p4TmkxaWVsWlFhV05sV25oV1oyUjBYMGx0VERsb1JIbHZWVTlNTFcwd1NtaFhOMnBmY1ZZMWFsUnBVbWgyZGtReWMzRk5VbUpwWVhWclkySnlhamhTZGpKcU4yNUJXSE50VlZkeVpqZE1VV0ozWjBGM1drcFlMVU5FYTAxU1QxbE1kWEF3ZVU5Zk9IcGtSekZGZWxwQmVqQlFPR1ZhUlZGQ1dGOXdjelpDTWpSYWIzZGxXRFpvTm5OR1NsTlhTekJ5VFZaRmQxVXdNMEZGZWxwVWVXVnVWVEZYUVZObWMwUnFSV3h6YVhsU1JYTlZka1o1VjFWcVVFMXdOM2sxZUZsWFJrdFlOMTl1VW01blpVbFlaa05LZFhkMlJHVklWbUpJYlZWYU1VRklTRzFUWjE5R1NFUmtWRkpPVmpKR1JqRklhWFJFVjBWaWF6bFdjazFhWWtGUWNFdHdXbXN4VlVKeGNuSlRkVEpCT1hGRmRIbEphMDVpUW1WdlEydEZRVFZWWjBsR1FWZEtWMVpOTFhkUU0wcHdZbEV4UWxGTk9YVXRWVGQzVjAweUxYaEJaRlJ3UVZaWGRYUXRRbk55YUhCWVdUSkJNSEY0VURKSFNXeHRjMnRNVGtJeVNXNXVaakJuVGxFNGRXOUZablEyUVZwWE1tcHpMVFp5V2pWNVgzbzVVSFZQY0hKcFNVcHFZMUpOTVRBd2VIa3lOMVJNTUZsblJHbGZabGRyTUVKUVUwSnVkRUZtV1U5V1RrOVlNVXh4WjJSWFR6RXlXRzVtZW1WbGNrTnlZalkzWkZaUloyUXlVbGwxV0MxeldHOXFNalpsTjJKNlFtNU1PRzkxTjFrMlVUVjFlV3N6YVhOc1dWQlFabk50TW1SdlZUSkxjblpLZDAxZldEaHVhWFZFTUhCdldtMU9PRkJEVlZwTWFFMTNRMkpyZG14U1p6RXdZM0Y2TjFweFYyRnhkM0ZOUzNVeGVVSnFOM3BYV25KaFRrbFRNVVZhV0RSVFFtWlBUV2xJZFdWS1VrcDFXSHA1YjBsTGVVeDRNVXBMVjNsMlozSjJVV3hPV1ZaSWFtODJVRTlQUlVwYWNHSlFYekJIVVMxSVNtbFBTVUV0VFZacE9FSnpiak5qVUZWb2JXeFlZa013TkhkdVQwbFFlR2hPYlVaWVpUbHRkemRxWlVoUWVUUktXVkJtYlV0WmJGTjJZVXRQTTNGdWEzSnZiMjgxYkc5b2RXOVdMVTUxVWs1bmVWazVWVzFqVEUxRU16VTVURlJZVnpReVMzQmxObVZwWVdobWMwdGtVbGRIWW5wb1FtaDFaWEZsZG5ac1IzZDJhMFZxWWpreVVrMTVWbmhQYms1M1RVZzRUbE5qVHpoTVVrOUhRblJpU0ZVM05UWlFPRzFzZDNOcVEyOVlXRXRCVVM1S2FFSTBlbDltT1UxelRFeGtVWEZMUlRGYWMwdEIuN3BzRWlmcy11UkFUbEl5ajJQWDI3MUNmNkxkZ3o2d0ZpYmtvOWNOWVlLcyIsImV4cCI6MTY5NTY4MzEyMSwiaWF0IjoxNjk1NTk2NzIxfQ.Ozncza_jvjkO6LOMo0EDgLvijSKEaj8rUV6ERXZ0-qI",
"callbacks": [
{
"type": "TextOutputCallback",
"output": [
{
"name": "message",
"value": "Loading..."
},
[...]
"value": "var setupPage = function() { var skipInputElem = document.getElementById(\"skip-input-398\"); var messageElem; document.getElementsByClassName(\"callback-component\").forEach( function (e) { var m = e.firstElementChild; if (m.firstChild && m.firstChild.nodeName == \"#text\" && m.firstChild.nodeValue.trim() == \"Loading...\") { messageElem = m; } } ); if (!skipInputElem || !messageElem) { return setTimeout(setupPage, 50); } var skipContainer = document.createElement(\"div\"); skipContainer.style = \"width:100%\"; skipContainer.innerHTML = \"\"; skipInputElem.parentNode.append(skipContainer); messageElem.align = \"center\"; messageElem.innerHTML = \"
Set up 2-step verification
Protect your account by adding a second step after entering your password to verify it's you signing in.
Protect your account by adding a second step after entering your password to verify it's you signing in.
\"; var bindSkipLink = function() { document.getElementById(\"skip-link-398\").onclick = function() { skipInputElem.value = \"Skip\"; document.getElementById(\"loginButton_0\").click(); return false; }; }; setTimeout(bindSkipLink, 100);};setupPage();"}, {"name": "messageType", "value": "4"}]}]}' "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/authenticate?realm=/"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"tokenId": "73Bprekgm_DmyNiRinwT6XV9VKY.*AAJTSQACMDIAAlNLABxUMWNBOVdBdjRJTGNRNklYcTNDN1pZVzloeW89AAR0eXBlAANDVFMAAlMxAAIwMQ..*",
"successUrl": "/platform",
"realm": "/"
}
[LoginSession] Obtaining session info
[http_cmd]: curl --header "0e26551c0104b88: 73Bprekgm_DmyNiRinwT6XV9VKY.*AAJTSQACMDIAAlNLABxUMWNBOVdBdjRJTGNRNklYcTNDN1pZVzloeW89AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --header "Content-Type: application/json" --header "Accept-API-Version: resource=3.0, protocol=2.1" --header "filters_cookie: 73Bprekgm_DmyNiRinwT6XV9VKY.*AAJTSQACMDIAAlNLABxUMWNBOVdBdjRJTGNRNklYcTNDN1pZVzloeW89AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --insecure -L --request POST "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/sessions?_action=getSessionInfo"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"username": "b8f2ab77-a994-4e9a-8476-3262f531b6aa",
"universalId": "id=b8f2ab77-a994-4e9a-8476-3262f531b6aa,ou=user,ou=am-config",
"realm": "/",
"latestAccessTime": "2023-09-24T23:05:22Z",
"maxIdleExpirationTime": "2023-09-24T23:35:22Z",
"maxSessionExpirationTime": "2023-09-25T01:05:21Z",
"properties": {
"AMCtxId": "b0bb3b59-ee8d-414f-85cf-5acfbde33886-2317"
}
}
[http_cmd]: curl --insecure -L --request GET --cookie "0e26551c0104b88=73Bprekgm_DmyNiRinwT6XV9VKY.*AAJTSQACMDIAAlNLABxUMWNBOVdBdjRJTGNRNklYcTNDN1pZVzloeW89AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "amlbcookie=01" "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/realms/alpha/serverinfo/version"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "version",
"_rev": "1217229914",
"version": "7.4.0-SNAPSHOT",
"fullVersion": "ForgeRock Access Management 7.4.0-SNAPSHOT Build 7e44c1624c3a11db5b5b0b576bb162618f1ac605 (2023-September-18 09:04)",
"revision": "7e44c1624c3a11db5b5b0b576bb162618f1ac605",
"date": "2023-September-18 09:04"
}
***************************** Initializing component pods for IDM *****************************
---------------------- Get IDM software version ----------------------
Getting product version from https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/version
[http_cmd]: curl --header "X-OpenIDM-Username: anonymous" --header "X-OpenIDM-Password: ****" --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/version"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "version",
"productVersion": "7.4.0-2023-5-0-SNAPSHOT",
"productBuildDate": "20230710182152",
"productRevision": "a58b3d0c3a"
}
**************************** Initializing component pods for DS-CTS ****************************
--------------------- Get DS-CTS software version ---------------------
Component ds-cts is not in Running state so impossible to get software version
************************** Initializing component pods for DS-IDREPO **************************
------------------- Get DS-IDREPO software version -------------------
Component ds-idrepo is not in Running state so impossible to get software version
*************************** Initializing component pods for ADMIN-UI ***************************
-------------------- Get ADMIN-UI software version --------------------
Component admin-ui is running in tenant so impossible to get software version
************************* Initializing component pods for END-USER-UI *************************
------------------ Get END-USER-UI software version ------------------
Component end-user-ui is running in tenant so impossible to get software version
*************************** Initializing component pods for LOGIN-UI ***************************
-------------------- Get LOGIN-UI software version --------------------
Component login-ui is running in tenant so impossible to get software version
[24/Sep/2023 23:05:22] - INFO: Deployment successful
________________________________________________________________________________
[24/Sep/2023 23:05:22] Deploy_Discover_IDC_tenant post : Post method
________________________________________________________________________________
Setting result to PASS
Task has been successfully stopped