--Task--
name: Deploy_Discover_IDC_tenant
enabled: True
class_name: DeployTenantTask
source_name: controller
source_namespace: >default<
target_name: controller
target_namespace: >default<
start: 0
stop: None
timeout: no timeout
loop: False
interval: None
dependencies: []
wait_for: []
options: {}
group_name: None
Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock
________________________________________________________________________________
[05/Oct/2023 20:45:24] Deploy_Discover_IDC_tenant pre : N/A
________________________________________________________________________________
________________________________________________________________________________
[05/Oct/2023 20:45:24] Deploy_Discover_IDC_tenant step1 : N/A
________________________________________________________________________________
******************************** Cleaning up existing namespace ********************************
------------------ Deleting secret agent controller ------------------
[loop_until]: kubectl --namespace=xlou delete sac --all
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
No resources found
--- stderr ---
----------------------- Deleting all resources -----------------------
[loop_until]: kubectl --namespace=xlou delete all --all --grace-period=0 --force
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
pod "overseer-0-679fffd7c9-xbql7" force deleted
service "overseer-0" force deleted
deployment.apps "overseer-0" force deleted
--- stderr ---
Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
[loop_until]: kubectl --namespace xlou get pods | grep "No resources found"
[loop_until]: (max_time=360, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 10s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 20s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 31s (rc=0) - failed to find expected output: No resources found - retry
[loop_until]: Function succeeded after 41s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
No resources found in xlou namespace.
------------------------- Deleting configmap -------------------------
[loop_until]: kubectl --namespace=xlou get configmap --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
kube-root-ca.crt overseer-config-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete configmap kube-root-ca.crt --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
configmap "kube-root-ca.crt" deleted
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete configmap overseer-config-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
configmap "overseer-config-0" deleted
--- stderr ---
--------------------------- Deleting secret ---------------------------
[loop_until]: kubectl --namespace=xlou get secret --output jsonpath='{.items[?(@.type=="Opaque")].metadata.name}'
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
-------------------------- Deleting ingress --------------------------
[loop_until]: kubectl --namespace=xlou get ingress --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete ingress overseer-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
ingress.networking.k8s.io "overseer-0" deleted
--- stderr ---
---------------------------- Deleting pvc ----------------------------
[loop_until]: kubectl --namespace=xlou get pvc --output jsonpath={.items[*].metadata.name}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete pvc overseer-0 --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
persistentvolumeclaim "overseer-0" deleted
--- stderr ---
[loop_until]: kubectl --namespace=xlou delete pv ds-backup-xlou --ignore-not-found
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
Warning: deleting cluster-scoped resources, not scoped to the provided namespace
----------------- Deleting admin clusterrolebindings -----------------
[loop_until]: kubectl get clusterrolebinding --output jsonpath="{range .items[?(@.subjects[0].namespace=='xlou')]}{.metadata.name} {end}"
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
k8s-svc-acct-crb-xlou-0
--- stderr ---
Deleting clusterrolebinding k8s-svc-acct-crb-xlou-0 associated with xlou namespace
[loop_until]: kubectl delete clusterrolebinding k8s-svc-acct-crb-xlou-0
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
clusterrolebinding.rbac.authorization.k8s.io "k8s-svc-acct-crb-xlou-0" deleted
--- stderr ---
------------------------- Deleting namespace -------------------------
[loop_until]: kubectl delete namespaces xlou --ignore-not-found --grace-period=0 --force
[loop_until]: (max_time=360, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
namespace "xlou" force deleted
--- stderr ---
Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.
[loop_until]: awk -F" " "{print NF}" <<< `kubectl get namespace xlou --ignore-not-found` | grep 0
[loop_until]: (max_time=600, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
--- stderr ---
************************************* Creating deployment *************************************
Creating IDC type deployment for stack
****************************** Livecheck stage: After deployment ******************************
------------------------ Running AM livecheck ------------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/am/json/health/ready
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/health/ready"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
------------------------ Running IDM livecheck ------------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/ping
[http_cmd]: curl --header "X-OpenIDM-Username: anonymous" --header "X-OpenIDM-Password: ****" --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/ping"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "",
"_rev": "",
"shortDesc": "OpenIDM ready",
"state": "ACTIVE_READY"
}
---------------------- Running DS-CTS livecheck ----------------------
--------------------- Running DS-IDREPO livecheck ---------------------
--------------------- Running ADMIN-UI livecheck ---------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/platform
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/platform"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Platform Admin
[]
-------------------- Running END-USER-UI livecheck --------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/enduser
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/enduser"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Identity Management
[]
--------------------- Running LOGIN-UI livecheck ---------------------
Livecheck to https://openam-ema-perf-benchmark.forgeblocks.com/am/XUI
[http_cmd]: curl --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/am/XUI"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
Login
[]
LIVECHECK SUCCEEDED
****************************** Initializing component pods for AM ******************************
----------------------- Get AM software version -----------------------
Getting product version from https://openam-ema-perf-benchmark.forgeblocks.com/am/json/realms/alpha/serverinfo/version
Create new LoginSession for user "xiaosong.lou@forgerock.com"
[LoginSession] Get "token_id" token for user "xiaosong.lou@forgerock.com"
[LoginSession] Obtaining new "token_id" token from server because it was not obtained yet for the user
Authenticate user xiaosong.lou@forgerock.com via REST
[http_cmd]: curl --header "X-OpenAM-Username: xiaosong.lou@forgerock.com" --header "X-OpenAM-Password: ****" --header "Content-Type: application/json" --header "Accept-API-Version: resource=2.0, protocol=1.0" --insecure -L --request POST "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/authenticate?realm=/"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
[print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (83 lines):
----- output -----
{
"authId": "eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJvdGsiOiIxcHZsczlxbW9oNWMxb2duNXNlMzUxbWhyMSIsInJlYWxtIjoiLyIsInNlc3Npb25JZCI6IipBQUpUU1FBQ01ESUFCSFI1Y0dVQUNFcFhWRjlCVlZSSUFBSlRNUUFDTURFLipleUowZVhBaU9pSktWMVFpTENKamRIa2lPaUpLVjFRaUxDSmhiR2NpT2lKSVV6STFOaUo5LlpYbEtNR1ZZUVdsUGFVcExWakZSYVV4RFNteGliVTFwVDJsS1FrMVVTVFJSTUVwRVRGVm9WRTFxVlRKSmFYZHBXVmQ0YmtscWIybGFSMng1U1c0d0xpNUxlakpWZDNOaVNEWk1OSGxWUjNKdlkyaElTbUpCTG10RlVEUldaMEpHYzNNMVNtczVXRWhrVGtKSmFFNHlNVGxCYW5oSVVYZ3RjV3hMWVcxUVkzUTFZME5QYUV0QlYzUnRSVkJvYWxWTWVtWjRTREZQYzNGcFNtcFdNalZEU0dwRFdXZFlMVWxsYWxOamVHZFRUREU0VldaTVVtSkNOMUl4V213eVZWZDFaVE5hUm1adU16QnBaM0U0YW14V1NXNTRPRTFPTjJGaFREQTJVMlZETjJaa2REVTFZVTVyWDJ4RlRrUmxVekJ0VTNWclRFaHRlbDlpZGpNd05WSmFaV0p1ZVRaRGRXUkZiRFp5ZVd4cGNrSkZXa1ZEYVdnMWN6Um9MWGRIVmpsTk4ySXhVMGRQYTIxVlVFbGFVekJNUjBscVYzTTJjMUpFUjFobFNHcEtaRTVhWmxaaFJGVnlRWEpJYWs1WVoyTXRZVnBtTUZobGN6RkRTRmxCV0RFMWNsSkJSVU5LTW1ReGFVNVhiRU5HVTBab1dFdFlaMEZTUVhwZmIxWjFiRFpuTURGc05IWnhWV3BVVW1oRFZGZFBiVmR2VjBkaVMzRkpOVGh5YTNGNlpVOVBPR0V3VDBaV1gzZHNSMk4wTm1wSWJtdHJWRlpyVEhGemRXTm5TVGRoZVdaZlVFY3lNR05WZUZoVE1rdHpWakZMVVY5T01XTTFhRk55UkRJME9FVmpRVnBXT0VaSmRsTnpjQzFaT1VGWU5uUjVNVlp5VkdkVVkzTnJiVFF5YkZOcU5FVktNamx4TkUxVFVFZ3liaTE2UldGa1FsYzRWVGREVUV3MFFXMXJaRzVOU205RllYbHJiV3hVU2pWR2NWUkRVbFZUZVd4TGEyaHBUMnd4TXkxb1RtdEZXR1ZhVmxaWE5UZzVZV05GTUdaRlNWaEpOVVZ4UkZCV2IwaFVZbVZPV2w5TE9VWTRNekZxYWpGd1kyWlRkM0pyZFVrNWRYcHZjalZOUzNVMWNWOUJZVXA1T1ZkWlpIZG1XbTlEY2pKVVltMTBRamRxYWtkSlNEWmxTMnRRY0RCSldIaGlXVzVOVGxGUVZXMVJPSFpGZERkQmFUVklhM2cyYkZaU2RIVmpaMk42T1VKZmJYZHJUR2hWUzJkRFVIZGhWRlZJTW05SVMyMTBhME55UjBJNVdUTjRlVkZyZWxwWGJHc3djMGRSTjFRMFozbDBiMGN0TVMxTmFIbGphM0I0TFhGRGNtWlZWWGxxTUZSbGFubGZRVFJJZHpGVll6ZEtNVEIxZVVkRFpVVlhWekJUVnpKelVrNUxaMFYyYWw5WGVFYzVZbVZGVlc0eWJGSjFkR0p1YlhBM2FrRlhja2xRTFVJNFNYUjFOVzl2VUVGWFZFbFhNbEI2WDFGelRGa3ljMjFHYkRablEyZFRkMnRQTmpkWlZsaFNiRzlCUkVWWlNVVmtOSE5GVTNCTmFFdFdOa3BCUkhOMU9HbHdia3Q0YkY5SWJVRnRhWGQyUnpSWWNrZEdZa0ZGY0dOelpFWklXRzB4U3pkTFozZG9XWGhqUkVNdFluUlljV1ZzVDBsdE0xQklSa0Z0YjBWWk1GZzFSMmxOU0VGSVgwWmxZMTgxVFVWa2QzRm9UVmxoVm1SR2FrVlNTeTFYVFVaa2JXRlNOMmhWWkdGTlFUSTViemRDVTJoQ1gyUlNNMHBpZEMxUU5XeHdRVU5PVVRBdFNFTktSakEyZFZCSVdXOHhWVXByTkhObExWVm9lRU5FYVZKNk4xYzFRemd3TW5Oc1IyNHRjR3BpUjA5UlQxSnlSWE50YTJWT1VHSkRRbWh1TFZBeE9XbG1aRlZNY0c1VWVETXhVMHh4Y0U1MldGTTJaMWREVVU5QlVHeGFNamxRYTJ4YVFYcFVVVnB3T0dSaE9VMVlSSGRJTFZsSGJIRnBNaTF2TVRGbWNGWlhVbG93TlhVd1VVeFlVMG8zUjBwcU9HeGhlREJsTW5CV2VqUjVkRXRsTm5aWloxSXdWRUpuZERkTlRFTkZNekl6TFVSVlJtZHpaVEo1VEc0NU9VVm1TbnAyUVdsalRXMVlTRE4yWDJVd2IxOWtlbGxDUWtaMlkxRm9iMGxXUWpGMWRIWnlXa3h3YTFKdGFsRTRNRmhsUWpOd2MwUktkbUpwU25OcGQyMUpORTVwUkhCTmJucHNOVlJOTlc5S1RGQnZPRmRJUjBWRFFqUndWelZPVkRWcGRIaFRjVEV4ZURWUlozRnBVWGhNY2pSWVJtTlZYMVJYUnpnMVEySldabVJsUkZCYVNWcExaR2R3UTFFNVEybExhSEpKVG05UFRtNUVhMHQ2TjNOMUxVOVlUbEZTYTNSWGJIQnJObGQ2V2tWSVZrcFRPSHA1TlZkYWEwdGFTbUpzY0d0S1VFUlpSVkZwU0U5a1duUnJkRk4xVTBjMlRsTjNTRGROTUVnNWFGTm9aM2RYTURacWNHcEhiMDVpU2paclRFSjNYM1Z3YzBwUlZ6UmtSMFJtV2xoMWMyOWpVbGRmVFcxSlpEWmFOM1o0TTNOcFpEUlpYMFp4VG1RMlExSTRjRms0UVRRdGVta3lPRVJXZVc1a1lsUldXQzE2YkZOeVYxRlhObGRLUTNkRVJGbEhTVUV5WWpKNU1IVnVZV0YyY1V4U1JWODNXakJWVVM1clRGWjJibEY2YTI1dVUwdG9TWEZKTWpSSFZFRlIuRnhTM08za19CWlRjNk5YU3FBcmd5QUZWRFF3OXFYUk9QU0laZERrZEZVUSIsImV4cCI6MTY5NjYyNTE4OSwiaWF0IjoxNjk2NTM4Nzg5fQ.dwyWUTOcha0psFujtNzSbmSKTsCz-9ZRGqrbkPFCTnQ",
"callbacks": [
{
"type": "TextOutputCallback",
"output": [
{
"name": "message",
"value": "Loading..."
},
[...]
"value": "var setupPage = function() { var skipInputElem = document.getElementById(\"skip-input-763\"); var messageElem; document.getElementsByClassName(\"callback-component\").forEach( function (e) { var m = e.firstElementChild; if (m.firstChild && m.firstChild.nodeName == \"#text\" && m.firstChild.nodeValue.trim() == \"Loading...\") { messageElem = m; } } ); if (!skipInputElem || !messageElem) { return setTimeout(setupPage, 50); } var skipContainer = document.createElement(\"div\"); skipContainer.style = \"width:100%\"; skipContainer.innerHTML = \"\"; skipInputElem.parentNode.append(skipContainer); messageElem.align = \"center\"; messageElem.innerHTML = \"
Set up 2-step verification
Protect your account by adding a second step after entering your password to verify it's you signing in.
Protect your account by adding a second step after entering your password to verify it's you signing in.
\"; var bindSkipLink = function() { document.getElementById(\"skip-link-763\").onclick = function() { skipInputElem.value = \"Skip\"; document.getElementById(\"loginButton_0\").click(); return false; }; }; setTimeout(bindSkipLink, 100);};setupPage();"}, {"name": "messageType", "value": "4"}]}]}' "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/authenticate?realm=/"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"tokenId": "9fZ0V0UbwtrCMMqy9RRZMLjUl3A.*AAJTSQACMDIAAlNLABxlNG90bUhKZG5TUXJ3ME1LVldVb3JSdUZmQ0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..*",
"successUrl": "/platform",
"realm": "/"
}
[LoginSession] Obtaining session info
[http_cmd]: curl --header "0e26551c0104b88: 9fZ0V0UbwtrCMMqy9RRZMLjUl3A.*AAJTSQACMDIAAlNLABxlNG90bUhKZG5TUXJ3ME1LVldVb3JSdUZmQ0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --header "Content-Type: application/json" --header "Accept-API-Version: resource=3.0, protocol=2.1" --header "filters_cookie: 9fZ0V0UbwtrCMMqy9RRZMLjUl3A.*AAJTSQACMDIAAlNLABxlNG90bUhKZG5TUXJ3ME1LVldVb3JSdUZmQ0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --insecure -L --request POST "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/sessions?_action=getSessionInfo"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"username": "ed39bea1-b72d-45ef-8b6a-8331a7d51630",
"universalId": "id=ed39bea1-b72d-45ef-8b6a-8331a7d51630,ou=user,ou=am-config",
"realm": "/",
"latestAccessTime": "2023-10-05T20:46:29Z",
"maxIdleExpirationTime": "2023-10-05T21:16:29Z",
"maxSessionExpirationTime": "2023-10-05T22:46:28Z",
"properties": {
"AMCtxId": "29aa3a9d-f66c-4261-aa54-339193452dc7-11573"
}
}
[http_cmd]: curl --insecure -L --request GET --cookie "0e26551c0104b88=9fZ0V0UbwtrCMMqy9RRZMLjUl3A.*AAJTSQACMDIAAlNLABxlNG90bUhKZG5TUXJ3ME1LVldVb3JSdUZmQ0k9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "amlbcookie=01" "https://openam-ema-perf-benchmark.forgeblocks.com/am/json/realms/alpha/serverinfo/version"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "version",
"_rev": "1217229914",
"version": "7.4.0-SNAPSHOT",
"fullVersion": "ForgeRock Access Management 7.4.0-SNAPSHOT Build 7e44c1624c3a11db5b5b0b576bb162618f1ac605 (2023-September-18 09:04)",
"revision": "7e44c1624c3a11db5b5b0b576bb162618f1ac605",
"date": "2023-September-18 09:04"
}
***************************** Initializing component pods for IDM *****************************
---------------------- Get IDM software version ----------------------
Getting product version from https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/version
[http_cmd]: curl --header "X-OpenIDM-Username: anonymous" --header "X-OpenIDM-Password: ****" --insecure -L --request GET "https://openam-ema-perf-benchmark.forgeblocks.com/openidm/info/version"
[http_cmd]: http status code OK
--- status code ---
http status code is 200 (expected 200)
--- http response ---
{
"_id": "version",
"productVersion": "7.4.0-2023-5-0-SNAPSHOT",
"productBuildDate": "20230710182152",
"productRevision": "a58b3d0c3a"
}
**************************** Initializing component pods for DS-CTS ****************************
--------------------- Get DS-CTS software version ---------------------
Component ds-cts is not in Running state so impossible to get software version
************************** Initializing component pods for DS-IDREPO **************************
------------------- Get DS-IDREPO software version -------------------
Component ds-idrepo is not in Running state so impossible to get software version
*************************** Initializing component pods for ADMIN-UI ***************************
-------------------- Get ADMIN-UI software version --------------------
Component admin-ui is running in tenant so impossible to get software version
************************* Initializing component pods for END-USER-UI *************************
------------------ Get END-USER-UI software version ------------------
Component end-user-ui is running in tenant so impossible to get software version
*************************** Initializing component pods for LOGIN-UI ***************************
-------------------- Get LOGIN-UI software version --------------------
Component login-ui is running in tenant so impossible to get software version
[05/Oct/2023 20:46:30] - INFO: Deployment successful
________________________________________________________________________________
[05/Oct/2023 20:46:30] Deploy_Discover_IDC_tenant post : Post method
________________________________________________________________________________
Setting result to PASS
Task has been successfully stopped