--Task-- name: Discover_IDC_tenant enabled: True class_name: DiscoverTenantTask source_name: controller source_namespace: >default< target_name: controller target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock [03/Nov/2022 23:23:46] - INFO: setting default timeout for task - 2x global_duration or 300 seconds (whatever is higher): [03/Nov/2022 23:23:46] - INFO: Timeout for this Task has changed to 12h (43200 seconds) ________________________________________________________________________________ [03/Nov/2022 23:23:46] Discover_IDC_tenant step1 : N/A ________________________________________________________________________________ Deployment is skipped as --skip-deploy flag is provided ************************************* Creating deployment ************************************* Creating IDC type deployment for stack ****************************** Livecheck stage: After deployment ****************************** ------------------------ Running AM livecheck ------------------------ Livecheck to https://openam-perf-100m-test.forgeblocks.com/am/json/health/ready [http_cmd]: curl --insecure -L -X GET "https://openam-perf-100m-test.forgeblocks.com/am/json/health/ready" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- ------------------------ Running IDM livecheck ------------------------ Livecheck to https://openam-perf-100m-test.forgeblocks.com/openidm/info/ping [http_cmd]: curl -H "X-OpenIDM-Username: anonymous" -H "X-OpenIDM-Password: ****" --insecure -L -X GET "https://openam-perf-100m-test.forgeblocks.com/openidm/info/ping" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "_id": "", "_rev": "", "shortDesc": "OpenIDM ready", "state": "ACTIVE_READY" } ---------------------- Running DS-CTS livecheck ---------------------- --------------------- Running DS-IDREPO livecheck --------------------- --------------------- Running ADMIN-UI livecheck --------------------- Livecheck to https://openam-perf-100m-test.forgeblocks.com/platform [http_cmd]: curl --insecure -L -X GET "https://openam-perf-100m-test.forgeblocks.com/platform" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Platform Admin

[] -------------------- Running END-USER-UI livecheck -------------------- Livecheck to https://openam-perf-100m-test.forgeblocks.com/enduser [http_cmd]: curl --insecure -L -X GET "https://openam-perf-100m-test.forgeblocks.com/enduser" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Identity Management

[] --------------------- Running LOGIN-UI livecheck --------------------- Livecheck to https://openam-perf-100m-test.forgeblocks.com/am/XUI [http_cmd]: curl --insecure -L -X GET "https://openam-perf-100m-test.forgeblocks.com/am/XUI" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Login

[] LIVECHECK SUCCEEDED ****************************** Initializing component pods for AM ****************************** ----------------------- Get AM software version ----------------------- Getting product version from https://openam-perf-100m-test.forgeblocks.com/am/json/realms/alpha/serverinfo/version - Login amadmin to get token Authenticate user via REST [http_cmd]: curl -H "X-OpenAM-Username: xiaosong.lou@forgerock.com" -H "X-OpenAM-Password: ****" -H "Content-Type: application/json" -H "Accept-API-Version: resource=2.0, protocol=1.0" --insecure -L -X POST "https://openam-perf-100m-test.forgeblocks.com/am/json/authenticate?realm=/" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- [print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (83 lines): ----- output ----- { "authId": "eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJvdGsiOiJ2ZG1mYXNpdGdyZjk2aWEwM21qaDJjM3MzNiIsInJlYWxtIjoiLyIsInNlc3Npb25JZCI6IipBQUpUU1FBQ01ESUFCSFI1Y0dVQUNFcFhWRjlCVlZSSUFBSlRNUUFDTURFLipleUowZVhBaU9pSktWMVFpTENKamRIa2lPaUpLVjFRaUxDSmhiR2NpT2lKSVV6STFOaUo5LlpYbEtNR1ZZUVdsUGFVcExWakZSYVV4RFNteGliVTFwVDJsS1FrMVVTVFJSTUVwRVRGVm9WRTFxVlRKSmFYZHBXVmQ0YmtscWIybGFSMng1U1c0d0xpNDFaMlpYY2pZeVdraHlZVFZVYWpkVVZFRlVTek5STGpSc09EbFNjMnN5YkdGcVgzTlRVaTB4VUhkdWVuQmFNVUZ5VUhoUWRXMWhiVWRGZUhKZlNqQTJUM3BwTkVkNmJGY3phVGx5ZFhsNVRrZE9lR0ZCUkZkYWMycElNMkZXUVhKbVpUbGpTSFZhZHpoeVJYRkdhRGxxUWw5R2VHZFhYM1ZPTFhGTlUwdE9aUzFUYkY5TWVuTlpZVzFFZFhZdE1sWlFNbGRYZUc5VVRVcDVUbHBwZVdNMmIxTmZWVkl5YzFSZk5GODRXbVJOZFdzNVltTTFkRlJsVW1Nd1dVbEVXRlZmV1hSaU0wZE9UVEZWVnpneGRWRktSMHgxTWtOblIxSXlUa0ZvV1ZVeU5UWklhSGxUV1V4SWVXVkJha015TlVac1ExWllTbmxqUW1KWWNGWnJWSGRoUkc5aFZETmpWV1JmVjJSQlUxUTBla2d5YVVrMlJHdE1RbmQxY1dwVU5rcG1WRzFUUkRkVVR6SlhObEpLUzBGVGFYVnZSM013V1VONWVVMDFSRVJ3U1ZaTFJsSkxZVVpqZUhCWGRYcHRYMFl0YW5Sa2VHeFRSRGhJZFZCRVpHTlZiVE0zUzNObFVFbGxaRWhyZDFjMldGZG5ORVZhT1c5U1oxUnVWVEl5WTBGMllXaHVaakZhY1ZoUVpHd3djekJEWHpOSVpuRjRaMlJIYjFZM01Ib3dhbnBQUzBrMWNIVkVRVUUyVkd4TVZXZ3hTV1Z1VTJ0RWNGTlBaVmx4WDAxTmEwSlJiM1JvTFhrMFRIZFdOMDFuWTFsb01tWlNkMnBOU2twZk9FRnBhMUJOZFV4ME4yeHlMV2RsWnpsZk5rMVljemMwVlRJeU9UQnJZekpwTVdaTlNXcDJiSGM0WDFOMFgydFdWV2gzWlhGUk1HdDRTVmxTVTNFd1puTnBiWGsxZHpWU1ZHc3hVMUpTVFc5aFEwSkJkMEpqZVhNeFRFc3lVbXhQTm5jemFGWnZNVTFqU0cxUmJVRlNkMFp6TWtWdWRXbFZXRmd3U0d0bVZVdFpaM0kwUlRFd1IwOUtUR0kxWkhBMVZWaGhTRWg2ZFdreGRrcDFSRkZJWDJwMU1HbEtVVkJzVVVSaU4yY3dOSE40VWs5WWJFdHdNbmRRTVVaVmExRlFhWE5oYWxJM1FXSkxORFZTV0Uxd05XTlBkVGRhVEZOb2JuQXpPRVJKUTJsTGJuUkhRak55U3pSWFdERTBSWEE0TmxreVJrUmFUVk56U0RWeFZUTmtYMEZVVUZnM2EzQldhMEozY3kwd05rOHhXRVZYVlVoS1EyZEZXSFZYTVVoUVlrWkViMHBVY1dwUFZFWnpURVJGT0VjemJXdFdjSFJ5TjJaWFVGSXdTVGxsVkhOUWJVOXhZbDlhTVZaWlZtNW5YM3BHYUVWTE1Hb3dUakZKYzFFM01uSTNNSEl5U1c5RmQyeDViMUJKUmsxT2MwNWlNSGxxT0RoTmRGRTFUVUYzZHpkMk1GQjNOR0pzTmxkTlMwNDJkbUkyTFZoZk9WSkRjalJ0TkROSU9EaG1NbTE1ZW5aTGVHWnlibDgxY1VwSk4yZERNRk01YlVGa1NHNUxSR1J6VlU0dFExRXlka2xzUmxoTVNuZFZlVFpxU2xsWFpsaEpZa3BsTWpkemJta3RWbU5UY21WWFEyZzFkakZZTFZwMkxVRlVTMGR2UTJveGVHMVBSVWg2TmpSZmEwSmlSa1JUTFZaTWVGQXliWHB3TFRKb1NWaENaVzVyU214a1VHcDNVREZXWDJaUlVXWkpNa0U1VWw4MFUxUnJaR2hYYlRkRGEyZEViamRzWWt3NVQxTTRabFV5TmxjNFRqSlRRa1pFY1VWaGQwbGtRVXd4WTFwbVVHUldPWGh5WTFoWFJVdFBYMVp4TkZaSWEzSTJkRmc1YlhCT1RVSXhjazVCYUdVeGJscGxTMjlOV0dwV1dVOTFieTE2WkRoSFlrTmFTR3hFVGxVNVZFeExNMUZGVjNSMk1WUjFSWGN4VDNoMGFtVmZkekYzTm1FNE1uRjZOa2x2WWtOcFNVOU9RMTk2Ymw5UFQwZHFRVlJ6VkZWaVdWWktTRjlMVlROemQyZExSbE5SY0ZVNFUzSXdkMlJWVG5KeU5rZGZkMWhqUVhkNlVtMXpORE5LVWtoNGFrVm5kV2hvYnkxbVJHMVpYM3AzYzJaV1RtMXhZa00yWjFKNk0xVjBRMnBOUVhKdmFrczBPVlJJVjFOS2NXUkdXVkZDWVVaNlFUbHVSVVF6VFd0NFUwaExZa0ZCYjE5Rk0xaG5PVFJhYWxWMk16RlZkMlYyZG0xeFNFSklSMlZxUXkxVVYxOTVZMWRQY3padWFGbHVSbE5XVDE4MFUwZGtZa2RuVVdob1ZYUXhRbmhLTkhNMWFIbDNWMDA0Y0doS1NUSk1iMUJNYlVJdFZtbzNNbGxaT0c5UmFVWTBjM0JTVmxkQmJYaEVVRzVEWVVsM2JucDBWQzFhUjNoRGEwbzJSVmR3TXpGQlh6VjNNMnhVU0ZsRE5IVmZVM0o1UW1OS2IwNWZZMHcxUmkwMlJFaHlSSGczVDJVdFVubFRiRW96UmtZemVuSkJVVGxVYkZsbFJTMXVMbE4yVmxkUk1XeHlSRVJEWmxKM2FGSjRWRXBYVEdjLlBWOHR1Q0c0Q0pLVEZFcUNQakVPQzBRd3B0NklNS0NkbEVtZmwxeFM5ckEiLCJleHAiOjE2Njc2MDQyNDAsImlhdCI6MTY2NzUxNzg0MH0._IJPwTdPqg9dYlp12HmlW2QnUAHq2Ec5U9pKiAgZLhE", "callbacks": [ { "type": "TextOutputCallback", "output": [ { "name": "message", "value": "Loading..." }, [...] "value": "var setupPage = function() { var skipInputElem = document.getElementById(\"skip-input-284\"); var messageElem; document.getElementsByClassName(\"callback-component\").forEach( function (e) { var m = e.firstElementChild; if (m.firstChild && m.firstChild.nodeName == \"#text\" && m.firstChild.nodeValue.trim() == \"Loading...\") { messageElem = m; } } ); if (!skipInputElem || !messageElem) { return setTimeout(setupPage, 50); } var skipContainer = document.createElement(\"div\"); skipContainer.style = \"width:100%\"; skipContainer.innerHTML = \"\"; skipInputElem.parentNode.append(skipContainer); messageElem.align = \"center\"; messageElem.innerHTML = \"

Set up 2-step verification

Protect your account by adding a second step after entering your password to verify it's you signing in.

Set up 2-step verification

Protect your account by adding a second step after entering your password to verify it's you signing in.

\"; var bindSkipLink = function() { document.getElementById(\"skip-link-284\").onclick = function() { skipInputElem.value = \"Skip\"; document.getElementById(\"loginButton_0\").click(); return false; }; }; setTimeout(bindSkipLink, 100);};setupPage();"}, {"name": "messageType", "value": "4"}]}]}' "https://openam-perf-100m-test.forgeblocks.com/am/json/authenticate?realm=/" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "tokenId": "T7QnWa--Lt3riEh96gCaMhlFq7s.*AAJTSQACMDIAAlNLABxKRlVyRVNlODN5K0IvTFBvdURWTzNuMk5qTDg9AAR0eXBlAANDVFMAAlMxAAIwMQ..*", "successUrl": "/platform", "realm": "/" } [http_cmd]: curl --insecure -L -X GET --cookie "amlbcookie=01" --cookie "ebe0cd0aefcd9d1=T7QnWa--Lt3riEh96gCaMhlFq7s.*AAJTSQACMDIAAlNLABxKRlVyRVNlODN5K0IvTFBvdURWTzNuMk5qTDg9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" "https://openam-perf-100m-test.forgeblocks.com/am/json/realms/alpha/serverinfo/version" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "_id": "version", "_rev": "717654468", "version": "7.3.0-2022-8-SNAPSHOT", "fullVersion": "ForgeRock Access Management 7.3.0-2022-8-SNAPSHOT Build a05ac3729caa18bbb3caff4730d3392600a1500b (2022-September-23 12:38)", "revision": "a05ac3729caa18bbb3caff4730d3392600a1500b", "date": "2022-September-23 12:38" } ***************************** Initializing component pods for IDM ***************************** ---------------------- Get IDM software version ---------------------- Getting product version from https://openam-perf-100m-test.forgeblocks.com/openidm/info/version [http_cmd]: curl -H "X-OpenIDM-Username: anonymous" -H "X-OpenIDM-Password: ****" --insecure -L -X GET "https://openam-perf-100m-test.forgeblocks.com/openidm/info/version" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "_id": "version", "productVersion": "7.3.0-2022-8-SNAPSHOT", "productBuildDate": "20220922184607", "productRevision": "4527e0b" } **************************** Initializing component pods for DS-CTS **************************** --------------------- Get DS-CTS software version --------------------- Component ds-cts is not in Running state so impossible to get software version ************************** Initializing component pods for DS-IDREPO ************************** ------------------- Get DS-IDREPO software version ------------------- Component ds-idrepo is not in Running state so impossible to get software version *************************** Initializing component pods for ADMIN-UI *************************** -------------------- Get ADMIN-UI software version -------------------- Component admin-ui is running in tenant so impossible to get software version ************************* Initializing component pods for END-USER-UI ************************* ------------------ Get END-USER-UI software version ------------------ Component end-user-ui is running in tenant so impossible to get software version *************************** Initializing component pods for LOGIN-UI *************************** -------------------- Get LOGIN-UI software version -------------------- Component login-ui is running in tenant so impossible to get software version [03/Nov/2022 23:24:00] - INFO: Deployment ready ________________________________________________________________________________ [03/Nov/2022 23:24:00] Discover_IDC_tenant step2 : Discover overseer ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou get deployments -l "release=overseer" -o name [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- deployment.apps/overseer-0 --- stderr --- --------------------- Get expected number of pods --------------------- [loop_until]: kubectl --namespace=xlou get deployments -l app=overseer-0 -o jsonpath={.items[*].spec.replicas} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 1 --- stderr --- -------------- Waiting for 1 expected pod(s) to be ready -------------- [loop_until]: kubectl --namespace=xlou get deployments overseer-0 -o jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1" [loop_until]: (max_time=900, interval=30, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- ready:1 replicas:1 --- stderr --- --------------------- Get expected number of pods --------------------- [loop_until]: kubectl --namespace=xlou get deployments -l app=overseer-0 -o jsonpath={.items[*].spec.replicas} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 1 --- stderr --- ---------------------------- Get pod list ---------------------------- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-779957466d-hs7t7 --- stderr --- ---------- Check pod overseer-0-779957466d-hs7t7 is running ---------- [loop_until]: kubectl --namespace=xlou get pods overseer-0-779957466d-hs7t7 -o=jsonpath={.status.phase} | grep "Running" [loop_until]: (max_time=360, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- Running --- stderr --- [loop_until]: kubectl --namespace=xlou get pods overseer-0-779957466d-hs7t7 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" [loop_until]: (max_time=360, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- true --- stderr --- [loop_until]: kubectl --namespace=xlou get pod overseer-0-779957466d-hs7t7 -o jsonpath={.status.startTime} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 2022-10-20T20:35:11Z --- stderr --- --- Check pod overseer-0-779957466d-hs7t7 filesystem is accessible --- [loop_until]: kubectl --namespace=xlou exec overseer-0-779957466d-hs7t7 -c overseer -- ls / | grep "bin" [loop_until]: (max_time=360, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- anaconda-post.log bin boot dev docker-entrypoint.sh etc home lib lib64 lodestar lost+found media mnt opt proc results root run sbin srv sys tmp usr var --- stderr --- --------- Check pod overseer-0-779957466d-hs7t7 restart count --------- [loop_until]: kubectl --namespace=xlou get pod overseer-0-779957466d-hs7t7 -o jsonpath={.status.containerStatuses[*].restartCount} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 0 --- stderr --- Pod overseer-0-779957466d-hs7t7 has been restarted 0 times. Livecheck to https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com [http_cmd]: curl --insecure -L -X GET "https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Directory listing for /

Directory listing for /

PASS : component overseer-0 is alive Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/access_token/pod-logs/20221103-232405-after-overseer-0-deploy/overseer-0-779957466d-hs7t7.txt Check pod logs for errors ________________________________________________________________________________ [03/Nov/2022 23:24:06] Discover_IDC_tenant post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped