--Task-- name: Discover_IDC_tenant enabled: True class_name: DiscoverTenantTask source_name: controller source_namespace: >default< target_name: controller target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock [27/Sep/2022 19:45:30] - INFO: setting default timeout for task - 2x global_duration or 300 seconds (whatever is higher): [27/Sep/2022 19:45:30] - INFO: Timeout for this Task has changed to 10h (36000 seconds) ________________________________________________________________________________ [27/Sep/2022 19:45:30] Discover_IDC_tenant step1 : N/A ________________________________________________________________________________ Deployment is skipped ************************************* Creating deployment ************************************* Creating IDC type deployment for stack ****************************** Livecheck stage: After deployment ****************************** ------------------------ Running AM livecheck ------------------------ Livecheck to https://openam-perf-100m-testing.forgeblocks.com/am/json/health/ready [http_cmd]: curl --insecure -L -X GET "https://openam-perf-100m-testing.forgeblocks.com/am/json/health/ready" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- ------------------------ Running IDM livecheck ------------------------ Livecheck to https://openam-perf-100m-testing.forgeblocks.com/openidm/info/ping [http_cmd]: curl -H "X-OpenIDM-Username: anonymous" -H "X-OpenIDM-Password: ****" --insecure -L -X GET "https://openam-perf-100m-testing.forgeblocks.com/openidm/info/ping" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "_id": "", "_rev": "", "shortDesc": "OpenIDM ready", "state": "ACTIVE_READY" } ---------------------- Running DS-CTS livecheck ---------------------- --------------------- Running DS-IDREPO livecheck --------------------- --------------------- Running ADMIN-UI livecheck --------------------- Livecheck to https://openam-perf-100m-testing.forgeblocks.com/platform [http_cmd]: curl --insecure -L -X GET "https://openam-perf-100m-testing.forgeblocks.com/platform" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Platform Admin

[] -------------------- Running END-USER-UI livecheck -------------------- Livecheck to https://openam-perf-100m-testing.forgeblocks.com/enduser [http_cmd]: curl --insecure -L -X GET "https://openam-perf-100m-testing.forgeblocks.com/enduser" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Identity Management

[] --------------------- Running LOGIN-UI livecheck --------------------- Livecheck to https://openam-perf-100m-testing.forgeblocks.com/am/XUI [http_cmd]: curl --insecure -L -X GET "https://openam-perf-100m-testing.forgeblocks.com/am/XUI" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Login

[] LIVECHECK SUCCEEDED ****************************** Initializing component pods for AM ****************************** ----------------------- Get AM software version ----------------------- Getting product version from https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/serverinfo/version - Login amadmin to get token Authenticate user via REST [http_cmd]: curl -H "X-OpenAM-Username: xiaosong.lou@forgerock.com" -H "X-OpenAM-Password: ****" -H "Content-Type: application/json" -H "Accept-API-Version: resource=2.0, protocol=1.0" --insecure -L -X POST "https://openam-perf-100m-testing.forgeblocks.com/am/json/authenticate?realm=/" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- [print_head_tail]: Print head (10 lines) and tail (10 lines) of input string (83 lines): ----- output ----- { "authId": "eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJvdGsiOiJrczkzcmJiNDA1bW52amoxdnE5NDA4YWpuayIsInJlYWxtIjoiLyIsInNlc3Npb25JZCI6IipBQUpUU1FBQ01ESUFCSFI1Y0dVQUNFcFhWRjlCVlZSSUFBSlRNUUFDTURFLipleUowZVhBaU9pSktWMVFpTENKamRIa2lPaUpLVjFRaUxDSmhiR2NpT2lKSVV6STFOaUo5LlpYbEtNR1ZZUVdsUGFVcExWakZSYVV4RFNteGliVTFwVDJsS1FrMVVTVFJSTUVwRVRGVm9WRTFxVlRKSmFYZHBXVmQ0YmtscWIybGFSMng1U1c0d0xpNXlZWFZaT0RWMmRqbEdlVWxNUmpSRWIyUkViMkYzTGxod1MyMVBjRFppWDI1M2FWWkZhbXRKYlVWb04za3hYMjFLUTIxWFQzSlNXRzh6UkVoVWNFUm9WbGhKTmsxS2FEWjFkMnRXYjJacFRHb3liWFF4TTNONVRFSmlZelJMUjJ4cWNFSndUbVJQV2kxSU9GQkVTSGhPT0hCR1JsQlVRemw0Vkdjd05tWlZja1JwV25KT1N6Rk1ORXBzYlZCV1kwUjJiMlJ1TlVaSGEyWmtTa0ZtVEVOcmFXc3lOMGg1VDFoTE4yVlNhVjkzTUVWbGRTMWpkRzV3VEY4M2FqRm9Ua2czUTJWek4xOWhabkpNUWpselFYQkNRbGQyUkUxdFJEaG1TMXB1VDBaYU1WSXdjRmMxVUVkeFZ6RmZPRkZCWkdWd056SkxNVE5TV0dWUk5WOHRaVWxXYkdSU05FOHlSbVIyTkhWbGQycGlWRTlSVGxwSmJGUlFjRFZhUkc1Wk5UYzNTSEJRVXkwNGEyZDNTVEUxWDBwdFpVbGhNMnBwVm1sdlZXUXdWRXMwWmkxcVdYaFZSbFZXVkRCS1NHaHVSVlYyY1RkU1UyNVFiV0l5VTJWUlYzTTFNRXRzYVRoTFRXMWxkRGQ1TVZKdk1rOTBiVGhuV1RSeGFtRnNNVU0xUkU4emVqSm5kekZ1UW5KcFVVbGFjbXBVYkZRM1RrUnFWVlpYUlVORU9VMXhWVmx2VVU1a1duRkJTV3RWU25GTmVsRkZZblo2YUMweFNWSmZjblpHYm0xWWVHcE9WbVYyWkhKcE5VdExXbWxSV0dWQ05tcG9ZM2RKWlc5S05GRklUMEowVXpWalNYRldkbmhLVms5UU5XUnliVGhMV0hKM2RIcGZObkpQTTJOcWNtZDNjRjgwTTFodVdEQlNhekJDWlMwd1NYSnpSRFExTFVKZk5GTkpWREZUTlc4NFJVcERRMjl4TlMwNWNYQjBaMlpvUm10RFNGSjFVRkpqY0RWUU1TMWZMV05vZEdoTFdtOTJTall3ZFhWdVozWkdiMVExVXpWTWNURlVkall3T0RSeGIxcG9URGxzZG5Sd1N5MVVNSGM0UWt4NFZGVmxWV3BKVDFkbU1WRnBTR2cwV0RGdmVtRkxjRTlUVm0xdU1sODVjVnBvU20xQk0wMDFhMU4xZDNWbGJuTmpPRmw1U1VKMldHWjBXakZJWDNGRE5WWndUWEI2WjJGeFJpMWFlVXhZVXpoYVZVRmhiRVpuYTFoWVdtVndVVWRpUTJOakxUTkphRUZXUzJZd1ZWOVpXRmw2YTA5cFluVnZjbTl6TVZsT1MwbzFSR1pUTmtOMU1rODVia2hoZG1FdFZtY3lOMVJuUVVKQlVuZHhOa1JJTTNodU4xZHRhM05oWjA0eVZGTldiVUZvVDFGSk4wcGtNekJ5V21nM1gxOUZXSEZIWWt0eE1FTlRWVTExUW1aRVVUVkhUVUZPTVZwV1MxcFRUVTF3Um5sVFFVUjRNMjFLVVZkQ1QxUm5SR1l6VVd4RU9FRkpVbUZUYVVoUExVaHdNazgyYjBNNE9YTjJlR05NTlhoMFJrZERUVzFsUTFGRlVHdGpZakJIUVVFNFlYVTFkblYyYUY5b1dsOUJkbnBKVFZOT2QyUTJjblJMYzJOM09WaDFVSFpUYVV4bFpIQTJTbVEwT1dzNFUzUm9WamRRUVV3MFFscFpPVFp1V1VaSE5uRndNa2RyTmxKVmVrSkRWSEV4T0drek1VWjZTR2hZWVRoNFFtUlhla1pMVjJodVQwaDNhWGg0YXkxWFFTMUVTa2M1WmpOUWRVTjRjM0pYY0hOWVpYUlRibm81UVRSUlRHSnNXR2xPVUVjMFptNUdNRVJHUXkxR2VucGxUVXc1WVROSFJWVndlVmhsTms4elVtaDRhWGhzYzFkdVprNTBhR1YxWmtoWlJtVTVMVGswZURBNVNXdGxZbkZtT0VsUldrZHhielpHUlRFMFRYRkVhbnBLWWxrNFZIUjVXbHBFV25CdVdVUnlNVUU0T0hOM1VsTkpZazQzUzBVMWJreEZhRFp6YzJVNGMwTTVXbnBKWWtGdGMyazVRMWRtZG1KTE1VTkJiSEpLY2pab1dVSnpjV05OYVRGMmRUQnFaQzFQU2pKS2FYbEpjMVZWYlVGR1oxTjZlV3BOYzJOQ1VUSndTVmRIYlRsWWJtb3hTelIzWlRKcE5saGFkRUp5VlZkaVQxbFdiVkp4TW5WTk5FaFBSRWR0WVZaUlVXWldSVEo2TWswMlkwZ3hSVW8zWVdvNGVYbzBUVzlYTTBnMGRUa3hTR0ZPU1hKaldsVjJSMnAxVlRkVlRXTjBjbFp2WTBGVlFsSXRkMHBDVXpkMWFERlVUbmQwTm5SRkxYZDViRVI1WTNadk15MVVibUk0T1c5RWJFUm1abkZUZDJvNVMxTkhRalV5Y0U1TGVXSmZjR0ZLYlhwcGFGYzVWMk5LU2pkblowVlhTRFJxZUZoTE4yMXNUV2QwWTJweFowaHdTMmhSUzNjNWVIVnJaVVJVVTBkS04ySlBjMkpzYUcxdlZWZHJNbWhUTVhOVlkxY3pNWE5qV2swMmRtNU9Ta2xuUzI1TVdsQlRibFpRU1VzdGNsQXRMbFV3TjJabE5tdHpSRGw2VXpoVlFVMVBXWEpDYjNjLkZDUkNFdHBaQ2VlUms5RGx2X1cxTjdydUdjQV95S1V0Tnc2a29zN0lXZmMiLCJleHAiOjE2NjQzOTQzMzEsImlhdCI6MTY2NDMwNzkzMX0.kWFVlhWOeSjhOxhIb_QHIoArhI_ADdtuIKCCuS3G6-0", "callbacks": [ { "type": "TextOutputCallback", "output": [ { "name": "message", "value": "Loading..." }, [...] "value": "var setupPage = function() { var skipInputElem = document.getElementById(\"skip-input-964\"); var messageElem; document.getElementsByClassName(\"callback-component\").forEach( function (e) { var m = e.firstElementChild; if (m.firstChild && m.firstChild.nodeName == \"#text\" && m.firstChild.nodeValue.trim() == \"Loading...\") { messageElem = m; } } ); if (!skipInputElem || !messageElem) { return setTimeout(setupPage, 50); } var skipContainer = document.createElement(\"div\"); skipContainer.style = \"width:100%\"; skipContainer.innerHTML = \"\"; skipInputElem.parentNode.append(skipContainer); messageElem.align = \"center\"; messageElem.innerHTML = \"

Set up 2-step verification

Protect your account by adding a second step after entering your password to verify it's you signing in.

Set up 2-step verification

Protect your account by adding a second step after entering your password to verify it's you signing in.

\"; var bindSkipLink = function() { document.getElementById(\"skip-link-964\").onclick = function() { skipInputElem.value = \"Skip\"; document.getElementById(\"loginButton_0\").click(); return false; }; }; setTimeout(bindSkipLink, 100);};setupPage();"}, {"name": "messageType", "value": "4"}]}]}' "https://openam-perf-100m-testing.forgeblocks.com/am/json/authenticate?realm=/" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "tokenId": "5zFfoTmo3f3xP7lWoNgYoTgJi8c.*AAJTSQACMDIAAlNLABxERFNwbmtjckE0S3JKMysrU3gwdjFncXZjYWc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*", "successUrl": "/platform", "realm": "/" } [http_cmd]: curl --insecure -L -X GET --cookie "6eb5177128b0e35=5zFfoTmo3f3xP7lWoNgYoTgJi8c.*AAJTSQACMDIAAlNLABxERFNwbmtjckE0S3JKMysrU3gwdjFncXZjYWc9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "amlbcookie=01" "https://openam-perf-100m-testing.forgeblocks.com/am/json/realms/alpha/serverinfo/version" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "_id": "version", "_rev": "-31970838", "version": "7.3.0-2022-8-SNAPSHOT", "fullVersion": "ForgeRock Access Management 7.3.0-2022-8-SNAPSHOT Build 2ae83b42cae82340c6e8f6ff5e82377aaaede227 (2022-September-12 09:26)", "revision": "2ae83b42cae82340c6e8f6ff5e82377aaaede227", "date": "2022-September-12 09:26" } ***************************** Initializing component pods for IDM ***************************** ---------------------- Get IDM software version ---------------------- Getting product version from https://openam-perf-100m-testing.forgeblocks.com/openidm/info/version [http_cmd]: curl -H "X-OpenIDM-Username: anonymous" -H "X-OpenIDM-Password: ****" --insecure -L -X GET "https://openam-perf-100m-testing.forgeblocks.com/openidm/info/version" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "_id": "version", "productVersion": "7.3.0-2022-8-SNAPSHOT", "productBuildDate": "20220908205519", "productRevision": "e307078" } **************************** Initializing component pods for DS-CTS **************************** --------------------- Get DS-CTS software version --------------------- Component ds-cts is not in Running state so impossible to get software version ************************** Initializing component pods for DS-IDREPO ************************** ------------------- Get DS-IDREPO software version ------------------- Component ds-idrepo is not in Running state so impossible to get software version *************************** Initializing component pods for ADMIN-UI *************************** -------------------- Get ADMIN-UI software version -------------------- Component admin-ui is running in tenant so impossible to get software version ************************* Initializing component pods for END-USER-UI ************************* ------------------ Get END-USER-UI software version ------------------ Component end-user-ui is running in tenant so impossible to get software version *************************** Initializing component pods for LOGIN-UI *************************** -------------------- Get LOGIN-UI software version -------------------- Component login-ui is running in tenant so impossible to get software version [27/Sep/2022 19:45:31] - INFO: Deployment ready ________________________________________________________________________________ [27/Sep/2022 19:45:31] Discover_IDC_tenant step2 : Discover overseer ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou get deployments -l "release=overseer" -o name [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- deployment.apps/overseer-0 --- stderr --- --------------------- Get expected number of pods --------------------- [loop_until]: kubectl --namespace=xlou get deployments -l app=overseer-0 -o jsonpath={.items[*].spec.replicas} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 1 --- stderr --- -------------- Waiting for 1 expected pod(s) to be ready -------------- [loop_until]: kubectl --namespace=xlou get deployments overseer-0 -o jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1" [loop_until]: (max_time=900, interval=30, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- ready:1 replicas:1 --- stderr --- --------------------- Get expected number of pods --------------------- [loop_until]: kubectl --namespace=xlou get deployments -l app=overseer-0 -o jsonpath={.items[*].spec.replicas} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 1 --- stderr --- ---------------------------- Get pod list ---------------------------- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=overseer-0 -o jsonpath={.items[*].metadata.name}` | grep 1 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- overseer-0-c7fc5cc47-x4c97 --- stderr --- ----------- Check pod overseer-0-c7fc5cc47-x4c97 is running ----------- [loop_until]: kubectl --namespace=xlou get pods overseer-0-c7fc5cc47-x4c97 -o=jsonpath={.status.phase} | grep "Running" [loop_until]: (max_time=360, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- Running --- stderr --- [loop_until]: kubectl --namespace=xlou get pods overseer-0-c7fc5cc47-x4c97 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true" [loop_until]: (max_time=360, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- true --- stderr --- [loop_until]: kubectl --namespace=xlou get pod overseer-0-c7fc5cc47-x4c97 -o jsonpath={.status.startTime} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 2022-09-21T17:36:20Z --- stderr --- ---- Check pod overseer-0-c7fc5cc47-x4c97 filesystem is accessible ---- [loop_until]: kubectl --namespace=xlou exec overseer-0-c7fc5cc47-x4c97 -c overseer -- ls / | grep "bin" [loop_until]: (max_time=360, interval=5, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- anaconda-post.log bin boot dev docker-entrypoint.sh etc home lib lib64 lodestar lost+found media mnt opt proc results root run sbin srv sys tmp usr var --- stderr --- --------- Check pod overseer-0-c7fc5cc47-x4c97 restart count --------- [loop_until]: kubectl --namespace=xlou get pod overseer-0-c7fc5cc47-x4c97 -o jsonpath={.status.containerStatuses[*].restartCount} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 0 --- stderr --- Pod overseer-0-c7fc5cc47-x4c97 has been restarted 0 times. Livecheck to https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com [http_cmd]: curl --insecure -L -X GET "https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Directory listing for /

Directory listing for /

PASS : component overseer-0 is alive Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/idc_am_authn/pod-logs/20220927-194535-after-overseer-0-deploy/overseer-0-c7fc5cc47-x4c97.txt Check pod logs for errors ________________________________________________________________________________ [27/Sep/2022 19:45:36] Discover_IDC_tenant post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped