--Task-- name: Verification_am enabled: True class_name: VerificationTask source_name: am source_namespace: >default< target_name: am target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {} group_name: None Current dir: /mnt/scratch/workspaces/workspace/pit-debug-tests-debug-other-tests-463-1679261215469-1550440051/pyrock ________________________________________________________________________________ [19/Mar/2023 23:41:22] Verification_am pre : N/A ________________________________________________________________________________ [19/Mar/2023 23:41:22] - INFO: Timeout for this Task has changed to 2h (7200 seconds) [19/Mar/2023 23:41:22] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset ________________________________________________________________________________ [19/Mar/2023 23:41:22] Verification_am step1 : Wait until pods are in Running state and check number of running pods ________________________________________________________________________________ --------------------- Get expected number of pods --------------------- [loop_until]: kubectl --namespace=jnkns-pt-dbg-tsts-dbg-thr-tsts-463 get deployments -l app=am -o jsonpath={.items[*].spec.replicas} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 3 --- stderr --- -------------- Waiting for 3 expected pod(s) to be ready -------------- [loop_until]: kubectl --namespace=jnkns-pt-dbg-tsts-dbg-thr-tsts-463 get deployments am -o jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:3 replicas:3" [loop_until]: (max_time=900, interval=30, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found [loop_until]: OK (rc = 0) --- stdout --- ready:3 replicas:3 --- stderr --- ________________________________________________________________________________ [19/Mar/2023 23:41:23] Verification_am step2 : Discovering pods ________________________________________________________________________________ --------------------- Get expected number of pods --------------------- [loop_until]: kubectl --namespace=jnkns-pt-dbg-tsts-dbg-thr-tsts-463 get deployments -l app=am -o jsonpath={.items[*].spec.replicas} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 3 --- stderr --- ---------------------------- Get pod list ---------------------------- [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=jnkns-pt-dbg-tsts-dbg-thr-tsts-463 get pods -l app=am -o jsonpath={.items[*].metadata.name}` | grep 3 [loop_until]: (max_time=180, interval=10, expected_rc=[0] [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found [loop_until]: OK (rc = 0) --- stdout --- am-6d8f754888-5n4hn am-6d8f754888-c2kkn am-6d8f754888-scwgw --- stderr --- ________________________________________________________________________________ [19/Mar/2023 23:41:24] Verification_am step3 : Check component is alive ________________________________________________________________________________ Livecheck to https://jnkns-pt-dbg-tsts-dbg-thr-tsts-463.iam.perf-daily.engineeringpit.com/am/json/health/ready [http_cmd]: curl -L -X GET "https://jnkns-pt-dbg-tsts-dbg-thr-tsts-463.iam.perf-daily.engineeringpit.com/am/json/health/ready" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- Authenticate user via REST [http_cmd]: curl -H "X-OpenAM-Username: amadmin" -H "X-OpenAM-Password: E3xIqaO4lrOImWDQ6kQdBHmr" -H "Content-Type: application/json" -H "Accept-API-Version: resource=2.0, protocol=1.0" -L -X POST "https://jnkns-pt-dbg-tsts-dbg-thr-tsts-463.iam.perf-daily.engineeringpit.com/am/json/authenticate?realm=/" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "tokenId": "YkAJhkcTspGE1xsHA_nuyd0T0v0.*AAJTSQACMDIAAlNLABx1MHp6cC9LaFlrZFdtR3JobE5sdFBtSVNPTzg9AAR0eXBlAANDVFMAAlMxAAIwMQ..*", "successUrl": "/am/console", "realm": "/" } PASS : component am is alive ________________________________________________________________________________ [19/Mar/2023 23:41:25] Verification_am step4 : Record version ________________________________________________________________________________ ----------------------- Get AM software version ----------------------- Getting product version from https://jnkns-pt-dbg-tsts-dbg-thr-tsts-463.iam.perf-daily.engineeringpit.com/am/json/serverinfo/version - Login amadmin to get token Authenticate user via REST [http_cmd]: curl -H "X-OpenAM-Username: amadmin" -H "X-OpenAM-Password: E3xIqaO4lrOImWDQ6kQdBHmr" -H "Content-Type: application/json" -H "Accept-API-Version: resource=2.0, protocol=1.0" -L -X POST "https://jnkns-pt-dbg-tsts-dbg-thr-tsts-463.iam.perf-daily.engineeringpit.com/am/json/authenticate?realm=/" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "tokenId": "aIlnbuQ0CIKKkhZ3qsqYjM8Z81w.*AAJTSQACMDIAAlNLABxhWm1ZS09sWWpDaDB0YUFDZmY1UzFGdDRuMlk9AAR0eXBlAANDVFMAAlMxAAIwMQ..*", "successUrl": "/am/console", "realm": "/" } [http_cmd]: curl -L -X GET --cookie "amlbcookie=01" --cookie "iPlanetDirectoryPro=aIlnbuQ0CIKKkhZ3qsqYjM8Z81w.*AAJTSQACMDIAAlNLABxhWm1ZS09sWWpDaDB0YUFDZmY1UzFGdDRuMlk9AAR0eXBlAANDVFMAAlMxAAIwMQ..*" --cookie "route=1679269286.441.4836.301401|1f6ad49129c94b6f331b254a4e8728f1" "https://jnkns-pt-dbg-tsts-dbg-thr-tsts-463.iam.perf-daily.engineeringpit.com/am/json/serverinfo/version" [http_cmd]: http status code OK --- status code --- http status code is 200 (expected 200) --- http response --- { "_id": "version", "_rev": "1225343614", "version": "7.4.0-SNAPSHOT", "fullVersion": "ForgeRock Access Management 7.4.0-SNAPSHOT Build 589e06a10d2d8d1575fa558147f5bbe0dad37755 (2023-March-19 12:44)", "revision": "589e06a10d2d8d1575fa558147f5bbe0dad37755", "date": "2023-March-19 12:44" } Version is 7.4.0-SNAPSHOT Revision is 589e06a10d2d8d1575fa558147f5bbe0dad37755 ________________________________________________________________________________ [19/Mar/2023 23:41:25] Verification_am step5 : Checking pod restart counts ________________________________________________________________________________ ------------- Check pod am-6d8f754888-5n4hn restart count ------------- [loop_until]: kubectl --namespace=jnkns-pt-dbg-tsts-dbg-thr-tsts-463 get pod am-6d8f754888-5n4hn -o jsonpath={.status.containerStatuses[*].restartCount} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 0 --- stderr --- Pod am-6d8f754888-5n4hn has been restarted 0 times. SUCCESS : pod restart count (0) did not change between validation and verification phases ------------- Check pod am-6d8f754888-c2kkn restart count ------------- [loop_until]: kubectl --namespace=jnkns-pt-dbg-tsts-dbg-thr-tsts-463 get pod am-6d8f754888-c2kkn -o jsonpath={.status.containerStatuses[*].restartCount} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 0 --- stderr --- Pod am-6d8f754888-c2kkn has been restarted 0 times. SUCCESS : pod restart count (0) did not change between validation and verification phases ------------- Check pod am-6d8f754888-scwgw restart count ------------- [loop_until]: kubectl --namespace=jnkns-pt-dbg-tsts-dbg-thr-tsts-463 get pod am-6d8f754888-scwgw -o jsonpath={.status.containerStatuses[*].restartCount} [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- 0 --- stderr --- Pod am-6d8f754888-scwgw has been restarted 0 times. SUCCESS : pod restart count (0) did not change between validation and verification phases ________________________________________________________________________________ [19/Mar/2023 23:41:27] Verification_am post : Post method ________________________________________________________________________________ Setting result to PASS Task has been successfully stopped