==================================================================================================== ========================================= Pod describe ========================================= ==================================================================================================== Name: am-7d597cf7d6-9wz9h Namespace: xlou Priority: 0 Service Account: default Node: gke-xlou-cdm-ds-0f601751-nj6q/10.142.0.23 Start Time: Sat, 13 Apr 2024 22:40:34 +0000 Labels: app=am app.kubernetes.io/component=am app.kubernetes.io/instance=am app.kubernetes.io/name=am app.kubernetes.io/part-of=forgerock pod-template-hash=7d597cf7d6 tier=middle Annotations: cluster-autoscaler.kubernetes.io/safe-to-evict: true Status: Running IP: 10.106.44.3 IPs: IP: 10.106.44.3 Controlled By: ReplicaSet/am-7d597cf7d6 Init Containers: fbc-init: Container ID: containerd://cb88fef82c877e5a27b1495494086b5e5e1f1c4336cdcef1a80691d9bc509442 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-bbf6791c961b39ef101ebad36686ee2c3cde94bb Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:a7ea1ec775d0ef298d9b61b08b9c9af67ece3e971c4ac5522323b3766d7d675d Port: Host Port: Command: /bin/bash -c if [ -d /fbc/config ]; then echo "Existing openam configuration found. Skipping copy" else echo "Copying docker image configuration files to the shared volume" cd /home/forgerock/openam cp -r .homeVersion * /fbc fi State: Terminated Reason: Completed Exit Code: 0 Started: Sat, 13 Apr 2024 22:40:42 +0000 Finished: Sat, 13 Apr 2024 22:40:42 +0000 Ready: True Restart Count: 0 Environment: Mounts: /fbc from fbc (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l5dmx (ro) truststore-init: Container ID: containerd://cd5ae5640656aabda383c4a451cb91a8df24b7ec63821661833ed1b23bec503f Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-bbf6791c961b39ef101ebad36686ee2c3cde94bb Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:a7ea1ec775d0ef298d9b61b08b9c9af67ece3e971c4ac5522323b3766d7d675d Port: Host Port: Command: /home/forgerock/import-pem-certs.sh State: Terminated Reason: Completed Exit Code: 0 Started: Sat, 13 Apr 2024 22:40:46 +0000 Finished: Sat, 13 Apr 2024 22:40:46 +0000 Ready: True Restart Count: 0 Environment: TRUSTSTORE_PATH: /truststore/amtruststore TRUSTSTORE_PASSWORD: changeit AM_PEM_TRUSTSTORE: /var/run/secrets/truststore/cacerts AM_PEM_TRUSTSTORE_DS: /var/run/secrets/truststore/ca.crt Mounts: /truststore from new-truststore (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l5dmx (ro) /var/run/secrets/truststore from truststore (rw) Containers: openam: Container ID: containerd://2c3d45aa51fb64a1a23a4ef84d53a92bf15f5ca0459f53999d9ee3d02b3f8c70 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-bbf6791c961b39ef101ebad36686ee2c3cde94bb Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:a7ea1ec775d0ef298d9b61b08b9c9af67ece3e971c4ac5522323b3766d7d675d Port: 8080/TCP Host Port: 0/TCP Command: bash /home/forgerock/docker-entrypoint.sh State: Running Started: Sat, 13 Apr 2024 22:40:47 +0000 Ready: True Restart Count: 0 Limits: memory: 10Gi Requests: cpu: 11 memory: 10Gi Liveness: http-get http://:8080/am/json/health/live delay=30s timeout=5s period=30s #success=1 #failure=3 Readiness: http-get http://:8080/am/json/health/ready delay=20s timeout=5s period=10s #success=1 #failure=3 Startup: http-get http://:8080/am/json/health/live delay=0s timeout=1s period=10s #success=1 #failure=40 Environment Variables from: am-env-secrets Secret Optional: false platform-config ConfigMap Optional: false amster-env-secrets Secret Optional: false ds-env-secrets Secret Optional: false Environment: NAMESPACE: xlou (v1:metadata.namespace) AM_STORES_SSL_ENABLED: true TRUSTSTORE_PATH: /home/forgerock/amtruststore TRUSTSTORE_PASSWORD: changeit AM_STORES_USER_TYPE: LDAPv3ForForgeRockIAM Mounts: /home/forgerock/amtruststore from new-truststore (ro,path="amtruststore") /home/forgerock/logging from am-logback (rw) /home/forgerock/openam from fbc (rw) /var/run/secrets/am from am-secrets (rw) /var/run/secrets/amster from amster-key (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l5dmx (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: fbc: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-secrets: Type: Projected (a volume that contains injected data from multiple sources) SecretName: am-passwords SecretOptionalName: SecretName: am-keystore SecretOptionalName: amster-key: Type: Secret (a volume populated by a Secret) SecretName: amster Optional: false truststore: Type: Projected (a volume that contains injected data from multiple sources) SecretName: truststore-pem SecretOptionalName: SecretName: ds-ssl-keypair SecretOptionalName: new-truststore: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-logback: Type: ConfigMap (a volume populated by a ConfigMap) Name: am-logback Optional: false kube-api-access-l5dmx: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: Tolerations: kubernetes.io/arch:NoSchedule op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: ==================================================================================================== =========================================== Pod logs =========================================== ==================================================================================================== Copying docker image configuration files to the shared volume Copying /opt/java/openjdk/lib/security/cacerts to /truststore/amtruststore Found (2) certificates in am_combined_truststore Importing (2) certificates into /truststore/amtruststore Certificate was added to keystore Certificate was added to keystore Import complete! 10.106.44.1 - - [14/Apr/2024:02:51:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:51:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:51:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:51:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357635 27ms 10.106.44.1 - - [14/Apr/2024:02:51:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:51:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:51:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:51:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:51:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357621 27ms 10.106.44.1 - - [14/Apr/2024:02:51:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:52:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:52:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:52:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:52:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357615 26ms 10.106.44.1 - - [14/Apr/2024:02:52:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [14/Apr/2024:02:52:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:52:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:52:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:52:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357638 32ms 10.106.44.1 - - [14/Apr/2024:02:52:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:53:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:53:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:53:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:53:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357591 25ms 10.106.44.1 - - [14/Apr/2024:02:53:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:53:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:53:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [14/Apr/2024:02:53:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:53:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357648 26ms 10.106.44.1 - - [14/Apr/2024:02:53:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:54:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:54:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:54:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [14/Apr/2024:02:54:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357650 26ms 10.106.44.1 - - [14/Apr/2024:02:54:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [14/Apr/2024:02:54:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:54:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:54:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:54:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357640 25ms 10.106.44.1 - - [14/Apr/2024:02:54:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:55:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:55:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:55:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:55:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357658 25ms 10.106.44.1 - - [14/Apr/2024:02:55:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms {"timestamp":"2024-04-14T02:55:31.545Z","eventName":"AM-LOGIN-MODULE-COMPLETED","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862829","trackingIds":["b5eef5cc-b013-4174-8d27-302dd8ef0203-136862832"],"userId":"id=amadmin,ou=user,ou=am-config","principal":["amadmin"],"entries":[{"moduleId":"DataStore","info":{"authControlFlag":"REQUIRED","moduleClass":"DataStore","ipAddress":"10.106.40.13","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862834","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-14T02:55:31.548Z","eventName":"AM-SESSION-CREATED","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862829","trackingIds":["b5eef5cc-b013-4174-8d27-302dd8ef0203-136862832"],"userId":"id=amadmin,ou=user,ou=am-config","runAs":"id=amadmin,ou=user,ou=am-config","objectId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862832","operation":"CREATE","realm":"/","component":"Session","source":"audit","topic":"activity","level":"INFO","_eventId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862837","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-14T02:55:31.548Z","eventName":"AM-LOGIN-COMPLETED","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862829","trackingIds":["b5eef5cc-b013-4174-8d27-302dd8ef0203-136862832"],"userId":"id=amadmin,ou=user,ou=am-config","principal":["amadmin"],"entries":[{"moduleId":"DataStore","info":{"ipAddress":"10.106.40.13","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862839","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-14T02:55:31.548Z","eventName":"AM-ACCESS-OUTCOME","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862829","trackingIds":["b5eef5cc-b013-4174-8d27-302dd8ef0203-136862832"],"userId":"id=amadmin,ou=user,ou=am-config","client":{"ip":"10.106.40.13","port":60670},"http":{"request":{"secure":true,"method":"POST","path":"https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/authenticate","headers":{"accept":["*/*"],"accept-api-version":["protocol=1.0,resource=2.0"],"content-type":["application/json"],"host":["xlou.iam.xlou-cdm.engineeringpit.com"],"user-agent":["python-requests/2.31.0"],"x-forwarded-for":["35.212.145.225"],"x-forwarded-host":["xlou.iam.xlou-cdm.engineeringpit.com"],"x-forwarded-port":["443"],"x-forwarded-proto":["https"],"x-real-ip":["35.212.145.225"],"x-request-id":["518bbcdd471e18a916a730df3dd67f6e"],"x-scheme":["https"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":6,"elapsedTimeUnits":"MILLISECONDS"},"realm":"/","component":"Authentication","source":"audit","topic":"access","level":"INFO","_eventId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862841","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-14T02:55:34.566Z","eventName":"AM-LOGIN-MODULE-COMPLETED","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862842","trackingIds":["b5eef5cc-b013-4174-8d27-302dd8ef0203-136862845"],"principal":["idm-resource-server"],"entries":[{"moduleId":"Application","info":{"authIndex":"module_instance","authControlFlag":"REQUIRED","moduleClass":"Application","ipAddress":"10.106.43.135","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862847","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-14T02:55:34.567Z","eventName":"AM-LOGIN-COMPLETED","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862842","trackingIds":["b5eef5cc-b013-4174-8d27-302dd8ef0203-136862845"],"userId":"id=idm-resource-server,ou=agent,ou=am-config","principal":["idm-resource-server"],"entries":[{"moduleId":"Application","info":{"authIndex":"module_instance","authIndexValue":"Application","ipAddress":"10.106.43.135","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862849","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-14T02:55:34.568Z","eventName":"AM-ACCESS-OUTCOME","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862842","trackingIds":["b5eef5cc-b013-4174-8d27-302dd8ef0203-136862845"],"userId":"id=idm-resource-server,ou=agent,ou=am-config","client":{"ip":"10.106.43.135","port":47534},"http":{"request":{"secure":true,"method":"POST","path":"https://am/am/oauth2/introspect","headers":{"accept":["application/json"],"content-type":["application/x-www-form-urlencoded"],"host":["am"],"user-agent":["Apache-HttpAsyncClient/4.1.4 (Java/17.0.10)"]}}},"request":{"detail":{"resourceOwnerId":"id=amadmin,ou=user,ou=am-config"}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":6,"elapsedTimeUnits":"MILLISECONDS","detail":{"scope":"fr:idm:*","token_type":"Bearer","client_id":"smokeclient","username":"amadmin","active":true}},"realm":"/","component":"OAuth","source":"audit","topic":"access","level":"INFO","_eventId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-136862851","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-14T02:55:35.327Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(9196)","mdc":{"transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-0"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-0"} 10.106.40.13 - - [14/Apr/2024:02:55:31 +0000] "POST /am/json/authenticate?realm=/ HTTP/1.1" 200 167 7ms 10.106.43.135 - - [14/Apr/2024:02:55:34 +0000] "POST /am/oauth2/introspect HTTP/1.1" 200 377 8ms 10.106.44.1 - - [14/Apr/2024:02:55:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:55:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [14/Apr/2024:02:55:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [14/Apr/2024:02:55:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357572 26ms 10.106.44.1 - - [14/Apr/2024:02:55:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms