==================================================================================================== ========================================= Pod describe ========================================= ==================================================================================================== Name: am-6d96779b5d-zn69c Namespace: xlou Priority: 0 Service Account: default Node: gke-xlou-cdm-default-pool-1b0769c8-w15q/10.142.0.108 Start Time: Fri, 12 Apr 2024 16:46:38 +0000 Labels: app=am app.kubernetes.io/component=am app.kubernetes.io/instance=am app.kubernetes.io/name=am app.kubernetes.io/part-of=forgerock pod-template-hash=6d96779b5d tier=middle Annotations: cluster-autoscaler.kubernetes.io/safe-to-evict: true Status: Running IP: 10.106.40.133 IPs: IP: 10.106.40.133 Controlled By: ReplicaSet/am-6d96779b5d Init Containers: fbc-init: Container ID: containerd://16bbbcded26b70e3cb51a35e499e8b419ea41f9396ed0c86385cf28f3b632032 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5 Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:77273b6ff1d7e8a29a87ee1eb79b0e899264271d5a6c52952e2ff16981aaca73 Port: Host Port: Command: /bin/bash -c if [ -d /fbc/config ]; then echo "Existing openam configuration found. Skipping copy" else echo "Copying docker image configuration files to the shared volume" cd /home/forgerock/openam cp -r .homeVersion * /fbc fi State: Terminated Reason: Completed Exit Code: 0 Started: Fri, 12 Apr 2024 16:46:46 +0000 Finished: Fri, 12 Apr 2024 16:46:46 +0000 Ready: True Restart Count: 0 Environment: Mounts: /fbc from fbc (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-rlt9k (ro) truststore-init: Container ID: containerd://091ee74cfd3d56321312ba041e687e526c8798a0fa10c002c542e6af6b287906 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5 Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:77273b6ff1d7e8a29a87ee1eb79b0e899264271d5a6c52952e2ff16981aaca73 Port: Host Port: Command: /home/forgerock/import-pem-certs.sh State: Terminated Reason: Completed Exit Code: 0 Started: Fri, 12 Apr 2024 16:46:49 +0000 Finished: Fri, 12 Apr 2024 16:46:49 +0000 Ready: True Restart Count: 0 Environment: TRUSTSTORE_PATH: /truststore/amtruststore TRUSTSTORE_PASSWORD: changeit AM_PEM_TRUSTSTORE: /var/run/secrets/truststore/cacerts AM_PEM_TRUSTSTORE_DS: /var/run/secrets/truststore/ca.crt Mounts: /truststore from new-truststore (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-rlt9k (ro) /var/run/secrets/truststore from truststore (rw) Containers: openam: Container ID: containerd://5ffac37d7e1778c5ad9d49ad685156a47e981abae54b4158c6b012c18252f780 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5 Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:77273b6ff1d7e8a29a87ee1eb79b0e899264271d5a6c52952e2ff16981aaca73 Port: 8080/TCP Host Port: 0/TCP Command: bash /home/forgerock/docker-entrypoint.sh State: Running Started: Fri, 12 Apr 2024 16:46:50 +0000 Ready: True Restart Count: 0 Limits: memory: 10Gi Requests: cpu: 11 memory: 10Gi Liveness: http-get http://:8080/am/json/health/live delay=30s timeout=5s period=30s #success=1 #failure=3 Readiness: http-get http://:8080/am/json/health/ready delay=20s timeout=5s period=10s #success=1 #failure=3 Startup: http-get http://:8080/am/json/health/live delay=0s timeout=1s period=10s #success=1 #failure=40 Environment Variables from: am-env-secrets Secret Optional: false platform-config ConfigMap Optional: false amster-env-secrets Secret Optional: false ds-env-secrets Secret Optional: false Environment: NAMESPACE: xlou (v1:metadata.namespace) AM_STORES_SSL_ENABLED: true TRUSTSTORE_PATH: /home/forgerock/amtruststore TRUSTSTORE_PASSWORD: changeit AM_STORES_USER_TYPE: LDAPv3ForForgeRockIAM Mounts: /home/forgerock/amtruststore from new-truststore (ro,path="amtruststore") /home/forgerock/logging from am-logback (rw) /home/forgerock/openam from fbc (rw) /var/run/secrets/am from am-secrets (rw) /var/run/secrets/amster from amster-key (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-rlt9k (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: fbc: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-secrets: Type: Projected (a volume that contains injected data from multiple sources) SecretName: am-passwords SecretOptionalName: SecretName: am-keystore SecretOptionalName: amster-key: Type: Secret (a volume populated by a Secret) SecretName: amster Optional: false truststore: Type: Projected (a volume that contains injected data from multiple sources) SecretName: truststore-pem SecretOptionalName: SecretName: ds-ssl-keypair SecretOptionalName: new-truststore: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-logback: Type: ConfigMap (a volume populated by a ConfigMap) Name: am-logback Optional: false kube-api-access-rlt9k: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: Tolerations: kubernetes.io/arch:NoSchedule op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 2m42s default-scheduler Successfully assigned xlou/am-6d96779b5d-zn69c to gke-xlou-cdm-default-pool-1b0769c8-w15q Normal Pulling 2m41s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5" Normal Pulled 2m34s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5" in 7.210761735s (7.210769928s including waiting) Normal Created 2m34s kubelet Created container fbc-init Normal Started 2m34s kubelet Started container fbc-init Normal Pulling 2m31s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5" Normal Pulled 2m31s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5" in 212.604471ms (212.611865ms including waiting) Normal Created 2m31s kubelet Created container truststore-init Normal Started 2m31s kubelet Started container truststore-init Normal Pulling 2m30s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5" Normal Pulled 2m30s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-0449af26230b3dbde39b69d27b76a420998ce4a5" in 220.08161ms (220.09864ms including waiting) Normal Created 2m30s kubelet Created container openam Normal Started 2m30s kubelet Started container openam Warning Unhealthy 2m10s (x2 over 2m20s) kubelet Startup probe failed: Get "http://10.106.40.133:8080/am/json/health/live": context deadline exceeded (Client.Timeout exceeded while awaiting headers) ==================================================================================================== =========================================== Pod logs =========================================== ==================================================================================================== Copying docker image configuration files to the shared volume Copying /opt/java/openjdk/lib/security/cacerts to /truststore/amtruststore Found (2) certificates in am_combined_truststore Importing (2) certificates into /truststore/amtruststore Certificate was added to keystore Certificate was added to keystore Import complete! Copying bootstrap files for legacy AMKeyProvider Waiting for User Store to be available Trying ds-idrepo-0.ds-idrepo:8080/alive endpoint User Store is responding Waiting for CTS to be available Trying ds-cts-0.ds-cts:8080/alive endpoint CTS is responding Waiting for Application Store to be available Trying ds-idrepo-0.ds-idrepo:8080/alive endpoint Application Store is responding Waiting for Policy Store to be available Trying ds-idrepo-0.ds-idrepo:8080/alive endpoint Policy Store is responding Waiting for UMA Store to be available Trying ds-idrepo-0.ds-idrepo:8080/alive endpoint UMA Store is responding Starting tomcat with opts: -server -Dcom.sun.services.debug.mergeall=on -Dcom.sun.identity.configuration.directory=/home/forgerock/openam -Dcom.iplanet.services.stats.state=off -Dcom.sun.identity.sm.sms_object_filebased_enabled=true -Dorg.forgerock.donotupgrade=true -DtomcatAccessLogDir=/proc/self/fd -DtomcatAccessLogFile=1 --add-opens java.xml/com.sun.org.apache.xerces.internal.dom=ALL-UNNAMED -XX:MaxRAMPercentage=75 -XX:InitialRAMPercentage=75 -XX:MaxTenuringThreshold=1 -Djava.security.egd=file:/dev/urandom -Dorg.forgerock.am.oauth2.consent.xui_path=/OAuth2_XUI -Dcom.forgerock.am.fileconfig.basepaths=/home/forgerock/base/config/services,/home/forgerock/cdk/config/services -Djavax.net.ssl.trustStore=/home/forgerock/amtruststore -Djavax.net.ssl.trustStorePassword=changeit -Djavax.net.ssl.trustStoreType=jks NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 12-Apr-2024 16:46:52.189 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat/9.0.87 12-Apr-2024 16:46:52.192 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: Mar 11 2024 10:12:34 UTC 12-Apr-2024 16:46:52.192 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.87.0 12-Apr-2024 16:46:52.192 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux 12-Apr-2024 16:46:52.192 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.15.133+ 12-Apr-2024 16:46:52.193 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64 12-Apr-2024 16:46:52.193 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /opt/java/openjdk 12-Apr-2024 16:46:52.193 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 17.0.10+7 12-Apr-2024 16:46:52.193 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Eclipse Adoptium 12-Apr-2024 16:46:52.193 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /usr/local/tomcat 12-Apr-2024 16:46:52.193 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /usr/local/tomcat 12-Apr-2024 16:46:52.199 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED 12-Apr-2024 16:46:52.199 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED 12-Apr-2024 16:46:52.199 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED 12-Apr-2024 16:46:52.199 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED 12-Apr-2024 16:46:52.199 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/local/tomcat/conf/logging.properties 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.sun.services.debug.mergeall=on 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.sun.identity.configuration.directory=/home/forgerock/openam 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.iplanet.services.stats.state=off 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.sun.identity.sm.sms_object_filebased_enabled=true 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.forgerock.donotupgrade=true 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -DtomcatAccessLogDir=/proc/self/fd 12-Apr-2024 16:46:52.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -DtomcatAccessLogFile=1 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.xml/com.sun.org.apache.xerces.internal.dom=ALL-UNNAMED 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:MaxRAMPercentage=75 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:InitialRAMPercentage=75 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:MaxTenuringThreshold=1 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.security.egd=file:/dev/urandom 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.forgerock.am.oauth2.consent.xui_path=/OAuth2_XUI 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.forgerock.am.fileconfig.basepaths=/home/forgerock/base/config/services,/home/forgerock/cdk/config/services 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStore=/home/forgerock/amtruststore 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStorePassword=changeit 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStoreType=jks 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs= 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/local/tomcat 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/local/tomcat 12-Apr-2024 16:46:52.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/usr/local/tomcat/temp 12-Apr-2024 16:46:52.204 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.3.0] using APR version [1.7.0]. 12-Apr-2024 16:46:52.205 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], UDS [true]. 12-Apr-2024 16:46:52.205 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true] 12-Apr-2024 16:46:52.208 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 3.0.2 15 Mar 2022] 12-Apr-2024 16:46:52.380 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"] 12-Apr-2024 16:46:52.395 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8081"] 12-Apr-2024 16:46:52.396 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [337] milliseconds 12-Apr-2024 16:46:52.422 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina] 12-Apr-2024 16:46:52.422 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.87] 12-Apr-2024 16:46:52.426 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory [/usr/local/tomcat/webapps/am] 12-Apr-2024 16:47:00.099 INFO [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time. Starting up OpenAM at Apr 12, 2024, 4:47:02 PM {"timestamp":"2024-04-12T16:47:05.744Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"org.forgerock.openam.plugins.PluginLifecycle","message":"PluginTools#upgradePlugins: Encountered plugin org.forgerock.openam.auth.nodes.CloudOnlyNodesPlugin not configured in SMS","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:06.777Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.sm.ldap.LDAPEventManager","message":"LDAPEventManager: received all entries changed event from EventService","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:06.853Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLDAPObject: got notifications, all objects changed","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:06.865Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.sm.ldap.LDAPEventManager","message":"LDAPEventManager: received all entries changed event from EventService","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:06.915Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLDAPObject: got notifications, all objects changed","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:06.958Z","level":"WARN","thread":"Thread-3","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-8"},"logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@43d3f217' is no longer operational: Connect Error: Host 'UNUSED.IN.FBC' cannot be resolved","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-8"} {"timestamp":"2024-04-12T16:47:06.969Z","level":"WARN","thread":"Thread-3","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-8"},"logger":"org.forgerock.openam.services.push.PushNotificationService","message":"No Push Notification Service Config found for realm /","context":"default","exception":"java.util.NoSuchElementException: No value present\n\tat java.base/java.util.Optional.get(Optional.java:143)\n\tat org.forgerock.openam.services.push.PushNotificationServiceConfigHelperFactory.getConfigHelperFor(PushNotificationServiceConfigHelperFactory.java:58)\n\tat org.forgerock.openam.services.push.PushNotificationService.getConfigHelper(PushNotificationService.java:322)\n\tat org.forgerock.openam.services.push.PushNotificationService.updatePreferences(PushNotificationService.java:284)\n\tat org.forgerock.openam.services.push.PushNotificationService.init(PushNotificationService.java:199)\n\tat org.forgerock.openam.services.push.PushNotificationServiceSetupListener$1.run(PushNotificationServiceSetupListener.java:46)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-8"} {"timestamp":"2024-04-12T16:47:06.969Z","level":"WARN","thread":"Thread-3","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-8"},"logger":"org.forgerock.openam.services.push.PushNotificationService","message":"No Push Notification Delegate configured for realm /","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-8"} {"timestamp":"2024-04-12T16:47:06.977Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringConfig","message":"JDMK runtime not found - Legacy Monitoring disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:06.986Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:08.037Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:08.075Z","level":"WARN","thread":"RADIUS-RadiusServerManager","logger":"org.forgerock.openam.radius.server.config.RadiusServerManager","message":"RADIUS service is not enabled.","context":"default","transactionId":null} {"timestamp":"2024-04-12T16:47:09.763Z","eventName":"AM-CONNECTION-UPDATE","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0","runAs":"","objectId":"UpdatableConnectionFactory","operation":"UPDATE","component":"Audit","source":"audit","topic":"activity","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-20","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:47:09.841Z","eventName":"AM-BOOT-JSON-UPDATED","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0","runAs":"","objectId":"boot.json","operation":"UPDATE","component":"Boot Json","source":"audit","topic":"config","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-22","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:47:09.860Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.iplanet.services.naming.WebtopNaming","message":"WebtopNaming.configMonitoring: start generating ssoserverinfo\n Start time = 2024-04-12 16:47:09","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.864Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring HTML port not enabled in configuration or JDMK not present.","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.864Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring SNMP port not enabled or JDMK not present.","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.865Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring RMI port not enabled.","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.868Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@43dbb465' is no longer operational: Connect Error: Host 'UNUSED.IN.FBC' cannot be resolved","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.887Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLdapObject:entryExists: LdapSmsEntryUid{dn='ou=default,ou=OrganizationConfig,ou=1.0,ou=sunFMCOTConfigService,ou=services,ou=am-config', dataStoreId=DataStoreId{id='application-store'}} does not exist","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.894Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLdapObject:entryExists: LdapSmsEntryUid{dn='ou=default,ou=OrganizationConfig,ou=1.0,ou=sunFMWSFederationMetadataService,ou=services,ou=am-config', dataStoreId=DataStoreId{id='application-store'}} does not exist","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.899Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.902Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.902Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.903Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.907Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.922Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} {"timestamp":"2024-04-12T16:47:09.926Z","level":"WARN","thread":"main","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"},"logger":"com.sun.identity.monitoring.FederationMonitoringSetupImpl","message":"JDMK runtime not found - Federation SNMP disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-0"} 12-Apr-2024 16:47:12.583 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/usr/local/tomcat/webapps/am] has finished in [20,154] ms 12-Apr-2024 16:47:12.586 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"] 12-Apr-2024 16:47:12.595 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8081"] 12-Apr-2024 16:47:12.597 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [20201] milliseconds {"timestamp":"2024-04-12T16:47:12.731Z","level":"WARN","thread":"http-nio-8080-exec-1","logger":"org.forgerock.openam.core.rest.docs.api.ApiDocsService","message":"API Descriptor has changed - regenerating docs","context":"default","transactionId":null} {"timestamp":"2024-04-12T16:47:13.570Z","level":"ERROR","thread":"http-nio-8081-exec-1","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-28"},"logger":"org.forgerock.http.servlet.HttpFrameworkServlet","message":"Failed to write response - rootId:06ec822b-6b76-4706-814c-30ec1bc7ab81-31","context":"default","exception":"org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe\n\tat org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:345)\n\tat org.apache.catalina.connector.OutputBuffer.flushByteBuffer(OutputBuffer.java:780)\n\tat org.apache.catalina.connector.OutputBuffer.append(OutputBuffer.java:677)\n\tat org.apache.catalina.connector.OutputBuffer.writeBytes(OutputBuffer.java:380)\n\tat org.apache.catalina.connector.OutputBuffer.write(OutputBuffer.java:358)\n\tat org.apache.catalina.connector.CoyoteOutputStream.write(CoyoteOutputStream.java:103)\n\tat org.forgerock.http.io.IO.stream(IO.java:290)\n\tat org.forgerock.http.servlet.HttpFrameworkServlet.writeChfResponse(HttpFrameworkServlet.java:397)\n\tat org.forgerock.http.servlet.HttpFrameworkServlet.lambda$writeAndCloseChfResponse$2(HttpFrameworkServlet.java:359)\n\tat org.forgerock.http.servlet.Servlet3Adapter$SynchronousServletSynchronizer.runIfNotCompleted(Servlet3Adapter.java:151)\n\tat org.forgerock.http.servlet.HttpFrameworkServlet.writeAndCloseChfResponse(HttpFrameworkServlet.java:359)\n\tat org.forgerock.http.servlet.HttpFrameworkServlet.lambda$service$0(HttpFrameworkServlet.java:284)\n\tat org.forgerock.util.promise.Promises$CompletedPromise.thenOnResult(Promises.java:132)\n\tat org.forgerock.http.servlet.HttpFrameworkServlet.service(HttpFrameworkServlet.java:284)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:623)\n\tat org.forgerock.openam.http.OpenAMHttpFrameworkServlet.service(OpenAMHttpFrameworkServlet.java:47)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:623)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:210)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.validation.LargeCookieWarningFilter.doFilter(LargeCookieWarningFilter.java:48)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.services.datastore.DataStoreConsistencyFilter.lambda$doFilter$0(DataStoreConsistencyFilter.java:46)\n\tat org.forgerock.openam.service.datastore.ReentrantVolatileActionConsistencyController.safeExecute(ReentrantVolatileActionConsistencyController.java:37)\n\tat org.forgerock.openam.services.datastore.DataStoreConsistencyFilter.doFilter(DataStoreConsistencyFilter.java:46)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.rest.ProtocolVersionFilter.doFilter(ProtocolVersionFilter.java:63)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.headers.SecureCookieFilter.doFilter(SecureCookieFilter.java:63)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.headers.DisableSameSiteCookiesFilter.doFilter(DisableSameSiteCookiesFilter.java:106)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.validation.ResponseValidationFilter.doFilter(ResponseValidationFilter.java:59)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.headers.SetHeadersFilter.doFilter(SetHeadersFilter.java:110)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.headers.SetHeadersFilter.doFilter(SetHeadersFilter.java:110)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.headers.SetHeadersFilter.doFilter(SetHeadersFilter.java:110)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat com.sun.identity.setup.AMSetupFilter.doFilter(AMSetupFilter.java:116)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.validation.RequestEntitySizeVerificationFilter.doFilter(RequestEntitySizeVerificationFilter.java:66)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.forgerock.openam.audit.context.AuditContextFilter.doFilter(AuditContextFilter.java:43)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:179)\n\tat org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:154)\n\tat org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:168)\n\tat org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90)\n\tat org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:481)\n\tat org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130)\n\tat org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93)\n\tat org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:670)\n\tat org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)\n\tat org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:346)\n\tat org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:390)\n\tat org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)\n\tat org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:928)\n\tat org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1786)\n\tat org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)\n\tat org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)\n\tat org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)\n\tat org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:63)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\nCaused by: java.io.IOException: Broken pipe\n\tat java.base/sun.nio.ch.FileDispatcherImpl.write0(Native Method)\n\tat java.base/sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:62)\n\tat java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:132)\n\tat java.base/sun.nio.ch.IOUtil.write(IOUtil.java:97)\n\tat java.base/sun.nio.ch.IOUtil.write(IOUtil.java:53)\n\tat java.base/sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:532)\n\tat org.apache.tomcat.util.net.NioChannel.write(NioChannel.java:136)\n\tat org.apache.tomcat.util.net.NioEndpoint$NioSocketWrapper.doWrite(NioEndpoint.java:1423)\n\tat org.apache.tomcat.util.net.SocketWrapperBase.doWrite(SocketWrapperBase.java:775)\n\tat org.apache.tomcat.util.net.SocketWrapperBase.writeBlocking(SocketWrapperBase.java:600)\n\tat org.apache.tomcat.util.net.SocketWrapperBase.write(SocketWrapperBase.java:544)\n\tat org.apache.coyote.http11.Http11OutputBuffer$SocketOutputBuffer.doWrite(Http11OutputBuffer.java:540)\n\tat org.apache.coyote.http11.filters.IdentityOutputFilter.doWrite(IdentityOutputFilter.java:73)\n\tat org.apache.coyote.http11.Http11OutputBuffer.doWrite(Http11OutputBuffer.java:193)\n\tat org.apache.coyote.Response.doWrite(Response.java:608)\n\tat org.apache.catalina.connector.OutputBuffer.realWriteBytes(OutputBuffer.java:333)\n\t... 76 common frames omitted\n","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-28"} 10.106.40.129 - - [12/Apr/2024:16:47:13 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 887ms 10.106.40.129 - - [12/Apr/2024:16:47:13 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 887ms 10.106.41.131 - - [12/Apr/2024:16:47:13 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 81920 952ms 10.106.40.129 - - [12/Apr/2024:16:47:19 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.40.129 - - [12/Apr/2024:16:47:19 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 7ms 10.106.40.129 - - [12/Apr/2024:16:47:29 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 5ms 10.106.41.131 - - [12/Apr/2024:16:47:31 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 199897 28ms 10.106.40.129 - - [12/Apr/2024:16:47:39 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.40.129 - - [12/Apr/2024:16:47:39 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 5ms 10.106.40.129 - - [12/Apr/2024:16:47:49 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 5ms 10.106.40.129 - - [12/Apr/2024:16:47:59 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 6ms 10.106.41.131 - - [12/Apr/2024:16:48:01 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 199926 26ms 10.106.40.129 - - [12/Apr/2024:16:48:09 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.40.129 - - [12/Apr/2024:16:48:09 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 5ms 10.106.40.129 - - [12/Apr/2024:16:48:19 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 5ms 10.106.40.129 - - [12/Apr/2024:16:48:29 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 5ms 10.106.41.131 - - [12/Apr/2024:16:48:31 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 199942 25ms 10.106.40.129 - - [12/Apr/2024:16:48:39 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.40.129 - - [12/Apr/2024:16:48:39 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 5ms {"timestamp":"2024-04-12T16:48:47.202Z","level":"WARN","thread":"http-nio-8081-exec-8","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"},"logger":"org.forgerock.openam.core.realms.impl.DefaultRealmLookup","message":"DefaultRealms:lookup Unable to find Org name for: authenticate","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"} {"timestamp":"2024-04-12T16:48:47.265Z","level":"WARN","thread":"http-nio-8081-exec-8","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module OpenIdConnect","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"} {"timestamp":"2024-04-12T16:48:47.274Z","level":"WARN","thread":"http-nio-8081-exec-8","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module AuthenticatorPushRegistration","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"} {"timestamp":"2024-04-12T16:48:47.282Z","level":"WARN","thread":"http-nio-8081-exec-8","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module PersistentCookie","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"} {"timestamp":"2024-04-12T16:48:47.396Z","level":"WARN","thread":"http-nio-8081-exec-8","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"} {"timestamp":"2024-04-12T16:48:47.414Z","eventName":"AM-NEW-CONNECTION-FACTORY","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92","runAs":"","objectId":"OpenDJ:bindConnectionFactory","operation":"UPDATE","realm":"ou=am-config","component":"ID Repo","source":"audit","topic":"activity","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-97","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:48:47.417Z","eventName":"AM-NEW-CONNECTION-FACTORY","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92","runAs":"","objectId":"OpenDJ:connectionFactory","operation":"UPDATE","realm":"ou=am-config","component":"ID Repo","source":"audit","topic":"activity","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-99","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:48:47.420Z","eventName":"AM-NEW-CONNECTION-FACTORY","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92","runAs":"","objectId":"OpenDJ:passwordConnectionFactory","operation":"UPDATE","realm":"ou=am-config","component":"ID Repo","source":"audit","topic":"activity","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-101","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:48:47.425Z","eventName":"AM-NEW-CONNECTION-FACTORY","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92","runAs":"","objectId":"OpenDJ:persistentSearchConnectionFactory","operation":"UPDATE","realm":"ou=am-config","component":"ID Repo","source":"audit","topic":"activity","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-103","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:48:47.462Z","level":"WARN","thread":"http-nio-8081-exec-8","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"},"logger":"com.sun.identity.idm.plugins.internal.AgentsRepo","message":"AgentsRepo.getAgentGroupConfig: Unable to get Agent Group Config due to The instance agentgroup does not exist","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"} {"timestamp":"2024-04-12T16:48:47.518Z","eventName":"AM-LOGIN-MODULE-COMPLETED","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92","trackingIds":["06ec822b-6b76-4706-814c-30ec1bc7ab81-95"],"userId":"id=amadmin,ou=user,ou=am-config","principal":["amadmin"],"entries":[{"moduleId":"DataStore","info":{"authControlFlag":"REQUIRED","moduleClass":"DataStore","ipAddress":"10.106.40.13","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-105","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:48:47.662Z","level":"WARN","thread":"http-nio-8081-exec-8","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92"} {"timestamp":"2024-04-12T16:48:47.657Z","eventName":"AM-SESSION-CREATED","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92","trackingIds":["06ec822b-6b76-4706-814c-30ec1bc7ab81-95"],"userId":"id=amadmin,ou=user,ou=am-config","runAs":"id=amadmin,ou=user,ou=am-config","objectId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-95","operation":"CREATE","realm":"/","component":"Session","source":"audit","topic":"activity","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-110","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:48:47.674Z","eventName":"AM-LOGIN-COMPLETED","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92","trackingIds":["06ec822b-6b76-4706-814c-30ec1bc7ab81-95"],"userId":"id=amadmin,ou=user,ou=am-config","principal":["amadmin"],"entries":[{"moduleId":"DataStore","info":{"ipAddress":"10.106.40.13","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-114","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:48:47.693Z","eventName":"AM-ACCESS-OUTCOME","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-92","trackingIds":["06ec822b-6b76-4706-814c-30ec1bc7ab81-95"],"userId":"id=amadmin,ou=user,ou=am-config","client":{"ip":"10.106.40.13","port":38482},"http":{"request":{"secure":true,"method":"POST","path":"https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/authenticate","headers":{"accept":["*/*"],"accept-api-version":["protocol=1.0,resource=2.0"],"content-type":["application/json"],"host":["xlou.iam.xlou-cdm.engineeringpit.com"],"user-agent":["python-requests/2.31.0"],"x-forwarded-for":["35.212.145.225"],"x-forwarded-host":["xlou.iam.xlou-cdm.engineeringpit.com"],"x-forwarded-port":["443"],"x-forwarded-proto":["https"],"x-real-ip":["35.212.145.225"],"x-request-id":["bed4db0eed2379c3c50b8c01d9f7740e"],"x-scheme":["https"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":549,"elapsedTimeUnits":"MILLISECONDS"},"realm":"/","component":"Authentication","source":"audit","topic":"access","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-120","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-12T16:48:50.740Z","level":"WARN","thread":"http-nio-8081-exec-9","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-124"},"logger":"org.forgerock.openam.core.realms.impl.DefaultRealmLookup","message":"DefaultRealms:lookup Unable to find Org name for: access_token","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-124"} {"timestamp":"2024-04-12T16:48:51.035Z","eventName":"AM-ACCESS-OUTCOME","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-124","trackingIds":["06ec822b-6b76-4706-814c-30ec1bc7ab81-127","b93c1dc0-ec6a-4532-ae7d-8b702af2ad3c-129"],"userId":"id=smokeclient,ou=agent,ou=am-config","client":{"ip":"10.106.40.13","port":38494},"http":{"request":{"secure":true,"method":"POST","path":"https://xlou.iam.xlou-cdm.engineeringpit.com/am/oauth2/access_token","headers":{"accept":["*/*"],"content-type":["application/x-www-form-urlencoded"],"host":["xlou.iam.xlou-cdm.engineeringpit.com"],"user-agent":["python-requests/2.31.0"],"x-forwarded-for":["35.212.145.225"],"x-forwarded-host":["xlou.iam.xlou-cdm.engineeringpit.com"],"x-forwarded-port":["443"],"x-forwarded-proto":["https"],"x-real-ip":["35.212.145.225"],"x-request-id":["ebe1148cd142713f0153283b98827765"],"x-scheme":["https"]}}},"request":{"detail":{"resourceOwnerId":"id=amadmin,ou=user,ou=am-config"}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":302,"elapsedTimeUnits":"MILLISECONDS","detail":{"scope":"fr:idm:*","token_type":"Bearer"}},"realm":"/","component":"OAuth","source":"audit","topic":"access","level":"INFO","_eventId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-130","_normalized":{"fieldNames":{}}} 10.106.40.13 - - [12/Apr/2024:16:48:46 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 7ms 10.106.40.13 - - [12/Apr/2024:16:48:47 +0000] "POST /am/json/authenticate?realm=/ HTTP/1.1" 200 167 556ms 10.106.40.129 - - [12/Apr/2024:16:48:49 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 6ms 10.106.40.13 - - [12/Apr/2024:16:48:51 +0000] "POST /am/oauth2/access_token?realm=/ HTTP/1.1" 200 105 305ms {"timestamp":"2024-04-12T16:48:52.675Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(1)","mdc":{"transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-43"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"06ec822b-6b76-4706-814c-30ec1bc7ab81-43"} 10.106.40.129 - - [12/Apr/2024:16:48:59 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 6ms 10.106.41.131 - - [12/Apr/2024:16:49:01 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 356704 51ms 10.106.40.129 - - [12/Apr/2024:16:49:09 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.40.129 - - [12/Apr/2024:16:49:09 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 5ms