==================================================================================================== ========================================= Pod describe ========================================= ==================================================================================================== Name: am-848586d8db-f4ck2 Namespace: xlou Priority: 0 Service Account: default Node: gke-xlou-cdm-ds-0f601751-cf7b/10.142.0.38 Start Time: Fri, 19 Apr 2024 14:59:40 +0000 Labels: app=am app.kubernetes.io/component=am app.kubernetes.io/instance=am app.kubernetes.io/name=am app.kubernetes.io/part-of=forgerock pod-template-hash=848586d8db tier=middle Annotations: cluster-autoscaler.kubernetes.io/safe-to-evict: true kubectl.kubernetes.io/restartedAt: 2024-04-18T23:35:12Z Status: Running IP: 10.106.44.142 IPs: IP: 10.106.44.142 Controlled By: ReplicaSet/am-848586d8db Init Containers: fbc-init: Container ID: containerd://ad1c1b81d09eb9b5dbfe3555f8ad634fb35317f2d1272560f3dc5fb43991fda2 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:0488d1f58b1bfb62dc04ff25b3bdf45580475705679ac11edf4a0407ca86f27f Port: Host Port: Command: /bin/bash -c if [ -d /fbc/config ]; then echo "Existing openam configuration found. Skipping copy" else echo "Copying docker image configuration files to the shared volume" cd /home/forgerock/openam cp -r .homeVersion * /fbc fi State: Terminated Reason: Completed Exit Code: 0 Started: Fri, 19 Apr 2024 14:59:42 +0000 Finished: Fri, 19 Apr 2024 14:59:42 +0000 Ready: True Restart Count: 0 Environment: Mounts: /fbc from fbc (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-c4tfc (ro) truststore-init: Container ID: containerd://74dba1ff90860ac80925838c10291d8166a61d861f566590ab17a5ac31813622 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:0488d1f58b1bfb62dc04ff25b3bdf45580475705679ac11edf4a0407ca86f27f Port: Host Port: Command: /home/forgerock/import-pem-certs.sh State: Terminated Reason: Completed Exit Code: 0 Started: Fri, 19 Apr 2024 14:59:42 +0000 Finished: Fri, 19 Apr 2024 14:59:43 +0000 Ready: True Restart Count: 0 Environment: TRUSTSTORE_PATH: /truststore/amtruststore TRUSTSTORE_PASSWORD: changeit AM_PEM_TRUSTSTORE: /var/run/secrets/truststore/cacerts AM_PEM_TRUSTSTORE_DS: /var/run/secrets/truststore/ca.crt Mounts: /truststore from new-truststore (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-c4tfc (ro) /var/run/secrets/truststore from truststore (rw) Containers: openam: Container ID: containerd://6e230748e84f2751c156392364c691cba484fbaf042fca2a3491c30851d0bd60 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:0488d1f58b1bfb62dc04ff25b3bdf45580475705679ac11edf4a0407ca86f27f Port: 8080/TCP Host Port: 0/TCP Command: bash /home/forgerock/docker-entrypoint.sh State: Running Started: Fri, 19 Apr 2024 14:59:43 +0000 Ready: True Restart Count: 0 Limits: memory: 10Gi Requests: cpu: 11 memory: 10Gi Liveness: http-get http://:8080/am/json/health/live delay=30s timeout=5s period=30s #success=1 #failure=3 Readiness: http-get http://:8080/am/json/health/ready delay=20s timeout=5s period=10s #success=1 #failure=3 Startup: http-get http://:8080/am/json/health/live delay=0s timeout=1s period=10s #success=1 #failure=40 Environment Variables from: am-env-secrets Secret Optional: false platform-config ConfigMap Optional: false amster-env-secrets Secret Optional: false ds-env-secrets Secret Optional: false Environment: NAMESPACE: xlou (v1:metadata.namespace) AM_STORES_SSL_ENABLED: true TRUSTSTORE_PATH: /home/forgerock/amtruststore TRUSTSTORE_PASSWORD: changeit AM_STORES_USER_TYPE: LDAPv3ForForgeRockIAM Mounts: /home/forgerock/amtruststore from new-truststore (ro,path="amtruststore") /home/forgerock/logging from am-logback (rw) /home/forgerock/openam from fbc (rw) /var/run/secrets/am from am-secrets (rw) /var/run/secrets/amster from amster-key (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-c4tfc (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: fbc: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-secrets: Type: Projected (a volume that contains injected data from multiple sources) SecretName: am-passwords SecretOptionalName: SecretName: am-keystore SecretOptionalName: amster-key: Type: Secret (a volume populated by a Secret) SecretName: amster Optional: false truststore: Type: Projected (a volume that contains injected data from multiple sources) SecretName: truststore-pem SecretOptionalName: SecretName: ds-ssl-keypair SecretOptionalName: new-truststore: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-logback: Type: ConfigMap (a volume populated by a ConfigMap) Name: am-logback Optional: false kube-api-access-c4tfc: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: Tolerations: kubernetes.io/arch:NoSchedule op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 5m57s default-scheduler Successfully assigned xlou/am-848586d8db-f4ck2 to gke-xlou-cdm-ds-0f601751-cf7b Normal Pulling 5m56s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" Normal Pulled 5m55s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" in 955.271781ms (955.27716ms including waiting) Normal Created 5m55s kubelet Created container fbc-init Normal Started 5m55s kubelet Started container fbc-init Normal Pulling 5m55s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" Normal Pulled 5m55s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" in 212.758947ms (212.765815ms including waiting) Normal Created 5m55s kubelet Created container truststore-init Normal Started 5m55s kubelet Started container truststore-init Normal Pulling 5m54s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" Normal Pulled 5m54s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" in 207.290982ms (207.296791ms including waiting) Normal Created 5m54s kubelet Created container openam Normal Started 5m54s kubelet Started container openam Warning Unhealthy 5m36s (x2 over 5m46s) kubelet Startup probe failed: Get "http://10.106.44.142:8080/am/json/health/live": context deadline exceeded (Client.Timeout exceeded while awaiting headers) ==================================================================================================== =========================================== Pod logs =========================================== ==================================================================================================== Copying docker image configuration files to the shared volume Copying /opt/java/openjdk/lib/security/cacerts to /truststore/amtruststore Found (2) certificates in am_combined_truststore Importing (2) certificates into /truststore/amtruststore Certificate was added to keystore Certificate was added to keystore Import complete! Copying bootstrap files for legacy AMKeyProvider Waiting for User Store to be available Trying ds-idrepo-0.ds-idrepo:8080/alive endpoint User Store is responding Waiting for CTS to be available Trying ds-cts-0.ds-cts:8080/alive endpoint CTS is responding Waiting for Application Store to be available Trying ds-idrepo-0.ds-idrepo:8080/alive endpoint Application Store is responding Waiting for Policy Store to be available Trying ds-idrepo-0.ds-idrepo:8080/alive endpoint Policy Store is responding Waiting for UMA Store to be available Trying ds-idrepo-0.ds-idrepo:8080/alive endpoint UMA Store is responding Starting tomcat with opts: -server -Dcom.sun.services.debug.mergeall=on -Dcom.sun.identity.configuration.directory=/home/forgerock/openam -Dcom.iplanet.services.stats.state=off -Dcom.sun.identity.sm.sms_object_filebased_enabled=true -Dorg.forgerock.donotupgrade=true -DtomcatAccessLogDir=/proc/self/fd -DtomcatAccessLogFile=1 --add-opens java.xml/com.sun.org.apache.xerces.internal.dom=ALL-UNNAMED -XX:MaxRAMPercentage=75 -XX:InitialRAMPercentage=75 -XX:MaxTenuringThreshold=1 -Djava.security.egd=file:/dev/urandom -Dorg.forgerock.am.oauth2.consent.xui_path=/OAuth2_XUI -Dcom.forgerock.am.fileconfig.basepaths=/home/forgerock/base/config/services,/home/forgerock/cdk/config/services -Djavax.net.ssl.trustStore=/home/forgerock/amtruststore -Djavax.net.ssl.trustStorePassword=changeit -Djavax.net.ssl.trustStoreType=jks NOTE: Picked up JDK_JAVA_OPTIONS: --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 19-Apr-2024 14:59:45.824 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat/9.0.87 19-Apr-2024 14:59:45.827 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: Mar 11 2024 10:12:34 UTC 19-Apr-2024 14:59:45.827 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.87.0 19-Apr-2024 14:59:45.827 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux 19-Apr-2024 14:59:45.827 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.15.133+ 19-Apr-2024 14:59:45.827 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64 19-Apr-2024 14:59:45.828 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /opt/java/openjdk 19-Apr-2024 14:59:45.828 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 17.0.10+7 19-Apr-2024 14:59:45.828 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Eclipse Adoptium 19-Apr-2024 14:59:45.828 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /usr/local/tomcat 19-Apr-2024 14:59:45.828 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /usr/local/tomcat 19-Apr-2024 14:59:45.834 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED 19-Apr-2024 14:59:45.834 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED 19-Apr-2024 14:59:45.834 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED 19-Apr-2024 14:59:45.834 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/local/tomcat/conf/logging.properties 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.sun.services.debug.mergeall=on 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.sun.identity.configuration.directory=/home/forgerock/openam 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.iplanet.services.stats.state=off 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.sun.identity.sm.sms_object_filebased_enabled=true 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.forgerock.donotupgrade=true 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -DtomcatAccessLogDir=/proc/self/fd 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -DtomcatAccessLogFile=1 19-Apr-2024 14:59:45.835 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.xml/com.sun.org.apache.xerces.internal.dom=ALL-UNNAMED 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:MaxRAMPercentage=75 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:InitialRAMPercentage=75 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:MaxTenuringThreshold=1 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.security.egd=file:/dev/urandom 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.forgerock.am.oauth2.consent.xui_path=/OAuth2_XUI 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcom.forgerock.am.fileconfig.basepaths=/home/forgerock/base/config/services,/home/forgerock/cdk/config/services 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStore=/home/forgerock/amtruststore 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStorePassword=changeit 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStoreType=jks 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs= 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/local/tomcat 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/local/tomcat 19-Apr-2024 14:59:45.836 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/usr/local/tomcat/temp 19-Apr-2024 14:59:45.839 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.3.0] using APR version [1.7.0]. 19-Apr-2024 14:59:45.839 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], UDS [true]. 19-Apr-2024 14:59:45.840 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true] 19-Apr-2024 14:59:45.843 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 3.0.2 15 Mar 2022] 19-Apr-2024 14:59:46.018 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"] 19-Apr-2024 14:59:46.034 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8081"] 19-Apr-2024 14:59:46.034 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [344] milliseconds 19-Apr-2024 14:59:46.061 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina] 19-Apr-2024 14:59:46.062 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.87] 19-Apr-2024 14:59:46.066 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory [/usr/local/tomcat/webapps/am] 19-Apr-2024 14:59:53.549 INFO [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time. Starting up OpenAM at Apr 19, 2024, 2:59:55 PM {"timestamp":"2024-04-19T14:59:59.295Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"org.forgerock.openam.plugins.PluginLifecycle","message":"PluginTools#upgradePlugins: Encountered plugin org.forgerock.openam.auth.nodes.CloudOnlyNodesPlugin not configured in SMS","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:00.290Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.sm.ldap.LDAPEventManager","message":"LDAPEventManager: received all entries changed event from EventService","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:00.366Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLDAPObject: got notifications, all objects changed","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:00.376Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.sm.ldap.LDAPEventManager","message":"LDAPEventManager: received all entries changed event from EventService","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:00.427Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLDAPObject: got notifications, all objects changed","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:00.470Z","level":"WARN","thread":"Thread-3","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-8"},"logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@20f4ad8f' is no longer operational: Connect Error: Host 'UNUSED.IN.FBC' cannot be resolved","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-8"} {"timestamp":"2024-04-19T15:00:00.481Z","level":"WARN","thread":"Thread-3","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-8"},"logger":"org.forgerock.openam.services.push.PushNotificationService","message":"No Push Notification Service Config found for realm /","context":"default","exception":"java.util.NoSuchElementException: No value present\n\tat java.base/java.util.Optional.get(Optional.java:143)\n\tat org.forgerock.openam.services.push.PushNotificationServiceConfigHelperFactory.getConfigHelperFor(PushNotificationServiceConfigHelperFactory.java:58)\n\tat org.forgerock.openam.services.push.PushNotificationService.getConfigHelper(PushNotificationService.java:322)\n\tat org.forgerock.openam.services.push.PushNotificationService.updatePreferences(PushNotificationService.java:284)\n\tat org.forgerock.openam.services.push.PushNotificationService.init(PushNotificationService.java:199)\n\tat org.forgerock.openam.services.push.PushNotificationServiceSetupListener$1.run(PushNotificationServiceSetupListener.java:46)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-8"} {"timestamp":"2024-04-19T15:00:00.481Z","level":"WARN","thread":"Thread-3","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-8"},"logger":"org.forgerock.openam.services.push.PushNotificationService","message":"No Push Notification Delegate configured for realm /","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-8"} {"timestamp":"2024-04-19T15:00:00.503Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringConfig","message":"JDMK runtime not found - Legacy Monitoring disabled","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:00.513Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:01.544Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:01.574Z","level":"WARN","thread":"RADIUS-RadiusServerManager","logger":"org.forgerock.openam.radius.server.config.RadiusServerManager","message":"RADIUS service is not enabled.","context":"default","transactionId":null} {"timestamp":"2024-04-19T15:00:03.368Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.iplanet.services.naming.WebtopNaming","message":"WebtopNaming.configMonitoring: start generating ssoserverinfo\n Start time = 2024-04-19 15:00:03","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.371Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring HTML port not enabled in configuration or JDMK not present.","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.371Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring SNMP port not enabled or JDMK not present.","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.372Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring RMI port not enabled.","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.375Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@63b89f6f' is no longer operational: Connect Error: Host 'UNUSED.IN.FBC' cannot be resolved","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.390Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLdapObject:entryExists: LdapSmsEntryUid{dn='ou=default,ou=OrganizationConfig,ou=1.0,ou=sunFMCOTConfigService,ou=services,ou=am-config', dataStoreId=DataStoreId{id='application-store'}} does not exist","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.395Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLdapObject:entryExists: LdapSmsEntryUid{dn='ou=default,ou=OrganizationConfig,ou=1.0,ou=sunFMWSFederationMetadataService,ou=services,ou=am-config', dataStoreId=DataStoreId{id='application-store'}} does not exist","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.399Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.402Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.403Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.403Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.407Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.420Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} {"timestamp":"2024-04-19T15:00:03.423Z","level":"WARN","thread":"main","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"},"logger":"com.sun.identity.monitoring.FederationMonitoringSetupImpl","message":"JDMK runtime not found - Federation SNMP disabled","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-0"} 19-Apr-2024 15:00:05.955 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/usr/local/tomcat/webapps/am] has finished in [19,887] ms 19-Apr-2024 15:00:05.959 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"] 19-Apr-2024 15:00:05.968 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8081"] 19-Apr-2024 15:00:05.969 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [19935] milliseconds {"timestamp":"2024-04-19T15:00:06.089Z","level":"WARN","thread":"http-nio-8080-exec-1","logger":"org.forgerock.openam.core.rest.docs.api.ApiDocsService","message":"API Descriptor has changed - regenerating docs","context":"default","transactionId":null} 10.106.44.129 - - [19/Apr/2024:15:00:06 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 726ms 10.106.44.129 - - [19/Apr/2024:15:00:06 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 726ms 10.106.41.131 - - [19/Apr/2024:15:00:06 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201733 767ms 10.106.44.129 - - [19/Apr/2024:15:00:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:00:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:00:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [19/Apr/2024:15:00:29 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201712 21ms 10.106.44.129 - - [19/Apr/2024:15:00:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:00:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:00:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:00:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.41.131 - - [19/Apr/2024:15:00:59 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201684 20ms 10.106.44.129 - - [19/Apr/2024:15:01:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:01:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [19/Apr/2024:15:01:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:01:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.41.131 - - [19/Apr/2024:15:01:29 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201704 20ms 10.106.44.129 - - [19/Apr/2024:15:01:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:01:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:01:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:01:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.41.131 - - [19/Apr/2024:15:01:59 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201658 18ms 10.106.44.129 - - [19/Apr/2024:15:02:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:02:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [19/Apr/2024:15:02:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:02:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [19/Apr/2024:15:02:29 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201657 19ms 10.106.44.129 - - [19/Apr/2024:15:02:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:02:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:02:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:02:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [19/Apr/2024:15:02:59 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201676 18ms 10.106.44.129 - - [19/Apr/2024:15:03:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:03:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [19/Apr/2024:15:03:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:03:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [19/Apr/2024:15:03:29 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201671 17ms 10.106.44.129 - - [19/Apr/2024:15:03:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:03:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:03:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:03:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [19/Apr/2024:15:03:59 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201685 17ms 10.106.44.129 - - [19/Apr/2024:15:04:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:04:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:04:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:04:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [19/Apr/2024:15:04:29 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201703 17ms 10.106.44.129 - - [19/Apr/2024:15:04:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:04:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:04:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.129 - - [19/Apr/2024:15:04:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [19/Apr/2024:15:04:59 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 201648 17ms 10.106.44.129 - - [19/Apr/2024:15:05:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.140 - - [19/Apr/2024:15:05:02 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms {"timestamp":"2024-04-19T15:05:13.631Z","level":"WARN","thread":"http-nio-8081-exec-6","mdc":{"transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-204"},"logger":"org.forgerock.openam.core.realms.impl.DefaultRealmLookup","message":"DefaultRealms:lookup Unable to find Org name for: serverinfo","context":"default","transactionId":"261134f3-ab95-42e5-bdcc-bb31512564e9-204"} 10.106.44.140 - - [19/Apr/2024:15:05:06 +0000] "POST /am/json/realms/root/sessions?_action=getSessionInfo HTTP/1.1" 200 289 206ms 10.106.44.129 - - [19/Apr/2024:15:05:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 3ms 10.106.44.129 - - [19/Apr/2024:15:05:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.44.140 - - [19/Apr/2024:15:05:13 +0000] "GET /am/json/serverinfo/version HTTP/1.1" 200 276 21ms 10.106.44.129 - - [19/Apr/2024:15:05:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [19/Apr/2024:15:05:29 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357988 35ms 10.106.44.129 - - [19/Apr/2024:15:05:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms