==================================================================================================== ========================================= Pod describe ========================================= ==================================================================================================== Name: am-6844b8c4b7-6m7z2 Namespace: xlou Priority: 0 Service Account: default Node: gke-xlou-cdm-ds-0f601751-cf7b/10.142.0.38 Start Time: Wed, 17 Apr 2024 17:42:39 +0000 Labels: app=am app.kubernetes.io/component=am app.kubernetes.io/instance=am app.kubernetes.io/name=am app.kubernetes.io/part-of=forgerock pod-template-hash=6844b8c4b7 tier=middle Annotations: cluster-autoscaler.kubernetes.io/safe-to-evict: true Status: Running IP: 10.106.44.138 IPs: IP: 10.106.44.138 Controlled By: ReplicaSet/am-6844b8c4b7 Init Containers: fbc-init: Container ID: containerd://757d5261d2e72bcbc8140358b30fc0ed510d548479c41cb7be6e0b7032f1f828 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:5a7ff8acce19e67259d55fb7b2afe48b171755446d751303b4117bafd41419b1 Port: Host Port: Command: /bin/bash -c if [ -d /fbc/config ]; then echo "Existing openam configuration found. Skipping copy" else echo "Copying docker image configuration files to the shared volume" cd /home/forgerock/openam cp -r .homeVersion * /fbc fi State: Terminated Reason: Completed Exit Code: 0 Started: Wed, 17 Apr 2024 17:42:49 +0000 Finished: Wed, 17 Apr 2024 17:42:49 +0000 Ready: True Restart Count: 0 Environment: Mounts: /fbc from fbc (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-8gtf9 (ro) truststore-init: Container ID: containerd://e849f1e511d61f1ffe83998e19f7d89ca1d4d182a7fecad2b4a5d40e52831a23 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:5a7ff8acce19e67259d55fb7b2afe48b171755446d751303b4117bafd41419b1 Port: Host Port: Command: /home/forgerock/import-pem-certs.sh State: Terminated Reason: Completed Exit Code: 0 Started: Wed, 17 Apr 2024 17:42:53 +0000 Finished: Wed, 17 Apr 2024 17:42:54 +0000 Ready: True Restart Count: 0 Environment: TRUSTSTORE_PATH: /truststore/amtruststore TRUSTSTORE_PASSWORD: changeit AM_PEM_TRUSTSTORE: /var/run/secrets/truststore/cacerts AM_PEM_TRUSTSTORE_DS: /var/run/secrets/truststore/ca.crt Mounts: /truststore from new-truststore (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-8gtf9 (ro) /var/run/secrets/truststore from truststore (rw) Containers: openam: Container ID: containerd://e75181f5d93af4037d405859c834c40e337131aa0bfc8e51436e41e16b9a102a Image: gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:5a7ff8acce19e67259d55fb7b2afe48b171755446d751303b4117bafd41419b1 Port: 8080/TCP Host Port: 0/TCP Command: bash /home/forgerock/docker-entrypoint.sh State: Running Started: Wed, 17 Apr 2024 17:42:54 +0000 Ready: True Restart Count: 0 Limits: memory: 10Gi Requests: cpu: 11 memory: 10Gi Liveness: http-get http://:8080/am/json/health/live delay=30s timeout=5s period=30s #success=1 #failure=3 Readiness: http-get http://:8080/am/json/health/ready delay=20s timeout=5s period=10s #success=1 #failure=3 Startup: http-get http://:8080/am/json/health/live delay=0s timeout=1s period=10s #success=1 #failure=40 Environment Variables from: am-env-secrets Secret Optional: false platform-config ConfigMap Optional: false amster-env-secrets Secret Optional: false ds-env-secrets Secret Optional: false Environment: NAMESPACE: xlou (v1:metadata.namespace) AM_STORES_SSL_ENABLED: true TRUSTSTORE_PATH: /home/forgerock/amtruststore TRUSTSTORE_PASSWORD: changeit AM_STORES_USER_TYPE: LDAPv3ForForgeRockIAM Mounts: /home/forgerock/amtruststore from new-truststore (ro,path="amtruststore") /home/forgerock/logging from am-logback (rw) /home/forgerock/openam from fbc (rw) /var/run/secrets/am from am-secrets (rw) /var/run/secrets/amster from amster-key (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-8gtf9 (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: fbc: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-secrets: Type: Projected (a volume that contains injected data from multiple sources) SecretName: am-passwords SecretOptionalName: SecretName: am-keystore SecretOptionalName: amster-key: Type: Secret (a volume populated by a Secret) SecretName: amster Optional: false truststore: Type: Projected (a volume that contains injected data from multiple sources) SecretName: truststore-pem SecretOptionalName: SecretName: ds-ssl-keypair SecretOptionalName: new-truststore: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-logback: Type: ConfigMap (a volume populated by a ConfigMap) Name: am-logback Optional: false kube-api-access-8gtf9: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: Tolerations: kubernetes.io/arch:NoSchedule op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 60m default-scheduler Successfully assigned xlou/am-6844b8c4b7-6m7z2 to gke-xlou-cdm-ds-0f601751-cf7b Normal Pulling 60m kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" Normal Pulled 59m kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" in 9.104542111s (9.104549774s including waiting) Normal Created 59m kubelet Created container fbc-init Normal Started 59m kubelet Started container fbc-init Normal Pulling 59m kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" Normal Pulled 59m kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" in 253.444165ms (253.447721ms including waiting) Normal Created 59m kubelet Created container truststore-init Normal Started 59m kubelet Started container truststore-init Normal Pulling 59m kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" Normal Pulled 59m kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/am:xlou-affinityAll-noauditlog" in 224.102754ms (224.108618ms including waiting) Normal Created 59m kubelet Created container openam Normal Started 59m kubelet Started container openam Warning Unhealthy 59m (x2 over 59m) kubelet Startup probe failed: Get "http://10.106.44.138:8080/am/json/health/live": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Warning Unhealthy 9m21s kubelet Readiness probe failed: HTTP probe failed with statuscode: 503 ==================================================================================================== =========================================== Pod logs =========================================== ==================================================================================================== Copying docker image configuration files to the shared volume Copying /opt/java/openjdk/lib/security/cacerts to /truststore/amtruststore Found (2) certificates in am_combined_truststore Importing (2) certificates into /truststore/amtruststore Certificate was added to keystore Certificate was added to keystore Import complete! 10.106.44.129 - - [17/Apr/2024:18:30:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:30:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:30:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362064 28ms 10.106.44.129 - - [17/Apr/2024:18:30:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:30:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:30:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:31:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:31:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362045 29ms {"timestamp":"2024-04-17T18:31:07.784Z","eventName":"AM-SESSION-MAX_TIMED_OUT","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-9697612"],"userId":"id=amadmin,ou=user,ou=am-config","runAs":"","objectId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-9697612","operation":"DELETE","realm":"/","component":"Session","source":"audit","topic":"activity","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018172","_normalized":{"fieldNames":{}}} 10.106.44.129 - - [17/Apr/2024:18:31:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:31:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:31:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:31:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:31:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362042 28ms 10.106.44.129 - - [17/Apr/2024:18:31:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:31:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:31:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:32:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:32:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362055 27ms 10.106.44.129 - - [17/Apr/2024:18:32:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:32:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:32:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:32:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:32:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362059 27ms {"timestamp":"2024-04-17T18:32:37.253Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-cts-0.ds-cts:1636, ldaps://ds-cts-1.ds-cts:1636, ldaps://ds-cts-2.ds-cts:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 221 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.onNext(FlowableGroupBy.java:434)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.onNext(FlowableGroupBy.java:345)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:181)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:32:40.282Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@6bb2ae73' is no longer operational: Connect Error: Host 'ds-cts-2.ds-cts' cannot be resolved","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} 10.106.44.129 - - [17/Apr/2024:18:32:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:32:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms {"timestamp":"2024-04-17T18:32:47.580Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-idrepo-2.ds-idrepo:1636, ldaps://ds-idrepo-0.ds-idrepo:1636, ldaps://ds-idrepo-1.ds-idrepo:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 260 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.subscribe(FlowableGroupBy.java:424)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.subscribeActual(FlowableGroupBy.java:341)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl$1.lambda$subscribeActual$4(LdapClientImpl.java:630)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.setResponseStream(LdapClientImpl.java:448)\n\tat io.reactivex.rxjava3.internal.subscribers.LambdaSubscriber.onNext(LambdaSubscriber.java:65)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:188)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:32:47.585Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"org.forgerock.openam.entitlement.indextree.IndexChangeHandler","message":"Persistent search connection failure.","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 263 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.subscribe(FlowableGroupBy.java:424)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.subscribeActual(FlowableGroupBy.java:341)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl$1.lambda$subscribeActual$4(LdapClientImpl.java:630)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.setResponseStream(LdapClientImpl.java:448)\n\tat io.reactivex.rxjava3.internal.subscribers.LambdaSubscriber.onNext(LambdaSubscriber.java:65)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:188)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:32:47.586Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-idrepo-2.ds-idrepo:1636, ldaps://ds-idrepo-0.ds-idrepo:1636, ldaps://ds-idrepo-1.ds-idrepo:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 261 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.subscribe(FlowableGroupBy.java:424)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.subscribeActual(FlowableGroupBy.java:341)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl$1.lambda$subscribeActual$4(LdapClientImpl.java:630)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.setResponseStream(LdapClientImpl.java:448)\n\tat io.reactivex.rxjava3.internal.subscribers.LambdaSubscriber.onNext(LambdaSubscriber.java:65)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:188)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:32:47.740Z","level":"WARN","thread":"pool-2-thread-1","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=10, blocked=0, ldapClient=LdapClient(host=ds-idrepo-2.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-2.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:32:47.855Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=14, blocked=0, ldapClient=LdapClient(host=ds-idrepo-2.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-2.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:32:47.858Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=14, blocked=0, ldapClient=LdapClient(host=ds-idrepo-2.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-2.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:32:47.866Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=2, blocked=0, ldapClient=LdapClient(host=ds-idrepo-2.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-2.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:32:47.948Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@7c83b7f7' is no longer operational: Connect Error: Host 'ds-idrepo-2.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:32:48.756Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:32:49.072Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=10, blocked=0, ldapClient=LdapClient(host=ds-idrepo-2.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-2.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:32:50.580Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.sm.ldap.LDAPEventManager","message":"LDAPEventManager: received all entries changed event from EventService","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.586Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.sm.ldap.LDAPEventManager","message":"LDAPEventManager: received all entries changed event from EventService","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.644Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLDAPObject: got notifications, all objects changed","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.644Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLDAPObject: got notifications, all objects changed","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.661Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.661Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.662Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.663Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.664Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.664Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.665Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.665Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.665Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.666Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.666Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.667Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.668Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.668Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.668Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.669Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.669Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.670Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.670Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.670Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.670Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.671Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.672Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.672Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.674Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring HTML port not enabled in configuration or JDMK not present.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.674Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring HTML port not enabled in configuration or JDMK not present.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.675Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring SNMP port not enabled or JDMK not present.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.675Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring SNMP port not enabled or JDMK not present.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:50.675Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring RMI port not enabled.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:50.675Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring RMI port not enabled.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:51.497Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@1a81f8ec' is no longer operational: Connect Error: Host 'ds-idrepo-2.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:32:52.147Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module OpenIdConnect","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.147Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module AuthenticatorPushRegistration","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.147Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module PersistentCookie","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.149Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.149Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.149Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.150Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.151Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.151Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.159Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module OpenIdConnect","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.159Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module AuthenticatorPushRegistration","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.160Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module PersistentCookie","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:32:52.949Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module OpenIdConnect","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:52.949Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module AuthenticatorPushRegistration","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:52.949Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module PersistentCookie","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:52.950Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:52.950Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:52.950Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:52.951Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:52.952Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:32:52.952Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} 10.106.44.129 - - [17/Apr/2024:18:32:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms {"timestamp":"2024-04-17T18:32:58.513Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-cts-0.ds-cts:1636, ldaps://ds-cts-1.ds-cts:1636, ldaps://ds-cts-2.ds-cts:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 219 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.onNext(FlowableGroupBy.java:434)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.onNext(FlowableGroupBy.java:345)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:181)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:32:58.514Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"org.forgerock.openam.notifications.integration.brokers.CTSNotificationBroker","message":"Continuous query listener has lost its connection","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:33:00.034Z","level":"WARN","thread":"http-nio-8080-exec-10","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018230"},"logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@72aeca12' is no longer operational: Connect Error: Host 'ds-cts-1.ds-cts' cannot be resolved","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018230"} 10.106.44.129 - - [17/Apr/2024:18:33:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 14ms 10.106.41.131 - - [17/Apr/2024:18:33:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362036 63ms 10.106.44.129 - - [17/Apr/2024:18:33:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:33:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms {"timestamp":"2024-04-17T18:33:18.703Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-cts-0.ds-cts:1636, ldaps://ds-cts-1.ds-cts:1636, ldaps://ds-cts-2.ds-cts:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 231 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.onNext(FlowableGroupBy.java:434)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.onNext(FlowableGroupBy.java:345)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:181)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:33:18.714Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-cts-0.ds-cts:1636, ldaps://ds-cts-1.ds-cts:1636, ldaps://ds-cts-2.ds-cts:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 434 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.subscribe(FlowableGroupBy.java:424)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.subscribeActual(FlowableGroupBy.java:341)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl$1.lambda$subscribeActual$4(LdapClientImpl.java:630)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.setResponseStream(LdapClientImpl.java:448)\n\tat io.reactivex.rxjava3.internal.subscribers.LambdaSubscriber.onNext(LambdaSubscriber.java:65)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:188)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:33:18.715Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"org.forgerock.openam.notifications.integration.brokers.CTSNotificationBroker","message":"Continuous query listener has lost its connection","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:33:18.718Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-cts-0.ds-cts:1636, ldaps://ds-cts-1.ds-cts:1636, ldaps://ds-cts-2.ds-cts:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 398 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.subscribe(FlowableGroupBy.java:424)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.subscribeActual(FlowableGroupBy.java:341)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl$1.lambda$subscribeActual$4(LdapClientImpl.java:630)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.setResponseStream(LdapClientImpl.java:448)\n\tat io.reactivex.rxjava3.internal.subscribers.LambdaSubscriber.onNext(LambdaSubscriber.java:65)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:188)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:33:20.025Z","level":"WARN","thread":"LDAP SDK Default AsyncRx I/O Thread (6)","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@54ccf70e' is no longer operational: Connect Error: Connection refused","context":"default","transactionId":null} 10.106.44.129 - - [17/Apr/2024:18:33:20 +0000] "GET /am/json/health/ready HTTP/1.1" 503 - 5ms 10.106.44.129 - - [17/Apr/2024:18:33:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:33:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362027 26ms {"timestamp":"2024-04-17T18:33:36.756Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:33:37.885Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=14, blocked=0, ldapClient=LdapClient(host=ds-idrepo-1.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-1.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:33:37.886Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=14, blocked=0, ldapClient=LdapClient(host=ds-idrepo-1.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-1.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:33:37.887Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=2, blocked=0, ldapClient=LdapClient(host=ds-idrepo-1.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-1.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:33:37.948Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@4d603a30' is no longer operational: Connect Error: Host 'ds-idrepo-1.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:33:39.072Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=10, blocked=0, ldapClient=LdapClient(host=ds-idrepo-1.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-1.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:33:39.321Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=10, blocked=0, ldapClient=LdapClient(host=ds-idrepo-1.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-1.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:33:41.497Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@44c845f7' is no longer operational: Connect Error: Host 'ds-idrepo-1.ds-idrepo' cannot be resolved","context":"default","transactionId":null} 10.106.44.129 - - [17/Apr/2024:18:33:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:33:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:33:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:34:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 4ms 10.106.41.131 - - [17/Apr/2024:18:34:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362044 26ms 10.106.44.129 - - [17/Apr/2024:18:34:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:34:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms {"timestamp":"2024-04-17T18:34:26.298Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-idrepo-2.ds-idrepo:1636, ldaps://ds-idrepo-0.ds-idrepo:1636, ldaps://ds-idrepo-1.ds-idrepo:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 533 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.subscribe(FlowableGroupBy.java:424)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.subscribeActual(FlowableGroupBy.java:341)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl$1.lambda$subscribeActual$4(LdapClientImpl.java:630)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.setResponseStream(LdapClientImpl.java:448)\n\tat io.reactivex.rxjava3.internal.subscribers.LambdaSubscriber.onNext(LambdaSubscriber.java:65)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:188)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:34:26.303Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"org.forgerock.openam.entitlement.indextree.IndexChangeHandler","message":"Persistent search connection failure.","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 313 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.subscribe(FlowableGroupBy.java:424)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.subscribeActual(FlowableGroupBy.java:341)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl$1.lambda$subscribeActual$4(LdapClientImpl.java:630)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.setResponseStream(LdapClientImpl.java:448)\n\tat io.reactivex.rxjava3.internal.subscribers.LambdaSubscriber.onNext(LambdaSubscriber.java:65)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:188)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:34:26.304Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-idrepo-2.ds-idrepo:1636, ldaps://ds-idrepo-0.ds-idrepo:1636, ldaps://ds-idrepo-1.ds-idrepo:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 312 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.subscribe(FlowableGroupBy.java:424)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.subscribeActual(FlowableGroupBy.java:341)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)\n\tat io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl$1.lambda$subscribeActual$4(LdapClientImpl.java:630)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.setResponseStream(LdapClientImpl.java:448)\n\tat io.reactivex.rxjava3.internal.subscribers.LambdaSubscriber.onNext(LambdaSubscriber.java:65)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:188)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:34:26.310Z","level":"ERROR","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.iplanet.services.ldap.event.LDAPv3PersistentSearch","message":"Persistent search failed against [ldaps://ds-idrepo-0.ds-idrepo:1636, ldaps://ds-idrepo-1.ds-idrepo:1636, ldaps://ds-idrepo-2.ds-idrepo:1636]","context":"default","exception":"org.forgerock.opendj.ldap.CancelledResultException: Canceled: Server Shutdown: LDAP connection 394 has been closed because the LDAP connection handler LDAPS 0.0.0.0:1636 is shutting down\n\tat org.forgerock.opendj.ldap.LdapException.newLdapException(LdapException.java:223)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.throwOnFailedResult(LdapClientImpl.java:678)\n\tat org.forgerock.opendj.ldap.LdapClientImpl$LdapClientSocketImpl.extractResponse(LdapClientImpl.java:671)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableMap$MapSubscriber.onNext(FlowableMap.java:64)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeWhile$TakeWhileSubscriber.onNext(FlowableTakeWhile.java:79)\n\tat io.reactivex.rxjava3.internal.util.HalfSerializer.onNext(HalfSerializer.java:46)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableTakeUntil$TakeUntilMainSubscriber.onNext(FlowableTakeUntil.java:70)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drainNormal(FlowableGroupBy.java:555)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.drain(FlowableGroupBy.java:474)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$State.onNext(FlowableGroupBy.java:434)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupedUnicast.onNext(FlowableGroupBy.java:345)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableGroupBy$GroupBySubscriber.onNext(FlowableGroupBy.java:181)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$MergeSubscriber.tryEmit(FlowableFlatMap.java:270)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMap$InnerSubscriber.onNext(FlowableFlatMap.java:627)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableOnErrorNext$OnErrorNextSubscriber.onNext(FlowableOnErrorNext.java:76)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.tryOnNext(FlowableFilter.java:75)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableFilter$FilterSubscriber.onNext(FlowableFilter.java:53)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmpty$SwitchIfEmptyMaybeObserver$OtherMaybeObserver.onSuccess(MaybeSwitchIfEmpty.java:110)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapMaybeObserver.onSuccess(SingleFlatMapMaybe.java:114)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeJust.subscribeActual(MaybeJust.java:36)\n\tat io.reactivex.rxjava3.core.Maybe.subscribe(Maybe.java:5375)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleFlatMapMaybe$FlatMapSingleObserver.onSuccess(SingleFlatMapMaybe.java:86)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onSuccess(SingleResumeNext.java:65)\n\tat io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeSwitchIfEmptySingle$SwitchIfEmptyMaybeObserver$OtherSingleObserver.onSuccess(MaybeSwitchIfEmptySingle.java:117)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableElementAtSingle$ElementAtSubscriber.onNext(FlowableElementAtSingle.java:87)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableRepeat$RepeatSubscriber.onNext(FlowableRepeat.java:65)\n\tat io.reactivex.rxjava3.internal.subscriptions.DeferredScalarSubscription.complete(DeferredScalarSubscription.java:133)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeToFlowable$MaybeToFlowableSubscriber.onSuccess(MaybeToFlowable.java:70)\n\tat io.reactivex.rxjava3.internal.jdk8.SingleMapOptional$MapOptionalSingleObserver.onSuccess(SingleMapOptional.java:94)\n\tat io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:256)\n\tat org.forgerock.opendj.io.rx.AsyncTcpRxTransport$AsyncTcpRxSocket$ReadCompletionHandler.completed(AsyncTcpRxTransport.java:229)\n\tat java.base/sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:129)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finishRead(UnixAsynchronousSocketChannelImpl.java:447)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:195)\n\tat java.base/sun.nio.ch.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:217)\n\tat java.base/sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:306)\n\tat java.base/sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:113)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} 10.106.44.129 - - [17/Apr/2024:18:34:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms {"timestamp":"2024-04-17T18:34:27.319Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=2, blocked=0, ldapClient=LdapClient(host=ds-idrepo-0.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-0.ds-idrepo' cannot be resolved","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:27.855Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=14, blocked=0, ldapClient=LdapClient(host=ds-idrepo-0.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-0.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:34:27.858Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=14, blocked=0, ldapClient=LdapClient(host=ds-idrepo-0.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-0.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:34:27.948Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@5ba6e55a' is no longer operational: Connect Error: Host 'ds-idrepo-0.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:34:28.130Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:34:29.072Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=10, blocked=0, ldapClient=LdapClient(host=ds-idrepo-0.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-0.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:34:29.299Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.sm.ldap.LDAPEventManager","message":"LDAPEventManager: received all entries changed event from EventService","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:29.305Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.sm.ldap.LDAPEventManager","message":"LDAPEventManager: received all entries changed event from EventService","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:29.321Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'ConnectionPool(size=0[in:0 + out:0 + pending:0], maxSize=10, blocked=0, ldapClient=LdapClient(host=ds-idrepo-0.ds-idrepo, port=1636, protocol=LDAPS))' is no longer operational: Connect Error: Host 'ds-idrepo-0.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:34:29.347Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLDAPObject: got notifications, all objects changed","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:29.347Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.sm.ldap.SMSLdapObject","message":"SMSLDAPObject: got notifications, all objects changed","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:30.762Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.762Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.762Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.763Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.764Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.764Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.765Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring HTML port not enabled in configuration or JDMK not present.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.765Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring SNMP port not enabled or JDMK not present.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.765Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring RMI port not enabled.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.769Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module OpenIdConnect","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.769Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module AuthenticatorPushRegistration","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.769Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module PersistentCookie","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.770Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module OpenIdConnect","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.771Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module AuthenticatorPushRegistration","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:30.771Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module PersistentCookie","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018229"} {"timestamp":"2024-04-17T18:34:31.496Z","level":"WARN","thread":"LDAP SDK Default Scheduler","logger":"PROTOCOL.LDAP_CLIENT","message":"Connection factory 'org.forgerock.openam.ldap.MonitoredLdapClient@49358fbd' is no longer operational: Connect Error: Host 'ds-idrepo-0.ds-idrepo' cannot be resolved","context":"default","transactionId":null} {"timestamp":"2024-04-17T18:34:31.538Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: DB password is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.539Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Logfile prefix string is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.539Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.log.s1is.LogConfigReader","message":"LogConfigReader: Filter class is null","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.540Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.540Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.541Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringServicesImpl","message":"JDMK runtime not found - Policy Monitoring disabled","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.541Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring HTML port not enabled in configuration or JDMK not present.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.541Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring SNMP port not enabled or JDMK not present.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.541Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.monitoring.MonitoringAdapters","message":"Agent.startAgent:Monitoring RMI port not enabled.","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.543Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module OpenIdConnect","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.543Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module AuthenticatorPushRegistration","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.543Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module PersistentCookie","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.544Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module OpenIdConnect","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.544Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module AuthenticatorPushRegistration","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} {"timestamp":"2024-04-17T18:34:31.545Z","level":"WARN","thread":"SystemTimerPool","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"},"logger":"com.sun.identity.authentication.config.AMAuthLevelManager","message":"No auth level for module PersistentCookie","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018225"} 10.106.44.129 - - [17/Apr/2024:18:34:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:34:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362065 28ms 10.106.44.129 - - [17/Apr/2024:18:34:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:34:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:34:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:35:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:35:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362039 26ms 10.106.44.129 - - [17/Apr/2024:18:35:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:35:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:35:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:35:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:35:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362029 25ms 10.106.44.129 - - [17/Apr/2024:18:35:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:35:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:35:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:36:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:36:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362051 26ms 10.106.44.129 - - [17/Apr/2024:18:36:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:36:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:36:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:36:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:36:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362062 26ms 10.106.44.129 - - [17/Apr/2024:18:36:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:36:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:36:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:37:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:37:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362095 25ms 10.106.44.129 - - [17/Apr/2024:18:37:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:37:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:37:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:37:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:37:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362059 25ms 10.106.44.129 - - [17/Apr/2024:18:37:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:37:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:37:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:38:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:38:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362069 27ms 10.106.44.129 - - [17/Apr/2024:18:38:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:38:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:38:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:38:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:38:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362059 26ms 10.106.44.129 - - [17/Apr/2024:18:38:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:38:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:38:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:39:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:39:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362077 26ms 10.106.44.129 - - [17/Apr/2024:18:39:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:39:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:39:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:39:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:39:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362084 27ms 10.106.44.129 - - [17/Apr/2024:18:39:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:39:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:39:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:40:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:40:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362093 26ms 10.106.44.129 - - [17/Apr/2024:18:40:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:40:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:40:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:40:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:40:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362099 27ms 10.106.44.129 - - [17/Apr/2024:18:40:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:40:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:40:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:41:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [17/Apr/2024:18:41:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362101 26ms 10.106.44.129 - - [17/Apr/2024:18:41:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:41:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:41:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:41:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:41:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362120 26ms 10.106.44.129 - - [17/Apr/2024:18:41:40 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:41:40 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.44.129 - - [17/Apr/2024:18:41:50 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.129 - - [17/Apr/2024:18:42:00 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:42:02 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362073 26ms {"timestamp":"2024-04-17T18:42:12.486Z","eventName":"AM-LOGIN-MODULE-COMPLETED","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018512","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018515"],"userId":"id=amadmin,ou=user,ou=am-config","principal":["amadmin"],"entries":[{"moduleId":"DataStore","info":{"authControlFlag":"REQUIRED","moduleClass":"DataStore","ipAddress":"10.106.44.133","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018517","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-17T18:42:12.515Z","eventName":"AM-SESSION-CREATED","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018512","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018515"],"userId":"id=amadmin,ou=user,ou=am-config","runAs":"id=amadmin,ou=user,ou=am-config","objectId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018515","operation":"CREATE","realm":"/","component":"Session","source":"audit","topic":"activity","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018520","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-17T18:42:12.515Z","eventName":"AM-LOGIN-COMPLETED","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018512","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018515"],"userId":"id=amadmin,ou=user,ou=am-config","principal":["amadmin"],"entries":[{"moduleId":"DataStore","info":{"ipAddress":"10.106.44.133","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018522","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-17T18:42:12.516Z","eventName":"AM-ACCESS-OUTCOME","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018512","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018515"],"userId":"id=amadmin,ou=user,ou=am-config","client":{"ip":"10.106.44.133","port":60084},"http":{"request":{"secure":true,"method":"POST","path":"https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/authenticate","headers":{"accept":["*/*"],"accept-api-version":["protocol=1.0,resource=2.0"],"content-type":["application/json"],"host":["xlou.iam.xlou-cdm.engineeringpit.com"],"user-agent":["python-requests/2.31.0"],"x-forwarded-for":["35.212.145.225"],"x-forwarded-host":["xlou.iam.xlou-cdm.engineeringpit.com"],"x-forwarded-port":["443"],"x-forwarded-proto":["https"],"x-real-ip":["35.212.145.225"],"x-request-id":["9c0592ffb59901ec21faa30d9dcd5b09"],"x-scheme":["https"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":80,"elapsedTimeUnits":"MILLISECONDS"},"realm":"/","component":"Authentication","source":"audit","topic":"access","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018524","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-17T18:42:14.267Z","eventName":"AM-LOGIN-MODULE-COMPLETED","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018525","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018528"],"userId":"id=amadmin,ou=user,ou=am-config","principal":["amadmin"],"entries":[{"moduleId":"DataStore","info":{"authControlFlag":"REQUIRED","moduleClass":"DataStore","ipAddress":"10.106.44.133","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018530","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-17T18:42:14.276Z","eventName":"AM-SESSION-CREATED","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018525","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018528"],"userId":"id=amadmin,ou=user,ou=am-config","runAs":"id=amadmin,ou=user,ou=am-config","objectId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018528","operation":"CREATE","realm":"/","component":"Session","source":"audit","topic":"activity","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018533","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-17T18:42:14.276Z","eventName":"AM-LOGIN-COMPLETED","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018525","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018528"],"userId":"id=amadmin,ou=user,ou=am-config","principal":["amadmin"],"entries":[{"moduleId":"DataStore","info":{"ipAddress":"10.106.44.133","authLevel":"0"}}],"result":"SUCCESSFUL","realm":"/","component":"Authentication","source":"audit","topic":"authentication","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018535","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-17T18:42:14.277Z","eventName":"AM-ACCESS-OUTCOME","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018525","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018528"],"userId":"id=amadmin,ou=user,ou=am-config","client":{"ip":"10.106.44.133","port":60092},"http":{"request":{"secure":true,"method":"POST","path":"https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/authenticate","headers":{"accept":["*/*"],"accept-api-version":["protocol=1.0,resource=2.0"],"content-type":["application/json"],"host":["xlou.iam.xlou-cdm.engineeringpit.com"],"user-agent":["python-requests/2.31.0"],"x-forwarded-for":["35.212.145.225"],"x-forwarded-host":["xlou.iam.xlou-cdm.engineeringpit.com"],"x-forwarded-port":["443"],"x-forwarded-proto":["https"],"x-real-ip":["35.212.145.225"],"x-request-id":["2d42bec16f98c409a95f2a9f0b348c7c"],"x-scheme":["https"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":12,"elapsedTimeUnits":"MILLISECONDS"},"realm":"/","component":"Authentication","source":"audit","topic":"access","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018537","_normalized":{"fieldNames":{}}} {"timestamp":"2024-04-17T18:42:14.823Z","level":"WARN","thread":"http-nio-8081-exec-1074","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018538"},"logger":"org.forgerock.openam.core.realms.impl.DefaultRealmLookup","message":"DefaultRealms:lookup Unable to find Org name for: authorize","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018538"} {"timestamp":"2024-04-17T18:42:14.873Z","eventName":"AM-ACCESS-OUTCOME","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018538","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018541","7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018528"],"userId":"id=amadmin,ou=user,ou=am-config","client":{"ip":"10.106.44.133","port":47310},"http":{"request":{"secure":true,"method":"POST","path":"https://xlou.iam.xlou-cdm.engineeringpit.com/am/oauth2/authorize","headers":{"accept":["*/*"],"content-type":["application/x-www-form-urlencoded"],"host":["xlou.iam.xlou-cdm.engineeringpit.com"],"user-agent":["python-requests/2.31.0"],"x-forwarded-for":["35.212.145.225"],"x-forwarded-host":["xlou.iam.xlou-cdm.engineeringpit.com"],"x-forwarded-port":["443"],"x-forwarded-proto":["https"],"x-real-ip":["35.212.145.225"],"x-request-id":["507c6ed8c61e26538773c9aa413329b4"],"x-scheme":["https"]}}},"response":{"status":"FAILED","statusCode":"302","elapsedTime":53,"elapsedTimeUnits":"MILLISECONDS","detail":{"reason":"Found"}},"realm":"/","component":"OAuth","source":"audit","topic":"access","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018543","_normalized":{"fieldNames":{}}} 10.106.44.129 - - [17/Apr/2024:18:42:10 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.129 - - [17/Apr/2024:18:42:10 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.133 - - [17/Apr/2024:18:42:12 +0000] "POST /am/json/authenticate?realm=/ HTTP/1.1" 200 167 80ms 10.106.44.133 - - [17/Apr/2024:18:42:14 +0000] "POST /am/json/authenticate?realm=/ HTTP/1.1" 200 167 12ms 10.106.44.133 - - [17/Apr/2024:18:42:14 +0000] "POST /am/oauth2/authorize?client_id=smokeclient&scope=fr%3Aidm%3A%2A&redirect_uri=https%3A%2F%2Ffake.com&response_type=code&realm=%2F HTTP/1.1" 302 - 55ms {"timestamp":"2024-04-17T18:42:17.126Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:42:18.125Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(1470)","mdc":{"transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-0"} {"timestamp":"2024-04-17T18:42:21.731Z","eventName":"AM-ACCESS-OUTCOME","transactionId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018547","trackingIds":["7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018528"],"userId":"id=amadmin,ou=user,ou=am-config","client":{"ip":"10.106.44.133","port":47320},"server":{"ip":"10.106.44.138","port":8081},"http":{"request":{"secure":true,"method":"GET","path":"https://xlou.iam.xlou-cdm.engineeringpit.com/am/json/serverinfo/version","headers":{"accept":["*/*"],"accept-api-version":["protocol=2.1"],"host":["xlou.iam.xlou-cdm.engineeringpit.com"],"user-agent":["python-requests/2.31.0"],"x-forwarded-for":["35.212.145.225"],"x-forwarded-host":["xlou.iam.xlou-cdm.engineeringpit.com"],"x-forwarded-port":["443"],"x-forwarded-proto":["https"],"x-real-ip":["35.212.145.225"],"x-request-id":["c467cff6dd5f516cd36e6d89db3e6fb3"],"x-scheme":["https"]}}},"request":{"protocol":"CREST","operation":"READ"},"response":{"status":"SUCCESSFUL","statusCode":"","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","detail":{"revision":"-1298450700"}},"realm":"/","component":"Server Info","source":"audit","topic":"access","level":"INFO","_eventId":"7535c5e9-83e7-4de0-b4d8-1f25516ff4a7-10018551","_normalized":{"fieldNames":{}}} 10.106.44.129 - - [17/Apr/2024:18:42:20 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.133 - - [17/Apr/2024:18:42:21 +0000] "GET /am/json/serverinfo/version HTTP/1.1" 200 276 3ms 10.106.44.129 - - [17/Apr/2024:18:42:30 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 3ms 10.106.41.131 - - [17/Apr/2024:18:42:32 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 362132 26ms