==================================================================================================== ========================================= Pod describe ========================================= ==================================================================================================== Name: ds-idrepo-0 Namespace: jnkns-pt-dbg-tsts-dbg-thr-tsts-463 Priority: 0 Node: gke-perf-daily-ds-e9a112eb-9m5h/10.128.0.91 Start Time: Sun, 19 Mar 2023 21:35:17 +0000 Labels: affinity=directory app=ds-idrepo app.kubernetes.io/component=directory app.kubernetes.io/instance=ds-idrepo app.kubernetes.io/name=ds app.kubernetes.io/part-of=forgerock controller-revision-hash=ds-idrepo-5b4858657b statefulset.kubernetes.io/pod-name=ds-idrepo-0 tier=ds Annotations: sidecar.istio.io/inject: false Status: Running IP: 10.108.8.2 IPs: IP: 10.108.8.2 Controlled By: StatefulSet/ds-idrepo Init Containers: initialize: Container ID: containerd://a9c82008a68b5ff790deafd5efa6151bceb02a6944fd6896992566583afd4210 Image: gcr.io/engineeringpit/lodestar-images/ds-idrepo:jnkns-pt-dbg-tsts-dbg-thr-tsts-463 Image ID: gcr.io/engineeringpit/lodestar-images/ds-idrepo@sha256:883e84e98783a4c35abf7ea32121173006d317ced0306ed4b3d815acc2ef6423 Port: Host Port: Command: /opt/opendj/scripts/init-and-restore.sh State: Terminated Reason: Completed Exit Code: 0 Started: Sun, 19 Mar 2023 21:35:39 +0000 Finished: Sun, 19 Mar 2023 21:35:56 +0000 Ready: True Restart Count: 0 Limits: memory: 14Gi Requests: cpu: 8 memory: 11Gi Environment Variables from: cloud-storage-credentials-idrepo Secret Optional: false Environment: DS_SET_UID_ADMIN_AND_MONITOR_PASSWORDS: true DS_UID_MONITOR_PASSWORD_FILE: /var/run/secrets/opendj-passwords/monitor.pw DS_UID_ADMIN_PASSWORD_FILE: /var/run/secrets/opendj-passwords/dirmanager.pw DSBACKUP_HOSTS: Optional: false DSBACKUP_DIRECTORY: Optional: false AUTORESTORE_FROM_DSBACKUP: Optional: false Mounts: /opt/opendj/data from data (rw) /opt/opendj/pem-keys-directory/master-key from secrets (rw,path="master-key-pair-combined.pem") /opt/opendj/pem-keys-directory/ssl-key-pair from secrets (rw,path="ssl-key-pair-combined.pem") /opt/opendj/pem-trust-directory/cacerts.pem from truststore (rw,path="cacerts") /opt/opendj/secrets from secrets (rw) /var/run/secrets/cloud-credentials-cache/ from cloud-credentials-cache (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qqdx4 (ro) /var/run/secrets/opendj from secrets (rw) /var/run/secrets/opendj-passwords from passwords (rw) Containers: ds: Container ID: containerd://b36cf55999fa8a09ac1a0c198bc2d6dd76231fb7257f287a763a12df4062da5e Image: gcr.io/engineeringpit/lodestar-images/ds-idrepo:jnkns-pt-dbg-tsts-dbg-thr-tsts-463 Image ID: gcr.io/engineeringpit/lodestar-images/ds-idrepo@sha256:883e84e98783a4c35abf7ea32121173006d317ced0306ed4b3d815acc2ef6423 Ports: 1389/TCP, 1636/TCP, 4444/TCP, 8989/TCP, 8080/TCP, 8443/TCP Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP Args: start-ds State: Running Started: Sun, 19 Mar 2023 21:35:57 +0000 Ready: True Restart Count: 0 Limits: memory: 14Gi Requests: cpu: 8 memory: 11Gi Environment Variables from: cloud-storage-credentials-idrepo Secret Optional: false Environment: NAMESPACE: jnkns-pt-dbg-tsts-dbg-thr-tsts-463 (v1:metadata.namespace) DSBACKUP_HOSTS: Optional: false DSBACKUP_DIRECTORY: Optional: false Mounts: /opt/opendj/data from data (rw) /opt/opendj/pem-keys-directory/master-key from secrets (rw,path="master-key-pair-combined.pem") /opt/opendj/pem-keys-directory/ssl-key-pair from secrets (rw,path="ssl-key-pair-combined.pem") /opt/opendj/pem-trust-directory/cacerts.pem from truststore (rw,path="cacerts") /opt/opendj/secrets from secrets (rw) /var/run/secrets/cloud-credentials-cache/ from cloud-credentials-cache (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qqdx4 (ro) /var/run/secrets/opendj from secrets (rw) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: data: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: data-ds-idrepo-0 ReadOnly: false secrets: Type: Secret (a volume populated by a Secret) SecretName: ds Optional: false passwords: Type: Secret (a volume populated by a Secret) SecretName: ds-passwords Optional: false cloud-credentials-cache: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: truststore: Type: Secret (a volume populated by a Secret) SecretName: truststore-pem Optional: false kube-api-access-qqdx4: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: Tolerations: WorkerDedicatedDS op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 6m1s default-scheduler Successfully assigned jnkns-pt-dbg-tsts-dbg-thr-tsts-463/ds-idrepo-0 to gke-perf-daily-ds-e9a112eb-9m5h Normal SuccessfulAttachVolume 5m57s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-eb5bfca9-51a3-414e-911e-0f0f52e77ec8" Normal Pulling 5m53s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/ds-idrepo:jnkns-pt-dbg-tsts-dbg-thr-tsts-463" Normal Pulled 5m39s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/ds-idrepo:jnkns-pt-dbg-tsts-dbg-thr-tsts-463" in 13.932029329s Normal Created 5m39s kubelet Created container initialize Normal Started 5m39s kubelet Started container initialize Normal Pulling 5m21s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/ds-idrepo:jnkns-pt-dbg-tsts-dbg-thr-tsts-463" Normal Pulled 5m21s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/ds-idrepo:jnkns-pt-dbg-tsts-dbg-thr-tsts-463" in 201.315961ms Normal Created 5m21s kubelet Created container ds Normal Started 5m21s kubelet Started container ds ==================================================================================================== =========================================== Pod logs =========================================== ==================================================================================================== Initializing "data/db" from Docker image Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Initializing "data/locks" from Docker image Initializing "data/var" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.8ad1b8d29cc84c442561c09ddf98ccb8e27234b4 Rebuilding degraded indexes for base DN "ou=tokens"... Rebuilding degraded indexes for base DN "ou=identities"... category=BACKEND severity=WARNING seq=39 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-meta is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=40 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-groups is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=41 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-authzroles-managed-role is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=42 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-roles is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=43 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-organization-admin is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=44 msg=Due to changes in the configuration, index ou=identities_fr-idm-effectiveGroup is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=45 msg=Due to changes in the configuration, index ou=identities_fr-idm-effectiveApplications is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=46 msg=Due to changes in the configuration, index ou=identities_fr-idm-lastSync is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=47 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-inactive-date is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=48 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-active-date is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=49 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-application-member is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=50 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-organization-member is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=51 msg=Due to changes in the configuration, index ou=identities_fr-idm-uuid is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=52 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-manager is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=53 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-notifications is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=54 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-organization-owner is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=55 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-assignment-member is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=56 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-application-owner is currently operating in a degraded state and must be rebuilt before it can be used category=BACKEND severity=WARNING seq=57 msg=Due to changes in the configuration, index ou=identities_fr-idm-managed-user-authzroles-internal-role is currently operating in a degraded state and must be rebuilt before it can be used Rebuilding degraded indexes for base DN "ou=am-config"... Rebuilding degraded indexes for base DN "dc=openidm,dc=forgerock,dc=io"... Updating the "uid=admin" password Updating the "uid=monitor" password Initialization completed AUTORESTORE_FROM_DSBACKUP is missing or not set to true. Skipping restore Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.8ad1b8d29cc84c442561c09ddf98ccb8e27234b4 Rebuilding degraded indexes for base DN "ou=tokens"... Rebuilding degraded indexes for base DN "ou=identities"... Rebuilding degraded indexes for base DN "ou=am-config"... Rebuilding degraded indexes for base DN "dc=openidm,dc=forgerock,dc=io"... Server configured with: Group ID : default Server ID : ds-idrepo-0 Advertised listen address : ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local Bootstrap replication server(s) : ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8989,ds-idrepo-1.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:11.986Z","category":"CORE","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.3.0-20230302225305-8ad1b8d29cc84c442561c09ddf98ccb8e27234b4 (build 20230303085327, revision number 8ad1b8d29cc84c442561c09ddf98ccb8e27234b4) starting up"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:11.986Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:11.986Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:11.986Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.6+10-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:11.986Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local default/ds-idrepo-0, running Linux 5.10.147+ amd64, unknown physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:11.986Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:12.386Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:12.587Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend idmRepo containing 42 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:12.987Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend cfgStore containing 115 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:12.987Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amIdentityStore containing 21 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.187Z","category":"SYNC","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-idrepo-0) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.388Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 42 entries and skipped 0 in 0 seconds (average rate 2470.6/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.388Z","category":"SYNC","severity":"WARNING","msgId":387,"message":"Directory server DS(ds-idrepo-0) was unable to connect to replication server at ds-idrepo-1.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8989 for domain 'dc=openidm,dc=forgerock,dc=io': unknown host"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.388Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.108.8.2:36580"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.388Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at 10.108.8.2:8989 with generation ID 555879"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"uid=monitor\" at /10.108.8.2:36600"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"uid=monitor\" at 10.108.8.2:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 115 entries and skipped 0 in 0 seconds (average rate 5227.3/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=am-config\" at /10.108.8.2:36610"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=am-config\" at 10.108.8.2:8989 with generation ID 2338230"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 21 entries and skipped 0 in 0 seconds (average rate 10500.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=identities\" at /10.108.8.2:36626"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=identities\" at 10.108.8.2:8989 with generation ID 253127"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.588Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 2500.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=tokens\" at /10.108.8.2:36648"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=tokens\" at 10.108.8.2:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"CORE","severity":"NOTICE","msgId":818,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:36:13.788Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-3","timestamp":"2023-03-19T21:36:18.788Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-2","client":{"ip":"10.108.1.23","port":45670},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":25,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-25","timestamp":"2023-03-19T21:36:34.453Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-24","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":89,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-29","timestamp":"2023-03-19T21:37:04.452Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-28","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":54,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:37:32.246Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.108.9.2:43364"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:37:32.446Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"uid=monitor\" at /10.108.9.2:43382"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:37:32.646Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=am-config\" at /10.108.9.2:43400"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:37:32.646Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=identities\" at /10.108.9.2:43418"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:37:32.646Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=tokens\" at /10.108.9.2:43430"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-33","timestamp":"2023-03-19T21:37:34.452Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-32","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-37","timestamp":"2023-03-19T21:38:04.451Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-36","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:38:11.873Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.108.2.2:53310"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:38:12.073Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=am-config\" at ds-idrepo-2.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local/10.108.2.2:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:38:12.073Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=tokens\" at ds-idrepo-2.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local/10.108.2.2:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:38:12.073Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"uid=monitor\" at ds-idrepo-2.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local/10.108.2.2:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-03-19T21:38:12.073Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=identities\" at ds-idrepo-2.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local/10.108.2.2:8989"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-41","timestamp":"2023-03-19T21:38:34.452Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-40","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-45","timestamp":"2023-03-19T21:38:59.093Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-44","client":{"ip":"10.108.11.3","port":39246},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-49","timestamp":"2023-03-19T21:38:59.121Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-48","client":{"ip":"10.108.11.3","port":39262},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-53","timestamp":"2023-03-19T21:38:59.134Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-52","client":{"ip":"10.108.11.3","port":39266},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-57","timestamp":"2023-03-19T21:38:59.146Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-56","client":{"ip":"10.108.11.3","port":39268},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-61","timestamp":"2023-03-19T21:38:59.991Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-60","client":{"ip":"10.108.0.3","port":39474},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-65","timestamp":"2023-03-19T21:39:00.019Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-64","client":{"ip":"10.108.0.3","port":39476},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-69","timestamp":"2023-03-19T21:39:00.031Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-68","client":{"ip":"10.108.0.3","port":39488},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-73","timestamp":"2023-03-19T21:39:00.043Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-72","client":{"ip":"10.108.0.3","port":39494},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-77","timestamp":"2023-03-19T21:39:03.608Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-76","client":{"ip":"10.108.1.24","port":44610},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-81","timestamp":"2023-03-19T21:39:03.635Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-80","client":{"ip":"10.108.1.24","port":44626},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-85","timestamp":"2023-03-19T21:39:03.648Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-84","client":{"ip":"10.108.1.24","port":44640},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-89","timestamp":"2023-03-19T21:39:03.660Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-88","client":{"ip":"10.108.1.24","port":44644},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-93","timestamp":"2023-03-19T21:39:04.452Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-92","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-308","timestamp":"2023-03-19T21:39:34.452Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-307","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-470","timestamp":"2023-03-19T21:40:04.452Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-469","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":51,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-632","timestamp":"2023-03-19T21:40:34.452Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-631","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-793","timestamp":"2023-03-19T21:41:04.451Z","eventName":"DJ-HTTP","transactionId":"9bd1abe5-48d9-44e8-9175-ed78a87e8907-792","client":{"ip":"10.108.1.22","port":33316},"server":{"ip":"10.108.8.2","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.jnkns-pt-dbg-tsts-dbg-thr-tsts-463.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.108.8.2:8080"],"user-agent":["Prometheus/2.37.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"}