==================================================================================================== ========================================= Pod describe ========================================= ==================================================================================================== Name: ds-cts-0 Namespace: xlou-sp Priority: 0 Node: gke-xlou-cdm-ds-28fbaf89-6sls/10.142.0.126 Start Time: Sun, 07 Aug 2022 02:33:29 +0000 Labels: affinity=directory app=ds-cts app.kubernetes.io/component=directory app.kubernetes.io/instance=ds-cts app.kubernetes.io/name=ds app.kubernetes.io/part-of=forgerock controller-revision-hash=ds-cts-6698c5f77 skaffold.dev/profile=small skaffold.dev/run-id=xlou-sp statefulset.kubernetes.io/pod-name=ds-cts-0 tier=ds Annotations: sidecar.istio.io/inject: false Status: Running IP: 10.0.10.32 IPs: IP: 10.0.10.32 Controlled By: StatefulSet/ds-cts Init Containers: initialize: Container ID: containerd://1e8cfa0a8138c7ee74c826bf31dc5dba4dd125bd00f14b1c70e7430e8e6606a0 Image: gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-sp@sha256:820132c915ddd86e84eb96ce9b15b1b0c20a7861268e9b20b64bc46126d2db9b Image ID: gcr.io/engineeringpit/lodestar-images/ds-cts@sha256:820132c915ddd86e84eb96ce9b15b1b0c20a7861268e9b20b64bc46126d2db9b Port: Host Port: Command: /opt/opendj/scripts/init-and-restore.sh State: Terminated Reason: Completed Exit Code: 0 Started: Sun, 07 Aug 2022 02:33:46 +0000 Finished: Sun, 07 Aug 2022 02:33:55 +0000 Ready: True Restart Count: 0 Limits: memory: 5Gi Requests: cpu: 2 memory: 3Gi Environment Variables from: cloud-storage-credentials-cts Secret Optional: false Environment: DS_SET_UID_ADMIN_AND_MONITOR_PASSWORDS: true DS_UID_MONITOR_PASSWORD_FILE: /var/run/secrets/opendj-passwords/monitor.pw DS_UID_ADMIN_PASSWORD_FILE: /var/run/secrets/opendj-passwords/dirmanager.pw DSBACKUP_HOSTS: Optional: false DSBACKUP_DIRECTORY: Optional: false AUTORESTORE_FROM_DSBACKUP: Optional: false Mounts: /opt/opendj/data from data (rw) /opt/opendj/pem-keys-directory/master-key from secrets (rw,path="master-key-pair-combined.pem") /opt/opendj/pem-keys-directory/ssl-key-pair from secrets (rw,path="ssl-key-pair-combined.pem") /opt/opendj/pem-trust-directory/cacerts.pem from truststore (rw,path="cacerts") /opt/opendj/secrets from secrets (rw) /var/run/secrets/cloud-credentials-cache/ from cloud-credentials-cache (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-xbt2n (ro) /var/run/secrets/opendj from secrets (rw) /var/run/secrets/opendj-passwords from passwords (rw) Containers: ds: Container ID: containerd://ea47e26a61c777dae1399f3f0c07ceb1fc6d2a205f89ff65c5e9960d48a42205 Image: gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-sp@sha256:820132c915ddd86e84eb96ce9b15b1b0c20a7861268e9b20b64bc46126d2db9b Image ID: gcr.io/engineeringpit/lodestar-images/ds-cts@sha256:820132c915ddd86e84eb96ce9b15b1b0c20a7861268e9b20b64bc46126d2db9b Ports: 1389/TCP, 1636/TCP, 4444/TCP, 8989/TCP, 8080/TCP, 8443/TCP Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP Args: start-ds State: Running Started: Sun, 07 Aug 2022 02:33:55 +0000 Ready: True Restart Count: 0 Limits: memory: 5Gi Requests: cpu: 2 memory: 3Gi Environment Variables from: cloud-storage-credentials-cts Secret Optional: false Environment: NAMESPACE: xlou-sp (v1:metadata.namespace) DSBACKUP_HOSTS: Optional: false DSBACKUP_DIRECTORY: Optional: false Mounts: /opt/opendj/data from data (rw) /opt/opendj/pem-keys-directory/master-key from secrets (rw,path="master-key-pair-combined.pem") /opt/opendj/pem-keys-directory/ssl-key-pair from secrets (rw,path="ssl-key-pair-combined.pem") /opt/opendj/pem-trust-directory/cacerts.pem from truststore (rw,path="cacerts") /opt/opendj/secrets from secrets (rw) /var/run/secrets/cloud-credentials-cache/ from cloud-credentials-cache (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-xbt2n (ro) /var/run/secrets/opendj from secrets (rw) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: data: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: data-ds-cts-0 ReadOnly: false secrets: Type: Secret (a volume populated by a Secret) SecretName: ds Optional: false passwords: Type: Secret (a volume populated by a Secret) SecretName: ds-passwords Optional: false cloud-credentials-cache: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: truststore: Type: Secret (a volume populated by a Secret) SecretName: truststore-pem Optional: false kube-api-access-xbt2n: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: Tolerations: WorkerDedicatedDS op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 3m12s default-scheduler Successfully assigned xlou-sp/ds-cts-0 to gke-xlou-cdm-ds-28fbaf89-6sls Normal SuccessfulAttachVolume 3m3s attachdetach-controller AttachVolume.Attach succeeded for volume "pvc-71cd2d95-950d-4a67-a621-c15dc1a9acc1" Normal Pulling 2m55s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-sp@sha256:820132c915ddd86e84eb96ce9b15b1b0c20a7861268e9b20b64bc46126d2db9b" Normal Pulled 2m55s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-sp@sha256:820132c915ddd86e84eb96ce9b15b1b0c20a7861268e9b20b64bc46126d2db9b" in 214.603142ms Normal Created 2m55s kubelet Created container initialize Normal Started 2m55s kubelet Started container initialize Normal Pulling 2m46s kubelet Pulling image "gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-sp@sha256:820132c915ddd86e84eb96ce9b15b1b0c20a7861268e9b20b64bc46126d2db9b" Normal Pulled 2m46s kubelet Successfully pulled image "gcr.io/engineeringpit/lodestar-images/ds-cts:xlou-sp@sha256:820132c915ddd86e84eb96ce9b15b1b0c20a7861268e9b20b64bc46126d2db9b" in 242.746917ms Normal Created 2m46s kubelet Created container ds Normal Started 2m46s kubelet Started container ds ==================================================================================================== =========================================== Pod logs =========================================== ==================================================================================================== Initializing "data/db" from Docker image Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Initializing "data/locks" from Docker image Initializing "data/var" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.167d7aaf6f08d4399db54a86d3d62ae8e9552a3f Rebuilding degraded indexes for base DN "ou=tokens"... Updating the "uid=admin" password Updating the "uid=monitor" password Initialization completed AUTORESTORE_FROM_DSBACKUP is missing or not set to true. Skipping restore Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.167d7aaf6f08d4399db54a86d3d62ae8e9552a3f Rebuilding degraded indexes for base DN "ou=tokens"... Server configured with: Group ID : default Server ID : ds-cts-0 Advertised listen address : ds-cts-0.ds-cts.xlou-sp.svc.cluster.local Bootstrap replication server(s) : ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8989,ds-cts-1.ds-cts.xlou-sp.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:02.148Z","category":"CORE","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.3.0-20220729080644-167d7aaf6f08d4399db54a86d3d62ae8e9552a3f (build 20220729082219, revision number 167d7aaf6f08d4399db54a86d3d62ae8e9552a3f) starting up"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:02.148Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:02.148Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:02.148Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.4+8-LTS by Azul Systems, Inc., 64-bit architecture, 4026531840 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:02.148Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-cts-0.ds-cts.xlou-sp.svc.cluster.local default/ds-cts-0, running Linux 5.4.188+ amd64, unknown physical memory size, number of processors available 2"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:02.148Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:02.749Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.149Z","category":"SYNC","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-cts-0) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.349Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-cts-0) has accepted a connection from directory server DS(ds-cts-0) for domain \"uid=monitor\" at /10.0.10.32:47006"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.349Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-cts-0) has connected to replication server RS(ds-cts-0) for domain \"uid=monitor\" at 10.0.10.32:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.349Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 384.6/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.349Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-cts-0) has accepted a connection from directory server DS(ds-cts-0) for domain \"ou=tokens\" at /10.0.10.32:47010"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.349Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-cts-0) has connected to replication server RS(ds-cts-0) for domain \"ou=tokens\" at 10.0.10.32:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.550Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.550Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.550Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.550Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.550Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.550Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:03.550Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"_id":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-3","timestamp":"2022-08-07T02:34:13.306Z","eventName":"DJ-HTTP","transactionId":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-2","client":{"ip":"10.0.6.22","port":50500},"server":{"ip":"10.0.10.32","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.10.32:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":95,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-7","timestamp":"2022-08-07T02:34:21.673Z","eventName":"DJ-HTTP","transactionId":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-6","client":{"ip":"10.0.11.68","port":35970},"server":{"ip":"10.0.10.32","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":4,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-11","timestamp":"2022-08-07T02:34:23.387Z","eventName":"DJ-HTTP","transactionId":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-10","client":{"ip":"10.0.7.129","port":43868},"server":{"ip":"10.0.10.32","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-15","timestamp":"2022-08-07T02:34:25.514Z","eventName":"DJ-HTTP","transactionId":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-14","client":{"ip":"10.0.6.42","port":52504},"server":{"ip":"10.0.10.32","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:34.784Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-0) has connected to replication server RS(ds-cts-1) for domain \"ou=tokens\" at ds-cts-1.ds-cts.xlou-sp.svc.cluster.local/10.0.3.29:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:34:34.784Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-0) has connected to replication server RS(ds-cts-1) for domain \"uid=monitor\" at ds-cts-1.ds-cts.xlou-sp.svc.cluster.local/10.0.3.29:8989"} {"_id":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-27","timestamp":"2022-08-07T02:34:43.271Z","eventName":"DJ-HTTP","transactionId":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-26","client":{"ip":"10.0.6.22","port":50500},"server":{"ip":"10.0.10.32","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.10.32:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":28,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:35:05.612Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-cts-0) has accepted a connection from replication server RS(ds-cts-2) for domain \"uid=monitor\" at /10.0.9.31:58116"} {"eventName":"DJ-SERVER","timestamp":"2022-08-07T02:35:05.813Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-0) has connected to replication server RS(ds-cts-2) for domain \"ou=tokens\" at ds-cts-2.ds-cts.xlou-sp.svc.cluster.local/10.0.9.31:8989"} {"_id":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-50","timestamp":"2022-08-07T02:35:13.271Z","eventName":"DJ-HTTP","transactionId":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-49","client":{"ip":"10.0.6.22","port":50500},"server":{"ip":"10.0.10.32","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.10.32:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":28,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-71","timestamp":"2022-08-07T02:35:43.271Z","eventName":"DJ-HTTP","transactionId":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-70","client":{"ip":"10.0.6.22","port":50500},"server":{"ip":"10.0.10.32","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.10.32:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":28,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-95","timestamp":"2022-08-07T02:36:13.271Z","eventName":"DJ-HTTP","transactionId":"6a733c4e-c844-46b5-b79a-03f1d5733e7e-94","client":{"ip":"10.0.6.22","port":50500},"server":{"ip":"10.0.10.32","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou-sp.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.10.32:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"}