==================================================================================================== ========================================= Pod describe ========================================= ==================================================================================================== Name: am-7d597cf7d6-9wz9h Namespace: xlou Priority: 0 Service Account: default Node: gke-xlou-cdm-ds-0f601751-nj6q/10.142.0.23 Start Time: Sat, 13 Apr 2024 22:40:34 +0000 Labels: app=am app.kubernetes.io/component=am app.kubernetes.io/instance=am app.kubernetes.io/name=am app.kubernetes.io/part-of=forgerock pod-template-hash=7d597cf7d6 tier=middle Annotations: cluster-autoscaler.kubernetes.io/safe-to-evict: true Status: Running IP: 10.106.44.3 IPs: IP: 10.106.44.3 Controlled By: ReplicaSet/am-7d597cf7d6 Init Containers: fbc-init: Container ID: containerd://cb88fef82c877e5a27b1495494086b5e5e1f1c4336cdcef1a80691d9bc509442 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-bbf6791c961b39ef101ebad36686ee2c3cde94bb Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:a7ea1ec775d0ef298d9b61b08b9c9af67ece3e971c4ac5522323b3766d7d675d Port: Host Port: Command: /bin/bash -c if [ -d /fbc/config ]; then echo "Existing openam configuration found. Skipping copy" else echo "Copying docker image configuration files to the shared volume" cd /home/forgerock/openam cp -r .homeVersion * /fbc fi State: Terminated Reason: Completed Exit Code: 0 Started: Sat, 13 Apr 2024 22:40:42 +0000 Finished: Sat, 13 Apr 2024 22:40:42 +0000 Ready: True Restart Count: 0 Environment: Mounts: /fbc from fbc (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l5dmx (ro) truststore-init: Container ID: containerd://cd5ae5640656aabda383c4a451cb91a8df24b7ec63821661833ed1b23bec503f Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-bbf6791c961b39ef101ebad36686ee2c3cde94bb Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:a7ea1ec775d0ef298d9b61b08b9c9af67ece3e971c4ac5522323b3766d7d675d Port: Host Port: Command: /home/forgerock/import-pem-certs.sh State: Terminated Reason: Completed Exit Code: 0 Started: Sat, 13 Apr 2024 22:40:46 +0000 Finished: Sat, 13 Apr 2024 22:40:46 +0000 Ready: True Restart Count: 0 Environment: TRUSTSTORE_PATH: /truststore/amtruststore TRUSTSTORE_PASSWORD: changeit AM_PEM_TRUSTSTORE: /var/run/secrets/truststore/cacerts AM_PEM_TRUSTSTORE_DS: /var/run/secrets/truststore/ca.crt Mounts: /truststore from new-truststore (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l5dmx (ro) /var/run/secrets/truststore from truststore (rw) Containers: openam: Container ID: containerd://2c3d45aa51fb64a1a23a4ef84d53a92bf15f5ca0459f53999d9ee3d02b3f8c70 Image: gcr.io/engineeringpit/lodestar-images/am:xlou-7.6.0-bbf6791c961b39ef101ebad36686ee2c3cde94bb Image ID: gcr.io/engineeringpit/lodestar-images/am@sha256:a7ea1ec775d0ef298d9b61b08b9c9af67ece3e971c4ac5522323b3766d7d675d Port: 8080/TCP Host Port: 0/TCP Command: bash /home/forgerock/docker-entrypoint.sh State: Running Started: Sat, 13 Apr 2024 22:40:47 +0000 Ready: True Restart Count: 0 Limits: memory: 10Gi Requests: cpu: 11 memory: 10Gi Liveness: http-get http://:8080/am/json/health/live delay=30s timeout=5s period=30s #success=1 #failure=3 Readiness: http-get http://:8080/am/json/health/ready delay=20s timeout=5s period=10s #success=1 #failure=3 Startup: http-get http://:8080/am/json/health/live delay=0s timeout=1s period=10s #success=1 #failure=40 Environment Variables from: am-env-secrets Secret Optional: false platform-config ConfigMap Optional: false amster-env-secrets Secret Optional: false ds-env-secrets Secret Optional: false Environment: NAMESPACE: xlou (v1:metadata.namespace) AM_STORES_SSL_ENABLED: true TRUSTSTORE_PATH: /home/forgerock/amtruststore TRUSTSTORE_PASSWORD: changeit AM_STORES_USER_TYPE: LDAPv3ForForgeRockIAM Mounts: /home/forgerock/amtruststore from new-truststore (ro,path="amtruststore") /home/forgerock/logging from am-logback (rw) /home/forgerock/openam from fbc (rw) /var/run/secrets/am from am-secrets (rw) /var/run/secrets/amster from amster-key (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l5dmx (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: fbc: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-secrets: Type: Projected (a volume that contains injected data from multiple sources) SecretName: am-passwords SecretOptionalName: SecretName: am-keystore SecretOptionalName: amster-key: Type: Secret (a volume populated by a Secret) SecretName: amster Optional: false truststore: Type: Projected (a volume that contains injected data from multiple sources) SecretName: truststore-pem SecretOptionalName: SecretName: ds-ssl-keypair SecretOptionalName: new-truststore: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: am-logback: Type: ConfigMap (a volume populated by a ConfigMap) Name: am-logback Optional: false kube-api-access-l5dmx: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: Tolerations: kubernetes.io/arch:NoSchedule op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: ==================================================================================================== =========================================== Pod logs =========================================== ==================================================================================================== Copying docker image configuration files to the shared volume Copying /opt/java/openjdk/lib/security/cacerts to /truststore/amtruststore Found (2) certificates in am_combined_truststore Importing (2) certificates into /truststore/amtruststore Certificate was added to keystore Certificate was added to keystore Import complete! {"timestamp":"2024-04-15T00:04:23.747Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(80248)","mdc":{"transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-0"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-0"} {"timestamp":"2024-04-15T00:04:24.328Z","level":"WARN","thread":"OpenDJ LDAP SDK Client Worker(80248)","mdc":{"transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-0"},"logger":"com.sun.identity.idm.IdRepoListener","message":"objectChanged called with an empty name","context":"default","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-0"} 10.106.41.131 - - [15/Apr/2024:00:04:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357812 26ms 10.106.44.1 - - [15/Apr/2024:00:04:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:04:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:04:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:04:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:04:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357789 27ms 10.106.44.1 - - [15/Apr/2024:00:04:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:05:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:05:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:05:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:05:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357778 26ms 10.106.44.1 - - [15/Apr/2024:00:05:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:05:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:05:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:05:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:05:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357815 26ms 10.106.44.1 - - [15/Apr/2024:00:05:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:06:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:06:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:06:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:06:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357780 26ms 10.106.44.1 - - [15/Apr/2024:00:06:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms {"timestamp":"2024-04-15T00:06:31.937Z","level":"WARN","thread":"CacheTokenReaper-0","mdc":{"transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-0"},"logger":"org.forgerock.openam.cts.reaper.CachedTokenReaper","message":"Error(s) while running cache reaper","context":"default","exception":"org.forgerock.am.cts.exceptions.CoreTokenException: \nCTS: Failed to delete expired session. Already deleted.\n\tat org.forgerock.openam.session.cts.SessionDeletionStrategy.lambda$delete$0(SessionDeletionStrategy.java:87)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:346)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleResult(PromiseImpl.java:267)\n\tat org.forgerock.util.promise.PromiseImpl.handleResult(PromiseImpl.java:217)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:346)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleResult(PromiseImpl.java:267)\n\tat org.forgerock.util.promise.PromiseImpl.handleResult(PromiseImpl.java:217)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:346)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleResult(PromiseImpl.java:267)\n\tat org.forgerock.util.promise.PromiseImpl.handleResult(PromiseImpl.java:217)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:346)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleResult(PromiseImpl.java:267)\n\tat org.forgerock.util.promise.PromiseImpl.handleResult(PromiseImpl.java:217)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:346)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleResult(PromiseImpl.java:267)\n\tat org.forgerock.util.promise.PromiseImpl.handleResult(PromiseImpl.java:217)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$handleResult$4(PromiseImpl.java:464)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:346)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleResult(PromiseImpl.java:267)\n\tat org.forgerock.util.promise.PromiseImpl.handleResult(PromiseImpl.java:217)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:346)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleResult(PromiseImpl.java:267)\n\tat org.forgerock.util.promise.PromiseImpl.handleResult(PromiseImpl.java:217)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:346)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleResult(PromiseImpl.java:267)\n\tat org.forgerock.util.promise.PromiseImpl.handleResult(PromiseImpl.java:217)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:350)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleException(PromiseImpl.java:242)\n\tat org.forgerock.util.promise.PromiseImpl.handleException(PromiseImpl.java:197)\n\tat org.forgerock.util.promise.PromiseImpl.lambda$then$2(PromiseImpl.java:361)\n\tat org.forgerock.util.promise.PromiseImpl.handleCompletion(PromiseImpl.java:538)\n\tat org.forgerock.util.promise.PromiseImpl.setState(PromiseImpl.java:579)\n\tat org.forgerock.util.promise.PromiseImpl.tryHandleException(PromiseImpl.java:242)\n\tat org.forgerock.util.promise.PromiseImpl.handleException(PromiseImpl.java:197)\n\tat org.forgerock.opendj.ldap.Utils.lambda$toPromise$4(Utils.java:217)\n\tat io.reactivex.rxjava3.internal.operators.maybe.MaybeCallbackObserver.onError(MaybeCallbackObserver.java:82)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableLastMaybe$LastSubscriber.onError(FlowableLastMaybe.java:85)\n\tat io.reactivex.rxjava3.internal.subscribers.BasicFuseableSubscriber.onError(BasicFuseableSubscriber.java:101)\n\tat io.reactivex.rxjava3.internal.subscribers.BasicFuseableSubscriber.onError(BasicFuseableSubscriber.java:101)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableUsing$UsingSubscriber.onError(FlowableUsing.java:126)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableObserveOn$BaseObserveOnSubscriber.checkTerminated(FlowableObserveOn.java:211)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableObserveOn$ObserveOnSubscriber.runAsync(FlowableObserveOn.java:396)\n\tat io.reactivex.rxjava3.internal.operators.flowable.FlowableObserveOn$BaseObserveOnSubscriber.run(FlowableObserveOn.java:178)\n\tat io.reactivex.rxjava3.internal.schedulers.ExecutorScheduler$ExecutorWorker$BooleanRunnable.run(ExecutorScheduler.java:324)\n\tat io.reactivex.rxjava3.internal.schedulers.ExecutorScheduler$ExecutorWorker.runEager(ExecutorScheduler.java:289)\n\tat io.reactivex.rxjava3.internal.schedulers.ExecutorScheduler$ExecutorWorker.run(ExecutorScheduler.java:250)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:840)\n","transactionId":"b5eef5cc-b013-4174-8d27-302dd8ef0203-0"} 10.106.44.1 - - [15/Apr/2024:00:06:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:06:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:06:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:06:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357791 26ms 10.106.44.1 - - [15/Apr/2024:00:06:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:07:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:07:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:07:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:07:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357806 25ms 10.106.44.1 - - [15/Apr/2024:00:07:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:07:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:07:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:07:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:07:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357757 25ms 10.106.44.1 - - [15/Apr/2024:00:07:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:08:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:08:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:08:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:08:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357742 26ms 10.106.44.1 - - [15/Apr/2024:00:08:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:08:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:08:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:08:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:08:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357777 25ms 10.106.44.1 - - [15/Apr/2024:00:08:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:09:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:09:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:09:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:09:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357789 25ms 10.106.44.1 - - [15/Apr/2024:00:09:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:09:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:09:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:09:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:09:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357802 25ms 10.106.44.1 - - [15/Apr/2024:00:09:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:10:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:10:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:10:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:10:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357788 25ms 10.106.44.1 - - [15/Apr/2024:00:10:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:10:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:10:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:10:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:10:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357771 26ms 10.106.44.1 - - [15/Apr/2024:00:10:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:11:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:11:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:11:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:11:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357776 26ms 10.106.44.1 - - [15/Apr/2024:00:11:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:11:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:11:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:11:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:11:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357742 25ms 10.106.44.1 - - [15/Apr/2024:00:11:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:12:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:12:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:12:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:12:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357757 26ms 10.106.44.1 - - [15/Apr/2024:00:12:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:12:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:12:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:12:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:12:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357755 25ms 10.106.44.1 - - [15/Apr/2024:00:12:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:13:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:13:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:13:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:13:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357762 26ms 10.106.44.1 - - [15/Apr/2024:00:13:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:13:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:13:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:13:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:13:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357774 25ms 10.106.44.1 - - [15/Apr/2024:00:13:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:14:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:14:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:14:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:14:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357774 26ms 10.106.44.1 - - [15/Apr/2024:00:14:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:14:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:14:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:14:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:14:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357741 25ms 10.106.44.1 - - [15/Apr/2024:00:14:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:15:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:15:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:15:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:15:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357755 25ms 10.106.44.1 - - [15/Apr/2024:00:15:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:15:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:15:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:15:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:15:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357743 26ms 10.106.44.1 - - [15/Apr/2024:00:15:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:16:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:16:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:16:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:16:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357779 26ms 10.106.44.1 - - [15/Apr/2024:00:16:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:16:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:16:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:16:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:16:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357776 25ms 10.106.44.1 - - [15/Apr/2024:00:16:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:17:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:17:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:17:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:17:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357745 26ms 10.106.44.1 - - [15/Apr/2024:00:17:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:17:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:17:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:17:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:17:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357802 25ms 10.106.44.1 - - [15/Apr/2024:00:17:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:18:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:18:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:18:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:18:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357780 26ms 10.106.44.1 - - [15/Apr/2024:00:18:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:18:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:18:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:18:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:18:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357792 26ms 10.106.44.1 - - [15/Apr/2024:00:18:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:19:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:19:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:19:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:19:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357783 26ms 10.106.44.1 - - [15/Apr/2024:00:19:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:19:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:19:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:19:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:19:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357773 25ms 10.106.44.1 - - [15/Apr/2024:00:19:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:20:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:20:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:20:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:20:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357775 25ms 10.106.44.1 - - [15/Apr/2024:00:20:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:20:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:20:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:20:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:20:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357811 25ms 10.106.44.1 - - [15/Apr/2024:00:20:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:21:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:21:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:21:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:21:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357792 25ms 10.106.44.1 - - [15/Apr/2024:00:21:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:21:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:21:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:21:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:21:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357732 24ms 10.106.44.1 - - [15/Apr/2024:00:21:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:22:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:22:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:22:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:22:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357754 25ms 10.106.44.1 - - [15/Apr/2024:00:22:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:22:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:22:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:22:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:22:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357787 26ms 10.106.44.1 - - [15/Apr/2024:00:22:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:23:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:23:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:23:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.41.131 - - [15/Apr/2024:00:23:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357766 25ms 10.106.44.1 - - [15/Apr/2024:00:23:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:23:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:23:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:23:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:23:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357769 25ms 10.106.44.1 - - [15/Apr/2024:00:23:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:24:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:24:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:24:14 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:24:18 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357756 25ms 10.106.44.1 - - [15/Apr/2024:00:24:24 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:24:34 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:24:34 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:24:44 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms 10.106.41.131 - - [15/Apr/2024:00:24:48 +0000] "GET /am/json/metrics/prometheus HTTP/1.1" 200 357757 25ms 10.106.44.1 - - [15/Apr/2024:00:24:54 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 2ms 10.106.44.1 - - [15/Apr/2024:00:25:04 +0000] "GET /am/json/health/live HTTP/1.1" 200 - 1ms 10.106.44.1 - - [15/Apr/2024:00:25:04 +0000] "GET /am/json/health/ready HTTP/1.1" 200 - 1ms