--Task-- name: CheckReplication_ds-cts enabled: True class_name: CheckReplicationTask source_name: ds-cts source_namespace: >default< target_name: ds-cts target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [2024-04-25 17:39:23] CheckReplication_ds-cts pre : N/A ________________________________________________________________________________ max_time: 50s sleep_interval: 10 [2024-04-25 17:39:23] - INFO: Timeout for this Task has changed to 5m (300 seconds) [2024-04-25 17:39:23] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset ________________________________________________________________________________ [2024-04-25 17:39:23] CheckReplication_ds-cts step1 : Check number of entries ________________________________________________________________________________ loop 1 : ERROR : Pod "ds-cts-0" has 9 entries but pod "ds-cts-1" has 12 entries (should have same number of entries) loop 1 : ERROR : Pod "ds-cts-0" has 9 entries but pod "ds-cts-2" has 12 entries (should have same number of entries) loop 1 : SUCCESS: Pods "ds-cts-1" and "ds-cts-2" are in sync (both have 12 entries) loop 1 : Sleep 10 and retry loop 2 : SUCCESS: Pods "ds-cts-0" and "ds-cts-1" are in sync (both have 12 entries) loop 2 : SUCCESS: Pods "ds-cts-0" and "ds-cts-2" are in sync (both have 12 entries) loop 2 : SUCCESS: Pods "ds-cts-1" and "ds-cts-2" are in sync (both have 12 entries) [check_number_of_entries] SUCCESS : replication is synchronised after 15s ________________________________________________________________________________ [2024-04-25 17:39:44] CheckReplication_ds-cts step2 : Monitor replication attributes in cn=monitor ________________________________________________________________________________ loop 1 : SUCCESS: ds-cts-0 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-cts-0 : ds-mon-updates-inbound-queue = 0 loop 1 : SUCCESS: ds-cts-1 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-cts-1 : ds-mon-updates-inbound-queue = 0 loop 1 : SUCCESS: ds-cts-2 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-cts-2 : ds-mon-updates-inbound-queue = 0 [check_monitoring_replication] final status : { "ds-cts-0": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 }, "ds-cts-1": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 }, "ds-cts-2": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 } } [check_monitoring_replication] SUCCESS : replication data in cn=monitor is synchronised after 0s ________________________________________________________________________________ [2024-04-25 17:39:50] CheckReplication_ds-cts step3 : Temporary step for PERF-1831 : Dump cn=monitor replication attributes ________________________________________________________________________________ ---------------- Pod ds-cts-0 ---------------- 2024-04-25 17:39:50,088 INFO 2024-04-25 17:39:50,089 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "cn=replicas,cn=replication,cn=monitor" "objectclass=*" 2024-04-25 17:39:51,932 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:39:51,932 DEBUG --- stdout --- 2024-04-25 17:39:51,933 DEBUG dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.40.138:8989 ds-mon-connected-to-server-id: ds-cts-0 ds-mon-current-receive-window: 2147483639 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":13,"total":56.076,"mean_rate":0.011,"m1_rate":0.080,"m5_rate":0.023,"m15_rate":0.010,"mean":4.310,"min":2.146,"max":9.306,"stddev":1.823,"p50":4.030,"p75":4.522,"p95":9.306,"p98":9.306,"p99":9.306,"p999":9.306,"p9999":9.306,"p99999":9.306} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates-total: 12 ds-mon-server-id: ds-cts-0 ds-mon-server-state: 0108018f16573e3e0000094ads-cts-2 ds-mon-server-state: 0108018f165735750000093eds-cts-1 ds-mon-server-state: 0108018f16573d0700000947ds-cts-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20240425171958.046Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 2, 0, 0, 0, 3, 0, 0] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-cts-1,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-last-received-update: 0108018f165735750000093eds-cts-1 ds-mon-last-replayed-update: 0108018f165735750000093eds-cts-1 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":7,"total":27.093,"mean_rate":0.008,"m1_rate":0.057,"m5_rate":0.026,"m15_rate":0.081,"mean":3.869,"min":2.146,"max":5.964,"stddev":1.135,"p50":3.883,"p75":4.522,"p95":5.964,"p98":5.964,"p99":5.964,"p999":5.964,"p9999":5.964,"p99999":5.964} ds-mon-server-id: ds-cts-1 ds-mon-updates-in-progress: 0 ds-mon-updates-in-queue: 0 dn: ds-mon-server-id=ds-cts-2,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-last-received-update: 0108018f16573e3e0000094ads-cts-2 ds-mon-last-replayed-update: 0108018f16573e3e0000094ads-cts-2 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":6,"total":28.983,"mean_rate":0.006,"m1_rate":0.024,"m5_rate":0.030,"m15_rate":0.207,"mean":4.825,"min":2.245,"max":9.306,"stddev":2.282,"p50":4.030,"p75":6.029,"p95":9.306,"p98":9.306,"p99":9.306,"p999":9.306,"p9999":9.306,"p99999":9.306} ds-mon-server-id: ds-cts-2 ds-mon-updates-in-progress: 0 ds-mon-updates-in-queue: 0 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.40.138:8989 ds-mon-connected-to-server-id: ds-cts-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 12671 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates-total: 0 ds-mon-server-id: ds-cts-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20240425171957.984Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 2, 0, 0, 0, 3, 0, 0] 2024-04-25 17:39:51,933 DEBUG --- stderr --- 2024-04-25 17:39:51,933 DEBUG 2024-04-25 17:39:51,933 INFO ---------------- Pod ds-cts-1 ---------------- 2024-04-25 17:39:51,933 INFO 2024-04-25 17:39:51,933 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "cn=replicas,cn=replication,cn=monitor" "objectclass=*" 2024-04-25 17:39:53,710 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:39:53,710 DEBUG --- stdout --- 2024-04-25 17:39:53,711 DEBUG dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.41.134:8989 ds-mon-connected-to-server-id: ds-cts-1 ds-mon-current-receive-window: 2147483644 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":18,"total":109.184,"mean_rate":0.015,"m1_rate":0.034,"m5_rate":0.020,"m15_rate":0.119,"mean":6.067,"min":1.860,"max":16.450,"stddev":3.987,"p50":4.686,"p75":6.029,"p95":16.450,"p98":16.450,"p99":16.450,"p999":16.450,"p9999":16.450,"p99999":16.450} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates-total: 7 ds-mon-server-id: ds-cts-1 ds-mon-server-state: 0108018f16573d0700000947ds-cts-0 ds-mon-server-state: 0108018f16573e3e0000094ads-cts-2 ds-mon-server-state: 0108018f165735750000093eds-cts-1 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20240425172024.366Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 0, 0, 5, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-cts-0,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-last-received-update: 0108018f16573d0700000947ds-cts-0 ds-mon-last-replayed-update: 0108018f16573d0700000947ds-cts-0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":12,"total":84.310,"mean_rate":0.010,"m1_rate":0.011,"m5_rate":0.013,"m15_rate":0.115,"mean":7.027,"min":2.884,"max":16.450,"stddev":4.418,"p50":5.341,"p75":6.029,"p95":16.450,"p98":16.450,"p99":16.450,"p999":16.450,"p9999":16.450,"p99999":16.450} ds-mon-server-id: ds-cts-0 ds-mon-updates-in-progress: 0 ds-mon-updates-in-queue: 0 dn: ds-mon-server-id=ds-cts-2,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-last-received-update: 0108018f16573e3e0000094ads-cts-2 ds-mon-last-replayed-update: 0108018f16573e3e0000094ads-cts-2 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":6,"total":24.874,"mean_rate":0.006,"m1_rate":0.022,"m5_rate":0.030,"m15_rate":0.206,"mean":4.149,"min":1.860,"max":7.307,"stddev":1.769,"p50":3.539,"p75":5.439,"p95":7.307,"p98":7.307,"p99":7.307,"p999":7.307,"p9999":7.307,"p99999":7.307} ds-mon-server-id: ds-cts-2 ds-mon-updates-in-progress: 0 ds-mon-updates-in-queue: 0 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.41.134:8989 ds-mon-connected-to-server-id: ds-cts-1 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 12671 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates-total: 0 ds-mon-server-id: ds-cts-1 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20240425172024.273Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 0, 0, 5, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0] 2024-04-25 17:39:53,711 DEBUG --- stderr --- 2024-04-25 17:39:53,711 DEBUG 2024-04-25 17:39:53,711 INFO ---------------- Pod ds-cts-2 ---------------- 2024-04-25 17:39:53,711 INFO 2024-04-25 17:39:53,711 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "cn=replicas,cn=replication,cn=monitor" "objectclass=*" 2024-04-25 17:39:55,446 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:39:55,446 DEBUG --- stdout --- 2024-04-25 17:39:55,447 DEBUG dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.43.7:8989 ds-mon-connected-to-server-id: ds-cts-2 ds-mon-current-receive-window: 2147483641 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":19,"total":114.096,"mean_rate":0.017,"m1_rate":0.064,"m5_rate":0.029,"m15_rate":0.124,"mean":6.008,"min":1.597,"max":17.433,"stddev":4.083,"p50":4.522,"p75":6.291,"p95":17.433,"p98":17.433,"p99":17.433,"p999":17.433,"p9999":17.433,"p99999":17.433} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates-total: 6 ds-mon-server-id: ds-cts-2 ds-mon-server-state: 0108018f165735750000093eds-cts-1 ds-mon-server-state: 0108018f16573d0700000947ds-cts-0 ds-mon-server-state: 0108018f16573e3e0000094ads-cts-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20240425172050.812Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 3, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 2, 0, 0, 0, 6, 0, 0] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-cts-0,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-last-received-update: 0108018f16573d0700000947ds-cts-0 ds-mon-last-replayed-update: 0108018f16573d0700000947ds-cts-0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":12,"total":86.616,"mean_rate":0.010,"m1_rate":0.011,"m5_rate":0.013,"m15_rate":0.118,"mean":7.222,"min":2.966,"max":17.433,"stddev":4.623,"p50":5.112,"p75":6.783,"p95":17.433,"p98":17.433,"p99":17.433,"p999":17.433,"p9999":17.433,"p99999":17.433} ds-mon-server-id: ds-cts-0 ds-mon-updates-in-progress: 0 ds-mon-updates-in-queue: 0 dn: ds-mon-server-id=ds-cts-1,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-last-received-update: 0108018f165735750000093eds-cts-1 ds-mon-last-replayed-update: 0108018f165735750000093eds-cts-1 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":7,"total":27.480,"mean_rate":0.008,"m1_rate":0.053,"m5_rate":0.026,"m15_rate":0.081,"mean":3.926,"min":1.597,"max":6.291,"stddev":1.324,"p50":3.834,"p75":4.620,"p95":6.291,"p98":6.291,"p99":6.291,"p999":6.291,"p9999":6.291,"p99999":6.291} ds-mon-server-id: ds-cts-1 ds-mon-updates-in-progress: 0 ds-mon-updates-in-queue: 0 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.43.7:8989 ds-mon-connected-to-server-id: ds-cts-2 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 12671 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates-total: 0 ds-mon-server-id: ds-cts-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20240425172050.722Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 3, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 2, 0, 0, 0, 6, 0, 0] 2024-04-25 17:39:55,447 DEBUG --- stderr --- 2024-04-25 17:39:55,447 DEBUG 2024-04-25 17:39:55,447 INFO ________________________________________________________________________________ [2024-04-25 17:39:55] CheckReplication_ds-cts step4 : Temporary step for PERF-1831 : checks logs ________________________________________________________________________________ ---------------- Pod ds-cts-0 ---------------- 2024-04-25 17:39:55,448 INFO 2024-04-25 17:39:55,448 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm logs ds-cts-0 2024-04-25 17:39:55,448 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:39:56,009 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:39:56,009 DEBUG --- stdout --- 2024-04-25 17:39:56,009 DEBUG Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.6.0.7e0436f7626375c00baee240ad259d6a2b07d5f4 Rebuilding degraded indexes for base DN "ou=tokens"... Server configured with: Group ID : default Server ID : ds-cts-0 Advertised listen address : ds-cts-0.ds-cts.xlou.svc.cluster.local Bootstrap replication server(s) : ds-cts-0.ds-cts.xlou.svc.cluster.local:8989,ds-cts-1.ds-cts.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:56.660Z","category":"JVM","severity":"NOTICE","msgId":1058,"message":"ForgeRock Directory Services 7.6.0-20240418130921-7e0436f7626375c00baee240ad259d6a2b07d5f4 (build 20240418132321, revision number 7e0436f7626375c00baee240ad259d6a2b07d5f4) starting up"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:56.660Z","category":"JVM","severity":"NOTICE","msgId":2233,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:56.660Z","category":"JVM","severity":"NOTICE","msgId":2235,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:56.660Z","category":"JVM","severity":"NOTICE","msgId":2229,"message":"JVM Information: 21.0.3+9-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:56.660Z","category":"JVM","severity":"NOTICE","msgId":2230,"message":"JVM Host: ds-cts-0.ds-cts.xlou.svc.cluster.local default/ds-cts-0, running Linux 5.15.146+ amd64, 15032385536 bytes physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:56.660Z","category":"JVM","severity":"NOTICE","msgId":2231,"message":"JVM Arguments: \"-XX:+ExitOnOutOfMemoryError\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:56.660Z","category":"CORE","severity":"WARNING","msgId":1025,"message":"'External Access Log Publisher' is DEPRECATED for removal since 7.2.0. Its usage is highly discouraged"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.262Z","category":"BACKEND","severity":"NOTICE","msgId":608,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.662Z","category":"SYNC.PURGE","severity":"INFORMATION","msgId":2210,"message":"The purge delay has been set to: 12 h"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.662Z","category":"SYNC.LIFECYCLE","severity":"NOTICE","msgId":2022,"message":"Replication server RS(ds-cts-0) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.662Z","category":"SYNC.STATE","severity":"NOTICE","msgId":2204,"message":"Directory server DS(ds-cts-0) did not find a generation ID for domain 'uid=monitor'. A new generation ID will be computed by exporting the first 1 entries in the domain"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.662Z","category":"SYNC.CONNECTIONS","severity":"WARNING","msgId":2203,"message":"Directory server DS(ds-cts-0) was unable to connect to replication server at ds-cts-1.ds-cts.xlou.svc.cluster.local:8989 for domain 'uid=monitor': unknown host"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.862Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2025,"message":"Replication server RS(ds-cts-0) has accepted a connection from directory server DS(ds-cts-0) for domain \"uid=monitor\" at /10.106.40.138:43646"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.862Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":2026,"message":"Directory server DS(ds-cts-0) has connected to replication server RS(ds-cts-0) for domain \"uid=monitor\" at 10.106.40.138:8989 with generation ID 12671"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.862Z","category":"SYNC.STATE","severity":"NOTICE","msgId":2204,"message":"Directory server DS(ds-cts-0) did not find a generation ID for domain 'ou=tokens'. A new generation ID will be computed by exporting the first 5 entries in the domain"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.862Z","category":"BACKEND","severity":"NOTICE","msgId":610,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 416.7/sec)"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.862Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2025,"message":"Replication server RS(ds-cts-0) has accepted a connection from directory server DS(ds-cts-0) for domain \"ou=tokens\" at /10.106.40.138:43668"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.862Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":2026,"message":"Directory server DS(ds-cts-0) has connected to replication server RS(ds-cts-0) for domain \"ou=tokens\" at 10.106.40.138:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:57.862Z","category":"CORE","severity":"NOTICE","msgId":1409,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:58.063Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:58.063Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:58.063Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:58.063Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:58.063Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:58.063Z","category":"CORE","severity":"NOTICE","msgId":1059,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:19:58.063Z","category":"CORE","severity":"NOTICE","msgId":1061,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.server-1059): The Directory Server has started successfully"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-54","timestamp":"2024-04-25T17:20:06.159Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-49","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":93,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-57","timestamp":"2024-04-25T17:20:20.493Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-56","client":{"ip":"10.106.42.138","port":34942},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.64.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.090Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2024,"message":"Replication server RS(ds-cts-0) has accepted a connection from replication server RS(ds-cts-1) for domain \"uid=monitor\" at /10.106.41.134:47742"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.290Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2024,"message":"Replication server RS(ds-cts-0) has accepted a connection from replication server RS(ds-cts-1) for domain \"ou=tokens\" at /10.106.41.134:47750"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-73","timestamp":"2024-04-25T17:20:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-68","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":24,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.512Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2024,"message":"Replication server RS(ds-cts-0) has accepted a connection from replication server RS(ds-cts-2) for domain \"uid=monitor\" at /10.106.43.7:46894"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.512Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2023,"message":"Replication server RS(ds-cts-0) has connected to replication server RS(ds-cts-2) for domain \"ou=tokens\" at ds-cts-2.ds-cts.xlou.svc.cluster.local/10.106.43.7:8989"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-80","timestamp":"2024-04-25T17:21:06.131Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-75","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":21,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-83","timestamp":"2024-04-25T17:21:30.586Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-82","client":{"ip":"10.106.42.21","port":37486},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.81.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-86","timestamp":"2024-04-25T17:21:31.050Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-85","client":{"ip":"10.106.45.138","port":57888},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.81.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-89","timestamp":"2024-04-25T17:21:31.282Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-88","client":{"ip":"10.106.46.8","port":40386},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.81.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-96","timestamp":"2024-04-25T17:21:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-91","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":18,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-132","timestamp":"2024-04-25T17:22:06.132Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-127","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":21,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-159","timestamp":"2024-04-25T17:22:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-154","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":19,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-187","timestamp":"2024-04-25T17:23:06.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-182","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-239","timestamp":"2024-04-25T17:23:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-234","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":18,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-274","timestamp":"2024-04-25T17:24:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-269","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":16,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-307","timestamp":"2024-04-25T17:24:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-302","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":20,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-344","timestamp":"2024-04-25T17:25:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-339","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-375","timestamp":"2024-04-25T17:25:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-370","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-406","timestamp":"2024-04-25T17:26:06.131Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-401","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":16,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-436","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.006Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-438","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-439","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":2,"elapsedQueueingTime":1,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.009Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-441","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-use-virtual-threads-if-available","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-442","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.013Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-444","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-446","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.035Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-448","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-449","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.036Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-451","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-452","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.039Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-454","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-456","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.047Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-458","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-459","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.048Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-461","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":27,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-462","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedQueueingTime":0,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.050Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-464","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":54682},"server":{"ip":"10.106.40.138","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":27,"msgId":15,"dn":"cn=config"},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-465","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":32,"elapsedQueueingTime":0,"elapsedProcessingTime":32,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2024-04-25T17:26:31.086Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-468","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-484","timestamp":"2024-04-25T17:26:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-479","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":23,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.40.138","port":51070},"server":{"ip":"10.106.40.138","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":29,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-488","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2024-04-25T17:26:37.469Z","_id":"d4d7d925-37cd-414b-840c-b62291153a02-490","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-517","timestamp":"2024-04-25T17:27:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-512","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":18,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-543","timestamp":"2024-04-25T17:27:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-538","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-570","timestamp":"2024-04-25T17:28:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-565","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-595","timestamp":"2024-04-25T17:28:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-590","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-621","timestamp":"2024-04-25T17:29:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-616","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-649","timestamp":"2024-04-25T17:29:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-644","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-675","timestamp":"2024-04-25T17:30:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-670","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-702","timestamp":"2024-04-25T17:30:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-697","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-727","timestamp":"2024-04-25T17:31:06.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-722","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-755","timestamp":"2024-04-25T17:31:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-750","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-782","timestamp":"2024-04-25T17:32:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-777","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-809","timestamp":"2024-04-25T17:32:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-804","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-836","timestamp":"2024-04-25T17:33:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-831","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-864","timestamp":"2024-04-25T17:33:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-859","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-890","timestamp":"2024-04-25T17:34:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-885","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-917","timestamp":"2024-04-25T17:34:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-912","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-943","timestamp":"2024-04-25T17:35:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-938","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-971","timestamp":"2024-04-25T17:35:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-966","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-999","timestamp":"2024-04-25T17:36:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-994","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-1026","timestamp":"2024-04-25T17:36:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-1021","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-1054","timestamp":"2024-04-25T17:37:06.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-1049","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-1081","timestamp":"2024-04-25T17:37:36.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-1076","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-1108","timestamp":"2024-04-25T17:38:06.129Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-1103","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-1135","timestamp":"2024-04-25T17:38:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-1130","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-1163","timestamp":"2024-04-25T17:39:06.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-1158","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"d4d7d925-37cd-414b-840c-b62291153a02-1216","timestamp":"2024-04-25T17:39:36.130Z","eventName":"DJ-HTTP","transactionId":"d4d7d925-37cd-414b-840c-b62291153a02-1211","client":{"ip":"10.106.44.133","port":53604},"server":{"ip":"10.106.40.138","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.40.138:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} 2024-04-25 17:39:56,010 DEBUG --- stderr --- 2024-04-25 17:39:56,010 DEBUG Defaulted container "ds" out of: ds, initialize (init) - Looking for string "heart" - Looking for string "publish" ---------------- Pod ds-cts-1 ---------------- 2024-04-25 17:39:56,011 INFO 2024-04-25 17:39:56,011 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm logs ds-cts-1 2024-04-25 17:39:56,011 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:39:56,587 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:39:56,587 DEBUG --- stdout --- 2024-04-25 17:39:56,587 DEBUG Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.6.0.7e0436f7626375c00baee240ad259d6a2b07d5f4 Rebuilding degraded indexes for base DN "ou=tokens"... Server configured with: Group ID : default Server ID : ds-cts-1 Advertised listen address : ds-cts-1.ds-cts.xlou.svc.cluster.local Bootstrap replication server(s) : ds-cts-0.ds-cts.xlou.svc.cluster.local:8989,ds-cts-1.ds-cts.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:22.968Z","category":"JVM","severity":"NOTICE","msgId":1058,"message":"ForgeRock Directory Services 7.6.0-20240418130921-7e0436f7626375c00baee240ad259d6a2b07d5f4 (build 20240418132321, revision number 7e0436f7626375c00baee240ad259d6a2b07d5f4) starting up"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:22.968Z","category":"JVM","severity":"NOTICE","msgId":2233,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:22.968Z","category":"JVM","severity":"NOTICE","msgId":2235,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:22.968Z","category":"JVM","severity":"NOTICE","msgId":2229,"message":"JVM Information: 21.0.3+9-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:22.968Z","category":"JVM","severity":"NOTICE","msgId":2230,"message":"JVM Host: ds-cts-1.ds-cts.xlou.svc.cluster.local default/ds-cts-1, running Linux 5.15.146+ amd64, 15032385536 bytes physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:22.968Z","category":"JVM","severity":"NOTICE","msgId":2231,"message":"JVM Arguments: \"-XX:+ExitOnOutOfMemoryError\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:22.968Z","category":"CORE","severity":"WARNING","msgId":1025,"message":"'External Access Log Publisher' is DEPRECATED for removal since 7.2.0. Its usage is highly discouraged"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:23.569Z","category":"BACKEND","severity":"NOTICE","msgId":608,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:23.970Z","category":"SYNC.PURGE","severity":"INFORMATION","msgId":2210,"message":"The purge delay has been set to: 12 h"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:23.970Z","category":"SYNC.LIFECYCLE","severity":"NOTICE","msgId":2022,"message":"Replication server RS(ds-cts-1) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:23.970Z","category":"SYNC.STATE","severity":"NOTICE","msgId":2204,"message":"Directory server DS(ds-cts-1) did not find a generation ID for domain 'uid=monitor'. A new generation ID will be computed by exporting the first 1 entries in the domain"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.170Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2023,"message":"Replication server RS(ds-cts-1) has connected to replication server RS(ds-cts-0) for domain \"uid=monitor\" at ds-cts-0.ds-cts.xlou.svc.cluster.local/10.106.40.138:8989"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.170Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2025,"message":"Replication server RS(ds-cts-1) has accepted a connection from directory server DS(ds-cts-1) for domain \"uid=monitor\" at /10.106.41.134:60826"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.170Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":2026,"message":"Directory server DS(ds-cts-1) has connected to replication server RS(ds-cts-1) for domain \"uid=monitor\" at 10.106.41.134:8989 with generation ID 12671"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.170Z","category":"SYNC.STATE","severity":"NOTICE","msgId":2204,"message":"Directory server DS(ds-cts-1) did not find a generation ID for domain 'ou=tokens'. A new generation ID will be computed by exporting the first 5 entries in the domain"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.170Z","category":"BACKEND","severity":"NOTICE","msgId":610,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 384.6/sec)"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.170Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2023,"message":"Replication server RS(ds-cts-1) has connected to replication server RS(ds-cts-0) for domain \"ou=tokens\" at ds-cts-0.ds-cts.xlou.svc.cluster.local/10.106.40.138:8989"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.170Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2025,"message":"Replication server RS(ds-cts-1) has accepted a connection from directory server DS(ds-cts-1) for domain \"ou=tokens\" at /10.106.41.134:60850"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.170Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":2026,"message":"Directory server DS(ds-cts-1) has connected to replication server RS(ds-cts-1) for domain \"ou=tokens\" at 10.106.41.134:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.370Z","category":"CORE","severity":"NOTICE","msgId":1409,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.370Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.370Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.370Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.370Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.370Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.370Z","category":"CORE","severity":"NOTICE","msgId":1059,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:24.370Z","category":"CORE","severity":"NOTICE","msgId":1061,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.server-1059): The Directory Server has started successfully"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-57","timestamp":"2024-04-25T17:20:29.102Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-52","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":101,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.596Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2024,"message":"Replication server RS(ds-cts-1) has accepted a connection from replication server RS(ds-cts-2) for domain \"uid=monitor\" at /10.106.43.7:49480"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.596Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2024,"message":"Replication server RS(ds-cts-1) has accepted a connection from replication server RS(ds-cts-2) for domain \"ou=tokens\" at /10.106.43.7:49482"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-64","timestamp":"2024-04-25T17:20:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-59","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":28,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-71","timestamp":"2024-04-25T17:21:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-66","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":25,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-97","timestamp":"2024-04-25T17:21:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-92","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":28,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-149","timestamp":"2024-04-25T17:22:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-144","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":22,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-189","timestamp":"2024-04-25T17:22:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-184","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-233","timestamp":"2024-04-25T17:23:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-228","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-292","timestamp":"2024-04-25T17:23:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-287","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":18,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-330","timestamp":"2024-04-25T17:24:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-325","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-374","timestamp":"2024-04-25T17:24:59.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-369","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":16,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-419","timestamp":"2024-04-25T17:25:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-414","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":16,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-466","timestamp":"2024-04-25T17:25:59.070Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-461","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-508","timestamp":"2024-04-25T17:26:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-503","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-528","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.428Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-530","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-531","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.430Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-533","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-use-virtual-threads-if-available","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-534","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedQueueingTime":0,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.434Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-536","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-538","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.454Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-540","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-541","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedQueueingTime":0,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.455Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-543","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-544","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":1,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.458Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-546","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-548","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedQueueingTime":0,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.465Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-550","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-551","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.467Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-553","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":21,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-554","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.469Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-556","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":46174},"server":{"ip":"10.106.41.134","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":21,"msgId":15,"dn":"cn=config"},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-557","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":32,"elapsedQueueingTime":0,"elapsedProcessingTime":32,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2024-04-25T17:26:33.506Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-559","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.41.134","port":48784},"server":{"ip":"10.106.41.134","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":22,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-570","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":2,"elapsedQueueingTime":1,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2024-04-25T17:26:39.242Z","_id":"e373968b-8785-4841-8a45-f150a7ab8a97-572","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-598","timestamp":"2024-04-25T17:26:59.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-593","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":22,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-632","timestamp":"2024-04-25T17:27:29.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-627","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-666","timestamp":"2024-04-25T17:27:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-661","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-700","timestamp":"2024-04-25T17:28:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-695","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-734","timestamp":"2024-04-25T17:28:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-729","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-768","timestamp":"2024-04-25T17:29:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-763","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-802","timestamp":"2024-04-25T17:29:59.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-797","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-836","timestamp":"2024-04-25T17:30:29.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-831","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-870","timestamp":"2024-04-25T17:30:59.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-865","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-904","timestamp":"2024-04-25T17:31:29.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-899","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-938","timestamp":"2024-04-25T17:31:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-933","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-973","timestamp":"2024-04-25T17:32:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-968","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1007","timestamp":"2024-04-25T17:32:59.070Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1002","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1041","timestamp":"2024-04-25T17:33:29.070Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1036","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1075","timestamp":"2024-04-25T17:33:59.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1070","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1109","timestamp":"2024-04-25T17:34:29.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1104","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1143","timestamp":"2024-04-25T17:34:59.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1138","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1178","timestamp":"2024-04-25T17:35:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1173","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1212","timestamp":"2024-04-25T17:35:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1207","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":16,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1246","timestamp":"2024-04-25T17:36:29.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1241","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":16,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1282","timestamp":"2024-04-25T17:36:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1277","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1316","timestamp":"2024-04-25T17:37:29.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1311","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1350","timestamp":"2024-04-25T17:37:59.069Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1345","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1384","timestamp":"2024-04-25T17:38:29.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1379","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1418","timestamp":"2024-04-25T17:38:59.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1413","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"e373968b-8785-4841-8a45-f150a7ab8a97-1469","timestamp":"2024-04-25T17:39:29.068Z","eventName":"DJ-HTTP","transactionId":"e373968b-8785-4841-8a45-f150a7ab8a97-1464","client":{"ip":"10.106.44.133","port":42756},"server":{"ip":"10.106.41.134","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-1.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.41.134:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} 2024-04-25 17:39:56,587 DEBUG --- stderr --- 2024-04-25 17:39:56,587 DEBUG Defaulted container "ds" out of: ds, initialize (init) - Looking for string "heart" - Looking for string "publish" ---------------- Pod ds-cts-2 ---------------- 2024-04-25 17:39:56,588 INFO 2024-04-25 17:39:56,588 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm logs ds-cts-2 2024-04-25 17:39:56,588 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:39:57,130 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:39:57,130 DEBUG --- stdout --- 2024-04-25 17:39:57,130 DEBUG Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.6.0.7e0436f7626375c00baee240ad259d6a2b07d5f4 Rebuilding degraded indexes for base DN "ou=tokens"... Server configured with: Group ID : default Server ID : ds-cts-2 Advertised listen address : ds-cts-2.ds-cts.xlou.svc.cluster.local Bootstrap replication server(s) : ds-cts-0.ds-cts.xlou.svc.cluster.local:8989,ds-cts-1.ds-cts.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:49.368Z","category":"JVM","severity":"NOTICE","msgId":1058,"message":"ForgeRock Directory Services 7.6.0-20240418130921-7e0436f7626375c00baee240ad259d6a2b07d5f4 (build 20240418132321, revision number 7e0436f7626375c00baee240ad259d6a2b07d5f4) starting up"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:49.368Z","category":"JVM","severity":"NOTICE","msgId":2233,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:49.368Z","category":"JVM","severity":"NOTICE","msgId":2235,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:49.368Z","category":"JVM","severity":"NOTICE","msgId":2229,"message":"JVM Information: 21.0.3+9-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:49.368Z","category":"JVM","severity":"NOTICE","msgId":2230,"message":"JVM Host: ds-cts-2.ds-cts.xlou.svc.cluster.local default/ds-cts-2, running Linux 5.15.146+ amd64, 15032385536 bytes physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:49.368Z","category":"JVM","severity":"NOTICE","msgId":2231,"message":"JVM Arguments: \"-XX:+ExitOnOutOfMemoryError\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:49.368Z","category":"CORE","severity":"WARNING","msgId":1025,"message":"'External Access Log Publisher' is DEPRECATED for removal since 7.2.0. Its usage is highly discouraged"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:49.969Z","category":"BACKEND","severity":"NOTICE","msgId":608,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.169Z","category":"SYNC.PURGE","severity":"INFORMATION","msgId":2210,"message":"The purge delay has been set to: 12 h"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.369Z","category":"SYNC.LIFECYCLE","severity":"NOTICE","msgId":2022,"message":"Replication server RS(ds-cts-2) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.369Z","category":"SYNC.STATE","severity":"NOTICE","msgId":2204,"message":"Directory server DS(ds-cts-2) did not find a generation ID for domain 'uid=monitor'. A new generation ID will be computed by exporting the first 1 entries in the domain"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.569Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2023,"message":"Replication server RS(ds-cts-2) has connected to replication server RS(ds-cts-1) for domain \"uid=monitor\" at ds-cts-1.ds-cts.xlou.svc.cluster.local/10.106.41.134:8989"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.569Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2023,"message":"Replication server RS(ds-cts-2) has connected to replication server RS(ds-cts-0) for domain \"uid=monitor\" at ds-cts-0.ds-cts.xlou.svc.cluster.local/10.106.40.138:8989"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.569Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2024,"message":"Replication server RS(ds-cts-2) has accepted a connection from replication server RS(ds-cts-0) for domain \"ou=tokens\" at /10.106.40.138:42600"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.569Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2023,"message":"Replication server RS(ds-cts-2) has connected to replication server RS(ds-cts-1) for domain \"ou=tokens\" at ds-cts-1.ds-cts.xlou.svc.cluster.local/10.106.41.134:8989"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.569Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2025,"message":"Replication server RS(ds-cts-2) has accepted a connection from directory server DS(ds-cts-2) for domain \"uid=monitor\" at /10.106.43.7:40216"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.569Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":2026,"message":"Directory server DS(ds-cts-2) has connected to replication server RS(ds-cts-2) for domain \"uid=monitor\" at 10.106.43.7:8989 with generation ID 12671"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.569Z","category":"SYNC.STATE","severity":"NOTICE","msgId":2204,"message":"Directory server DS(ds-cts-2) did not find a generation ID for domain 'ou=tokens'. A new generation ID will be computed by exporting the first 5 entries in the domain"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.569Z","category":"BACKEND","severity":"NOTICE","msgId":610,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 384.6/sec)"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":2025,"message":"Replication server RS(ds-cts-2) has accepted a connection from directory server DS(ds-cts-2) for domain \"ou=tokens\" at /10.106.43.7:40238"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":2026,"message":"Directory server DS(ds-cts-2) has connected to replication server RS(ds-cts-2) for domain \"ou=tokens\" at 10.106.43.7:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"CORE","severity":"NOTICE","msgId":1409,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":1845,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"CORE","severity":"NOTICE","msgId":1059,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2024-04-25T17:20:50.770Z","category":"CORE","severity":"NOTICE","msgId":1061,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.server-1059): The Directory Server has started successfully"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-57","timestamp":"2024-04-25T17:20:57.959Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-52","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":92,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-64","timestamp":"2024-04-25T17:21:27.932Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-59","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":26,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-81","timestamp":"2024-04-25T17:21:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-76","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":25,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-123","timestamp":"2024-04-25T17:22:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-118","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":31,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-154","timestamp":"2024-04-25T17:22:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-149","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":18,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-188","timestamp":"2024-04-25T17:23:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-183","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":28,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-239","timestamp":"2024-04-25T17:23:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-234","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":18,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-271","timestamp":"2024-04-25T17:24:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-266","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-305","timestamp":"2024-04-25T17:24:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-300","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":16,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-341","timestamp":"2024-04-25T17:25:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-336","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":21,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-372","timestamp":"2024-04-25T17:25:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-367","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":18,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-404","timestamp":"2024-04-25T17:26:27.930Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-399","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-422","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.629Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-424","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-425","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":1,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.632Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-427","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-use-virtual-threads-if-available","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-428","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.635Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-430","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-432","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.658Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-434","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-435","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedQueueingTime":0,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.660Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-437","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-438","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedQueueingTime":0,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.662Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-440","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-442","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedQueueingTime":0,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.668Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-444","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-445","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":0,"elapsedProcessingTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.670Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-447","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":20,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-448","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedQueueingTime":1,"elapsedProcessingTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.672Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-450","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":52002},"server":{"ip":"10.106.43.7","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":20,"msgId":15,"dn":"cn=config"},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-451","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":31,"elapsedQueueingTime":0,"elapsedProcessingTime":31,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2024-04-25T17:26:35.707Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-453","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.7","port":43492},"server":{"ip":"10.106.43.7","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":21,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-459","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":2,"elapsedQueueingTime":0,"elapsedProcessingTime":2,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2024-04-25T17:26:41.004Z","_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-461","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-482","timestamp":"2024-04-25T17:26:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-477","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-510","timestamp":"2024-04-25T17:27:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-505","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-537","timestamp":"2024-04-25T17:27:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-532","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":18,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-564","timestamp":"2024-04-25T17:28:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-559","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-592","timestamp":"2024-04-25T17:28:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-587","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-620","timestamp":"2024-04-25T17:29:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-615","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-647","timestamp":"2024-04-25T17:29:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-642","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-672","timestamp":"2024-04-25T17:30:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-667","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-699","timestamp":"2024-04-25T17:30:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-694","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":17,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-727","timestamp":"2024-04-25T17:31:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-722","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-754","timestamp":"2024-04-25T17:31:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-749","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-782","timestamp":"2024-04-25T17:32:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-777","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-809","timestamp":"2024-04-25T17:32:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-804","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-837","timestamp":"2024-04-25T17:33:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-832","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-864","timestamp":"2024-04-25T17:33:57.930Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-859","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-891","timestamp":"2024-04-25T17:34:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-886","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-919","timestamp":"2024-04-25T17:34:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-914","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-946","timestamp":"2024-04-25T17:35:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-941","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-973","timestamp":"2024-04-25T17:35:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-968","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1000","timestamp":"2024-04-25T17:36:27.930Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-995","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":15,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1030","timestamp":"2024-04-25T17:36:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1025","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1058","timestamp":"2024-04-25T17:37:27.930Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1053","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1085","timestamp":"2024-04-25T17:37:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1080","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1112","timestamp":"2024-04-25T17:38:27.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1107","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1139","timestamp":"2024-04-25T17:38:57.931Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1134","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":13,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1185","timestamp":"2024-04-25T17:39:27.930Z","eventName":"DJ-HTTP","transactionId":"a044d6cf-a593-4ba8-b32b-dc7c5249bdc2-1180","client":{"ip":"10.106.44.133","port":39488},"server":{"ip":"10.106.43.7","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-2.ds-cts.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.106.43.7:8080"],"user-agent":["Prometheus/2.44.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":14,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} 2024-04-25 17:39:57,131 DEBUG --- stderr --- 2024-04-25 17:39:57,131 DEBUG Defaulted container "ds" out of: ds, initialize (init) - Looking for string "heart" - Looking for string "publish" ________________________________________________________________________________ [2024-04-25 17:39:57] CheckReplication_ds-cts step5 : Compare ds-sync-state for suffixes across all replicas ________________________________________________________________________________ 2024-04-25 17:39:57,132 INFO 2024-04-25 17:39:57,133 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn " " --searchScope base "objectclass=*" namingContexts 2024-04-25 17:39:58,957 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:39:58,957 DEBUG --- stdout --- 2024-04-25 17:39:58,957 DEBUG dn: namingContexts: uid=admin namingContexts: ou=tokens namingContexts: uid=monitor namingContexts: uid=proxy 2024-04-25 17:39:58,957 DEBUG --- stderr --- 2024-04-25 17:39:58,957 DEBUG 2024-04-25 17:39:58,957 INFO => Using namingContexts: {'ou=tokens', 'uid=proxy'} 2024-04-25 17:39:58,958 INFO 2024-04-25 17:39:58,958 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "ou=tokens" --searchScope base "objectclass=*" ds-sync-state 2024-04-25 17:40:00,741 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:40:00,742 DEBUG --- stdout --- 2024-04-25 17:40:00,742 DEBUG dn: ou=tokens ds-sync-state: 0108018f16573e3e0000094ads-cts-2 ds-sync-state: 0108018f165735750000093eds-cts-1 ds-sync-state: 0108018f16573d0700000947ds-cts-0 2024-04-25 17:40:00,742 DEBUG --- stderr --- 2024-04-25 17:40:00,742 DEBUG 2024-04-25 17:40:00,742 INFO 2024-04-25 17:40:00,742 INFO 2024-04-25 17:40:00,743 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "ou=tokens" --searchScope base "objectclass=*" ds-sync-state 2024-04-25 17:40:02,458 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:40:02,458 DEBUG --- stdout --- 2024-04-25 17:40:02,458 DEBUG dn: ou=tokens ds-sync-state: 0108018f16573d0700000947ds-cts-0 ds-sync-state: 0108018f16573e3e0000094ads-cts-2 ds-sync-state: 0108018f165735750000093eds-cts-1 2024-04-25 17:40:02,458 DEBUG --- stderr --- 2024-04-25 17:40:02,458 DEBUG 2024-04-25 17:40:02,458 INFO 2024-04-25 17:40:02,458 INFO 2024-04-25 17:40:02,459 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "ou=tokens" --searchScope base "objectclass=*" ds-sync-state 2024-04-25 17:40:04,219 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:40:04,219 DEBUG --- stdout --- 2024-04-25 17:40:04,220 DEBUG dn: ou=tokens ds-sync-state: 0108018f165735750000093eds-cts-1 ds-sync-state: 0108018f16573d0700000947ds-cts-0 ds-sync-state: 0108018f16573e3e0000094ads-cts-2 2024-04-25 17:40:04,220 DEBUG --- stderr --- 2024-04-25 17:40:04,220 DEBUG 2024-04-25 17:40:04,220 INFO 2024-04-25 17:40:04,220 INFO 2024-04-25 17:40:04,220 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "uid=proxy" --searchScope base "objectclass=*" ds-sync-state 2024-04-25 17:40:06,033 INFO [run_command]: OK (rc = 0 - expected to be in [0]) 2024-04-25 17:40:06,033 DEBUG --- stdout --- 2024-04-25 17:40:06,033 DEBUG dn: uid=proxy 2024-04-25 17:40:06,033 DEBUG --- stderr --- 2024-04-25 17:40:06,033 DEBUG 2024-04-25 17:40:06,033 INFO => Skipping suffix "uid=proxy" as "ds-sync-state" not found in stdout => loop 1 out of 30 : repl_state = {'ou=tokens': {'ds-cts-0': ['0108018f16573e3e0000094ads-cts-2', '0108018f165735750000093eds-cts-1', '0108018f16573d0700000947ds-cts-0'], 'ds-cts-1': ['0108018f16573d0700000947ds-cts-0', '0108018f16573e3e0000094ads-cts-2', '0108018f165735750000093eds-cts-1'], 'ds-cts-2': ['0108018f165735750000093eds-cts-1', '0108018f16573d0700000947ds-cts-0', '0108018f16573e3e0000094ads-cts-2']}} => ds-sync-state match for "ou=tokens" => {'ou=tokens', 'uid=proxy'} expunged. set() remain SUCCESS: replication seems to be synchronised ________________________________________________________________________________ [2024-04-25 17:40:06] CheckReplication_ds-cts step6 : Check replication is in sync by adding once and searching all ________________________________________________________________________________ 2024-04-25 17:40:06,034 INFO 2024-04-25 17:40:06,035 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm cp /tmp/tmp7h0n7_fl --container ds ds-cts-0:/tmp/entries.ldif 2024-04-25 17:40:06,035 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:40:07,477 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:40:07,477 DEBUG --- stdout --- 2024-04-25 17:40:07,477 DEBUG 2024-04-25 17:40:07,477 DEBUG --- stderr --- 2024-04-25 17:40:07,477 DEBUG 2024-04-25 17:40:07,478 INFO 2024-04-25 17:40:07,478 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapmodify --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** 2024-04-25 17:40:07,478 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:40:09,228 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:40:09,228 DEBUG --- stdout --- 2024-04-25 17:40:09,228 DEBUG # ADD operation successful for DN uid=pyrock_nllqy,ou=tokens 2024-04-25 17:40:09,228 DEBUG --- stderr --- 2024-04-25 17:40:09,228 DEBUG => Added test entry with dn "uid=pyrock_nllqy,ou=tokens" => loop 1 out of 5 to check "3" pods for presence of test entry "uid=pyrock_nllqy,ou=tokens" 2024-04-25 17:40:09,228 INFO 2024-04-25 17:40:09,229 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "uid=pyrock_nllqy,ou=tokens" --searchScope base objectclass=* 1.1 2024-04-25 17:40:10,991 INFO [run_command]: OK (rc = 0 - expected to be in [0, 32]) 2024-04-25 17:40:10,991 DEBUG --- stdout --- 2024-04-25 17:40:10,991 DEBUG dn: uid=pyrock_nllqy,ou=tokens 2024-04-25 17:40:10,991 DEBUG --- stderr --- 2024-04-25 17:40:10,991 DEBUG 2024-04-25 17:40:10,991 INFO => Found test entry "uid=pyrock_nllqy,ou=tokens" on "ds-cts-0" 2024-04-25 17:40:10,991 INFO 2024-04-25 17:40:10,992 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "uid=pyrock_nllqy,ou=tokens" --searchScope base objectclass=* 1.1 2024-04-25 17:40:12,740 INFO [run_command]: OK (rc = 0 - expected to be in [0, 32]) 2024-04-25 17:40:12,741 DEBUG --- stdout --- 2024-04-25 17:40:12,741 DEBUG dn: uid=pyrock_nllqy,ou=tokens 2024-04-25 17:40:12,741 DEBUG --- stderr --- 2024-04-25 17:40:12,741 DEBUG 2024-04-25 17:40:12,741 INFO => Found test entry "uid=pyrock_nllqy,ou=tokens" on "ds-cts-1" 2024-04-25 17:40:12,741 INFO 2024-04-25 17:40:12,742 INFO [run_command]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword **** --baseDn "uid=pyrock_nllqy,ou=tokens" --searchScope base objectclass=* 1.1 2024-04-25 17:40:14,521 INFO [run_command]: OK (rc = 0 - expected to be in [0, 32]) 2024-04-25 17:40:14,521 DEBUG --- stdout --- 2024-04-25 17:40:14,521 DEBUG dn: uid=pyrock_nllqy,ou=tokens 2024-04-25 17:40:14,521 DEBUG --- stderr --- 2024-04-25 17:40:14,521 DEBUG 2024-04-25 17:40:14,521 INFO => Found test entry "uid=pyrock_nllqy,ou=tokens" on "ds-cts-2" 2024-04-25 17:40:24,532 INFO 2024-04-25 17:40:24,532 INFO [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm exec ds-cts-0 --container ds -- ldapdelete --port 4444 --useSsl --trustAll --bindDn "uid=admin" --bindPassword **** 2024-04-25 17:40:24,532 INFO [loop_until]: (max_time=180, interval=5, expected_rc=[0] 2024-04-25 17:40:26,297 INFO [loop_until]: OK (rc = 0) 2024-04-25 17:40:26,297 DEBUG --- stdout --- 2024-04-25 17:40:26,297 DEBUG # DELETE operation successful for DN uid=pyrock_nllqy,ou=tokens 2024-04-25 17:40:26,297 DEBUG --- stderr --- 2024-04-25 17:40:26,297 DEBUG => Deleted test entry with dn "uid=pyrock_nllqy,ou=tokens" SUCCESS: replication seems to be synchronised ________________________________________________________________________________ [2024-04-25 17:40:26] CheckReplication_ds-cts post : N/A ________________________________________________________________________________ SUCCESS : replication seems to be synchronised Setting result to PASS Task has been successfully stopped