--Task-- name: CheckReplication_ds-idrepo enabled: True class_name: CheckReplicationTask source_name: ds-idrepo source_namespace: >default< target_name: ds-idrepo target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [05/Aug/2022 06:19:50] CheckReplication_ds-idrepo pre : N/A ________________________________________________________________________________ max_time: 4h 59m sleep_interval: 10 [05/Aug/2022 06:19:50] - INFO: Timeout for this Task has changed to 10h (36000 seconds) ________________________________________________________________________________ [05/Aug/2022 06:19:50] CheckReplication_ds-idrepo step1 : Check number of entries ________________________________________________________________________________ loop 1 : SUCCESS: Pods "ds-idrepo-0" and "ds-idrepo-1" are in sync (both have 1022 entries) loop 1 : SUCCESS: Pods "ds-idrepo-0" and "ds-idrepo-2" are in sync (both have 1022 entries) loop 1 : SUCCESS: Pods "ds-idrepo-1" and "ds-idrepo-2" are in sync (both have 1022 entries) [check_number_of_entries] SUCCESS : replication is synchronised after 0s ________________________________________________________________________________ [05/Aug/2022 06:19:55] CheckReplication_ds-idrepo step2 : Monitor replication attributes in cn=monitor ________________________________________________________________________________ loop 1 : SUCCESS: ds-idrepo-0 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-idrepo-0 : ds-mon-updates-inbound-queue = 0 loop 1 : SUCCESS: ds-idrepo-1 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-idrepo-1 : ds-mon-updates-inbound-queue = 0 loop 1 : SUCCESS: ds-idrepo-2 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-idrepo-2 : ds-mon-updates-inbound-queue = 0 [check_monitoring_replication] final status : { "ds-idrepo-0": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 }, "ds-idrepo-1": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 }, "ds-idrepo-2": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 } } [check_monitoring_replication] SUCCESS : replication data in cn=monitor is synchronised after 0s ________________________________________________________________________________ [05/Aug/2022 06:20:00] CheckReplication_ds-idrepo step3 : Temporary step for PERF-1831 : Dump cn=monitor replication attributes ________________________________________________________________________________ ---------------- Pod ds-idrepo-0 ---------------- [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (172 lines): ----- output ----- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.5.14:8989 ds-mon-connected-to-server-id: ds-idrepo-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 542096 ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 283 ds-mon-server-id: ds-idrepo-0 ds-mon-server-state: 010b01826ca92bd60000119cds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060854.708Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [7, 1, 3, 1, 1, 0, 3, 4] dn: ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.5.14:8989 ds-mon-connected-to-server-id: ds-idrepo-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 2338230 ds-mon-domain-name: ou=am-config ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":20,"total":37.939,"mean_rate":0.030,"m1_rate":0.016,"m5_rate":0.036,"m15_rate":0.018,"mean":1.897,"min":0.885,"max":3.457,"stddev":0.685,"p50":1.827,"p75":2.376,"p95":3.031,"p98":3.457,"p99":3.457,"p999":3.457,"p9999":3.457,"p99999":3.457} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 15 ds-mon-server-id: ds-idrepo-0 ds-mon-server-state: 010b01826c9fcfbf00000137ds-idrepo-0 ds-mon-server-state: 010b01826ca66975000007f8ds-idrepo-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060854.989Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [7, 1, 3, 1, 1, 0, 3, 4] dn: cn=remote replicas,ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-2,cn=remote replicas,ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=am-config ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 [...] ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 1005 ds-mon-server-id: ds-idrepo-0 ds-mon-server-state: 010b01826ca9191300001181ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060855.053Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [7, 1, 3, 1, 1, 0, 3, 4] dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.5.14:8989 ds-mon-connected-to-server-id: ds-idrepo-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 2 ds-mon-server-id: ds-idrepo-0 ds-mon-server-state: 010b01826c9f0b7a00000016ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060855.098Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [7, 1, 3, 1, 1, 0, 3, 4] dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.5.14:8989 ds-mon-connected-to-server-id: ds-idrepo-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060854.936Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [7, 1, 3, 1, 1, 0, 3, 4] --- stderr --- ---------------- Pod ds-idrepo-1 ---------------- [run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (230 lines): ----- output ----- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.4.14:8989 ds-mon-connected-to-server-id: ds-idrepo-1 ds-mon-current-receive-window: 2147483576 ds-mon-domain-generation-id: 542096 ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":284,"total":638.624,"mean_rate":0.452,"m1_rate":0.507,"m5_rate":1.056,"m15_rate":2.918,"mean":2.249,"min":0.893,"max":26.870,"stddev":3.369,"p50":1.581,"p75":1.933,"p95":4.522,"p98":18.088,"p99":24.248,"p999":26.870,"p9999":26.870,"p99999":26.870} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-1 ds-mon-server-state: 010b01826ca92ef7000011a1ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060935.567Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [278, 134, 141, 115, 124, 115, 278, 141] dn: cn=remote replicas,ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-0,cn=remote replicas,ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":284,"total":638.624,"mean_rate":0.452,"m1_rate":0.506,"m5_rate":1.056,"m15_rate":2.918,"mean":2.249,"min":0.893,"max":26.870,"stddev":3.369,"p50":1.581,"p75":1.933,"p95":4.522,"p98":18.088,"p99":24.248,"p999":26.870,"p9999":26.870,"p99999":26.870} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.4.14:8989 ds-mon-connected-to-server-id: ds-idrepo-1 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 2338230 ds-mon-domain-name: ou=am-config ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":35,"total":113.231,"mean_rate":0.056,"m1_rate":0.016,"m5_rate":0.093,"m15_rate":0.226,"mean":3.235,"min":1.032,"max":15.466,"stddev":3.052,"p50":2.032,"p75":4.489,"p95":12.124,"p98":15.466,"p99":15.466,"p999":15.466,"p9999":15.466,"p99999":15.466} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-1 ds-mon-server-state: 010b01826c9fcfbf00000137ds-idrepo-0 ds-mon-server-state: 010b01826ca66975000007f8ds-idrepo-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060935.965Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 [...] ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":1005,"total":5098.292,"mean_rate":1.600,"m1_rate":1.639,"m5_rate":2.145,"m15_rate":1.154,"mean":5.073,"min":1.647,"max":18.219,"stddev":2.589,"p50":4.489,"p75":6.390,"p95":10.158,"p98":12.714,"p99":13.763,"p999":17.433,"p9999":18.219,"p99999":18.219} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.4.14:8989 ds-mon-connected-to-server-id: ds-idrepo-1 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":2,"total":18.055,"mean_rate":0.003,"m1_rate":0.000,"m5_rate":0.051,"m15_rate":0.201,"mean":9.040,"min":2.572,"max":15.532,"stddev":6.459,"p50":2.589,"p75":15.532,"p95":15.532,"p98":15.532,"p99":15.532,"p999":15.532,"p9999":15.532,"p99999":15.532} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-1 ds-mon-server-state: 010b01826c9f0b7a00000016ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060936.151Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [278, 134, 141, 115, 124, 115, 278, 141] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-0,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":2,"total":18.055,"mean_rate":0.003,"m1_rate":0.000,"m5_rate":0.051,"m15_rate":0.201,"mean":9.040,"min":2.572,"max":15.532,"stddev":6.459,"p50":2.589,"p75":15.532,"p95":15.532,"p98":15.532,"p99":15.532,"p999":15.532,"p9999":15.532,"p99999":15.532} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.4.14:8989 ds-mon-connected-to-server-id: ds-idrepo-1 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-1 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805060935.870Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [278, 134, 141, 115, 124, 115, 278, 141] --- stderr --- ---------------- Pod ds-idrepo-2 ---------------- [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (220 lines): ----- output ----- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.3.14:8989 ds-mon-connected-to-server-id: ds-idrepo-2 ds-mon-current-receive-window: 2147483576 ds-mon-domain-generation-id: 542096 ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":284,"total":612.746,"mean_rate":0.482,"m1_rate":0.501,"m5_rate":1.609,"m15_rate":4.712,"mean":2.157,"min":0.844,"max":26.870,"stddev":3.005,"p50":1.556,"p75":1.884,"p95":3.883,"p98":11.993,"p99":21.103,"p999":26.870,"p9999":26.870,"p99999":26.870} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-2 ds-mon-server-state: 010b01826ca92ef7000011a1ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805061017.069Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [271, 133, 138, 114, 123, 115, 275, 137] dn: cn=remote replicas,ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-0,cn=remote replicas,ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":284,"total":612.746,"mean_rate":0.483,"m1_rate":0.499,"m5_rate":1.638,"m15_rate":4.817,"mean":2.157,"min":0.844,"max":26.870,"stddev":3.005,"p50":1.556,"p75":1.884,"p95":3.883,"p98":11.993,"p99":21.103,"p999":26.870,"p9999":26.870,"p99999":26.870} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.3.14:8989 ds-mon-connected-to-server-id: ds-idrepo-2 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 2338230 ds-mon-domain-name: ou=am-config ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":15,"total":180.465,"mean_rate":0.025,"m1_rate":0.000,"m5_rate":0.434,"m15_rate":1.575,"mean":12.034,"min":3.064,"max":23.200,"stddev":6.373,"p50":11.796,"p75":16.646,"p95":23.200,"p98":23.200,"p99":23.200,"p999":23.200,"p9999":23.200,"p99999":23.200} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 20 ds-mon-server-id: ds-idrepo-2 ds-mon-server-state: 010b01826c9fcfbf00000137ds-idrepo-0 ds-mon-server-state: 010b01826ca66975000007f8ds-idrepo-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805061017.671Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 [...] ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":1005,"total":4658.677,"mean_rate":1.709,"m1_rate":1.593,"m5_rate":2.140,"m15_rate":1.162,"mean":4.636,"min":1.425,"max":32.244,"stddev":2.849,"p50":3.883,"p75":5.636,"p95":10.158,"p98":12.386,"p99":15.598,"p999":24.642,"p9999":32.244,"p99999":32.244} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.3.14:8989 ds-mon-connected-to-server-id: ds-idrepo-2 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":2,"total":16.982,"mean_rate":0.003,"m1_rate":0.000,"m5_rate":0.058,"m15_rate":0.210,"mean":8.489,"min":2.064,"max":14.942,"stddev":6.420,"p50":2.073,"p75":14.942,"p95":14.942,"p98":14.942,"p99":14.942,"p999":14.942,"p9999":14.942,"p99999":14.942} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-2 ds-mon-server-state: 010b01826c9f0b7a00000016ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805061017.836Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [271, 133, 138, 114, 123, 115, 275, 137] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-0,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":2,"total":16.982,"mean_rate":0.003,"m1_rate":0.000,"m5_rate":0.058,"m15_rate":0.210,"mean":8.489,"min":2.064,"max":14.942,"stddev":6.420,"p50":2.073,"p75":14.942,"p95":14.942,"p98":14.942,"p99":14.942,"p999":14.942,"p9999":14.942,"p99999":14.942} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.0.3.14:8989 ds-mon-connected-to-server-id: ds-idrepo-2 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20220805061017.425Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [271, 133, 138, 114, 123, 115, 275, 137] --- stderr --- ________________________________________________________________________________ [05/Aug/2022 06:20:06] CheckReplication_ds-idrepo step4 : Temporary step for PERF-1831 : checks logs ________________________________________________________________________________ ---------------- Pod ds-idrepo-0 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-idrepo-0 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.167d7aaf6f08d4399db54a86d3d62ae8e9552a3f Rebuilding degraded indexes for base DN "ou=tokens"... Rebuilding degraded indexes for base DN "ou=identities"... Rebuilding degraded indexes for base DN "ou=am-config"... Rebuilding degraded indexes for base DN "dc=openidm,dc=forgerock,dc=io"... Server configured with: Group ID : default Server ID : ds-idrepo-0 Advertised listen address : ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local Bootstrap replication server(s) : ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8989,ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:53.339Z","category":"CORE","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.3.0-20220729080644-167d7aaf6f08d4399db54a86d3d62ae8e9552a3f (build 20220729082219, revision number 167d7aaf6f08d4399db54a86d3d62ae8e9552a3f) starting up"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:53.339Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:53.339Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:53.339Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.4+8-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:53.339Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local default/ds-idrepo-0, running Linux 5.4.188+ amd64, unknown physical memory size, number of processors available 8"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:53.339Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:53.940Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:53.940Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend idmRepo containing 41 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.341Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend cfgStore containing 115 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.341Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amIdentityStore containing 21 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.541Z","category":"SYNC","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-idrepo-0) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.741Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 41 entries and skipped 0 in 0 seconds (average rate 2562.5/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.741Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.0.5.14:35508"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.741Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at 10.0.5.14:8989 with generation ID 542096"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"uid=monitor\" at /10.0.5.14:35512"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"uid=monitor\" at 10.0.5.14:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 115 entries and skipped 0 in 0 seconds (average rate 9583.3/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=am-config\" at /10.0.5.14:35516"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=am-config\" at 10.0.5.14:8989 with generation ID 2338230"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 21 entries and skipped 0 in 0 seconds (average rate 7000.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=identities\" at /10.0.5.14:35520"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=identities\" at 10.0.5.14:8989 with generation ID 253127"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 5000.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=tokens\" at /10.0.5.14:35524"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:54.941Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=tokens\" at 10.0.5.14:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:55.142Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:55.142Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:55.142Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:55.142Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:55.142Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:55.142Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:08:55.142Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3","timestamp":"2022-08-05T06:08:56.502Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2","client":{"ip":"10.0.7.65","port":38174},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":30,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-7","timestamp":"2022-08-05T06:08:56.628Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-6","client":{"ip":"10.0.7.65","port":38178},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-11","timestamp":"2022-08-05T06:08:56.641Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-10","client":{"ip":"10.0.7.65","port":38180},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-15","timestamp":"2022-08-05T06:08:56.654Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-14","client":{"ip":"10.0.7.65","port":38182},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-19","timestamp":"2022-08-05T06:08:57.389Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-18","client":{"ip":"10.0.7.66","port":36454},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-26","timestamp":"2022-08-05T06:08:58.214Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-25","client":{"ip":"10.0.6.29","port":49662},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-30","timestamp":"2022-08-05T06:08:58.242Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-29","client":{"ip":"10.0.6.29","port":49666},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-34","timestamp":"2022-08-05T06:08:58.255Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-33","client":{"ip":"10.0.6.29","port":49668},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-38","timestamp":"2022-08-05T06:08:58.267Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-37","client":{"ip":"10.0.6.29","port":49670},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-42","timestamp":"2022-08-05T06:08:58.459Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-41","client":{"ip":"10.0.11.34","port":49092},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-46","timestamp":"2022-08-05T06:08:58.486Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-45","client":{"ip":"10.0.11.34","port":49096},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-50","timestamp":"2022-08-05T06:08:58.498Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-49","client":{"ip":"10.0.11.34","port":49098},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-54","timestamp":"2022-08-05T06:08:58.510Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-53","client":{"ip":"10.0.11.34","port":49100},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-67","timestamp":"2022-08-05T06:09:00.397Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-66","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":96,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-372","timestamp":"2022-08-05T06:09:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-370","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.780Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.0.4.14:56116"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.780Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"uid=monitor\" at /10.0.4.14:56124"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.980Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=am-config\" at /10.0.4.14:56132"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.980Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=identities\" at /10.0.4.14:56140"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.181Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=tokens\" at /10.0.4.14:56148"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-714","timestamp":"2022-08-05T06:10:00.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-712","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.213Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.0.3.14:37368"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.413Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=am-config\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.0.3.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.413Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=tokens\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.0.3.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.413Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"uid=monitor\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.0.3.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.413Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=identities\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.0.3.14:8989"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-913","timestamp":"2022-08-05T06:10:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-911","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1113","timestamp":"2022-08-05T06:11:00.397Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1111","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1308","timestamp":"2022-08-05T06:11:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1306","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1509","timestamp":"2022-08-05T06:12:00.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1507","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1715","timestamp":"2022-08-05T06:12:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1713","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1927","timestamp":"2022-08-05T06:13:00.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-1925","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2133","timestamp":"2022-08-05T06:13:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2131","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":50,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2338","timestamp":"2022-08-05T06:14:00.397Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2336","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2542","timestamp":"2022-08-05T06:14:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2540","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2748","timestamp":"2022-08-05T06:15:00.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2746","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2953","timestamp":"2022-08-05T06:15:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-2952","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3158","timestamp":"2022-08-05T06:16:00.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3157","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3365","timestamp":"2022-08-05T06:16:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3363","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3582","timestamp":"2022-08-05T06:17:00.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3581","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3732","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.026Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3734","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3735","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.029Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3737","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3738","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.032Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3740","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3742","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.048Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3744","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3745","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.050Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3747","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3748","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.052Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3750","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3752","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.058Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3754","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3755","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.059Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3757","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":247,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3758","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.061Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3760","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":58266},"server":{"ip":"10.0.5.14","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":247,"msgId":15,"dn":"cn=config"},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3761","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2022-08-05T06:17:22.099Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3763","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.5.14","port":51080},"server":{"ip":"10.0.5.14","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":254,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3796","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2022-08-05T06:17:28.266Z","_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3798","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3806","timestamp":"2022-08-05T06:17:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-3804","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-4983","timestamp":"2022-08-05T06:18:00.397Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-4981","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-5107","timestamp":"2022-08-05T06:18:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-5105","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-5231","timestamp":"2022-08-05T06:19:00.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-5229","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-5354","timestamp":"2022-08-05T06:19:30.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-5353","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-5486","timestamp":"2022-08-05T06:20:00.396Z","eventName":"DJ-HTTP","transactionId":"be6f1abe-d28f-4349-a48d-7d1b9c88716e-5485","client":{"ip":"10.0.6.22","port":54232},"server":{"ip":"10.0.5.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.5.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} --- stderr --- - Looking for string "heart" - Looking for string "publish" ---------------- Pod ds-idrepo-1 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-idrepo-1 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.167d7aaf6f08d4399db54a86d3d62ae8e9552a3f Rebuilding degraded indexes for base DN "ou=tokens"... Rebuilding degraded indexes for base DN "ou=identities"... Rebuilding degraded indexes for base DN "ou=am-config"... Rebuilding degraded indexes for base DN "dc=openidm,dc=forgerock,dc=io"... Server configured with: Group ID : default Server ID : ds-idrepo-1 Advertised listen address : ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local Bootstrap replication server(s) : ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8989,ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.193Z","category":"CORE","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.3.0-20220729080644-167d7aaf6f08d4399db54a86d3d62ae8e9552a3f (build 20220729082219, revision number 167d7aaf6f08d4399db54a86d3d62ae8e9552a3f) starting up"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.193Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.193Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.193Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.4+8-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.193Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local default/ds-idrepo-1, running Linux 5.4.188+ amd64, unknown physical memory size, number of processors available 8"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.193Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.594Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.794Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend idmRepo containing 41 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:34.995Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend cfgStore containing 115 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.195Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amIdentityStore containing 21 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.395Z","category":"SYNC","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-idrepo-1) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.595Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 41 entries and skipped 0 in 0 seconds (average rate 2277.8/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.796Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.0.5.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.796Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.0.4.14:51078"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.796Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at 10.0.4.14:8989 with generation ID 542096"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.796Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"uid=monitor\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.0.5.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.796Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"uid=monitor\" at /10.0.4.14:51086"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.796Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"uid=monitor\" at 10.0.4.14:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.796Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 115 entries and skipped 0 in 0 seconds (average rate 8846.2/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.996Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"ou=am-config\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.0.5.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.996Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"ou=am-config\" at /10.0.4.14:51094"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.996Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"ou=am-config\" at 10.0.4.14:8989 with generation ID 2338230"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.996Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 21 entries and skipped 0 in 0 seconds (average rate 10500.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.996Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"ou=identities\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.0.5.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.996Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"ou=identities\" at /10.0.4.14:51102"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.996Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"ou=identities\" at 10.0.4.14:8989 with generation ID 253127"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:35.996Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 2500.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"ou=tokens\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.0.5.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"ou=tokens\" at /10.0.4.14:51110"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"ou=tokens\" at 10.0.4.14:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:09:36.196Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-53","timestamp":"2022-08-05T06:09:55.767Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-52","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":158,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.237Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from replication server RS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.0.3.14:39390"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.437Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-2) for domain \"ou=am-config\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.0.3.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.437Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-2) for domain \"ou=tokens\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.0.3.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.437Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-2) for domain \"uid=monitor\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.0.3.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.437Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-2) for domain \"ou=identities\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.0.3.14:8989"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-127","timestamp":"2022-08-05T06:10:25.726Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-126","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":66,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-202","timestamp":"2022-08-05T06:10:55.726Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-201","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-273","timestamp":"2022-08-05T06:11:25.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-272","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":44,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-344","timestamp":"2022-08-05T06:11:55.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-343","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":54,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-415","timestamp":"2022-08-05T06:12:25.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-414","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-486","timestamp":"2022-08-05T06:12:55.726Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-485","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-557","timestamp":"2022-08-05T06:13:25.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-556","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-628","timestamp":"2022-08-05T06:13:55.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-627","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":50,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-699","timestamp":"2022-08-05T06:14:25.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-698","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-770","timestamp":"2022-08-05T06:14:55.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-769","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-841","timestamp":"2022-08-05T06:15:25.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-840","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-912","timestamp":"2022-08-05T06:15:55.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-911","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-983","timestamp":"2022-08-05T06:16:25.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-982","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1054","timestamp":"2022-08-05T06:16:55.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1053","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1119","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.249Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1121","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1122","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.251Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1124","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1125","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.255Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1127","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1129","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.270Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1131","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1132","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.272Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1134","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1135","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.274Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1137","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1139","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.279Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1141","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1142","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.281Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1144","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":36,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1145","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.283Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1147","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":48348},"server":{"ip":"10.0.4.14","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":36,"msgId":15,"dn":"cn=config"},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1148","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2022-08-05T06:17:24.322Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1150","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1161","timestamp":"2022-08-05T06:17:25.726Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1160","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.4.14","port":44826},"server":{"ip":"10.0.4.14","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":38,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1173","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":2,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2022-08-05T06:17:30.075Z","_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1175","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1238","timestamp":"2022-08-05T06:17:55.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1237","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1309","timestamp":"2022-08-05T06:18:25.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1308","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1380","timestamp":"2022-08-05T06:18:55.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1379","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1451","timestamp":"2022-08-05T06:19:25.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1450","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1526","timestamp":"2022-08-05T06:19:55.725Z","eventName":"DJ-HTTP","transactionId":"8f7575f5-c13e-4fa0-89ad-3757807d577f-1525","client":{"ip":"10.0.6.22","port":40332},"server":{"ip":"10.0.4.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.4.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} --- stderr --- - Looking for string "heart" - Looking for string "publish" ---------------- Pod ds-idrepo-2 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-idrepo-2 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.167d7aaf6f08d4399db54a86d3d62ae8e9552a3f Rebuilding degraded indexes for base DN "ou=tokens"... Rebuilding degraded indexes for base DN "ou=identities"... Rebuilding degraded indexes for base DN "ou=am-config"... Rebuilding degraded indexes for base DN "dc=openidm,dc=forgerock,dc=io"... Server configured with: Group ID : default Server ID : ds-idrepo-2 Advertised listen address : ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local Bootstrap replication server(s) : ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8989,ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:15.673Z","category":"CORE","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.3.0-20220729080644-167d7aaf6f08d4399db54a86d3d62ae8e9552a3f (build 20220729082219, revision number 167d7aaf6f08d4399db54a86d3d62ae8e9552a3f) starting up"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:15.673Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:15.673Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:15.673Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.4+8-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:15.673Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local default/ds-idrepo-2, running Linux 5.4.188+ amd64, unknown physical memory size, number of processors available 8"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:15.673Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:16.074Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:16.274Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend idmRepo containing 41 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:16.675Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend cfgStore containing 115 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:16.675Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amIdentityStore containing 21 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:16.875Z","category":"SYNC","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-idrepo-2) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.075Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 41 entries and skipped 0 in 0 seconds (average rate 2277.8/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.276Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.0.5.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.276Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local/10.0.4.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.276Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.0.3.14:40032"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.276Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at 10.0.3.14:8989 with generation ID 542096"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.276Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-0) for domain \"ou=am-config\" at /10.0.5.14:37124"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-0) for domain \"ou=tokens\" at /10.0.5.14:37126"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-0) for domain \"uid=monitor\" at /10.0.5.14:37128"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-0) for domain \"ou=identities\" at /10.0.5.14:37130"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=am-config\" at /10.0.4.14:46196"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=tokens\" at /10.0.4.14:46198"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"uid=monitor\" at /10.0.4.14:46200"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=identities\" at /10.0.4.14:46202"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"uid=monitor\" at /10.0.3.14:40042"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.476Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"uid=monitor\" at 10.0.3.14:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.676Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 115 entries and skipped 0 in 0 seconds (average rate 9583.3/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.676Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"ou=am-config\" at /10.0.3.14:40050"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.676Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"ou=am-config\" at 10.0.3.14:8989 with generation ID 2338230"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.676Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 21 entries and skipped 0 in 0 seconds (average rate 5250.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.676Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"ou=identities\" at /10.0.3.14:40058"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.676Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"ou=identities\" at 10.0.3.14:8989 with generation ID 253127"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.676Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 5000.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"ou=tokens\" at /10.0.3.14:40066"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"ou=tokens\" at 10.0.3.14:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2022-08-05T06:10:17.876Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-81","timestamp":"2022-08-05T06:10:46.270Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-80","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":139,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-156","timestamp":"2022-08-05T06:11:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-155","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-227","timestamp":"2022-08-05T06:11:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-226","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":45,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-298","timestamp":"2022-08-05T06:12:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-297","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-369","timestamp":"2022-08-05T06:12:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-368","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":54,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-440","timestamp":"2022-08-05T06:13:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-439","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-511","timestamp":"2022-08-05T06:13:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-510","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-582","timestamp":"2022-08-05T06:14:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-581","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-653","timestamp":"2022-08-05T06:14:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-652","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-724","timestamp":"2022-08-05T06:15:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-723","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-795","timestamp":"2022-08-05T06:15:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-794","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-866","timestamp":"2022-08-05T06:16:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-865","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-937","timestamp":"2022-08-05T06:16:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-936","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1099","timestamp":"2022-08-05T06:17:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1098","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":55,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1124","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.428Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1126","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1127","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.431Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1129","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1130","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.435Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1132","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1134","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.453Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1136","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1137","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.455Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1139","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1140","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.458Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1142","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1144","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.464Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1146","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1147","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.466Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1149","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":40,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1150","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.468Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1152","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":48122},"server":{"ip":"10.0.3.14","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":40,"msgId":15,"dn":"cn=config"},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1153","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2022-08-05T06:17:26.509Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1156","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.0.3.14","port":53290},"server":{"ip":"10.0.3.14","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":41,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1170","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2022-08-05T06:17:31.810Z","_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1172","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1212","timestamp":"2022-08-05T06:17:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1211","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1283","timestamp":"2022-08-05T06:18:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1282","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1354","timestamp":"2022-08-05T06:18:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1353","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1425","timestamp":"2022-08-05T06:19:16.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1424","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"513427ef-4bca-44c9-8aaf-738d666e81eb-1496","timestamp":"2022-08-05T06:19:46.236Z","eventName":"DJ-HTTP","transactionId":"513427ef-4bca-44c9-8aaf-738d666e81eb-1495","client":{"ip":"10.0.6.22","port":46502},"server":{"ip":"10.0.3.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.0.3.14:8080"],"user-agent":["Prometheus/2.35.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} --- stderr --- - Looking for string "heart" - Looking for string "publish" ________________________________________________________________________________ [05/Aug/2022 06:20:07] CheckReplication_ds-idrepo step5 : Compare ds-sync-state for suffixes across all replicas ________________________________________________________________________________ [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b " " -s base "objectclass=*" namingContexts [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: namingContexts: uid=admin namingContexts: ou=tokens namingContexts: uid=monitor namingContexts: dc=openidm,dc=forgerock,dc=io namingContexts: ou=am-config namingContexts: ou=identities namingContexts: uid=proxy --- stderr --- => Using namingContexts: {'uid=proxy', 'ou=identities', 'ou=tokens'} [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "uid=proxy" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: uid=proxy --- stderr --- => Skipping suffix "uid=proxy" as "ds-sync-state" not found in stdout [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "ou=identities" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=identities ds-sync-state: 010b01826ca9191300001181ds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "ou=identities" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=identities ds-sync-state: 010b01826ca9191300001181ds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "ou=identities" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=identities ds-sync-state: 010b01826ca9191300001181ds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "ou=tokens" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 010b01826c9f0b7a00000016ds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "ou=tokens" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 010b01826c9f0b7a00000016ds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "ou=tokens" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 010b01826c9f0b7a00000016ds-idrepo-0 --- stderr --- => loop 1 out of 30 : repl_state = {'ou=identities': {'ds-idrepo-0': ['010b01826ca9191300001181ds-idrepo-0'], 'ds-idrepo-1': ['010b01826ca9191300001181ds-idrepo-0'], 'ds-idrepo-2': ['010b01826ca9191300001181ds-idrepo-0']}, 'ou=tokens': {'ds-idrepo-0': ['010b01826c9f0b7a00000016ds-idrepo-0'], 'ds-idrepo-1': ['010b01826c9f0b7a00000016ds-idrepo-0'], 'ds-idrepo-2': ['010b01826c9f0b7a00000016ds-idrepo-0']}} => ds-sync-state match for "ou=identities" => ds-sync-state match for "ou=tokens" => {'uid=proxy', 'ou=identities', 'ou=tokens'} expunged. set() remain SUCCESS: replication seems to be synchronised ________________________________________________________________________________ [05/Aug/2022 06:20:21] CheckReplication_ds-idrepo step6 : Check replication is in sync by adding once and searching all ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou cp /tmp/tmp_d4066c8 -c ds ds-idrepo-0:/tmp/entries.ldif [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapmodify --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -f /tmp/entries.ldif [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- # ADD operation successful for DN uid=pyrock_cccka,ou=identities --- stderr --- => Added test entry with dn "uid=pyrock_cccka,ou=identities" => loop 1 out of 5 to check "3" pods for presence of test entry "uid=pyrock_cccka,ou=identities" [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "uid=pyrock_cccka,ou=identities" -s base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_cccka,ou=identities --- stderr --- => Found test entry "uid=pyrock_cccka,ou=identities" on "ds-idrepo-0" [run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "uid=pyrock_cccka,ou=identities" -s base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_cccka,ou=identities --- stderr --- => Found test entry "uid=pyrock_cccka,ou=identities" on "ds-idrepo-1" [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" -b "uid=pyrock_cccka,ou=identities" -s base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_cccka,ou=identities --- stderr --- => Found test entry "uid=pyrock_cccka,ou=identities" on "ds-idrepo-2" [loop_until]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapdelete -p 4444 -Z -X -D "uid=admin" -w "pA4XCUIwcQaDi0qWjrA9JasO0tHkrU38" uid=pyrock_cccka,ou=identities [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- # DELETE operation successful for DN uid=pyrock_cccka,ou=identities --- stderr --- => Deleted test entry with dn "uid=pyrock_cccka,ou=identities" SUCCESS: replication seems to be synchronised ________________________________________________________________________________ [05/Aug/2022 06:20:42] CheckReplication_ds-idrepo post : N/A ________________________________________________________________________________ SUCCESS : replication seems to be synchronised Setting result to PASS Task has been successfully stopped