--Task-- name: CheckReplication_ds-idrepo enabled: True class_name: CheckReplicationTask source_name: ds-idrepo source_namespace: >default< target_name: ds-idrepo target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [05/Feb/2023 17:51:58] CheckReplication_ds-idrepo pre : N/A ________________________________________________________________________________ max_time: 7h 59m sleep_interval: 10 [05/Feb/2023 17:51:58] - INFO: Timeout for this Task has changed to 16h (57600 seconds) [05/Feb/2023 17:51:58] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset ________________________________________________________________________________ [05/Feb/2023 17:51:58] CheckReplication_ds-idrepo step1 : Check number of entries ________________________________________________________________________________ loop 1 : SUCCESS: Pods "ds-idrepo-0" and "ds-idrepo-1" are in sync (both have 1000022 entries) loop 1 : ERROR : Pod "ds-idrepo-0" has 1000022 entries but pod "ds-idrepo-2" has 1000021 entries (should have same number of entries) loop 1 : ERROR : Pod "ds-idrepo-1" has 1000022 entries but pod "ds-idrepo-2" has 1000021 entries (should have same number of entries) loop 1 : Sleep 10 and retry loop 2 : SUCCESS: Pods "ds-idrepo-0" and "ds-idrepo-1" are in sync (both have 1000021 entries) loop 2 : SUCCESS: Pods "ds-idrepo-0" and "ds-idrepo-2" are in sync (both have 1000021 entries) loop 2 : SUCCESS: Pods "ds-idrepo-1" and "ds-idrepo-2" are in sync (both have 1000021 entries) [check_number_of_entries] SUCCESS : replication is synchronised after 15s ________________________________________________________________________________ [05/Feb/2023 17:52:18] CheckReplication_ds-idrepo step2 : Monitor replication attributes in cn=monitor ________________________________________________________________________________ loop 1 : SUCCESS: ds-idrepo-0 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-idrepo-0 : ds-mon-updates-inbound-queue = 0 loop 1 : SUCCESS: ds-idrepo-1 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-idrepo-1 : ds-mon-updates-inbound-queue = 0 loop 1 : SUCCESS: ds-idrepo-2 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-idrepo-2 : ds-mon-updates-inbound-queue = 0 [check_monitoring_replication] final status : { "ds-idrepo-0": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 }, "ds-idrepo-1": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 }, "ds-idrepo-2": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 } } [check_monitoring_replication] SUCCESS : replication data in cn=monitor is synchronised after 0s ________________________________________________________________________________ [05/Feb/2023 17:52:24] CheckReplication_ds-idrepo step3 : Temporary step for PERF-1831 : Dump cn=monitor replication attributes ________________________________________________________________________________ ---------------- Pod ds-idrepo-0 ---------------- [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (172 lines): ----- output ----- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.52.8:8989 ds-mon-connected-to-server-id: ds-idrepo-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 555879 ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 2001002 ds-mon-server-id: ds-idrepo-0 ds-mon-server-state: 010b018622b533b8003d32fbds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171031.099Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [3, 1, 1, 0, 2, 0, 0, 1, 0, 0, 1, 0, 2, 0, 0, 2] dn: ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.52.8:8989 ds-mon-connected-to-server-id: ds-idrepo-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 2338230 ds-mon-domain-name: ou=am-config ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":13,"total":60.251,"mean_rate":0.005,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.001,"mean":4.636,"min":2.540,"max":11.534,"stddev":2.160,"p50":4.047,"p75":4.882,"p95":11.534,"p98":11.534,"p99":11.534,"p999":11.534,"p9999":11.534,"p99999":11.534} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 2 ds-mon-server-id: ds-idrepo-0 ds-mon-server-state: 010b0186228eec7d00000027ds-idrepo-0 ds-mon-server-state: 010b01862290505c000000abds-idrepo-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171031.407Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [3, 1, 1, 0, 2, 0, 0, 1, 0, 0, 1, 0, 2, 0, 0, 2] dn: cn=remote replicas,ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-2,cn=remote replicas,ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=am-config ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 [...] ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 2000005 ds-mon-server-id: ds-idrepo-0 ds-mon-server-state: 010b018622b4d69a003d327dds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171031.475Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [3, 1, 1, 0, 2, 0, 0, 1, 0, 0, 1, 0, 2, 0, 0, 2] dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.52.8:8989 ds-mon-connected-to-server-id: ds-idrepo-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 2 ds-mon-server-id: ds-idrepo-0 ds-mon-server-state: 010b0186228ee0c100000014ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171031.540Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [3, 1, 1, 0, 2, 0, 0, 1, 0, 0, 1, 0, 2, 0, 0, 2] dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.52.8:8989 ds-mon-connected-to-server-id: ds-idrepo-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171031.349Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [3, 1, 1, 0, 2, 0, 0, 1, 0, 0, 1, 0, 2, 0, 0, 2] --- stderr --- ---------------- Pod ds-idrepo-1 ---------------- [run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (230 lines): ----- output ----- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.54.136:8989 ds-mon-connected-to-server-id: ds-idrepo-1 ds-mon-current-receive-window: 2145482787 ds-mon-domain-generation-id: 555879 ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":2001002,"total":916843.511,"mean_rate":805.082,"m1_rate":0.472,"m5_rate":158.585,"m15_rate":553.523,"mean":0.458,"min":0.254,"max":164.626,"stddev":0.531,"p50":0.426,"p75":0.485,"p95":0.606,"p98":0.684,"p99":0.774,"p999":3.293,"p9999":16.581,"p99999":61.080} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-1 ds-mon-server-state: 010b018622b533b8003d32fbds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171102.774Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [251010, 250140, 249679, 249648, 250687, 250579, 250106, 249474, 249353, 251259, 250286, 249045, 250233, 249061, 250495, 249967] dn: cn=remote replicas,ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-0,cn=remote replicas,ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":2001002,"total":916843.511,"mean_rate":818.535,"m1_rate":0.478,"m5_rate":160.796,"m15_rate":556.322,"mean":0.458,"min":0.254,"max":164.626,"stddev":0.531,"p50":0.426,"p75":0.485,"p95":0.606,"p98":0.684,"p99":0.774,"p999":3.293,"p9999":16.581,"p99999":61.080} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.54.136:8989 ds-mon-connected-to-server-id: ds-idrepo-1 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 2338230 ds-mon-domain-name: ou=am-config ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":15,"total":79.997,"mean_rate":0.006,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.026,"mean":5.329,"min":1.991,"max":17.039,"stddev":3.971,"p50":4.260,"p75":4.817,"p95":17.039,"p98":17.039,"p99":17.039,"p999":17.039,"p9999":17.039,"p99999":17.039} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-1 ds-mon-server-state: 010b01862290505c000000abds-idrepo-2 ds-mon-server-state: 010b0186228eec7d00000027ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171103.175Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 [...] ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":2000005,"total":1857970.962,"mean_rate":804.804,"m1_rate":0.051,"m5_rate":157.980,"m15_rate":552.936,"mean":0.929,"min":0.262,"max":293.601,"stddev":3.062,"p50":0.786,"p75":1.065,"p95":1.786,"p98":2.474,"p99":3.408,"p999":26.083,"p9999":161.481,"p99999":236.978} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.54.136:8989 ds-mon-connected-to-server-id: ds-idrepo-1 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":2,"total":19.956,"mean_rate":0.001,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.025,"mean":9.998,"min":2.753,"max":17.302,"stddev":7.238,"p50":2.769,"p75":17.302,"p95":17.302,"p98":17.302,"p99":17.302,"p999":17.302,"p9999":17.302,"p99999":17.302} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-1 ds-mon-server-state: 010b0186228ee0c100000014ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171103.367Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [251010, 250140, 249679, 249648, 250687, 250579, 250106, 249474, 249353, 251259, 250286, 249045, 250233, 249061, 250495, 249967] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-0,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":2,"total":19.956,"mean_rate":0.001,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.025,"mean":9.998,"min":2.753,"max":17.302,"stddev":7.238,"p50":2.769,"p75":17.302,"p95":17.302,"p98":17.302,"p99":17.302,"p999":17.302,"p9999":17.302,"p99999":17.302} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.54.136:8989 ds-mon-connected-to-server-id: ds-idrepo-1 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-1 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171103.082Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [251010, 250140, 249679, 249648, 250687, 250579, 250106, 249474, 249353, 251259, 250286, 249045, 250233, 249061, 250495, 249967] --- stderr --- ---------------- Pod ds-idrepo-2 ---------------- [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- [print_head_tail]: Print head (80 lines) and tail (80 lines) of input string (220 lines): ----- output ----- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.52.136:8989 ds-mon-connected-to-server-id: ds-idrepo-2 ds-mon-current-receive-window: 2145482786 ds-mon-domain-generation-id: 555879 ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-entries-awaiting-updates-count: 1 ds-mon-lost-connections: 0 ds-mon-receive-delay: 93 ds-mon-replay-delay: 3603 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":2001003,"total":942680.341,"mean_rate":815.700,"m1_rate":0.474,"m5_rate":159.097,"m15_rate":554.123,"mean":0.471,"min":0.257,"max":132.645,"stddev":0.410,"p50":0.440,"p75":0.502,"p95":0.627,"p98":0.709,"p99":0.799,"p999":2.408,"p9999":19.137,"p99999":38.011} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-2 ds-mon-server-state: 010b018622b533b8003d32fbds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171136.776Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 1 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [251007, 250139, 249679, 249648, 250684, 250580, 250106, 249473, 249352, 251259, 250283, 249046, 250229, 249061, 250495, 249965] dn: cn=remote replicas,ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-0,cn=remote replicas,ds-mon-domain-name=dc=openidm\,dc=forgerock\,dc=io,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: dc=openidm,dc=forgerock,dc=io ds-mon-receive-delay: 93 ds-mon-replay-delay: 3603 ds-mon-replayed-updates: {"count":2001003,"total":942680.341,"mean_rate":817.977,"m1_rate":0.472,"m5_rate":158.144,"m15_rate":553.242,"mean":0.471,"min":0.257,"max":132.645,"stddev":0.410,"p50":0.440,"p75":0.502,"p95":0.627,"p98":0.709,"p99":0.799,"p999":2.408,"p9999":19.137,"p99999":38.011} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=ou=am-config,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.52.136:8989 ds-mon-connected-to-server-id: ds-idrepo-2 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 2338230 ds-mon-domain-name: ou=am-config ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":2,"total":19.788,"mean_rate":0.001,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.026,"mean":9.900,"min":4.096,"max":15.729,"stddev":5.796,"p50":4.112,"p75":15.729,"p95":15.729,"p98":15.729,"p99":15.729,"p999":15.729,"p9999":15.729,"p99999":15.729} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 13 ds-mon-server-id: ds-idrepo-2 ds-mon-server-state: 010b0186228eec7d00000027ds-idrepo-0 ds-mon-server-state: 010b01862290505c000000abds-idrepo-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171137.332Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 [...] ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":2000005,"total":1898070.131,"mean_rate":815.454,"m1_rate":0.051,"m5_rate":158.437,"m15_rate":553.474,"mean":0.949,"min":0.257,"max":301.990,"stddev":3.047,"p50":0.803,"p75":1.090,"p95":1.819,"p98":2.523,"p99":3.457,"p999":26.608,"p9999":147.849,"p99999":251.658} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.52.136:8989 ds-mon-connected-to-server-id: ds-idrepo-2 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":2,"total":5.408,"mean_rate":0.001,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.026,"mean":2.705,"min":1.876,"max":3.539,"stddev":0.825,"p50":1.884,"p75":3.539,"p95":3.539,"p98":3.539,"p99":3.539,"p999":3.539,"p9999":3.539,"p99999":3.539} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-2 ds-mon-server-state: 010b0186228ee0c100000014ds-idrepo-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171137.502Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [251007, 250139, 249679, 249648, 250684, 250580, 250106, 249473, 249352, 251259, 250283, 249046, 250229, 249061, 250495, 249965] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-idrepo-0,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":2,"total":5.408,"mean_rate":0.001,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.026,"mean":2.705,"min":1.876,"max":3.539,"stddev":0.825,"p50":1.884,"p75":3.539,"p95":3.539,"p98":3.539,"p99":3.539,"p999":3.539,"p9999":3.539,"p99999":3.539} ds-mon-server-id: ds-idrepo-0 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.56.52.136:8989 ds-mon-connected-to-server-id: ds-idrepo-2 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-idrepo-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230205171137.101Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [251007, 250139, 249679, 249648, 250684, 250580, 250106, 249473, 249352, 251259, 250283, 249046, 250229, 249061, 250495, 249965] --- stderr --- ________________________________________________________________________________ [05/Feb/2023 17:52:30] CheckReplication_ds-idrepo step4 : Temporary step for PERF-1831 : checks logs ________________________________________________________________________________ ---------------- Pod ds-idrepo-0 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-idrepo-0 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.35060cde0333c76dfba29a4e88896b885a0deba7 Rebuilding degraded indexes for base DN "ou=tokens"... Rebuilding degraded indexes for base DN "ou=identities"... Rebuilding degraded indexes for base DN "ou=am-config"... Rebuilding degraded indexes for base DN "dc=openidm,dc=forgerock,dc=io"... Server configured with: Group ID : default Server ID : ds-idrepo-0 Advertised listen address : ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local Bootstrap replication server(s) : ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8989,ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:29.426Z","category":"CORE","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.3.0-20230127121641-35060cde0333c76dfba29a4e88896b885a0deba7 (build 20230127141714, revision number 35060cde0333c76dfba29a4e88896b885a0deba7) starting up"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:29.426Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:29.426Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:29.426Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.6+10-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:29.426Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local default/ds-idrepo-0, running Linux 5.10.147+ amd64, unknown physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:29.426Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:30.027Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:30.228Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend idmRepo containing 42 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:30.628Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend cfgStore containing 115 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:30.628Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amIdentityStore containing 21 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.029Z","category":"SYNC","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-idrepo-0) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.029Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 42 entries and skipped 0 in 0 seconds (average rate 2000.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.229Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.56.52.8:42194"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.229Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at 10.56.52.8:8989 with generation ID 555879"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.229Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"uid=monitor\" at /10.56.52.8:42214"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.229Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"uid=monitor\" at 10.56.52.8:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.229Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 115 entries and skipped 0 in 0 seconds (average rate 6388.9/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=am-config\" at /10.56.52.8:42246"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=am-config\" at 10.56.52.8:8989 with generation ID 2338230"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 21 entries and skipped 0 in 0 seconds (average rate 10500.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=identities\" at /10.56.52.8:42262"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=identities\" at 10.56.52.8:8989 with generation ID 253127"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 2500.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from directory server DS(ds-idrepo-0) for domain \"ou=tokens\" at /10.56.52.8:42274"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-0) for domain \"ou=tokens\" at 10.56.52.8:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"CORE","severity":"NOTICE","msgId":818,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.429Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.629Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.629Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.629Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.629Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.629Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:10:31.629Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3","timestamp":"2023-02-05T17:10:32.902Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2","client":{"ip":"10.56.49.140","port":34552},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":28,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-25","timestamp":"2023-02-05T17:10:55.044Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-24","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":97,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:02.865Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.56.54.136:42768"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.065Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"uid=monitor\" at /10.56.54.136:42794"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.065Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=am-config\" at /10.56.54.136:42812"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.265Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=identities\" at /10.56.54.136:42836"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.265Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=tokens\" at /10.56.54.136:42868"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-29","timestamp":"2023-02-05T17:11:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-28","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":55,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-33","timestamp":"2023-02-05T17:11:32.241Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-32","client":{"ip":"10.56.51.13","port":46578},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-37","timestamp":"2023-02-05T17:11:32.271Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-36","client":{"ip":"10.56.51.13","port":46584},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-41","timestamp":"2023-02-05T17:11:32.285Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-40","client":{"ip":"10.56.51.13","port":46592},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-45","timestamp":"2023-02-05T17:11:32.299Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-44","client":{"ip":"10.56.51.13","port":46608},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-49","timestamp":"2023-02-05T17:11:32.498Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-48","client":{"ip":"10.56.48.142","port":57526},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-53","timestamp":"2023-02-05T17:11:32.530Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-52","client":{"ip":"10.56.48.142","port":57528},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-57","timestamp":"2023-02-05T17:11:32.546Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-56","client":{"ip":"10.56.48.142","port":57538},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-61","timestamp":"2023-02-05T17:11:32.560Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-60","client":{"ip":"10.56.48.142","port":57544},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-65","timestamp":"2023-02-05T17:11:33.957Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-64","client":{"ip":"10.56.49.141","port":37654},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-69","timestamp":"2023-02-05T17:11:33.991Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-68","client":{"ip":"10.56.49.141","port":37670},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-73","timestamp":"2023-02-05T17:11:34.006Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-72","client":{"ip":"10.56.49.141","port":37678},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-77","timestamp":"2023-02-05T17:11:34.023Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-76","client":{"ip":"10.56.49.141","port":37692},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-idrepo-0.ds-idrepo:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.896Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-0) has accepted a connection from replication server RS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.56.52.136:51660"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.097Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=am-config\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.56.52.136:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.097Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=tokens\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.56.52.136:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.097Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"uid=monitor\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.56.52.136:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.097Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-0) has connected to replication server RS(ds-idrepo-2) for domain \"ou=identities\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.56.52.136:8989"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-225","timestamp":"2023-02-05T17:11:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-224","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":66,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-379","timestamp":"2023-02-05T17:12:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-378","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:12:44.953Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-524","timestamp":"2023-02-05T17:12:55.044Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-522","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-668","timestamp":"2023-02-05T17:13:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-667","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-829","timestamp":"2023-02-05T17:13:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-828","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-992","timestamp":"2023-02-05T17:14:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-991","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1173","timestamp":"2023-02-05T17:14:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1172","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1350","timestamp":"2023-02-05T17:15:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1349","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:15:54.894Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-1' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1527","timestamp":"2023-02-05T17:15:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1526","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1703","timestamp":"2023-02-05T17:16:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1702","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1870","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:53.999Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1872","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1873","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.001Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1875","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1876","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.005Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1878","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1880","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.024Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1882","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1883","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.026Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1885","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1886","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.029Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1888","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1890","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.035Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1892","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1893","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.036Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1895","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":49,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1896","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.039Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1898","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":33484},"server":{"ip":"10.56.52.8","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":49,"msgId":15,"dn":"cn=config"},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1899","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2023-02-05T17:16:54.076Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1901","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1912","timestamp":"2023-02-05T17:16:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1911","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.8","port":32896},"server":{"ip":"10.56.52.8","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":51,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1928","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2023-02-05T17:16:59.954Z","_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1930","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2009","timestamp":"2023-02-05T17:17:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2008","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:17:44.966Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2100","timestamp":"2023-02-05T17:17:55.044Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2099","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2191","timestamp":"2023-02-05T17:18:25.052Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2190","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2282","timestamp":"2023-02-05T17:18:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2281","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2373","timestamp":"2023-02-05T17:19:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2372","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2496","timestamp":"2023-02-05T17:19:55.042Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2495","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":52,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2605","timestamp":"2023-02-05T17:20:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2604","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":53,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2717","timestamp":"2023-02-05T17:20:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2716","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":53,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:21:11.894Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-1' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2826","timestamp":"2023-02-05T17:21:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2825","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":55,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2936","timestamp":"2023-02-05T17:21:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-2935","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":54,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3045","timestamp":"2023-02-05T17:22:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3044","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":52,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3155","timestamp":"2023-02-05T17:22:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3154","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3264","timestamp":"2023-02-05T17:23:25.042Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3263","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":52,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3375","timestamp":"2023-02-05T17:23:55.044Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3374","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3484","timestamp":"2023-02-05T17:24:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3483","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3596","timestamp":"2023-02-05T17:24:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3595","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":53,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3705","timestamp":"2023-02-05T17:25:25.042Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3704","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":50,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3816","timestamp":"2023-02-05T17:25:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3815","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":45,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3925","timestamp":"2023-02-05T17:26:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-3924","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4037","timestamp":"2023-02-05T17:26:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4036","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4149","timestamp":"2023-02-05T17:27:25.044Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4148","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":51,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:27:44.980Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4258","timestamp":"2023-02-05T17:27:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4257","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":50,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4369","timestamp":"2023-02-05T17:28:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4368","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":50,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4478","timestamp":"2023-02-05T17:28:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4477","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4590","timestamp":"2023-02-05T17:29:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4589","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4699","timestamp":"2023-02-05T17:29:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4698","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":51,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4812","timestamp":"2023-02-05T17:30:25.042Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4811","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4921","timestamp":"2023-02-05T17:30:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-4920","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5032","timestamp":"2023-02-05T17:31:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5031","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":51,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5142","timestamp":"2023-02-05T17:31:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5141","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":51,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5251","timestamp":"2023-02-05T17:32:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5250","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:32:39.896Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-1' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5360","timestamp":"2023-02-05T17:32:55.042Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5359","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5469","timestamp":"2023-02-05T17:33:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5468","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5580","timestamp":"2023-02-05T17:33:55.042Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5579","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5689","timestamp":"2023-02-05T17:34:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5688","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5799","timestamp":"2023-02-05T17:34:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5798","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":45,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5910","timestamp":"2023-02-05T17:35:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-5909","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6022","timestamp":"2023-02-05T17:35:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6021","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6132","timestamp":"2023-02-05T17:36:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6131","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6241","timestamp":"2023-02-05T17:36:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6240","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6350","timestamp":"2023-02-05T17:37:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6349","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":50,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6460","timestamp":"2023-02-05T17:37:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6459","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":51,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6572","timestamp":"2023-02-05T17:38:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6571","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":51,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:38:36.063Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6682","timestamp":"2023-02-05T17:38:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6681","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6792","timestamp":"2023-02-05T17:39:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6791","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":45,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6904","timestamp":"2023-02-05T17:39:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-6903","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":49,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7017","timestamp":"2023-02-05T17:40:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7016","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7128","timestamp":"2023-02-05T17:40:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7127","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7241","timestamp":"2023-02-05T17:41:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7240","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7378","timestamp":"2023-02-05T17:41:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7377","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7516","timestamp":"2023-02-05T17:42:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7515","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:42:40.072Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-1' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7634","timestamp":"2023-02-05T17:42:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7633","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7752","timestamp":"2023-02-05T17:43:25.042Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7751","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7871","timestamp":"2023-02-05T17:43:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7870","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7989","timestamp":"2023-02-05T17:44:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-7988","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8107","timestamp":"2023-02-05T17:44:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8106","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8225","timestamp":"2023-02-05T17:45:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8224","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8343","timestamp":"2023-02-05T17:45:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8342","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8461","timestamp":"2023-02-05T17:46:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8460","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8579","timestamp":"2023-02-05T17:46:55.044Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8578","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8697","timestamp":"2023-02-05T17:47:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8696","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8815","timestamp":"2023-02-05T17:47:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8814","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8933","timestamp":"2023-02-05T17:48:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-8932","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:48:39.884Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9051","timestamp":"2023-02-05T17:48:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9050","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9169","timestamp":"2023-02-05T17:49:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9168","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9287","timestamp":"2023-02-05T17:49:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9286","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:50:16.940Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9405","timestamp":"2023-02-05T17:50:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9404","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9523","timestamp":"2023-02-05T17:50:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9522","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9641","timestamp":"2023-02-05T17:51:25.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9640","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9759","timestamp":"2023-02-05T17:51:55.043Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-9758","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1462571","timestamp":"2023-02-05T17:52:25.044Z","eventName":"DJ-HTTP","transactionId":"38bd34dd-7009-4dbf-b1c3-e53f037a6318-1456926","client":{"ip":"10.56.49.4","port":44672},"server":{"ip":"10.56.52.8","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.8:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":63,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} --- stderr --- - Looking for string "heart" - Looking for string "publish" ---------------- Pod ds-idrepo-1 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-idrepo-1 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.35060cde0333c76dfba29a4e88896b885a0deba7 Rebuilding degraded indexes for base DN "ou=tokens"... Rebuilding degraded indexes for base DN "ou=identities"... Rebuilding degraded indexes for base DN "ou=am-config"... Rebuilding degraded indexes for base DN "dc=openidm,dc=forgerock,dc=io"... Server configured with: Group ID : default Server ID : ds-idrepo-1 Advertised listen address : ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local Bootstrap replication server(s) : ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8989,ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:01.118Z","category":"CORE","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.3.0-20230127121641-35060cde0333c76dfba29a4e88896b885a0deba7 (build 20230127141714, revision number 35060cde0333c76dfba29a4e88896b885a0deba7) starting up"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:01.118Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:01.118Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:01.118Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.6+10-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:01.118Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local default/ds-idrepo-1, running Linux 5.10.147+ amd64, unknown physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:01.118Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:01.719Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:01.920Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend idmRepo containing 42 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:02.320Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend cfgStore containing 115 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:02.320Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amIdentityStore containing 21 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:02.721Z","category":"SYNC","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-idrepo-1) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:02.721Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 42 entries and skipped 0 in 0 seconds (average rate 1909.1/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:02.921Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.56.52.8:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:02.921Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.56.54.136:51418"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:02.921Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at 10.56.54.136:8989 with generation ID 555879"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.121Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"uid=monitor\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.56.52.8:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.121Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"uid=monitor\" at /10.56.54.136:51444"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.121Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"uid=monitor\" at 10.56.54.136:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.121Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 115 entries and skipped 0 in 0 seconds (average rate 6388.9/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.121Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"ou=am-config\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.56.52.8:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.121Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"ou=am-config\" at /10.56.54.136:51470"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.121Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"ou=am-config\" at 10.56.54.136:8989 with generation ID 2338230"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.121Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 21 entries and skipped 0 in 0 seconds (average rate 7000.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"ou=identities\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.56.52.8:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"ou=identities\" at /10.56.54.136:51484"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"ou=identities\" at 10.56.54.136:8989 with generation ID 253127"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 2500.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-0) for domain \"ou=tokens\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.56.52.8:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from directory server DS(ds-idrepo-1) for domain \"ou=tokens\" at /10.56.54.136:51498"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-1) for domain \"ou=tokens\" at 10.56.54.136:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"CORE","severity":"NOTICE","msgId":818,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.321Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.521Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.521Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.521Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.521Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:03.521Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3","timestamp":"2023-02-05T17:11:12.990Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":139,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.955Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-1) has accepted a connection from replication server RS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.56.52.136:39872"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.155Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-2) for domain \"ou=am-config\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.56.52.136:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.155Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-2) for domain \"ou=tokens\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.56.52.136:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.155Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-2) for domain \"uid=monitor\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.56.52.136:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.155Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-1) has connected to replication server RS(ds-idrepo-2) for domain \"ou=identities\" at ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local/10.56.52.136:8989"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-7","timestamp":"2023-02-05T17:11:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":59,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-45","timestamp":"2023-02-05T17:12:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-44","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":63,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:12:39.604Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-98","timestamp":"2023-02-05T17:12:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-97","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-148","timestamp":"2023-02-05T17:13:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-147","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-211","timestamp":"2023-02-05T17:13:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-210","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-276","timestamp":"2023-02-05T17:14:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-275","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-354","timestamp":"2023-02-05T17:14:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-353","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-434","timestamp":"2023-02-05T17:15:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-433","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-514","timestamp":"2023-02-05T17:15:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-513","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-594","timestamp":"2023-02-05T17:16:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-593","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-674","timestamp":"2023-02-05T17:16:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-673","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-708","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.115Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-710","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-711","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.117Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-713","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-714","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.123Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-716","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-718","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.150Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-720","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-721","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.152Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-723","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-724","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.155Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-726","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-728","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.164Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-730","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-731","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.166Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-733","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":38,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-734","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.169Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-736","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":51516},"server":{"ip":"10.56.54.136","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":38,"msgId":15,"dn":"cn=config"},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-737","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2023-02-05T17:16:56.209Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-740","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.54.136","port":50486},"server":{"ip":"10.56.54.136","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":39,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-756","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":2,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2023-02-05T17:17:01.639Z","_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-758","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-796","timestamp":"2023-02-05T17:17:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-795","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:17:39.605Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-876","timestamp":"2023-02-05T17:17:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-875","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-956","timestamp":"2023-02-05T17:18:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-955","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1036","timestamp":"2023-02-05T17:18:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1035","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1116","timestamp":"2023-02-05T17:19:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1115","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1196","timestamp":"2023-02-05T17:19:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1195","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1276","timestamp":"2023-02-05T17:20:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1275","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:20:28.713Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1356","timestamp":"2023-02-05T17:20:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1355","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1436","timestamp":"2023-02-05T17:21:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1435","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1516","timestamp":"2023-02-05T17:21:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1515","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":44,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:22:11.588Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-1' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1596","timestamp":"2023-02-05T17:22:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1595","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1676","timestamp":"2023-02-05T17:22:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1675","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1756","timestamp":"2023-02-05T17:23:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1755","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1836","timestamp":"2023-02-05T17:23:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1835","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1916","timestamp":"2023-02-05T17:24:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1915","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1996","timestamp":"2023-02-05T17:24:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-1995","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2076","timestamp":"2023-02-05T17:25:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2075","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:25:28.740Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2156","timestamp":"2023-02-05T17:25:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2155","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":54,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2236","timestamp":"2023-02-05T17:26:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2235","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2316","timestamp":"2023-02-05T17:26:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2315","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:27:11.640Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-1' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2396","timestamp":"2023-02-05T17:27:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2395","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2476","timestamp":"2023-02-05T17:27:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2475","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":45,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2556","timestamp":"2023-02-05T17:28:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2555","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2636","timestamp":"2023-02-05T17:28:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2635","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2716","timestamp":"2023-02-05T17:29:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2715","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2796","timestamp":"2023-02-05T17:29:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2795","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2876","timestamp":"2023-02-05T17:30:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2875","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":44,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2956","timestamp":"2023-02-05T17:30:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-2955","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3036","timestamp":"2023-02-05T17:31:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3035","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3116","timestamp":"2023-02-05T17:31:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3115","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3196","timestamp":"2023-02-05T17:32:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3195","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3276","timestamp":"2023-02-05T17:32:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3275","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3356","timestamp":"2023-02-05T17:33:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3355","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3436","timestamp":"2023-02-05T17:33:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3435","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":44,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3516","timestamp":"2023-02-05T17:34:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3515","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3596","timestamp":"2023-02-05T17:34:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3595","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3677","timestamp":"2023-02-05T17:35:12.959Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3676","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3757","timestamp":"2023-02-05T17:35:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3756","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":59,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:36:03.677Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3837","timestamp":"2023-02-05T17:36:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3836","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3917","timestamp":"2023-02-05T17:36:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3916","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":55,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3997","timestamp":"2023-02-05T17:37:12.956Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-3996","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4077","timestamp":"2023-02-05T17:37:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4076","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":45,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4157","timestamp":"2023-02-05T17:38:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4156","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4237","timestamp":"2023-02-05T17:38:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4236","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4317","timestamp":"2023-02-05T17:39:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4316","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4398","timestamp":"2023-02-05T17:39:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4397","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4478","timestamp":"2023-02-05T17:40:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4477","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4558","timestamp":"2023-02-05T17:40:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4557","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:41:03.582Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4638","timestamp":"2023-02-05T17:41:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4637","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4718","timestamp":"2023-02-05T17:41:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4717","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4798","timestamp":"2023-02-05T17:42:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4797","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4878","timestamp":"2023-02-05T17:42:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4877","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4958","timestamp":"2023-02-05T17:43:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-4957","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5038","timestamp":"2023-02-05T17:43:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5037","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5118","timestamp":"2023-02-05T17:44:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5117","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5198","timestamp":"2023-02-05T17:44:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5197","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5278","timestamp":"2023-02-05T17:45:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5277","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5358","timestamp":"2023-02-05T17:45:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5357","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:45:54.744Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5438","timestamp":"2023-02-05T17:46:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5437","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5518","timestamp":"2023-02-05T17:46:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5517","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5598","timestamp":"2023-02-05T17:47:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5597","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5678","timestamp":"2023-02-05T17:47:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5677","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5758","timestamp":"2023-02-05T17:48:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5757","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5838","timestamp":"2023-02-05T17:48:42.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5837","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5918","timestamp":"2023-02-05T17:49:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5917","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5998","timestamp":"2023-02-05T17:49:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-5997","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6078","timestamp":"2023-02-05T17:50:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6077","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6158","timestamp":"2023-02-05T17:50:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6157","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:50:54.711Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6238","timestamp":"2023-02-05T17:51:12.951Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6237","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6318","timestamp":"2023-02-05T17:51:42.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6317","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6402","timestamp":"2023-02-05T17:52:12.952Z","eventName":"DJ-HTTP","transactionId":"35ea0588-cfb4-4dd8-98b1-0010ae155f6c-6401","client":{"ip":"10.56.49.4","port":59994},"server":{"ip":"10.56.54.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.54.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} --- stderr --- - Looking for string "heart" - Looking for string "publish" ---------------- Pod ds-idrepo-2 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-idrepo-2 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.3.0.35060cde0333c76dfba29a4e88896b885a0deba7 Rebuilding degraded indexes for base DN "ou=tokens"... Rebuilding degraded indexes for base DN "ou=identities"... Rebuilding degraded indexes for base DN "ou=am-config"... Rebuilding degraded indexes for base DN "dc=openidm,dc=forgerock,dc=io"... Server configured with: Group ID : default Server ID : ds-idrepo-2 Advertised listen address : ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local Bootstrap replication server(s) : ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local:8989,ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:35.308Z","category":"CORE","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.3.0-20230127121641-35060cde0333c76dfba29a4e88896b885a0deba7 (build 20230127141714, revision number 35060cde0333c76dfba29a4e88896b885a0deba7) starting up"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:35.308Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:35.308Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:35.308Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.6+10-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:35.308Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local default/ds-idrepo-2, running Linux 5.10.147+ amd64, unknown physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:35.308Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:35.909Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.109Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend idmRepo containing 42 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.309Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend cfgStore containing 115 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.509Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amIdentityStore containing 21 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.710Z","category":"SYNC","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-idrepo-2) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.710Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 42 entries and skipped 0 in 0 seconds (average rate 2210.5/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.910Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-0) for domain \"dc=openidm,dc=forgerock,dc=io\" at ds-idrepo-0.ds-idrepo.xlou.svc.cluster.local/10.56.52.8:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.910Z","category":"SYNC","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-1) for domain \"dc=openidm,dc=forgerock,dc=io\" at ds-idrepo-1.ds-idrepo.xlou.svc.cluster.local/10.56.54.136:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.910Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at /10.56.52.136:49022"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:36.910Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"dc=openidm,dc=forgerock,dc=io\" at 10.56.52.136:8989 with generation ID 555879"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.110Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-0) for domain \"ou=am-config\" at /10.56.52.8:51148"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.110Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-0) for domain \"ou=tokens\" at /10.56.52.8:51150"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.110Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-0) for domain \"uid=monitor\" at /10.56.52.8:51152"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.110Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-0) for domain \"ou=identities\" at /10.56.52.8:51164"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.110Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=am-config\" at /10.56.54.136:53222"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.110Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=tokens\" at /10.56.54.136:53228"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.110Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"uid=monitor\" at /10.56.54.136:53236"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.110Z","category":"SYNC","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from replication server RS(ds-idrepo-1) for domain \"ou=identities\" at /10.56.54.136:53252"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"uid=monitor\" at /10.56.52.136:49048"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"uid=monitor\" at 10.56.52.136:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 115 entries and skipped 0 in 0 seconds (average rate 7666.7/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"ou=am-config\" at /10.56.52.136:49054"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"ou=am-config\" at 10.56.52.136:8989 with generation ID 2338230"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 21 entries and skipped 0 in 0 seconds (average rate 7000.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"ou=identities\" at /10.56.52.136:49074"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"ou=identities\" at 10.56.52.136:8989 with generation ID 253127"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.310Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 2500.0/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"SYNC","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-idrepo-2) has accepted a connection from directory server DS(ds-idrepo-2) for domain \"ou=tokens\" at /10.56.52.136:49106"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"SYNC","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-idrepo-2) has connected to replication server RS(ds-idrepo-2) for domain \"ou=tokens\" at 10.56.52.136:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"CORE","severity":"NOTICE","msgId":818,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"PROTOCOL","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:11:37.511Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-108","timestamp":"2023-02-05T17:11:57.061Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-102","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":117,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-298","timestamp":"2023-02-05T17:12:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-296","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":57,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:12:44.569Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-376","timestamp":"2023-02-05T17:12:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-375","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-461","timestamp":"2023-02-05T17:13:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-456","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":44,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-557","timestamp":"2023-02-05T17:13:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-556","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-665","timestamp":"2023-02-05T17:14:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-664","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-788","timestamp":"2023-02-05T17:14:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-787","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-912","timestamp":"2023-02-05T17:15:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-911","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1037","timestamp":"2023-02-05T17:15:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1036","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1162","timestamp":"2023-02-05T17:16:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1161","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1287","timestamp":"2023-02-05T17:16:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1286","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1296","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.239Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1298","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1299","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.241Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1301","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1302","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.245Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1304","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1306","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.264Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1308","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1309","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.266Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1311","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1312","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.269Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1314","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1316","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.276Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1318","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1319","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.277Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1321","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":105,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1322","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.279Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1324","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":39184},"server":{"ip":"10.56.52.136","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":105,"msgId":15,"dn":"cn=config"},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1325","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":35,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2023-02-05T17:16:58.319Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1327","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.56.52.136","port":50470},"server":{"ip":"10.56.52.136","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":107,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1345","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":2,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2023-02-05T17:17:03.320Z","_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1347","source":"audit","topic":"ldap-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1446","timestamp":"2023-02-05T17:17:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1445","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:17:44.575Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1561","timestamp":"2023-02-05T17:17:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1560","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1678","timestamp":"2023-02-05T17:18:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1677","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1793","timestamp":"2023-02-05T17:18:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1792","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1910","timestamp":"2023-02-05T17:19:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-1909","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2051","timestamp":"2023-02-05T17:19:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2049","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2165","timestamp":"2023-02-05T17:20:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2164","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":47,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:20:28.675Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2284","timestamp":"2023-02-05T17:20:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2283","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":44,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2402","timestamp":"2023-02-05T17:21:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2399","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":62,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2520","timestamp":"2023-02-05T17:21:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2519","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:22:11.748Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-1' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2643","timestamp":"2023-02-05T17:22:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2642","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":50,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2764","timestamp":"2023-02-05T17:22:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2763","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2887","timestamp":"2023-02-05T17:23:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-2886","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3012","timestamp":"2023-02-05T17:23:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3011","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3137","timestamp":"2023-02-05T17:24:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3136","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3261","timestamp":"2023-02-05T17:24:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3260","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":44,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3386","timestamp":"2023-02-05T17:25:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3385","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:25:28.708Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3511","timestamp":"2023-02-05T17:25:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3510","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3636","timestamp":"2023-02-05T17:26:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3635","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3761","timestamp":"2023-02-05T17:26:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3760","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:27:11.608Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-1' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3886","timestamp":"2023-02-05T17:27:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-3885","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":45,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4011","timestamp":"2023-02-05T17:27:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4010","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4135","timestamp":"2023-02-05T17:28:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4134","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":48,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4260","timestamp":"2023-02-05T17:28:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4259","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":39,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4385","timestamp":"2023-02-05T17:29:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4384","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4510","timestamp":"2023-02-05T17:29:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4509","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4635","timestamp":"2023-02-05T17:30:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4634","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4760","timestamp":"2023-02-05T17:30:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4759","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4885","timestamp":"2023-02-05T17:31:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-4884","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5011","timestamp":"2023-02-05T17:31:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5010","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5136","timestamp":"2023-02-05T17:32:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5135","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":44,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5261","timestamp":"2023-02-05T17:32:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5260","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":45,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5386","timestamp":"2023-02-05T17:33:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5385","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5512","timestamp":"2023-02-05T17:33:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5510","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":60,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5636","timestamp":"2023-02-05T17:34:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5635","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5761","timestamp":"2023-02-05T17:34:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5760","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":52,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5886","timestamp":"2023-02-05T17:35:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-5885","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6011","timestamp":"2023-02-05T17:35:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6010","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:36:03.571Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6136","timestamp":"2023-02-05T17:36:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6135","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":46,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6265","timestamp":"2023-02-05T17:36:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6260","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":76,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6387","timestamp":"2023-02-05T17:37:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6386","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6512","timestamp":"2023-02-05T17:37:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6511","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":40,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6637","timestamp":"2023-02-05T17:38:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6636","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":43,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6762","timestamp":"2023-02-05T17:38:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6761","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6887","timestamp":"2023-02-05T17:39:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-6886","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7012","timestamp":"2023-02-05T17:39:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7011","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":41,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7137","timestamp":"2023-02-05T17:40:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7136","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":36,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7262","timestamp":"2023-02-05T17:40:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7261","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":38,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:41:03.737Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-0' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7387","timestamp":"2023-02-05T17:41:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7386","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7512","timestamp":"2023-02-05T17:41:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7511","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7637","timestamp":"2023-02-05T17:42:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7636","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7762","timestamp":"2023-02-05T17:42:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7761","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7887","timestamp":"2023-02-05T17:43:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-7886","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8012","timestamp":"2023-02-05T17:43:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8011","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8137","timestamp":"2023-02-05T17:44:27.024Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8136","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8262","timestamp":"2023-02-05T17:44:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8261","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8387","timestamp":"2023-02-05T17:45:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8386","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8512","timestamp":"2023-02-05T17:45:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8511","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8637","timestamp":"2023-02-05T17:46:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8636","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:46:31.725Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8762","timestamp":"2023-02-05T17:46:57.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8761","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8887","timestamp":"2023-02-05T17:47:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-8886","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9012","timestamp":"2023-02-05T17:47:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9011","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9137","timestamp":"2023-02-05T17:48:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9136","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9262","timestamp":"2023-02-05T17:48:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9261","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9387","timestamp":"2023-02-05T17:49:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9386","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9512","timestamp":"2023-02-05T17:49:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9511","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9637","timestamp":"2023-02-05T17:50:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9636","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9762","timestamp":"2023-02-05T17:50:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9761","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9887","timestamp":"2023-02-05T17:51:27.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-9886","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":32,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-SERVER","timestamp":"2023-02-05T17:51:31.695Z","category":"SYNC","severity":"WARNING","msgId":383,"message":"The change number indexer cannot advance because replica 'ds-idrepo-2' has not sent any messages for a while. Verify whether the replica is still running or is connected to a replication server"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-10012","timestamp":"2023-02-05T17:51:57.025Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-10011","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":34,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-10149","timestamp":"2023-02-05T17:52:27.026Z","eventName":"DJ-HTTP","transactionId":"0f81e3c2-f9d7-4ede-8ccb-b2a3ef92e1af-10148","client":{"ip":"10.56.49.4","port":42052},"server":{"ip":"10.56.52.136","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-idrepo-2.ds-idrepo.xlou.svc.cluster.local:8080/metrics/prometheus","headers":{"accept":["application/openmetrics-text;version=1.0.0,application/openmetrics-text;version=0.0.1;q=0.75,text/plain;version=0.0.4;q=0.5,*/*;q=0.1"],"host":["10.56.52.136:8080"],"user-agent":["Prometheus/2.41.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":33,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} --- stderr --- - Looking for string "heart" - Looking for string "publish" ________________________________________________________________________________ [05/Feb/2023 17:52:31] CheckReplication_ds-idrepo step5 : Compare ds-sync-state for suffixes across all replicas ________________________________________________________________________________ [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b " " -s base "objectclass=*" namingContexts [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: namingContexts: uid=admin namingContexts: ou=tokens namingContexts: uid=monitor namingContexts: dc=openidm,dc=forgerock,dc=io namingContexts: ou=am-config namingContexts: ou=identities namingContexts: uid=proxy --- stderr --- => Using namingContexts: {'uid=proxy', 'ou=tokens', 'ou=identities'} [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "uid=proxy" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: uid=proxy --- stderr --- => Skipping suffix "uid=proxy" as "ds-sync-state" not found in stdout [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "ou=tokens" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 010b0186228ee0c100000014ds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "ou=tokens" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 010b0186228ee0c100000014ds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "ou=tokens" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 010b0186228ee0c100000014ds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "ou=identities" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=identities ds-sync-state: 010b018622b4d69a003d327dds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "ou=identities" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=identities ds-sync-state: 010b018622b4d69a003d327dds-idrepo-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "ou=identities" -s base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=identities ds-sync-state: 010b018622b4d69a003d327dds-idrepo-0 --- stderr --- => loop 1 out of 30 : repl_state = {'ou=tokens': {'ds-idrepo-0': ['010b0186228ee0c100000014ds-idrepo-0'], 'ds-idrepo-1': ['010b0186228ee0c100000014ds-idrepo-0'], 'ds-idrepo-2': ['010b0186228ee0c100000014ds-idrepo-0']}, 'ou=identities': {'ds-idrepo-0': ['010b018622b4d69a003d327dds-idrepo-0'], 'ds-idrepo-1': ['010b018622b4d69a003d327dds-idrepo-0'], 'ds-idrepo-2': ['010b018622b4d69a003d327dds-idrepo-0']}} => ds-sync-state match for "ou=tokens" => ds-sync-state match for "ou=identities" => {'uid=proxy', 'ou=tokens', 'ou=identities'} expunged. set() remain SUCCESS: replication seems to be synchronised ________________________________________________________________________________ [05/Feb/2023 17:52:47] CheckReplication_ds-idrepo step6 : Check replication is in sync by adding once and searching all ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou cp /tmp/tmp10j8om1m -c ds ds-idrepo-0:/tmp/entries.ldif [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapmodify --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -f /tmp/entries.ldif [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- # ADD operation successful for DN uid=pyrock_niqiq,ou=identities --- stderr --- => Added test entry with dn "uid=pyrock_niqiq,ou=identities" => loop 1 out of 5 to check "3" pods for presence of test entry "uid=pyrock_niqiq,ou=identities" [run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "uid=pyrock_niqiq,ou=identities" -s base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_niqiq,ou=identities --- stderr --- => Found test entry "uid=pyrock_niqiq,ou=identities" on "ds-idrepo-0" [run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "uid=pyrock_niqiq,ou=identities" -s base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_niqiq,ou=identities --- stderr --- => Found test entry "uid=pyrock_niqiq,ou=identities" on "ds-idrepo-1" [run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" -b "uid=pyrock_niqiq,ou=identities" -s base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_niqiq,ou=identities --- stderr --- => Found test entry "uid=pyrock_niqiq,ou=identities" on "ds-idrepo-2" [loop_until]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapdelete -p 4444 -Z -X -D "uid=admin" -w "HixGVBxGakblo1gvjzlTE8aQAXJDzanw" uid=pyrock_niqiq,ou=identities [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- # DELETE operation successful for DN uid=pyrock_niqiq,ou=identities --- stderr --- => Deleted test entry with dn "uid=pyrock_niqiq,ou=identities" SUCCESS: replication seems to be synchronised ________________________________________________________________________________ [05/Feb/2023 17:53:09] CheckReplication_ds-idrepo post : N/A ________________________________________________________________________________ SUCCESS : replication seems to be synchronised Setting result to PASS Task has been successfully stopped