--Task-- name: CheckReplication_ds-cts enabled: True class_name: CheckReplicationTask source_name: ds-cts source_namespace: >default< target_name: ds-cts target_namespace: >default< start: 0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow loop: False interval: None dependencies: [] wait_for: [] options: {} group_name: None Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock ________________________________________________________________________________ [12/Aug/2023 21:32:06] CheckReplication_ds-cts pre : N/A ________________________________________________________________________________ max_time: 1h 59m sleep_interval: 10 [12/Aug/2023 21:32:06] - INFO: Timeout for this Task has changed to 4h (14400 seconds) [12/Aug/2023 21:32:06] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset ________________________________________________________________________________ [12/Aug/2023 21:32:06] CheckReplication_ds-cts step1 : Check number of entries ________________________________________________________________________________ loop 1 : ERROR : Pod "ds-cts-0" has 10 entries but pod "ds-cts-1" has 13 entries (should have same number of entries) loop 1 : ERROR : Pod "ds-cts-0" has 10 entries but pod "ds-cts-2" has 14 entries (should have same number of entries) loop 1 : ERROR : Pod "ds-cts-1" has 13 entries but pod "ds-cts-2" has 14 entries (should have same number of entries) loop 1 : Sleep 10 and retry loop 2 : SUCCESS: Pods "ds-cts-0" and "ds-cts-1" are in sync (both have 16 entries) loop 2 : SUCCESS: Pods "ds-cts-0" and "ds-cts-2" are in sync (both have 16 entries) loop 2 : SUCCESS: Pods "ds-cts-1" and "ds-cts-2" are in sync (both have 16 entries) [check_number_of_entries] SUCCESS : replication is synchronised after 15s ________________________________________________________________________________ [12/Aug/2023 21:32:26] CheckReplication_ds-cts step2 : Monitor replication attributes in cn=monitor ________________________________________________________________________________ loop 1 : SUCCESS: ds-cts-0 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-cts-0 : ds-mon-updates-inbound-queue = 0 loop 1 : SUCCESS: ds-cts-1 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-cts-1 : ds-mon-updates-inbound-queue = 0 loop 1 : SUCCESS: ds-cts-2 : ds-mon-current-delay = 0 loop 1 : SUCCESS: ds-cts-2 : ds-mon-updates-inbound-queue = 0 [check_monitoring_replication] final status : { "ds-cts-0": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 }, "ds-cts-1": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 }, "ds-cts-2": { "status": true, "ds-mon-current-delay": 0, "ds-mon-updates-inbound-queue": 0 } } [check_monitoring_replication] SUCCESS : replication data in cn=monitor is synchronised after 0s ________________________________________________________________________________ [12/Aug/2023 21:32:30] CheckReplication_ds-cts step3 : Temporary step for PERF-1831 : Dump cn=monitor replication attributes ________________________________________________________________________________ ---------------- Pod ds-cts-0 ---------------- [run_command]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.42.14:8989 ds-mon-connected-to-server-id: ds-cts-0 ds-mon-current-receive-window: 2147483638 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":11,"total":52.493,"mean_rate":0.004,"m1_rate":0.100,"m5_rate":0.028,"m15_rate":0.011,"mean":4.770,"min":1.499,"max":9.634,"stddev":1.926,"p50":4.784,"p75":5.669,"p95":9.634,"p98":9.634,"p99":9.634,"p999":9.634,"p9999":9.634,"p99999":9.634} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 10 ds-mon-server-id: ds-cts-0 ds-mon-server-state: 01080189eba9f43e000015bdds-cts-2 ds-mon-server-state: 01080189eba9e8350000161cds-cts-0 ds-mon-server-state: 01080189eba9f5d5000015f1ds-cts-1 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230812204502.178Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-cts-1,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":7,"total":33.832,"mean_rate":0.008,"m1_rate":0.071,"m5_rate":0.030,"m15_rate":0.083,"mean":4.833,"min":1.499,"max":9.634,"stddev":2.375,"p50":4.522,"p75":5.702,"p95":9.634,"p98":9.634,"p99":9.634,"p999":9.634,"p9999":9.634,"p99999":9.634} ds-mon-server-id: ds-cts-1 dn: ds-mon-server-id=ds-cts-2,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":4,"total":18.661,"mean_rate":0.005,"m1_rate":0.036,"m5_rate":0.024,"m15_rate":0.087,"mean":4.659,"min":3.736,"max":5.276,"stddev":0.560,"p50":4.784,"p75":4.882,"p95":5.276,"p98":5.276,"p99":5.276,"p999":5.276,"p9999":5.276,"p99999":5.276} ds-mon-server-id: ds-cts-2 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.42.14:8989 ds-mon-connected-to-server-id: ds-cts-0 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-cts-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230812204502.088Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 2, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] --- stderr --- ---------------- Pod ds-cts-1 ---------------- [run_command]: kubectl --namespace=xlou exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.42.142:8989 ds-mon-connected-to-server-id: ds-cts-1 ds-mon-current-receive-window: 2147483640 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":14,"total":74.555,"mean_rate":0.005,"m1_rate":0.080,"m5_rate":0.023,"m15_rate":0.010,"mean":5.324,"min":2.408,"max":15.532,"stddev":3.780,"p50":4.112,"p75":4.850,"p95":15.532,"p98":15.532,"p99":15.532,"p999":15.532,"p9999":15.532,"p99999":15.532} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 7 ds-mon-server-id: ds-cts-1 ds-mon-server-state: 01080189eba9f5d5000015f1ds-cts-1 ds-mon-server-state: 01080189eba9f43e000015bdds-cts-2 ds-mon-server-state: 01080189eba9e8350000161cds-cts-0 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230812204526.237Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 0, 1, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 2, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-cts-0,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":10,"total":57.697,"mean_rate":0.006,"m1_rate":0.046,"m5_rate":0.015,"m15_rate":0.062,"mean":5.768,"min":2.408,"max":15.532,"stddev":4.390,"p50":4.112,"p75":4.948,"p95":15.532,"p98":15.532,"p99":15.532,"p999":15.532,"p9999":15.532,"p99999":15.532} ds-mon-server-id: ds-cts-0 dn: ds-mon-server-id=ds-cts-2,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":4,"total":16.858,"mean_rate":0.005,"m1_rate":0.036,"m5_rate":0.024,"m15_rate":0.087,"mean":4.215,"min":3.834,"max":4.751,"stddev":0.328,"p50":4.080,"p75":4.227,"p95":4.751,"p98":4.751,"p99":4.751,"p999":4.751,"p9999":4.751,"p99999":4.751} ds-mon-server-id: ds-cts-2 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.42.142:8989 ds-mon-connected-to-server-id: ds-cts-1 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-cts-1 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230812204526.138Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 0, 1, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 1, 0, 2, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0] --- stderr --- ---------------- Pod ds-cts-2 ---------------- [run_command]: kubectl --namespace=xlou exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "cn=replicas,cn=replication,cn=monitor" "objectclass=*" [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: replicas dn: ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.43.14:8989 ds-mon-connected-to-server-id: ds-cts-2 ds-mon-current-receive-window: 2147483637 ds-mon-domain-generation-id: 69125 ds-mon-domain-name: ou=tokens ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":17,"total":107.512,"mean_rate":0.006,"m1_rate":0.106,"m5_rate":0.032,"m15_rate":0.013,"mean":6.328,"min":2.064,"max":17.957,"stddev":4.430,"p50":5.276,"p75":7.799,"p95":17.957,"p98":17.957,"p99":17.957,"p999":17.957,"p9999":17.957,"p99999":17.957} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 4 ds-mon-server-id: ds-cts-2 ds-mon-server-state: 01080189eba9f43e000015bdds-cts-2 ds-mon-server-state: 01080189eba9e8350000161cds-cts-0 ds-mon-server-state: 01080189eba9f5d5000015f1ds-cts-1 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230812204549.980Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 2, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 2, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0] dn: cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectclass: top objectclass: ds-monitor objectclass: ds-monitor-branch cn: remote replicas dn: ds-mon-server-id=ds-cts-0,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":10,"total":73.018,"mean_rate":0.006,"m1_rate":0.046,"m5_rate":0.015,"m15_rate":0.062,"mean":7.307,"min":2.933,"max":17.957,"stddev":5.260,"p50":4.456,"p75":8.520,"p95":17.957,"p98":17.957,"p99":17.957,"p999":17.957,"p9999":17.957,"p99999":17.957} ds-mon-server-id: ds-cts-0 dn: ds-mon-server-id=ds-cts-1,cn=remote replicas,ds-mon-domain-name=ou=tokens,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-remote-replica ds-mon-domain-name: ou=tokens ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-updates: {"count":7,"total":34.494,"mean_rate":0.008,"m1_rate":0.065,"m5_rate":0.030,"m15_rate":0.083,"mean":4.929,"min":2.064,"max":9.110,"stddev":2.192,"p50":5.374,"p75":5.898,"p95":9.110,"p98":9.110,"p99":9.110,"p999":9.110,"p9999":9.110,"p99999":9.110} ds-mon-server-id: ds-cts-1 dn: ds-mon-domain-name=uid=monitor,cn=replicas,cn=replication,cn=monitor objectClass: top objectClass: ds-monitor objectClass: ds-monitor-replica ds-mon-connected-to-server-hostport: 10.106.43.14:8989 ds-mon-connected-to-server-id: ds-cts-2 ds-mon-current-receive-window: 2147483647 ds-mon-domain-generation-id: 48 ds-mon-domain-name: uid=monitor ds-mon-entries-awaiting-updates-count: 0 ds-mon-lost-connections: 0 ds-mon-receive-delay: 0 ds-mon-replay-delay: 0 ds-mon-replayed-internal-updates: 0 ds-mon-replayed-updates: {"count":0,"total":0.000,"mean_rate":0.000,"m1_rate":0.000,"m5_rate":0.000,"m15_rate":0.000,"mean":0.000,"min":0.000,"max":0.000,"stddev":0.000,"p50":0.000,"p75":0.000,"p95":0.000,"p98":0.000,"p99":0.000,"p999":0.000,"p9999":0.000,"p99999":0.000} ds-mon-replayed-updates-conflicts-resolved: 0 ds-mon-replayed-updates-conflicts-unresolved: 0 ds-mon-sent-updates: 0 ds-mon-server-id: ds-cts-2 ds-mon-ssl-encryption: true ds-mon-status: Normal ds-mon-status-last-changed: 20230812204549.862Z ds-mon-total-update-entry-count: 0 ds-mon-total-update-entry-left: 0 ds-mon-updates-already-in-progress: 0 ds-mon-updates-inbound-queue: 0 ds-mon-updates-outbound-queue: 0 ds-mon-updates-totals-per-replay-thread: [0, 0, 2, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 2, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 0, 0] --- stderr --- ________________________________________________________________________________ [12/Aug/2023 21:32:35] CheckReplication_ds-cts step4 : Temporary step for PERF-1831 : checks logs ________________________________________________________________________________ ---------------- Pod ds-cts-0 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-cts-0 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.4.0.e46808a022da759ebe0ee43bf6f422fe91a4e54b Rebuilding degraded indexes for base DN "ou=tokens"... Server configured with: Group ID : default Server ID : ds-cts-0 Advertised listen address : ds-cts-0.ds-cts.xlou.svc.cluster.local Bootstrap replication server(s) : ds-cts-0.ds-cts.xlou.svc.cluster.local:8989,ds-cts-1.ds-cts.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:00.375Z","category":"JVM","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.4.0-20230804090409-e46808a022da759ebe0ee43bf6f422fe91a4e54b (build 20230804100405, revision number e46808a022da759ebe0ee43bf6f422fe91a4e54b) starting up"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:00.375Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:00.375Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:00.375Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.8+7-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:00.375Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-cts-0.ds-cts.xlou.svc.cluster.local default/ds-cts-0, running Linux 5.10.162+ amd64, unknown physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:00.375Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:00.575Z","category":"CORE","severity":"WARNING","msgId":779,"message":"'External Access Log Publisher' is DEPRECATED for removal since 7.2.0. Its usage is highly discouraged."} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.377Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.777Z","category":"SYNC.PURGE","severity":"INFORMATION","msgId":394,"message":"The purge delay has been set to: 12 h"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.777Z","category":"SYNC.LIFECYCLE","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-cts-0) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.777Z","category":"SYNC.CONNECTIONS","severity":"WARNING","msgId":387,"message":"Directory server DS(ds-cts-0) was unable to connect to replication server at ds-cts-1.ds-cts.xlou.svc.cluster.local:8989 for domain 'uid=monitor': unknown host"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.978Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-cts-0) has accepted a connection from directory server DS(ds-cts-0) for domain \"uid=monitor\" at /10.106.42.14:40192"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.978Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-cts-0) has connected to replication server RS(ds-cts-0) for domain \"uid=monitor\" at 10.106.42.14:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.978Z","category":"SYNC.STATE","severity":"NOTICE","msgId":388,"message":"Directory server DS(ds-cts-0) did not find a generation ID for domain 'ou=tokens'. A new generation ID will be computed by exporting the first 5 entries in the domain."} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.978Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 333.3/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:01.978Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-cts-0) has accepted a connection from directory server DS(ds-cts-0) for domain \"ou=tokens\" at /10.106.42.14:40206"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-cts-0) has connected to replication server RS(ds-cts-0) for domain \"ou=tokens\" at 10.106.42.14:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"CORE","severity":"NOTICE","msgId":818,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:02.178Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.012Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-cts-0) has accepted a connection from replication server RS(ds-cts-1) for domain \"uid=monitor\" at /10.106.42.142:46664"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.012Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-cts-0) has accepted a connection from replication server RS(ds-cts-1) for domain \"ou=tokens\" at /10.106.42.142:46680"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.641Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-cts-0) has accepted a connection from replication server RS(ds-cts-2) for domain \"uid=monitor\" at /10.106.43.14:35410"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.641Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-0) has connected to replication server RS(ds-cts-2) for domain \"ou=tokens\" at ds-cts-2.ds-cts.xlou.svc.cluster.local/10.106.43.14:8989"} {"_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-3","timestamp":"2023-08-12T21:02:45.492Z","eventName":"DJ-HTTP","transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-2","client":{"ip":"10.106.46.150","port":56708},"server":{"ip":"10.106.42.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.74.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":25,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-13","timestamp":"2023-08-12T21:17:27.658Z","eventName":"DJ-HTTP","transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-12","client":{"ip":"10.106.43.142","port":53878},"server":{"ip":"10.106.42.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.81.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-17","timestamp":"2023-08-12T21:17:27.971Z","eventName":"DJ-HTTP","transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-16","client":{"ip":"10.106.46.151","port":49952},"server":{"ip":"10.106.42.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.81.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-21","timestamp":"2023-08-12T21:17:28.137Z","eventName":"DJ-HTTP","transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-20","client":{"ip":"10.106.44.13","port":58142},"server":{"ip":"10.106.42.14","port":8080},"http":{"request":{"secure":false,"method":"GET","path":"http://ds-cts-0.ds-cts.xlou.svc.cluster.local:8080/alive","headers":{"accept":["*/*"],"host":["ds-cts-0.ds-cts:8080"],"user-agent":["curl/7.81.0"]}}},"response":{"status":"SUCCESSFUL","statusCode":"200","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS"},"source":"audit","topic":"http-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-531","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.798Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-533","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-534","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.801Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-536","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-537","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.805Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-539","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-541","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.826Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-543","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-544","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.827Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-546","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-547","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.830Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-549","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-551","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.836Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-553","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-554","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.838Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-556","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":10,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-557","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.840Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-559","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":46764},"server":{"ip":"10.106.42.14","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":10,"msgId":15,"dn":"cn=config"},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-560","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2023-08-12T21:27:31.886Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-562","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.14","port":53540},"server":{"ip":"10.106.42.14","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":11,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-570","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2023-08-12T21:27:37.608Z","_id":"ae8f8239-56a5-4dc4-b72d-3434a79756ad-572","source":"audit","topic":"ldap-access","level":"INFO"} --- stderr --- Defaulted container "ds" out of: ds, initialize (init) - Looking for string "heart" - Looking for string "publish" ---------------- Pod ds-cts-1 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-cts-1 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.4.0.e46808a022da759ebe0ee43bf6f422fe91a4e54b Rebuilding degraded indexes for base DN "ou=tokens"... Server configured with: Group ID : default Server ID : ds-cts-1 Advertised listen address : ds-cts-1.ds-cts.xlou.svc.cluster.local Bootstrap replication server(s) : ds-cts-0.ds-cts.xlou.svc.cluster.local:8989,ds-cts-1.ds-cts.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:24.908Z","category":"JVM","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.4.0-20230804090409-e46808a022da759ebe0ee43bf6f422fe91a4e54b (build 20230804100405, revision number e46808a022da759ebe0ee43bf6f422fe91a4e54b) starting up"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:24.908Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:24.908Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:24.908Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.8+7-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:24.908Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-cts-1.ds-cts.xlou.svc.cluster.local default/ds-cts-1, running Linux 5.10.162+ amd64, unknown physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:24.908Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:24.908Z","category":"CORE","severity":"WARNING","msgId":779,"message":"'External Access Log Publisher' is DEPRECATED for removal since 7.2.0. Its usage is highly discouraged."} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:25.509Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:25.709Z","category":"SYNC.PURGE","severity":"INFORMATION","msgId":394,"message":"The purge delay has been set to: 12 h"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:25.709Z","category":"SYNC.LIFECYCLE","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-cts-1) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:25.909Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-1) has connected to replication server RS(ds-cts-0) for domain \"uid=monitor\" at ds-cts-0.ds-cts.xlou.svc.cluster.local/10.106.42.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-cts-1) has accepted a connection from directory server DS(ds-cts-1) for domain \"uid=monitor\" at /10.106.42.142:42106"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-cts-1) has connected to replication server RS(ds-cts-1) for domain \"uid=monitor\" at 10.106.42.142:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"SYNC.STATE","severity":"NOTICE","msgId":388,"message":"Directory server DS(ds-cts-1) did not find a generation ID for domain 'ou=tokens'. A new generation ID will be computed by exporting the first 5 entries in the domain."} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 416.7/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-1) has connected to replication server RS(ds-cts-0) for domain \"ou=tokens\" at ds-cts-0.ds-cts.xlou.svc.cluster.local/10.106.42.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-cts-1) has accepted a connection from directory server DS(ds-cts-1) for domain \"ou=tokens\" at /10.106.42.142:42126"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-cts-1) has connected to replication server RS(ds-cts-1) for domain \"ou=tokens\" at 10.106.42.142:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"CORE","severity":"NOTICE","msgId":818,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:26.110Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.732Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-cts-1) has accepted a connection from replication server RS(ds-cts-2) for domain \"uid=monitor\" at /10.106.43.14:46650"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.732Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-cts-1) has accepted a connection from replication server RS(ds-cts-2) for domain \"ou=tokens\" at /10.106.43.14:46660"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-606","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.795Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-608","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-609","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.802Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-611","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-612","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.807Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-614","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-616","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.828Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-618","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-619","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.829Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-621","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-622","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.832Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-624","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-626","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.840Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-628","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-629","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":0,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.841Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-631","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":7,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-632","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.844Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-634","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":39268},"server":{"ip":"10.106.42.142","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":7,"msgId":15,"dn":"cn=config"},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-635","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":37,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2023-08-12T21:27:33.885Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-639","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.42.142","port":54814},"server":{"ip":"10.106.42.142","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":8,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-646","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2023-08-12T21:27:39.210Z","_id":"1a68a91d-308b-4ecf-8ff4-7f06523b0565-648","source":"audit","topic":"ldap-access","level":"INFO"} --- stderr --- Defaulted container "ds" out of: ds, initialize (init) - Looking for string "heart" - Looking for string "publish" ---------------- Pod ds-cts-2 ---------------- [loop_until]: kubectl --namespace=xlou logs ds-cts-2 [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- Initializing "data/changelogDb" from Docker image Initializing "data/import-tmp" from Docker image Upgrading configuration and data... * OpenDJ data has already been upgraded to version 7.4.0.e46808a022da759ebe0ee43bf6f422fe91a4e54b Rebuilding degraded indexes for base DN "ou=tokens"... Server configured with: Group ID : default Server ID : ds-cts-2 Advertised listen address : ds-cts-2.ds-cts.xlou.svc.cluster.local Bootstrap replication server(s) : ds-cts-0.ds-cts.xlou.svc.cluster.local:8989,ds-cts-1.ds-cts.xlou.svc.cluster.local:8989 {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:48.274Z","category":"JVM","severity":"NOTICE","msgId":134,"message":"ForgeRock Directory Services 7.4.0-20230804090409-e46808a022da759ebe0ee43bf6f422fe91a4e54b (build 20230804100405, revision number e46808a022da759ebe0ee43bf6f422fe91a4e54b) starting up"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:48.274Z","category":"JVM","severity":"NOTICE","msgId":21,"message":"Installation Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:48.274Z","category":"JVM","severity":"NOTICE","msgId":23,"message":"Instance Directory: /opt/opendj"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:48.274Z","category":"JVM","severity":"NOTICE","msgId":17,"message":"JVM Information: 17.0.8+7-LTS by Azul Systems, Inc., 64-bit architecture, 11274289152 bytes heap size"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:48.274Z","category":"JVM","severity":"NOTICE","msgId":20,"message":"JVM Host: ds-cts-2.ds-cts.xlou.svc.cluster.local default/ds-cts-2, running Linux 5.10.162+ amd64, unknown physical memory size, number of processors available 16"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:48.274Z","category":"JVM","severity":"NOTICE","msgId":19,"message":"JVM Arguments: \"-XX:+UseG1GC\", \"-XX:MaxRAMPercentage=75\", \"-XX:MaxTenuringThreshold=1\", \"-Djava.security.egd=file:/dev/urandom\", \"-Dorg.opends.server.scriptName=start-ds\""} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:48.475Z","category":"CORE","severity":"WARNING","msgId":779,"message":"'External Access Log Publisher' is DEPRECATED for removal since 7.2.0. Its usage is highly discouraged."} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.076Z","category":"BACKEND","severity":"NOTICE","msgId":513,"message":"The database backend amCts containing 5 entries has started"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.276Z","category":"SYNC.PURGE","severity":"INFORMATION","msgId":394,"message":"The purge delay has been set to: 12 h"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.276Z","category":"SYNC.LIFECYCLE","severity":"NOTICE","msgId":204,"message":"Replication server RS(ds-cts-2) started listening for new connections on address 0.0.0.0 port 8989"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.677Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-2) has connected to replication server RS(ds-cts-1) for domain \"uid=monitor\" at ds-cts-1.ds-cts.xlou.svc.cluster.local/10.106.42.142:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.677Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-2) has connected to replication server RS(ds-cts-0) for domain \"uid=monitor\" at ds-cts-0.ds-cts.xlou.svc.cluster.local/10.106.42.14:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.677Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":206,"message":"Replication server RS(ds-cts-2) has accepted a connection from replication server RS(ds-cts-0) for domain \"ou=tokens\" at /10.106.42.14:40300"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.677Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":205,"message":"Replication server RS(ds-cts-2) has connected to replication server RS(ds-cts-1) for domain \"ou=tokens\" at ds-cts-1.ds-cts.xlou.svc.cluster.local/10.106.42.142:8989"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.677Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-cts-2) has accepted a connection from directory server DS(ds-cts-2) for domain \"uid=monitor\" at /10.106.43.14:37148"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.677Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-cts-2) has connected to replication server RS(ds-cts-2) for domain \"uid=monitor\" at 10.106.43.14:8989 with generation ID 48"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"SYNC.STATE","severity":"NOTICE","msgId":388,"message":"Directory server DS(ds-cts-2) did not find a generation ID for domain 'ou=tokens'. A new generation ID will be computed by exporting the first 5 entries in the domain."} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"BACKEND","severity":"NOTICE","msgId":515,"message":"Exported 5 entries and skipped 0 in 0 seconds (average rate 357.1/sec)"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"SYNC.CONNECTIONS","severity":"INFORMATION","msgId":207,"message":"Replication server RS(ds-cts-2) has accepted a connection from directory server DS(ds-cts-2) for domain \"ou=tokens\" at /10.106.43.14:37168"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"SYNC.CONNECTIONS","severity":"NOTICE","msgId":62,"message":"Directory server DS(ds-cts-2) has connected to replication server RS(ds-cts-2) for domain \"ou=tokens\" at 10.106.43.14:8989 with generation ID 69125"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"CORE","severity":"NOTICE","msgId":818,"message":"Registered 0 static groups, 0 dynamic groups and 0 virtual static groups. The static group cache is using 0 bytes of memory"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on Administration Connector 0.0.0.0:4444"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAP 0.0.0.0:1389"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTP 0.0.0.0:8080"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"PROTOCOL.HTTP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on HTTPS 0.0.0.0:8443"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"PROTOCOL.LDAP","severity":"NOTICE","msgId":276,"message":"Started listening for new connections on LDAPS 0.0.0.0:1636"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"CORE","severity":"NOTICE","msgId":135,"message":"The Directory Server has started successfully"} {"eventName":"DJ-SERVER","timestamp":"2023-08-12T20:45:49.877Z","category":"CORE","severity":"NOTICE","msgId":139,"message":"The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":4,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-456","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:35.950Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-458","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":5,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-459","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:35.958Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-461","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":6,"dn":"cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-time-limit","ds-cfg-default-password-policy","ds-cfg-etime-resolution","ds-cfg-allowed-task","ds-cfg-invalid-attribute-syntax-behavior","ds-cfg-max-psearches","ds-cfg-group-id","ds-cfg-check-schema","ds-cfg-add-missing-rdn-attributes","ds-cfg-max-candidate-set-size","ds-cfg-max-internal-buffer-size","ds-cfg-restricted-client","ds-cfg-single-structural-objectclass-behavior","ds-cfg-size-limit","ds-cfg-trust-transaction-ids","ds-cfg-proxy-protocol-enabled","ds-cfg-subordinate-base-dn","ds-cfg-denied-client","ds-cfg-bind-with-dn-requires-password","ds-cfg-advertised-listen-address","ds-cfg-allowed-client","ds-cfg-server-id","ds-cfg-max-allowed-client-connections","ds-cfg-listen-address","ds-cfg-writability-mode","ds-cfg-save-config-on-successful-startup","ds-cfg-proxy-protocol-allowed-client","ds-cfg-disabled-privilege","ds-cfg-return-bind-error-messages","ds-cfg-je-backend-shared-cache-enabled","ds-cfg-unauthenticated-requests-policy","ds-cfg-idle-time-limit","ds-cfg-proxied-authorization-identity-mapper","ds-cfg-restricted-client-connection-limit","ds-cfg-group-id-failover-order","ds-cfg-notify-abandoned-operations","ds-cfg-allow-attribute-name-exceptions"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-462","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:35.964Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-464","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":8,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-466","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:35.988Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-468","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":9,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-469","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:35.990Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-471","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":10,"dn":"cn=Default Password Policy,cn=Password Policies,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-min-password-age","ds-cfg-require-change-by-time","ds-cfg-password-validator","ds-cfg-password-generator","ds-cfg-password-history-count","ds-cfg-default-password-storage-scheme","ds-cfg-allow-expired-password-changes","ds-cfg-lockout-duration","ds-cfg-allow-pre-encoded-passwords","ds-cfg-password-change-requires-current-password","ds-cfg-allow-multiple-password-values","ds-cfg-max-password-reset-age","ds-cfg-skip-validation-for-administrators","ds-cfg-last-login-time-attribute","ds-cfg-require-secure-password-changes","ds-cfg-require-secure-authentication","ds-cfg-state-update-failure-policy","ds-cfg-grace-login-count","ds-cfg-lockout-failure-expiration-interval","ds-cfg-password-expiration-warning-interval","ds-cfg-allow-user-password-changes","ds-cfg-force-change-on-reset","ds-cfg-lockout-failure-count","ds-cfg-password-history-duration","ds-cfg-expire-passwords-without-warning","ds-cfg-max-password-age","ds-cfg-last-login-time-format","ds-cfg-previous-last-login-time-format","ds-cfg-deprecated-password-storage-scheme","ds-cfg-account-status-notification-handler","ds-cfg-idle-lockout-interval","ds-cfg-password-attribute","ds-cfg-force-change-on-add"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-472","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:35.994Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-474","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":12,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["1.1"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-476","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:36.003Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-478","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":13,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["objectclass"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-479","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:36.006Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-481","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"SEARCH","connId":8,"msgId":14,"dn":"cn=Exact Match,cn=Identity Mappers,cn=config","scope":"base","filter":"(objectClass=*)","attrs":["ds-cfg-java-class","ds-cfg-match-base-dn","ds-cfg-match-attribute","ds-cfg-enabled"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-482","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":1,"elapsedTimeUnits":"MILLISECONDS","nentries":1},"userId":"uid=admin","timestamp":"2023-08-12T21:27:36.009Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-484","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":42782},"server":{"ip":"10.106.43.14","port":4444},"request":{"protocol":"LDAPS","operation":"MODIFY","connId":8,"msgId":15,"dn":"cn=config"},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-485","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":42,"elapsedTimeUnits":"MILLISECONDS"},"userId":"uid=admin","timestamp":"2023-08-12T21:27:36.056Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-487","source":"audit","topic":"ldap-access","level":"INFO"} {"eventName":"DJ-LDAP","client":{"ip":"10.106.43.14","port":52794},"server":{"ip":"10.106.43.14","port":1389},"request":{"protocol":"LDAP","operation":"SEARCH","connId":9,"msgId":3,"dn":"cn=Filtering Criteria,cn=Console LDAP Access Logger,cn=Loggers,cn=config","scope":"sub","filter":"(objectClass=*)","attrs":["ALL"]},"transactionId":"f9237c1f-70c5-4ea5-bff4-294490bf8784-491","response":{"status":"SUCCESSFUL","statusCode":"0","elapsedTime":2,"elapsedTimeUnits":"MILLISECONDS","nentries":7},"userId":"uid=admin","timestamp":"2023-08-12T21:27:40.895Z","_id":"f9237c1f-70c5-4ea5-bff4-294490bf8784-493","source":"audit","topic":"ldap-access","level":"INFO"} --- stderr --- Defaulted container "ds" out of: ds, initialize (init) - Looking for string "heart" - Looking for string "publish" ________________________________________________________________________________ [12/Aug/2023 21:32:36] CheckReplication_ds-cts step5 : Compare ds-sync-state for suffixes across all replicas ________________________________________________________________________________ [run_command]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn " " --searchScope base "objectclass=*" namingContexts [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: namingContexts: uid=admin namingContexts: ou=tokens namingContexts: uid=monitor namingContexts: uid=proxy --- stderr --- => Using namingContexts: {'ou=tokens', 'uid=proxy'} [run_command]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "ou=tokens" --searchScope base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 01080189eba9f43e000015bdds-cts-2 ds-sync-state: 01080189eba9e8350000161cds-cts-0 ds-sync-state: 01080189eba9f5d5000015f1ds-cts-1 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "ou=tokens" --searchScope base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 01080189eba9f5d5000015f1ds-cts-1 ds-sync-state: 01080189eba9f43e000015bdds-cts-2 ds-sync-state: 01080189eba9e8350000161cds-cts-0 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "ou=tokens" --searchScope base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: ou=tokens ds-sync-state: 01080189eba9f43e000015bdds-cts-2 ds-sync-state: 01080189eba9e8350000161cds-cts-0 ds-sync-state: 01080189eba9f5d5000015f1ds-cts-1 --- stderr --- [run_command]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "uid=proxy" --searchScope base "objectclass=*" ds-sync-state [run_command]: OK (rc = 0 - expected to be in [0]) --- stdout --- dn: uid=proxy --- stderr --- => Skipping suffix "uid=proxy" as "ds-sync-state" not found in stdout => loop 1 out of 30 : repl_state = {'ou=tokens': {'ds-cts-0': ['01080189eba9f43e000015bdds-cts-2', '01080189eba9e8350000161cds-cts-0', '01080189eba9f5d5000015f1ds-cts-1'], 'ds-cts-1': ['01080189eba9f5d5000015f1ds-cts-1', '01080189eba9f43e000015bdds-cts-2', '01080189eba9e8350000161cds-cts-0'], 'ds-cts-2': ['01080189eba9f43e000015bdds-cts-2', '01080189eba9e8350000161cds-cts-0', '01080189eba9f5d5000015f1ds-cts-1']}} => ds-sync-state match for "ou=tokens" => {'ou=tokens', 'uid=proxy'} expunged. set() remain SUCCESS: replication seems to be synchronised ________________________________________________________________________________ [12/Aug/2023 21:32:44] CheckReplication_ds-cts step6 : Check replication is in sync by adding once and searching all ________________________________________________________________________________ [loop_until]: kubectl --namespace=xlou cp /tmp/tmpnaot50ds --container ds ds-cts-0:/tmp/entries.ldif [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- --- stderr --- [loop_until]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- ldapmodify --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" /tmp/entries.ldif [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- # ADD operation successful for DN uid=pyrock_fxwpb,ou=tokens --- stderr --- => Added test entry with dn "uid=pyrock_fxwpb,ou=tokens" => loop 1 out of 5 to check "3" pods for presence of test entry "uid=pyrock_fxwpb,ou=tokens" [run_command]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "uid=pyrock_fxwpb,ou=tokens" --searchScope base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_fxwpb,ou=tokens --- stderr --- => Found test entry "uid=pyrock_fxwpb,ou=tokens" on "ds-cts-0" [run_command]: kubectl --namespace=xlou exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "uid=pyrock_fxwpb,ou=tokens" --searchScope base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_fxwpb,ou=tokens --- stderr --- => Found test entry "uid=pyrock_fxwpb,ou=tokens" on "ds-cts-1" [run_command]: kubectl --namespace=xlou exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" --baseDn "uid=pyrock_fxwpb,ou=tokens" --searchScope base objectclass=* 1.1 [run_command]: OK (rc = 0 - expected to be in [0, 32]) --- stdout --- dn: uid=pyrock_fxwpb,ou=tokens --- stderr --- => Found test entry "uid=pyrock_fxwpb,ou=tokens" on "ds-cts-2" [loop_until]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- ldapdelete --port 4444 --useSsl --trustAll --bindDn "uid=admin" --bindPassword "EnuGiNFQGUaEqMW18hSuoNRt0sJmnw3k" uid=pyrock_fxwpb,ou=tokens [loop_until]: (max_time=180, interval=5, expected_rc=[0] [loop_until]: OK (rc = 0) --- stdout --- # DELETE operation successful for DN uid=pyrock_fxwpb,ou=tokens --- stderr --- => Deleted test entry with dn "uid=pyrock_fxwpb,ou=tokens" SUCCESS: replication seems to be synchronised ________________________________________________________________________________ [12/Aug/2023 21:33:04] CheckReplication_ds-cts post : N/A ________________________________________________________________________________ SUCCESS : replication seems to be synchronised Setting result to PASS Task has been successfully stopped