--Task--
              name: Verification_ds-cts
           enabled: True
        class_name: VerificationTask
       source_name: ds-cts
  source_namespace: >default<
       target_name: ds-cts
  target_namespace: >default<
             start: 0
              stop: None
           timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow
              loop: False
          interval: None
      dependencies: []
          wait_for: []
           options: {}
        group_name: None
       Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock

________________________________________________________________________________

[13/Aug/2023 03:32:50] Verification_ds-cts pre : N/A
________________________________________________________________________________

[13/Aug/2023 03:32:50] - INFO: Timeout for this Task has changed to 4h (14400 seconds)
[13/Aug/2023 03:32:50] - INFO: timeout was set to Task default (2x global_duration or 300 seconds (whatever is higher)), because it was unset
________________________________________________________________________________

[13/Aug/2023 03:32:50] Verification_ds-cts step1 : Wait until pods are in Running state and check number of running pods
________________________________________________________________________________


---------------------   Get expected number of pods   ---------------------

[loop_until]: kubectl --namespace=xlou get statefulsets --selector app=ds-cts --output jsonpath={.items[*].spec.replicas}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
3
--- stderr ---


--------------   Waiting for 3 expected pod(s) to be ready   --------------

[loop_until]: kubectl --namespace=xlou get statefulsets ds-cts --output jsonpath="current:{.status.currentReplicas} ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "current:3 ready:3 replicas:3"
[loop_until]: (max_time=900, interval=30, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
current:3 ready:3 replicas:3
--- stderr ---

________________________________________________________________________________

[13/Aug/2023 03:32:51] Verification_ds-cts step2 : Discovering pods
________________________________________________________________________________


---------------------   Get expected number of pods   ---------------------

[loop_until]: kubectl --namespace=xlou get statefulsets --selector app=ds-cts --output jsonpath={.items[*].spec.replicas}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
3
--- stderr ---


----------------------------    Get pod list   ----------------------------

[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods --selector app=ds-cts --output jsonpath={.items[*].metadata.name}` | grep 3
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
ds-cts-0 ds-cts-1 ds-cts-2
--- stderr ---

________________________________________________________________________________

[13/Aug/2023 03:32:52] Verification_ds-cts step3 : Check component is alive
________________________________________________________________________________

Livecheck to ds-cts-0

[run_command]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "iDO4jfjwcD1B0lpvgy2LanUPQjw3Y27W" --baseDn "" --searchScope base "(&)" alive
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
dn: 
alive: true
--- stderr ---


Livecheck to ds-cts-1

[run_command]: kubectl --namespace=xlou exec ds-cts-1 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "iDO4jfjwcD1B0lpvgy2LanUPQjw3Y27W" --baseDn "" --searchScope base "(&)" alive
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
dn: 
alive: true
--- stderr ---


Livecheck to ds-cts-2

[run_command]: kubectl --namespace=xlou exec ds-cts-2 --container ds -- ldapsearch --noPropertiesFile --port 1389 --useStartTls --trustAll --bindDn "uid=admin" --bindPassword "iDO4jfjwcD1B0lpvgy2LanUPQjw3Y27W" --baseDn "" --searchScope base "(&)" alive
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
dn: 
alive: true
--- stderr ---


PASS : component ds-cts is alive
________________________________________________________________________________

[13/Aug/2023 03:32:57] Verification_ds-cts step4 : Record version
________________________________________________________________________________


---------------------   Get DS-CTS software version   ---------------------

[loop_until]: kubectl --namespace=xlou exec ds-cts-0 --container ds -- find /opt/opendj -name opendj-core.jar
[loop_until]: (max_time=30, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
/opt/opendj/lib/opendj-core.jar
--- stderr ---


[loop_until]: kubectl --namespace=xlou cp ds-cts-0:/opt/opendj/lib/opendj-core.jar /tmp/ds-cts_info/opendj-core.jar --container ds
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---

Version is 7.4.0.20230804090409-e46808a022da759ebe0ee43bf6f422fe9
Revision is e46808a022da759ebe0ee43bf6f422fe91a4e54b
________________________________________________________________________________

[13/Aug/2023 03:32:59] Verification_ds-cts step5 :  Checking pod restart counts 
________________________________________________________________________________


------------------    Check pod ds-cts-0 restart count   ------------------

[loop_until]: kubectl --namespace=xlou get pod ds-cts-0 --output jsonpath={.status.containerStatuses[*].restartCount}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
0
--- stderr ---

Pod ds-cts-0 has been restarted 0 times.
SUCCESS : pod restart count (0) did not change between validation and verification phases

------------------    Check pod ds-cts-1 restart count   ------------------

[loop_until]: kubectl --namespace=xlou get pod ds-cts-1 --output jsonpath={.status.containerStatuses[*].restartCount}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
0
--- stderr ---

Pod ds-cts-1 has been restarted 0 times.
SUCCESS : pod restart count (0) did not change between validation and verification phases

------------------    Check pod ds-cts-2 restart count   ------------------

[loop_until]: kubectl --namespace=xlou get pod ds-cts-2 --output jsonpath={.status.containerStatuses[*].restartCount}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
0
--- stderr ---

Pod ds-cts-2 has been restarted 0 times.
SUCCESS : pod restart count (0) did not change between validation and verification phases
________________________________________________________________________________

[13/Aug/2023 03:33:00] Verification_ds-cts post : Post method
________________________________________________________________________________

Setting result to PASS
Task has been successfully stopped