--Task--
              name: Verification_ds-idrepo
           enabled: True
        class_name: VerificationTask
       source_name: ds-idrepo
  source_namespace: >default<
       target_name: ds-idrepo
  target_namespace: >default<
             start: 0
              stop: None
           timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates bellow
              loop: False
          interval: None
      dependencies: []
          wait_for: []
           options: {}
        group_name: None
       Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock

________________________________________________________________________________

[21/Sep/2022 02:55:46] Verification_ds-idrepo pre : N/A
________________________________________________________________________________

[21/Sep/2022 02:55:46] - INFO: setting default timeout for task - 2x global_duration or 300 seconds (whatever is higher):
[21/Sep/2022 02:55:46] - INFO: Timeout for this Task has changed to 10h (36000 seconds)
________________________________________________________________________________

[21/Sep/2022 02:55:46] Verification_ds-idrepo step1 : Wait until pods are in Running state and check number of running pods
________________________________________________________________________________


---------------------   Get expected number of pods   ---------------------

[loop_until]: kubectl --namespace=xlou get statefulsets -l app=ds-idrepo -o jsonpath={.items[*].spec.replicas}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
3
--- stderr ---


--------------   Waiting for 3 expected pod(s) to be ready   --------------

[loop_until]: kubectl --namespace=xlou get statefulsets ds-idrepo -o jsonpath="current:{.status.currentReplicas} ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "current:3 ready:3 replicas:3"
[loop_until]: (max_time=900, interval=30, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
current:3 ready:3 replicas:3
--- stderr ---

________________________________________________________________________________

[21/Sep/2022 02:55:47] Verification_ds-idrepo step2 : Discovering pods
________________________________________________________________________________


---------------------   Get expected number of pods   ---------------------

[loop_until]: kubectl --namespace=xlou get statefulsets -l app=ds-idrepo -o jsonpath={.items[*].spec.replicas}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
3
--- stderr ---


----------------------------    Get pod list   ----------------------------

[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods -l app=ds-idrepo -o jsonpath={.items[*].metadata.name}` | grep 3
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
ds-idrepo-0 ds-idrepo-1 ds-idrepo-2
--- stderr ---

________________________________________________________________________________

[21/Sep/2022 02:55:48] Verification_ds-idrepo step3 : Check component is alive
________________________________________________________________________________

Livecheck to ds-idrepo-0

[run_command]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "eWQnSznAHi4gPsJ88mtzfKp1DPMslQux" -b "" -s base "(&)" alive
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
dn: 
alive: true
--- stderr ---


Livecheck to ds-idrepo-1

[run_command]: kubectl --namespace=xlou exec ds-idrepo-1 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "eWQnSznAHi4gPsJ88mtzfKp1DPMslQux" -b "" -s base "(&)" alive
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
dn: 
alive: true
--- stderr ---


Livecheck to ds-idrepo-2

[run_command]: kubectl --namespace=xlou exec ds-idrepo-2 -c ds -- ldapsearch --noPropertiesFile -p 1389 --useStartTls --trustAll -D "uid=admin" -w "eWQnSznAHi4gPsJ88mtzfKp1DPMslQux" -b "" -s base "(&)" alive
[run_command]: OK (rc = 0 - expected to be in [0])
--- stdout ---
dn: 
alive: true
--- stderr ---


PASS : component ds-idrepo is alive
________________________________________________________________________________

[21/Sep/2022 02:55:53] Verification_ds-idrepo step4 : Record version
________________________________________________________________________________


-------------------    Get DS-IDREPO software version   -------------------

[loop_until]: kubectl --namespace=xlou exec ds-idrepo-0 -c ds -- find /opt/opendj -name opendj-core.jar
[loop_until]: (max_time=30, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
/opt/opendj/lib/opendj-core.jar
--- stderr ---


[loop_until]: kubectl --namespace=xlou cp ds-idrepo-0:/opt/opendj/lib/opendj-core.jar /tmp/ds-idrepo_info/opendj-core.jar -c ds
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
tar: Removing leading `/' from member names
--- stderr ---

Version is 7.3.0.20220909080120-954176524467342398ae1a6e1012191e7
Revision is 954176524467342398ae1a6e1012191e730e09e5
________________________________________________________________________________

[21/Sep/2022 02:55:56] Verification_ds-idrepo step5 :  Checking pod restart counts 
________________________________________________________________________________


-----------------   Check pod ds-idrepo-0 restart count   -----------------

[loop_until]: kubectl --namespace=xlou get pod ds-idrepo-0 -o jsonpath={.status.containerStatuses[*].restartCount}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
0
--- stderr ---

Pod ds-idrepo-0 has been restarted 0 times.
SUCCESS : pod restart count (0) did not change between validation and verification phases

-----------------   Check pod ds-idrepo-1 restart count   -----------------

[loop_until]: kubectl --namespace=xlou get pod ds-idrepo-1 -o jsonpath={.status.containerStatuses[*].restartCount}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
0
--- stderr ---

Pod ds-idrepo-1 has been restarted 0 times.
SUCCESS : pod restart count (0) did not change between validation and verification phases

-----------------   Check pod ds-idrepo-2 restart count   -----------------

[loop_until]: kubectl --namespace=xlou get pod ds-idrepo-2 -o jsonpath={.status.containerStatuses[*].restartCount}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
0
--- stderr ---

Pod ds-idrepo-2 has been restarted 0 times.
SUCCESS : pod restart count (0) did not change between validation and verification phases
________________________________________________________________________________

[21/Sep/2022 02:55:57] Verification_ds-idrepo post : Post method
________________________________________________________________________________

Setting result to PASS
Task has been successfully stopped