--Task--
              name: Deploy_or_discover_overseer
           enabled: True
        class_name: DeployOrDiscoverOverseerTask
       source_name: controller
  source_namespace: >default<
       target_name: controller
  target_namespace: >default<
             start: 0.0
              stop: None
           timeout: no timeout
              loop: False
          interval: None
      dependencies: ['Discover_all_components']
          wait_for: []
    preceding_task: None
           options: {}
        group_name: None
       Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock

________________________________________________________________________________

[2024-04-21 22:10:53] Deploy_or_discover_overseer pre : Initialising task parameters
________________________________________________________________________________

task will be executed on controller (localhost)
________________________________________________________________________________

[2024-04-21 22:10:53] Deploy_or_discover_overseer step1 : Discover or deploy overseer
________________________________________________________________________________

2024-04-21 22:10:53,653 INFO    
2024-04-21 22:10:53,655 INFO    [loop_until]: kubectl --namespace=xlou get deployments -l "release=overseer" -o name
2024-04-21 22:10:53,655 INFO    [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-21 22:10:54,005 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:54,005 DEBUG   --- stdout ---
2024-04-21 22:10:54,005 DEBUG   deployment.apps/overseer-0
2024-04-21 22:10:54,005 DEBUG   --- stderr ---
2024-04-21 22:10:54,005 DEBUG   
Discover overseer pod: overseer-0
2024-04-21 22:10:54,385 INFO    
2024-04-21 22:10:54,385 INFO    ---------------------   Get expected number of pods   ---------------------
2024-04-21 22:10:54,385 INFO    
2024-04-21 22:10:54,385 INFO    [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app=overseer-0 --output jsonpath={.items[*].spec.replicas}
2024-04-21 22:10:54,385 INFO    [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-21 22:10:54,714 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:54,714 DEBUG   --- stdout ---
2024-04-21 22:10:54,714 DEBUG   1
2024-04-21 22:10:54,714 DEBUG   --- stderr ---
2024-04-21 22:10:54,714 DEBUG   
2024-04-21 22:10:54,715 INFO    
2024-04-21 22:10:54,715 INFO    ----------------------------    Get pod list   ----------------------------
2024-04-21 22:10:54,715 INFO    
2024-04-21 22:10:54,715 INFO    [loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
2024-04-21 22:10:54,715 INFO    [loop_until]: (max_time=180, interval=10, expected_rc=[0]
2024-04-21 22:10:55,050 INFO    [loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
2024-04-21 22:10:55,051 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:55,051 DEBUG   --- stdout ---
2024-04-21 22:10:55,051 DEBUG   overseer-0-68c5d5b884-p97w5
2024-04-21 22:10:55,051 DEBUG   --- stderr ---
2024-04-21 22:10:55,051 DEBUG   
2024-04-21 22:10:55,051 INFO    
2024-04-21 22:10:55,051 INFO    ----------    Check pod overseer-0-68c5d5b884-p97w5 is running   ----------
2024-04-21 22:10:55,052 INFO    
2024-04-21 22:10:55,052 INFO    [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-68c5d5b884-p97w5 -o=jsonpath={.status.phase} | grep "Running"
2024-04-21 22:10:55,052 INFO    [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-21 22:10:55,392 INFO    [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-21 22:10:55,392 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:55,392 DEBUG   --- stdout ---
2024-04-21 22:10:55,392 DEBUG   Running
2024-04-21 22:10:55,392 DEBUG   --- stderr ---
2024-04-21 22:10:55,392 DEBUG   
2024-04-21 22:10:55,393 INFO    
2024-04-21 22:10:55,393 INFO    [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pods overseer-0-68c5d5b884-p97w5 -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
2024-04-21 22:10:55,393 INFO    [loop_until]: (max_time=360, interval=5, expected_rc=[0]
2024-04-21 22:10:55,712 INFO    [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-21 22:10:55,713 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:55,713 DEBUG   --- stdout ---
2024-04-21 22:10:55,713 DEBUG   true
2024-04-21 22:10:55,713 DEBUG   --- stderr ---
2024-04-21 22:10:55,713 DEBUG   
2024-04-21 22:10:55,713 INFO    
2024-04-21 22:10:55,713 INFO    [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod overseer-0-68c5d5b884-p97w5 --output jsonpath={.status.startTime}
2024-04-21 22:10:55,713 INFO    [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-21 22:10:56,033 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:56,034 DEBUG   --- stdout ---
2024-04-21 22:10:56,034 DEBUG   2024-04-21T01:54:14Z
2024-04-21 22:10:56,034 DEBUG   --- stderr ---
2024-04-21 22:10:56,034 DEBUG   
2024-04-21 22:10:56,035 INFO    
2024-04-21 22:10:56,035 INFO    ---    Check pod overseer-0-68c5d5b884-p97w5 filesystem is accessible   ---
2024-04-21 22:10:56,829 INFO    [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-21 22:10:56,830 INFO    
2024-04-21 22:10:56,830 INFO    ---------   Check pod overseer-0-68c5d5b884-p97w5 restart count   ---------
2024-04-21 22:10:56,830 INFO    
2024-04-21 22:10:56,830 INFO    [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get pod overseer-0-68c5d5b884-p97w5 --output jsonpath={.status.containerStatuses[*].restartCount}
2024-04-21 22:10:56,830 INFO    [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-21 22:10:57,155 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:57,155 DEBUG   --- stdout ---
2024-04-21 22:10:57,155 DEBUG   0
2024-04-21 22:10:57,155 DEBUG   --- stderr ---
2024-04-21 22:10:57,155 DEBUG   
2024-04-21 22:10:57,155 INFO    Pod overseer-0-68c5d5b884-p97w5 has been restarted 0 times.
2024-04-21 22:10:57,155 INFO    
2024-04-21 22:10:57,155 INFO    ---------------------   Get expected number of pods   ---------------------
2024-04-21 22:10:57,156 INFO    
2024-04-21 22:10:57,156 INFO    [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments --selector app=overseer-0 --output jsonpath={.items[*].spec.replicas}
2024-04-21 22:10:57,156 INFO    [loop_until]: (max_time=180, interval=5, expected_rc=[0]
2024-04-21 22:10:57,479 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:57,479 DEBUG   --- stdout ---
2024-04-21 22:10:57,480 DEBUG   1
2024-04-21 22:10:57,480 DEBUG   --- stderr ---
2024-04-21 22:10:57,480 DEBUG   
2024-04-21 22:10:57,480 INFO    
2024-04-21 22:10:57,480 INFO    --------------   Waiting for 1 expected pod(s) to be ready   --------------
2024-04-21 22:10:57,480 INFO    
2024-04-21 22:10:57,480 INFO    [loop_until]: kubectl --namespace=xlou --context=gke_engineeringpit_us-east1-d_xlou-cdm get deployments overseer-0 --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1"
2024-04-21 22:10:57,480 INFO    [loop_until]: (max_time=900, interval=30, expected_rc=[0]
2024-04-21 22:10:57,815 INFO    [loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
2024-04-21 22:10:57,815 INFO    [loop_until]: OK (rc = 0)
2024-04-21 22:10:57,816 DEBUG   --- stdout ---
2024-04-21 22:10:57,816 DEBUG   ready:1 replicas:1
2024-04-21 22:10:57,816 DEBUG   --- stderr ---
2024-04-21 22:10:57,816 DEBUG   
2024-04-21 22:10:57,816 INFO    Livecheck to https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com
2024-04-21 22:10:57,817 INFO    [http_cmd]: curl --insecure -L --request GET  "https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com"
2024-04-21 22:10:58,089 INFO    [http_cmd]: http status code OK
2024-04-21 22:10:58,089 DEBUG   ---  status code  ---
2024-04-21 22:10:58,089 DEBUG   http status code is 200 (expected 200)
2024-04-21 22:10:58,089 DEBUG   --- http response ---
2024-04-21 22:10:58,089 DEBUG   <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<title>Directory listing for /</title>
</head>
<body>
<h1>Directory listing for /</h1>
<hr>
<ul>
<li><a href="ds-idrepo/">ds-idrepo/</a></li>
<li><a href="gatling/">gatling/</a></li>
<li><a href="lost%2Bfound/">lost+found/</a></li>
<li><a href="orders/">orders/</a></li>
</ul>
<hr>
</body>
</html>


________________________________________________________________________________

[2024-04-21 22:10:58] Deploy_or_discover_overseer post : Post method
________________________________________________________________________________

Setting result to PASS
Task has been successfully stopped