--Task--
              name: Deploy_or_discover_overseer
           enabled: True
        class_name: DeployOrDiscoverOverseerTask
       source_name: controller
  source_namespace: >default<
       target_name: controller
  target_namespace: >default<
             start: 0
              stop: None
           timeout: no timeout
              loop: False
          interval: None
      dependencies: ['Deploy_Discover_IDC_tenant']
          wait_for: []
           options: {}
        group_name: None
       Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock

________________________________________________________________________________

[22/Sep/2023 03:44:07] Deploy_or_discover_overseer pre : Initialising task parameters
________________________________________________________________________________

task will be executed on controller (localhost)
________________________________________________________________________________

[22/Sep/2023 03:44:07] Deploy_or_discover_overseer step1 : Discover or deploy overseer
________________________________________________________________________________


[loop_until]: kubectl create namespace xlou
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
namespace/xlou created
--- stderr ---


[loop_until]: kubectl label namespace xlou self-service=false timeout=48
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
namespace/xlou labeled
--- stderr ---


[loop_until]: kubectl --namespace=xlou get deployments -l "release=overseer" -o name
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---

--- stderr ---

overseer-0 pod does not exit, deploy it

------------    Deploy the lodestarbox with overseer profile   ------------

[run_command]: skaffold deploy --profile overseer --config=/tmp/tmp4946k_9k --status-check=true --namespace=xlou --platform=linux/amd64
Tags used in deployment:
Starting deploy...
- serviceaccount/k8s-svc-acct-0 created
- clusterrolebinding.rbac.authorization.k8s.io/k8s-svc-acct-crb-xlou-0 created
- configmap/overseer-config-0 created
- service/overseer-0 created
- persistentvolumeclaim/overseer-0 created
- deployment.apps/overseer-0 created
- ingress.networking.k8s.io/overseer-0 created
Waiting for deployments to stabilize...
- xlou:deployment/overseer-0: creating container overseer
- xlou:pod/overseer-0-f4fc875f5-wpsqt: creating container overseer
- xlou:deployment/overseer-0 is ready.
Deployments stabilized in 14.891 seconds
There is a new version (2.7.0) of Skaffold available. Download it from:
https://github.com/GoogleContainerTools/skaffold/releases/tag/v2.7.0

Help improve Skaffold with our 2-minute anonymous survey: run 'skaffold survey'
To help improve the quality of this product, we collect anonymized usage data for details on what is tracked and how we use this data visit <https://skaffold.dev/docs/resources/telemetry/>. This data is handled in accordance with our privacy policy <https://policies.google.com/privacy>

You may choose to opt out of this collection by running the following command:
skaffold config set --global collect-metrics false

---------------------   Get expected number of pods   ---------------------

[loop_until]: kubectl --namespace=xlou get deployments --selector app=overseer-0 --output jsonpath={.items[*].spec.replicas}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
1
--- stderr ---


----------------------------    Get pod list   ----------------------------

[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-f4fc875f5-wpsqt
--- stderr ---


-----------   Check pod overseer-0-f4fc875f5-wpsqt is running   -----------

[loop_until]: kubectl --namespace=xlou get pods overseer-0-f4fc875f5-wpsqt -o=jsonpath={.status.phase} | grep "Running"
[loop_until]: (max_time=360, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
Running
--- stderr ---


[loop_until]: kubectl --namespace=xlou get pods overseer-0-f4fc875f5-wpsqt -o=jsonpath={.status.containerStatuses[*].ready} | grep "true"
[loop_until]: (max_time=360, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
true
--- stderr ---


[loop_until]: kubectl --namespace=xlou get pod overseer-0-f4fc875f5-wpsqt --output jsonpath={.status.startTime}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
2023-09-22T03:44:16Z
--- stderr ---


----   Check pod overseer-0-f4fc875f5-wpsqt filesystem is accessible   ----

[loop_until]: kubectl --namespace=xlou exec overseer-0-f4fc875f5-wpsqt --container overseer -- ls / | grep "bin"
[loop_until]: (max_time=360, interval=5, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
bin
boot
dev
docker-entrypoint.sh
etc
home
lib
lib64
lodestar
lost+found
media
mnt
opt
proc
results
root
run
sbin
srv
sys
tmp
usr
var
--- stderr ---


---------    Check pod overseer-0-f4fc875f5-wpsqt restart count   ---------

[loop_until]: kubectl --namespace=xlou get pod overseer-0-f4fc875f5-wpsqt --output jsonpath={.status.containerStatuses[*].restartCount}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
0
--- stderr ---

Pod overseer-0-f4fc875f5-wpsqt has been restarted 0 times.

---------------------   Get expected number of pods   ---------------------

[loop_until]: kubectl --namespace=xlou get deployments --selector app=overseer-0 --output jsonpath={.items[*].spec.replicas}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
1
--- stderr ---


--------------   Waiting for 1 expected pod(s) to be ready   --------------

[loop_until]: kubectl --namespace=xlou get deployments overseer-0 --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1"
[loop_until]: (max_time=900, interval=30, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
ready:1 replicas:1
--- stderr ---

Livecheck to https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com
[http_cmd]: curl --insecure -L --request GET  "https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com"
[http_cmd]: http status code OK
---  status code  ---
http status code is 200 (expected 200)
--- http response ---
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<title>Directory listing for /</title>
</head>
<body>
<h1>Directory listing for /</h1>
<hr>
<ul>
<li><a href="lost%2Bfound/">lost+found/</a></li>
<li><a href="orders/">orders/</a></li>
</ul>
<hr>
</body>
</html>


Component overseer-0 is alive
Dumping pod description and logs to /mnt/disks/data/xslou/lodestar-fork/results/pyrock/pod-logs/20230922-034432-after-overseer-0-deploy/overseer-0-f4fc875f5-wpsqt.txt
Check pod logs for errors

---------------------   Get expected number of pods   ---------------------

[loop_until]: kubectl --namespace=xlou get deployments --selector app=overseer-0 --output jsonpath={.items[*].spec.replicas}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
1
--- stderr ---


----------------------------    Get pod list   ----------------------------

[loop_until]: awk -F" " "{print NF}" <<< `kubectl --namespace=xlou get pods --selector app=overseer-0 --output jsonpath={.items[*].metadata.name}` | grep 1
[loop_until]: (max_time=180, interval=10, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected number of elements found
[loop_until]: OK (rc = 0)
--- stdout ---
overseer-0-f4fc875f5-wpsqt
--- stderr ---


---------------------   Get expected number of pods   ---------------------

[loop_until]: kubectl --namespace=xlou get deployments --selector app=overseer-0 --output jsonpath={.items[*].spec.replicas}
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
1
--- stderr ---


--------------   Waiting for 1 expected pod(s) to be ready   --------------

[loop_until]: kubectl --namespace=xlou get deployments overseer-0 --output jsonpath="ready:{.status.readyReplicas} replicas:{.status.replicas}" | grep "ready:1 replicas:1"
[loop_until]: (max_time=900, interval=30, expected_rc=[0]
[loop_until]: Function succeeded after 0s (rc=0) - expected pattern found
[loop_until]: OK (rc = 0)
--- stdout ---
ready:1 replicas:1
--- stderr ---

Livecheck to https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com
[http_cmd]: curl --insecure -L --request GET  "https://overseer-0.xlou.iam.xlou-cdm.engineeringpit.com"
[http_cmd]: http status code OK
---  status code  ---
http status code is 200 (expected 200)
--- http response ---
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<title>Directory listing for /</title>
</head>
<body>
<h1>Directory listing for /</h1>
<hr>
<ul>
<li><a href="lost%2Bfound/">lost+found/</a></li>
<li><a href="orders/">orders/</a></li>
</ul>
<hr>
</body>
</html>


________________________________________________________________________________

[22/Sep/2023 03:44:34] Deploy_or_discover_overseer post : Post method
________________________________________________________________________________

Setting result to PASS
Task has been successfully stopped