--Task--
              name: Enable_prometheus_admin_api
           enabled: True
        class_name: EnablePrometheusAdminAPI
       source_name: controller
  source_namespace: >default<
       target_name: controller
  target_namespace: >default<
             start: 0
              stop: None
           timeout: no timeout
              loop: False
          interval: None
      dependencies: []
          wait_for: []
           options: {}
        group_name: None
       Current dir: /mnt/disks/data/xslou/lodestar-fork/pyrock

________________________________________________________________________________

[16/Aug/2023 00:31:07] Enable_prometheus_admin_api pre : N/A
________________________________________________________________________________

________________________________________________________________________________

[16/Aug/2023 00:31:07] Enable_prometheus_admin_api step1 : Discover the prometheus pod
________________________________________________________________________________

[16/Aug/2023 00:31:07] - INFO: Discovering prometheus pods

[loop_until]: kubectl --namespace=monitoring get pods --output json --field-selector metadata.name=prometheus-prometheus-operator-kube-p-prometheus-0
[loop_until]: (max_time=180, interval=5, expected_rc=[0]
[loop_until]: OK (rc = 0)
--- stdout ---
[print_head_tail]: Print head (100 lines) and tail (100 lines) of input string (512 lines):
----- output -----
{
    "apiVersion": "v1",
    "items": [
        {
            "apiVersion": "v1",
            "kind": "Pod",
            "metadata": {
                "annotations": {
                    "kubectl.kubernetes.io/default-container": "prometheus"
                },
                "creationTimestamp": "2023-08-13T20:13:56Z",
                "generateName": "prometheus-prometheus-operator-kube-p-prometheus-",
                "labels": {
                    "app.kubernetes.io/instance": "prometheus-operator-kube-p-prometheus",
                    "app.kubernetes.io/managed-by": "prometheus-operator",
                    "app.kubernetes.io/name": "prometheus",
                    "app.kubernetes.io/version": "2.44.0",
                    "controller-revision-hash": "prometheus-prometheus-operator-kube-p-prometheus-7b495c798d",
                    "operator.prometheus.io/name": "prometheus-operator-kube-p-prometheus",
                    "operator.prometheus.io/shard": "0",
                    "prometheus": "prometheus-operator-kube-p-prometheus",
                    "statefulset.kubernetes.io/pod-name": "prometheus-prometheus-operator-kube-p-prometheus-0"
                },
                "name": "prometheus-prometheus-operator-kube-p-prometheus-0",
                "namespace": "monitoring",
                "ownerReferences": [
                    {
                        "apiVersion": "apps/v1",
                        "blockOwnerDeletion": true,
                        "controller": true,
                        "kind": "StatefulSet",
                        "name": "prometheus-prometheus-operator-kube-p-prometheus",
                        "uid": "af636164-e309-4214-abfb-69e4f4ed19ff"
                    }
                ],
                "resourceVersion": "57427500",
                "uid": "3416e84e-2d44-46d6-9839-11600cc5e1fe"
            },
            "spec": {
                "automountServiceAccountToken": true,
                "containers": [
                    {
                        "args": [
                            "--web.console.templates=/etc/prometheus/consoles",
                            "--web.console.libraries=/etc/prometheus/console_libraries",
                            "--config.file=/etc/prometheus/config_out/prometheus.env.yaml",
                            "--web.enable-lifecycle",
                            "--web.external-url=http://prometheus-operator-kube-p-prometheus.monitoring:9090",
                            "--web.route-prefix=/",
                            "--storage.tsdb.wal-compression",
                            "--storage.tsdb.retention.time=10d",
                            "--storage.tsdb.path=/prometheus",
                            "--web.enable-admin-api",
                            "--web.config.file=/etc/prometheus/web_config/web-config.yaml"
                        ],
                        "image": "quay.io/prometheus/prometheus:v2.44.0",
                        "imagePullPolicy": "IfNotPresent",
                        "livenessProbe": {
                            "failureThreshold": 6,
                            "httpGet": {
                                "path": "/-/healthy",
                                "port": "http-web",
                                "scheme": "HTTP"
                            },
                            "periodSeconds": 5,
                            "successThreshold": 1,
                            "timeoutSeconds": 3
                        },
                        "name": "prometheus",
                        "ports": [
                            {
                                "containerPort": 9090,
                                "name": "http-web",
                                "protocol": "TCP"
                            }
                        ],
                        "readinessProbe": {
                            "failureThreshold": 3,
                            "httpGet": {
                                "path": "/-/ready",
                                "port": "http-web",
                                "scheme": "HTTP"
                            },
                            "periodSeconds": 5,
                            "successThreshold": 1,
                            "timeoutSeconds": 3
                        },
                        "resources": {},
                        "securityContext": {
                            "allowPrivilegeEscalation": false,
                            "capabilities": {
                                "drop": [
                                    "ALL"
                                ]
                            },
                            "readOnlyRootFilesystem": true
                        },
                        "startupProbe": {
                            "failureThreshold": 60,
                            "httpGet": {



[...]



                                                "path": "namespace"
                                            }
                                        ]
                                    }
                                }
                            ]
                        }
                    }
                ]
            },
            "status": {
                "conditions": [
                    {
                        "lastProbeTime": null,
                        "lastTransitionTime": "2023-08-13T20:13:56Z",
                        "message": "containers with incomplete status: [init-config-reloader]",
                        "reason": "ContainersNotInitialized",
                        "status": "False",
                        "type": "Initialized"
                    },
                    {
                        "lastProbeTime": null,
                        "lastTransitionTime": "2023-08-13T20:13:56Z",
                        "message": "containers with unready status: [prometheus config-reloader]",
                        "reason": "ContainersNotReady",
                        "status": "False",
                        "type": "Ready"
                    },
                    {
                        "lastProbeTime": null,
                        "lastTransitionTime": "2023-08-13T20:13:56Z",
                        "message": "containers with unready status: [prometheus config-reloader]",
                        "reason": "ContainersNotReady",
                        "status": "False",
                        "type": "ContainersReady"
                    },
                    {
                        "lastProbeTime": null,
                        "lastTransitionTime": "2023-08-13T20:13:56Z",
                        "status": "True",
                        "type": "PodScheduled"
                    }
                ],
                "containerStatuses": [
                    {
                        "image": "quay.io/prometheus-operator/prometheus-config-reloader:v0.65.1",
                        "imageID": "",
                        "lastState": {},
                        "name": "config-reloader",
                        "ready": false,
                        "restartCount": 0,
                        "started": false,
                        "state": {
                            "waiting": {
                                "reason": "PodInitializing"
                            }
                        }
                    },
                    {
                        "image": "quay.io/prometheus/prometheus:v2.44.0",
                        "imageID": "",
                        "lastState": {},
                        "name": "prometheus",
                        "ready": false,
                        "restartCount": 0,
                        "started": false,
                        "state": {
                            "waiting": {
                                "reason": "PodInitializing"
                            }
                        }
                    }
                ],
                "hostIP": "10.142.0.48",
                "initContainerStatuses": [
                    {
                        "image": "quay.io/prometheus-operator/prometheus-config-reloader:v0.65.1",
                        "imageID": "",
                        "lastState": {},
                        "name": "init-config-reloader",
                        "ready": false,
                        "restartCount": 0,
                        "state": {
                            "waiting": {
                                "reason": "PodInitializing"
                            }
                        }
                    }
                ],
                "phase": "Pending",
                "qosClass": "Burstable",
                "startTime": "2023-08-13T20:13:56Z"
            }
        }
    ],
    "kind": "List",
    "metadata": {
        "resourceVersion": ""
    }
}
--- stderr ---

________________________________________________________________________________

[16/Aug/2023 00:31:07] Enable_prometheus_admin_api step2 : Enable the API if disabled
________________________________________________________________________________

[16/Aug/2023 00:31:07] - INFO: REST API is enabled: True
________________________________________________________________________________

[16/Aug/2023 00:31:07] Enable_prometheus_admin_api post : Post method
________________________________________________________________________________

Setting result to PASS
Task has been successfully stopped