==================================================================================================== ============================ Pod describe kube-dns-85c58c549b-ht2x9 ============================ ==================================================================================================== Name: kube-dns-85c58c549b-ht2x9 Namespace: kube-system Priority: 2000000000 Priority Class Name: system-cluster-critical Service Account: kube-dns Node: gke-xlou-cdm-frontend-18a44ad7-wov8/10.142.0.92 Start Time: Sat, 07 Jun 2025 11:04:26 +0000 Labels: k8s-app=kube-dns pod-template-hash=85c58c549b Annotations: components.gke.io/component-name: kubedns components.gke.io/component-version: 31.1.5 kubectl.kubernetes.io/restartedAt: 2024-04-10T15:47:12Z prometheus.io/port: 10054 prometheus.io/scrape: true scheduler.alpha.kubernetes.io/critical-pod: seccomp.security.alpha.kubernetes.io/pod: runtime/default Status: Running IP: 10.106.41.5 IPs: IP: 10.106.41.5 Controlled By: ReplicaSet/kube-dns-85c58c549b Containers: kubedns: Container ID: containerd://34d24995e286fcce799efaea7878463d06d476e8ab9eb5cd869c0c1d01f63525 Image: gke.gcr.io/k8s-dns-kube-dns:1.23.0-gke.20@sha256:b609a51c8aa4add2d1d0811737f177b4e944ea0781a48eead0d804722787f96f Image ID: gke.gcr.io/k8s-dns-kube-dns@sha256:b609a51c8aa4add2d1d0811737f177b4e944ea0781a48eead0d804722787f96f Ports: 10053/UDP, 10053/TCP Host Ports: 0/UDP, 0/TCP Args: --domain=cluster.local. --dns-port=10053 --config-dir=/kube-dns-config --v=2 State: Running Started: Sat, 07 Jun 2025 11:04:28 +0000 Ready: True Restart Count: 0 Limits: memory: 210Mi Requests: cpu: 100m memory: 70Mi Liveness: http-get http://:10054/healthcheck/kubedns delay=60s timeout=5s period=10s #success=1 #failure=5 Readiness: http-get http://:8081/readiness delay=3s timeout=5s period=10s #success=1 #failure=3 Environment: PROMETHEUS_PORT: 10055 Mounts: /kube-dns-config from kube-dns-config (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jv2rq (ro) dnsmasq: Container ID: containerd://34a025913109a3bc3edbe657b1924a3ce10fe4dbd2e7c9435f649c1b0678b037 Image: gke.gcr.io/k8s-dns-dnsmasq-nanny:1.23.0-gke.20@sha256:e178b753d49a90ec32f1f45e0f52ce64019641d3fd45d8deadcf08cb73b8c840 Image ID: gke.gcr.io/k8s-dns-dnsmasq-nanny@sha256:e178b753d49a90ec32f1f45e0f52ce64019641d3fd45d8deadcf08cb73b8c840 Ports: 53/UDP, 53/TCP Host Ports: 0/UDP, 0/TCP Args: -v=2 -logtostderr -configDir=/etc/k8s/dns/dnsmasq-nanny -restartDnsmasq=true -- -k --cache-size=1000 --no-negcache --dns-forward-max=1500 --log-facility=- --server=/cluster.local/127.0.0.1#10053 --server=/in-addr.arpa/127.0.0.1#10053 --server=/ip6.arpa/127.0.0.1#10053 --max-ttl=30 --max-cache-ttl=30 --max-tcp-connections=200 State: Running Started: Sat, 07 Jun 2025 11:04:30 +0000 Ready: True Restart Count: 0 Requests: cpu: 150m memory: 20Mi Liveness: http-get http://:10054/healthcheck/dnsmasq delay=60s timeout=5s period=10s #success=1 #failure=5 Environment: Mounts: /etc/k8s/dns/dnsmasq-nanny from kube-dns-config (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jv2rq (ro) sidecar: Container ID: containerd://7c3d45910c36a568e6b41e67c0fb7a46cba777681cdb48a1439dcc460e2ad768 Image: gke.gcr.io/k8s-dns-sidecar:1.23.0-gke.20@sha256:9e60f83b54d010a7dd7e5a868a6713ad410442c72f0b7540cda010c50651c0bc Image ID: gke.gcr.io/k8s-dns-sidecar@sha256:9e60f83b54d010a7dd7e5a868a6713ad410442c72f0b7540cda010c50651c0bc Port: 10054/TCP Host Port: 0/TCP Args: --v=2 --logtostderr --probe=kubedns,127.0.0.1:10053,kubernetes.default.svc.cluster.local,5,SRV --probe=dnsmasq,127.0.0.1:53,kubernetes.default.svc.cluster.local,5,SRV State: Running Started: Sat, 07 Jun 2025 11:04:34 +0000 Ready: True Restart Count: 0 Requests: cpu: 10m memory: 20Mi Liveness: http-get http://:10054/metrics delay=60s timeout=5s period=10s #success=1 #failure=5 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jv2rq (ro) prometheus-to-sd: Container ID: containerd://a8a46f6d0a06b3af4d0f65d0acb3e3f849f8c193b716ba88d2ee29800b15d2bf Image: gke.gcr.io/prometheus-to-sd:v0.11.12-gke.51@sha256:798127b7368b1a3a2851a6a336776739f32b0ed741d5d6ee07b97d6ac2998fa3 Image ID: gke.gcr.io/prometheus-to-sd@sha256:798127b7368b1a3a2851a6a336776739f32b0ed741d5d6ee07b97d6ac2998fa3 Port: Host Port: Command: /monitor --source=kubedns:http://localhost:10054?whitelisted=probe_kubedns_latency_ms,probe_kubedns_errors,probe_dnsmasq_latency_ms,probe_dnsmasq_errors,dnsmasq_misses,dnsmasq_hits --stackdriver-prefix=container.googleapis.com/internal/addons --api-override=https://monitoring.googleapis.com/ --pod-id=$(POD_NAME) --namespace-id=$(POD_NAMESPACE) --v=2 State: Running Started: Sat, 07 Jun 2025 11:04:36 +0000 Ready: True Restart Count: 0 Environment: POD_NAME: kube-dns-85c58c549b-ht2x9 (v1:metadata.name) POD_NAMESPACE: kube-system (v1:metadata.namespace) Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jv2rq (ro) kubedns-metrics-collector: Container ID: containerd://d3226ba688c20bd6617cb5b1a05fc7ac0308856d7fe4fb617ce08617d6e3eb6c Image: gke.gcr.io/gke-metrics-collector:20250309_2300_RC0@sha256:2a1c8eae472870af33b3f5e1b7d57134c221c4a1d48281f3736edd640b24dbf9 Image ID: gke.gcr.io/gke-metrics-collector@sha256:2a1c8eae472870af33b3f5e1b7d57134c221c4a1d48281f3736edd640b24dbf9 Port: Host Port: State: Running Started: Sat, 07 Jun 2025 11:04:37 +0000 Ready: True Restart Count: 0 Limits: cpu: 1 memory: 30Mi Requests: cpu: 5m memory: 30Mi Environment: GOMAXPROCS: 2 COLLECTOR_CONFIG_PATH: /conf/kubedns-metrics-collector-config-data.textproto SPLIT_GAUGE_BUFFER: true PROJECT_NUMBER: 941969722215 LOCATION: us-east1-d CLUSTER_NAME: xlou-cdm POD_NAMESPACE: kube-system (v1:metadata.namespace) NODE_NAME: (v1:spec.nodeName) POD_NAME: kube-dns-85c58c549b-ht2x9 (v1:metadata.name) CONTAINER_NAME: kubedns-metrics-collector COMPONENT_VERSION: (v1:metadata.annotations['components.gke.io/component-version']) COMPONENT_NAME: (v1:metadata.annotations['components.gke.io/component-name']) Mounts: /conf from kubedns-metrics-collector-config-map-vol (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-jv2rq (ro) Conditions: Type Status PodReadyToStartContainers True Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-dns-config: Type: ConfigMap (a volume populated by a ConfigMap) Name: kube-dns Optional: true kubedns-metrics-collector-config-map-vol: Type: ConfigMap (a volume populated by a ConfigMap) Name: kubedns-metrics-collector-config-map Optional: false kube-api-access-jv2rq: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: kubernetes.io/os=linux Tolerations: CriticalAddonsOnly op=Exists components.gke.io/gke-managed-components op=Exists kubernetes.io/arch=arm64:NoSchedule node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: ==================================================================================================== ============================== Pod logs kube-dns-85c58c549b-ht2x9 ============================== ==================================================================================================== Flag --logtostderr has been deprecated, will be removed in a future release, see https://github.com/kubernetes/enhancements/tree/master/keps/sig-instrumentation/2845-deprecate-klog-specific-flags-in-k8s-components I0607 11:04:34.959075 1 flags.go:57] FLAG: --add-dir-header="false" I0607 11:04:34.959180 1 flags.go:57] FLAG: --alsologtostderr="false" I0607 11:04:34.959183 1 flags.go:57] FLAG: --dnsmasq-addr="127.0.0.1" I0607 11:04:34.959187 1 flags.go:57] FLAG: --dnsmasq-poll-interval-ms="5000" I0607 11:04:34.959190 1 flags.go:57] FLAG: --dnsmasq-port="53" I0607 11:04:34.959192 1 flags.go:57] FLAG: --log-backtrace-at=":0" I0607 11:04:34.959197 1 flags.go:57] FLAG: --log-dir="" I0607 11:04:34.959200 1 flags.go:57] FLAG: --log-file="" I0607 11:04:34.959202 1 flags.go:57] FLAG: --log-file-max-size="1800" I0607 11:04:34.959204 1 flags.go:57] FLAG: --log-flush-frequency="5s" I0607 11:04:34.959206 1 flags.go:57] FLAG: --logtostderr="true" I0607 11:04:34.959209 1 flags.go:57] FLAG: --one-output="false" I0607 11:04:34.959211 1 flags.go:57] FLAG: --probe="[{Label:kubedns Server:127.0.0.1:10053 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33} {Label:dnsmasq Server:127.0.0.1:53 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33}]" I0607 11:04:34.959235 1 flags.go:57] FLAG: --prometheus-addr="0.0.0.0" I0607 11:04:34.959238 1 flags.go:57] FLAG: --prometheus-namespace="kubedns" I0607 11:04:34.959240 1 flags.go:57] FLAG: --prometheus-path="/metrics" I0607 11:04:34.959242 1 flags.go:57] FLAG: --prometheus-port="10054" I0607 11:04:34.959245 1 flags.go:57] FLAG: --skip-headers="false" I0607 11:04:34.959247 1 flags.go:57] FLAG: --skip-log-headers="false" I0607 11:04:34.959249 1 flags.go:57] FLAG: --stderrthreshold="2" I0607 11:04:34.959252 1 flags.go:57] FLAG: --v="2" I0607 11:04:34.959254 1 flags.go:57] FLAG: --version="false" I0607 11:04:34.959257 1 flags.go:57] FLAG: --vmodule="" I0607 11:04:34.959280 1 main.go:55] Version v1.23.0-gke.20 I0607 11:04:34.959288 1 server.go:46] Starting server (options {DnsMasqPort:53 DnsMasqAddr:127.0.0.1 DnsMasqPollIntervalMs:5000 Probes:[{Label:kubedns Server:127.0.0.1:10053 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33} {Label:dnsmasq Server:127.0.0.1:53 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33}] PrometheusAddr:0.0.0.0 PrometheusPort:10054 PrometheusPath:/metrics PrometheusNamespace:kubedns}) I0607 11:04:34.959318 1 dnsprobe.go:75] Starting dnsProbe {Label:kubedns Server:127.0.0.1:10053 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33} I0607 11:04:34.959353 1 dnsprobe.go:75] Starting dnsProbe {Label:dnsmasq Server:127.0.0.1:53 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33} I0607 11:04:36.827369 1 main.go:125] GCE config: &{Project:engineeringpit Zone:us-east1-d Cluster:xlou-cdm ClusterLocation:us-east1-d Instance:gke-xlou-cdm-frontend-18a44ad7-wov8 InstanceId:8335848010624377467} I0607 11:04:36.827460 1 main.go:194] Taking source configs from flags I0607 11:04:36.827477 1 main.go:196] Taking source configs from kubernetes api server I0607 11:04:36.827483 1 main.go:128] Built the following source configs: [0xc0002105b0] I0607 11:04:36.827566 1 main.go:205] Running prometheus-to-sd, monitored target is kubedns http://localhost:10054 {"level":"info","ts":1749294278.016286,"caller":"collector/main.go:47","msg":"Starting Metrics Collector","log_first_n":2,"log_interval(s)":3600} {"level":"info","ts":1749294278.0167603,"caller":"collector/multi_target_collector.go:50","msg":"Start Metrics Collector","target_url":"http://127.0.0.1:10055/metrics","target_name":"kubedns"} {"level":"info","ts":1749294278.0170434,"caller":"collector/collector.go:111","msg":"Connecting to Cloud Monitoring","target_name":"kubedns","endpoint":"monitoring.googleapis.com:443"} I0607 11:04:28.667166 1 flags.go:57] FLAG: --add-dir-header="false" I0607 11:04:28.667289 1 flags.go:57] FLAG: --alsologtostderr="false" I0607 11:04:28.667292 1 flags.go:57] FLAG: --config-dir="/kube-dns-config" I0607 11:04:28.667296 1 flags.go:57] FLAG: --config-map="" I0607 11:04:28.667299 1 flags.go:57] FLAG: --config-map-namespace="kube-system" I0607 11:04:28.667302 1 flags.go:57] FLAG: --config-period="10s" I0607 11:04:28.667305 1 flags.go:57] FLAG: --dns-bind-address="0.0.0.0" I0607 11:04:28.667307 1 flags.go:57] FLAG: --dns-port="10053" I0607 11:04:28.667310 1 flags.go:57] FLAG: --domain="cluster.local." I0607 11:04:28.667320 1 flags.go:57] FLAG: --federations="" I0607 11:04:28.667323 1 flags.go:57] FLAG: --healthz-port="8081" I0607 11:04:28.667325 1 flags.go:57] FLAG: --initial-sync-timeout="1m0s" I0607 11:04:28.667327 1 flags.go:57] FLAG: --kube-master-url="" I0607 11:04:28.667330 1 flags.go:57] FLAG: --kubecfg-file="" I0607 11:04:28.667332 1 flags.go:57] FLAG: --log-backtrace-at=":0" I0607 11:04:28.667336 1 flags.go:57] FLAG: --log-dir="" I0607 11:04:28.667338 1 flags.go:57] FLAG: --log-file="" I0607 11:04:28.667340 1 flags.go:57] FLAG: --log-file-max-size="1800" I0607 11:04:28.667343 1 flags.go:57] FLAG: --log-flush-frequency="5s" I0607 11:04:28.667345 1 flags.go:57] FLAG: --logtostderr="true" I0607 11:04:28.667348 1 flags.go:57] FLAG: --nameservers="" I0607 11:04:28.667352 1 flags.go:57] FLAG: --one-output="false" I0607 11:04:28.667355 1 flags.go:57] FLAG: --profiling="false" I0607 11:04:28.667358 1 flags.go:57] FLAG: --skip-headers="false" I0607 11:04:28.667361 1 flags.go:57] FLAG: --skip-log-headers="false" I0607 11:04:28.667363 1 flags.go:57] FLAG: --stderrthreshold="2" I0607 11:04:28.667366 1 flags.go:57] FLAG: --v="2" I0607 11:04:28.667368 1 flags.go:57] FLAG: --version="false" I0607 11:04:28.667375 1 flags.go:57] FLAG: --vmodule="" I0607 11:04:28.667394 1 dns.go:49] version: 1.23.0-gke.20 I0607 11:04:28.667711 1 server.go:73] Using configuration read from directory: /kube-dns-config with period 10s I0607 11:04:28.667743 1 server.go:126] FLAG: --add-dir-header="false" I0607 11:04:28.667748 1 server.go:126] FLAG: --alsologtostderr="false" I0607 11:04:28.667750 1 server.go:126] FLAG: --config-dir="/kube-dns-config" I0607 11:04:28.667754 1 server.go:126] FLAG: --config-map="" I0607 11:04:28.667756 1 server.go:126] FLAG: --config-map-namespace="kube-system" I0607 11:04:28.667759 1 server.go:126] FLAG: --config-period="10s" I0607 11:04:28.667762 1 server.go:126] FLAG: --dns-bind-address="0.0.0.0" I0607 11:04:28.667765 1 server.go:126] FLAG: --dns-port="10053" I0607 11:04:28.667768 1 server.go:126] FLAG: --domain="cluster.local." I0607 11:04:28.667771 1 server.go:126] FLAG: --federations="" I0607 11:04:28.667774 1 server.go:126] FLAG: --healthz-port="8081" I0607 11:04:28.667777 1 server.go:126] FLAG: --initial-sync-timeout="1m0s" I0607 11:04:28.667779 1 server.go:126] FLAG: --kube-master-url="" I0607 11:04:28.667783 1 server.go:126] FLAG: --kubecfg-file="" I0607 11:04:28.667785 1 server.go:126] FLAG: --log-backtrace-at=":0" I0607 11:04:28.667788 1 server.go:126] FLAG: --log-dir="" I0607 11:04:28.667791 1 server.go:126] FLAG: --log-file="" I0607 11:04:28.667793 1 server.go:126] FLAG: --log-file-max-size="1800" I0607 11:04:28.667796 1 server.go:126] FLAG: --log-flush-frequency="5s" I0607 11:04:28.667799 1 server.go:126] FLAG: --logtostderr="true" I0607 11:04:28.667802 1 server.go:126] FLAG: --nameservers="" I0607 11:04:28.667804 1 server.go:126] FLAG: --one-output="false" I0607 11:04:28.667807 1 server.go:126] FLAG: --profiling="false" I0607 11:04:28.667810 1 server.go:126] FLAG: --skip-headers="false" I0607 11:04:28.667812 1 server.go:126] FLAG: --skip-log-headers="false" I0607 11:04:28.667815 1 server.go:126] FLAG: --stderrthreshold="2" I0607 11:04:28.667818 1 server.go:126] FLAG: --v="2" I0607 11:04:28.667820 1 server.go:126] FLAG: --version="false" I0607 11:04:28.667824 1 server.go:126] FLAG: --vmodule="" I0607 11:04:28.667983 1 server.go:182] Starting SkyDNS server (0.0.0.0:10053) I0607 11:04:28.668245 1 server.go:194] Skydns metrics enabled (/metrics:10055) I0607 11:04:28.668268 1 dns.go:190] Starting endpointsController I0607 11:04:28.668274 1 dns.go:193] Starting serviceController I0607 11:04:28.668411 1 log.go:245] skydns: ready for queries on cluster.local. for tcp://0.0.0.0:10053 [rcache 0] I0607 11:04:28.668394 1 dns.go:186] Configuration updated: {TypeMeta:{Kind: APIVersion:} Federations:map[] StubDomains:map[] UpstreamNameservers:[]} I0607 11:04:28.668437 1 log.go:245] skydns: ready for queries on cluster.local. for udp://0.0.0.0:10053 [rcache 0] I0607 11:04:29.169252 1 dns.go:224] Initialized services and endpoints from apiserver I0607 11:04:29.169311 1 server.go:150] Setting up Healthz Handler (/readiness) I0607 11:04:29.169339 1 server.go:155] Setting up cache handler (/cache) I0607 11:04:29.169350 1 server.go:136] Status HTTP port 8081 I0607 11:04:30.149604 1 main.go:78] opts: {{/usr/sbin/dnsmasq [-k --cache-size=1000 --no-negcache --dns-forward-max=1500 --log-facility=- --server=/cluster.local/127.0.0.1#10053 --server=/in-addr.arpa/127.0.0.1#10053 --server=/ip6.arpa/127.0.0.1#10053 --max-ttl=30 --max-cache-ttl=30 --max-tcp-connections=200] true} /etc/k8s/dns/dnsmasq-nanny 10000000000 127.0.0.1:10053} I0607 11:04:30.149799 1 nanny.go:124] Starting dnsmasq [-k --cache-size=1000 --no-negcache --dns-forward-max=1500 --log-facility=- --server=/cluster.local/127.0.0.1#10053 --server=/in-addr.arpa/127.0.0.1#10053 --server=/ip6.arpa/127.0.0.1#10053 --max-ttl=30 --max-cache-ttl=30 --max-tcp-connections=200] I0607 11:04:30.152306 1 nanny.go:149] W0607 11:04:30.152362 1 nanny.go:150] Got EOF from stdout I0607 11:04:30.152379 1 nanny.go:146] dnsmasq[11]: started, version 2.90 cachesize 1000 I0607 11:04:30.152405 1 nanny.go:146] dnsmasq[11]: compile time options: IPv6 GNU-getopt no-DBus no-UBus no-i18n no-IDN DHCP DHCPv6 no-Lua TFTP no-conntrack ipset no-nftset auth no-cryptohash no-DNSSEC loop-detect inotify dumpfile I0607 11:04:30.152415 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain cluster.local I0607 11:04:30.152418 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain in-addr.arpa I0607 11:04:30.152422 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain ip6.arpa I0607 11:04:30.152428 1 nanny.go:146] dnsmasq[11]: reading /etc/resolv.conf I0607 11:04:30.152435 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain cluster.local I0607 11:04:30.152438 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain in-addr.arpa I0607 11:04:30.152440 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain ip6.arpa I0607 11:04:30.152443 1 nanny.go:146] dnsmasq[11]: using nameserver 169.254.169.254#53 I0607 11:04:30.152445 1 nanny.go:146] dnsmasq[11]: read /etc/hosts - 9 names ==================================================================================================== ============================ Pod describe kube-dns-85c58c549b-r9zkl ============================ ==================================================================================================== Name: kube-dns-85c58c549b-r9zkl Namespace: kube-system Priority: 2000000000 Priority Class Name: system-cluster-critical Service Account: kube-dns Node: gke-xlou-cdm-default-pool-9d1e5395-4mc8/10.142.0.91 Start Time: Sat, 07 Jun 2025 10:44:48 +0000 Labels: k8s-app=kube-dns pod-template-hash=85c58c549b Annotations: components.gke.io/component-name: kubedns components.gke.io/component-version: 31.1.5 kubectl.kubernetes.io/restartedAt: 2024-04-10T15:47:12Z prometheus.io/port: 10054 prometheus.io/scrape: true scheduler.alpha.kubernetes.io/critical-pod: seccomp.security.alpha.kubernetes.io/pod: runtime/default Status: Running IP: 10.106.40.6 IPs: IP: 10.106.40.6 Controlled By: ReplicaSet/kube-dns-85c58c549b Containers: kubedns: Container ID: containerd://8e0937c04c71c59dc3e7bce2c648f148ee643e0a07795d231540edf51fa89912 Image: gke.gcr.io/k8s-dns-kube-dns:1.23.0-gke.20@sha256:b609a51c8aa4add2d1d0811737f177b4e944ea0781a48eead0d804722787f96f Image ID: gke.gcr.io/k8s-dns-kube-dns@sha256:b609a51c8aa4add2d1d0811737f177b4e944ea0781a48eead0d804722787f96f Ports: 10053/UDP, 10053/TCP Host Ports: 0/UDP, 0/TCP Args: --domain=cluster.local. --dns-port=10053 --config-dir=/kube-dns-config --v=2 State: Running Started: Sat, 07 Jun 2025 10:44:51 +0000 Ready: True Restart Count: 0 Limits: memory: 210Mi Requests: cpu: 100m memory: 70Mi Liveness: http-get http://:10054/healthcheck/kubedns delay=60s timeout=5s period=10s #success=1 #failure=5 Readiness: http-get http://:8081/readiness delay=3s timeout=5s period=10s #success=1 #failure=3 Environment: PROMETHEUS_PORT: 10055 Mounts: /kube-dns-config from kube-dns-config (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-stldh (ro) dnsmasq: Container ID: containerd://5b518920c0ab355998820622a868b58ae0798b164c1c386e8159641b1037c80f Image: gke.gcr.io/k8s-dns-dnsmasq-nanny:1.23.0-gke.20@sha256:e178b753d49a90ec32f1f45e0f52ce64019641d3fd45d8deadcf08cb73b8c840 Image ID: gke.gcr.io/k8s-dns-dnsmasq-nanny@sha256:e178b753d49a90ec32f1f45e0f52ce64019641d3fd45d8deadcf08cb73b8c840 Ports: 53/UDP, 53/TCP Host Ports: 0/UDP, 0/TCP Args: -v=2 -logtostderr -configDir=/etc/k8s/dns/dnsmasq-nanny -restartDnsmasq=true -- -k --cache-size=1000 --no-negcache --dns-forward-max=1500 --log-facility=- --server=/cluster.local/127.0.0.1#10053 --server=/in-addr.arpa/127.0.0.1#10053 --server=/ip6.arpa/127.0.0.1#10053 --max-ttl=30 --max-cache-ttl=30 --max-tcp-connections=200 State: Running Started: Sat, 07 Jun 2025 10:44:57 +0000 Ready: True Restart Count: 0 Requests: cpu: 150m memory: 20Mi Liveness: http-get http://:10054/healthcheck/dnsmasq delay=60s timeout=5s period=10s #success=1 #failure=5 Environment: Mounts: /etc/k8s/dns/dnsmasq-nanny from kube-dns-config (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-stldh (ro) sidecar: Container ID: containerd://c8a12fe37746a153ee67a7c9ea272f48e779f9add5b4f3d82761c9dd04aa73eb Image: gke.gcr.io/k8s-dns-sidecar:1.23.0-gke.20@sha256:9e60f83b54d010a7dd7e5a868a6713ad410442c72f0b7540cda010c50651c0bc Image ID: gke.gcr.io/k8s-dns-sidecar@sha256:9e60f83b54d010a7dd7e5a868a6713ad410442c72f0b7540cda010c50651c0bc Port: 10054/TCP Host Port: 0/TCP Args: --v=2 --logtostderr --probe=kubedns,127.0.0.1:10053,kubernetes.default.svc.cluster.local,5,SRV --probe=dnsmasq,127.0.0.1:53,kubernetes.default.svc.cluster.local,5,SRV State: Running Started: Sat, 07 Jun 2025 10:45:09 +0000 Ready: True Restart Count: 0 Requests: cpu: 10m memory: 20Mi Liveness: http-get http://:10054/metrics delay=60s timeout=5s period=10s #success=1 #failure=5 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-stldh (ro) prometheus-to-sd: Container ID: containerd://e6283f73dab8076ddf63b6ff5b3d09bbe7ef95738806f6b0c9c4b4fe5f45393f Image: gke.gcr.io/prometheus-to-sd:v0.11.12-gke.51@sha256:798127b7368b1a3a2851a6a336776739f32b0ed741d5d6ee07b97d6ac2998fa3 Image ID: gke.gcr.io/prometheus-to-sd@sha256:798127b7368b1a3a2851a6a336776739f32b0ed741d5d6ee07b97d6ac2998fa3 Port: Host Port: Command: /monitor --source=kubedns:http://localhost:10054?whitelisted=probe_kubedns_latency_ms,probe_kubedns_errors,probe_dnsmasq_latency_ms,probe_dnsmasq_errors,dnsmasq_misses,dnsmasq_hits --stackdriver-prefix=container.googleapis.com/internal/addons --api-override=https://monitoring.googleapis.com/ --pod-id=$(POD_NAME) --namespace-id=$(POD_NAMESPACE) --v=2 State: Running Started: Sat, 07 Jun 2025 10:45:11 +0000 Ready: True Restart Count: 0 Environment: POD_NAME: kube-dns-85c58c549b-r9zkl (v1:metadata.name) POD_NAMESPACE: kube-system (v1:metadata.namespace) Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-stldh (ro) kubedns-metrics-collector: Container ID: containerd://ca5cbf48797eeb739168b1a03f866c2d2e3c3cdd5e35c13dfc2da38fba93cc4b Image: gke.gcr.io/gke-metrics-collector:20250309_2300_RC0@sha256:2a1c8eae472870af33b3f5e1b7d57134c221c4a1d48281f3736edd640b24dbf9 Image ID: gke.gcr.io/gke-metrics-collector@sha256:2a1c8eae472870af33b3f5e1b7d57134c221c4a1d48281f3736edd640b24dbf9 Port: Host Port: State: Running Started: Sat, 07 Jun 2025 10:45:12 +0000 Ready: True Restart Count: 0 Limits: cpu: 1 memory: 30Mi Requests: cpu: 5m memory: 30Mi Environment: GOMAXPROCS: 2 COLLECTOR_CONFIG_PATH: /conf/kubedns-metrics-collector-config-data.textproto SPLIT_GAUGE_BUFFER: true PROJECT_NUMBER: 941969722215 LOCATION: us-east1-d CLUSTER_NAME: xlou-cdm POD_NAMESPACE: kube-system (v1:metadata.namespace) NODE_NAME: (v1:spec.nodeName) POD_NAME: kube-dns-85c58c549b-r9zkl (v1:metadata.name) CONTAINER_NAME: kubedns-metrics-collector COMPONENT_VERSION: (v1:metadata.annotations['components.gke.io/component-version']) COMPONENT_NAME: (v1:metadata.annotations['components.gke.io/component-name']) Mounts: /conf from kubedns-metrics-collector-config-map-vol (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-stldh (ro) Conditions: Type Status PodReadyToStartContainers True Initialized True Ready True ContainersReady True PodScheduled True Volumes: kube-dns-config: Type: ConfigMap (a volume populated by a ConfigMap) Name: kube-dns Optional: true kubedns-metrics-collector-config-map-vol: Type: ConfigMap (a volume populated by a ConfigMap) Name: kubedns-metrics-collector-config-map Optional: false kube-api-access-stldh: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Burstable Node-Selectors: kubernetes.io/os=linux Tolerations: CriticalAddonsOnly op=Exists components.gke.io/gke-managed-components op=Exists kubernetes.io/arch=arm64:NoSchedule node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: ==================================================================================================== ============================== Pod logs kube-dns-85c58c549b-r9zkl ============================== ==================================================================================================== I0607 10:45:11.325837 1 main.go:125] GCE config: &{Project:engineeringpit Zone:us-east1-d Cluster:xlou-cdm ClusterLocation:us-east1-d Instance:gke-xlou-cdm-default-pool-9d1e5395-4mc8 InstanceId:5738263334875670254} I0607 10:45:11.326066 1 main.go:194] Taking source configs from flags I0607 10:45:11.326080 1 main.go:196] Taking source configs from kubernetes api server I0607 10:45:11.326086 1 main.go:128] Built the following source configs: [0xc0000c24e0] I0607 10:45:11.326390 1 main.go:205] Running prometheus-to-sd, monitored target is kubedns http://localhost:10054 {"level":"info","ts":1749293112.3662958,"caller":"collector/main.go:47","msg":"Starting Metrics Collector","log_first_n":2,"log_interval(s)":3600} {"level":"info","ts":1749293112.3671777,"caller":"collector/multi_target_collector.go:50","msg":"Start Metrics Collector","target_url":"http://127.0.0.1:10055/metrics","target_name":"kubedns"} {"level":"info","ts":1749293112.3673098,"caller":"collector/collector.go:111","msg":"Connecting to Cloud Monitoring","target_name":"kubedns","endpoint":"monitoring.googleapis.com:443"} I0607 10:44:51.724733 1 flags.go:57] FLAG: --add-dir-header="false" I0607 10:44:51.724828 1 flags.go:57] FLAG: --alsologtostderr="false" I0607 10:44:51.724833 1 flags.go:57] FLAG: --config-dir="/kube-dns-config" I0607 10:44:51.724838 1 flags.go:57] FLAG: --config-map="" I0607 10:44:51.724841 1 flags.go:57] FLAG: --config-map-namespace="kube-system" I0607 10:44:51.724845 1 flags.go:57] FLAG: --config-period="10s" I0607 10:44:51.724850 1 flags.go:57] FLAG: --dns-bind-address="0.0.0.0" I0607 10:44:51.724853 1 flags.go:57] FLAG: --dns-port="10053" I0607 10:44:51.724858 1 flags.go:57] FLAG: --domain="cluster.local." I0607 10:44:51.724863 1 flags.go:57] FLAG: --federations="" I0607 10:44:51.724867 1 flags.go:57] FLAG: --healthz-port="8081" I0607 10:44:51.724870 1 flags.go:57] FLAG: --initial-sync-timeout="1m0s" I0607 10:44:51.724873 1 flags.go:57] FLAG: --kube-master-url="" I0607 10:44:51.724876 1 flags.go:57] FLAG: --kubecfg-file="" I0607 10:44:51.724878 1 flags.go:57] FLAG: --log-backtrace-at=":0" I0607 10:44:51.724885 1 flags.go:57] FLAG: --log-dir="" I0607 10:44:51.724888 1 flags.go:57] FLAG: --log-file="" I0607 10:44:51.724890 1 flags.go:57] FLAG: --log-file-max-size="1800" I0607 10:44:51.724892 1 flags.go:57] FLAG: --log-flush-frequency="5s" I0607 10:44:51.724894 1 flags.go:57] FLAG: --logtostderr="true" I0607 10:44:51.724897 1 flags.go:57] FLAG: --nameservers="" I0607 10:44:51.724899 1 flags.go:57] FLAG: --one-output="false" I0607 10:44:51.724901 1 flags.go:57] FLAG: --profiling="false" I0607 10:44:51.724904 1 flags.go:57] FLAG: --skip-headers="false" I0607 10:44:51.724906 1 flags.go:57] FLAG: --skip-log-headers="false" I0607 10:44:51.724908 1 flags.go:57] FLAG: --stderrthreshold="2" I0607 10:44:51.724910 1 flags.go:57] FLAG: --v="2" I0607 10:44:51.724912 1 flags.go:57] FLAG: --version="false" I0607 10:44:51.724917 1 flags.go:57] FLAG: --vmodule="" I0607 10:44:51.724933 1 dns.go:49] version: 1.23.0-gke.20 I0607 10:44:51.725270 1 server.go:73] Using configuration read from directory: /kube-dns-config with period 10s I0607 10:44:51.725298 1 server.go:126] FLAG: --add-dir-header="false" I0607 10:44:51.725306 1 server.go:126] FLAG: --alsologtostderr="false" I0607 10:44:51.725311 1 server.go:126] FLAG: --config-dir="/kube-dns-config" I0607 10:44:51.725315 1 server.go:126] FLAG: --config-map="" I0607 10:44:51.725319 1 server.go:126] FLAG: --config-map-namespace="kube-system" I0607 10:44:51.725323 1 server.go:126] FLAG: --config-period="10s" I0607 10:44:51.725327 1 server.go:126] FLAG: --dns-bind-address="0.0.0.0" I0607 10:44:51.725331 1 server.go:126] FLAG: --dns-port="10053" I0607 10:44:51.725336 1 server.go:126] FLAG: --domain="cluster.local." I0607 10:44:51.725341 1 server.go:126] FLAG: --federations="" I0607 10:44:51.725346 1 server.go:126] FLAG: --healthz-port="8081" I0607 10:44:51.725350 1 server.go:126] FLAG: --initial-sync-timeout="1m0s" I0607 10:44:51.725357 1 server.go:126] FLAG: --kube-master-url="" I0607 10:44:51.725360 1 server.go:126] FLAG: --kubecfg-file="" I0607 10:44:51.725364 1 server.go:126] FLAG: --log-backtrace-at=":0" I0607 10:44:51.725369 1 server.go:126] FLAG: --log-dir="" I0607 10:44:51.725373 1 server.go:126] FLAG: --log-file="" I0607 10:44:51.725377 1 server.go:126] FLAG: --log-file-max-size="1800" I0607 10:44:51.725381 1 server.go:126] FLAG: --log-flush-frequency="5s" I0607 10:44:51.725387 1 server.go:126] FLAG: --logtostderr="true" I0607 10:44:51.725391 1 server.go:126] FLAG: --nameservers="" I0607 10:44:51.725395 1 server.go:126] FLAG: --one-output="false" I0607 10:44:51.725398 1 server.go:126] FLAG: --profiling="false" I0607 10:44:51.725403 1 server.go:126] FLAG: --skip-headers="false" I0607 10:44:51.725407 1 server.go:126] FLAG: --skip-log-headers="false" I0607 10:44:51.725411 1 server.go:126] FLAG: --stderrthreshold="2" I0607 10:44:51.725415 1 server.go:126] FLAG: --v="2" I0607 10:44:51.725419 1 server.go:126] FLAG: --version="false" I0607 10:44:51.725423 1 server.go:126] FLAG: --vmodule="" I0607 10:44:51.725523 1 server.go:182] Starting SkyDNS server (0.0.0.0:10053) I0607 10:44:51.725699 1 server.go:194] Skydns metrics enabled (/metrics:10055) I0607 10:44:51.725714 1 dns.go:190] Starting endpointsController I0607 10:44:51.725722 1 dns.go:193] Starting serviceController I0607 10:44:51.725810 1 dns.go:186] Configuration updated: {TypeMeta:{Kind: APIVersion:} Federations:map[] StubDomains:map[] UpstreamNameservers:[]} I0607 10:44:51.725831 1 log.go:245] skydns: ready for queries on cluster.local. for tcp://0.0.0.0:10053 [rcache 0] I0607 10:44:51.725848 1 log.go:245] skydns: ready for queries on cluster.local. for udp://0.0.0.0:10053 [rcache 0] I0607 10:44:52.226171 1 dns.go:224] Initialized services and endpoints from apiserver I0607 10:44:52.226191 1 server.go:150] Setting up Healthz Handler (/readiness) I0607 10:44:52.226217 1 server.go:155] Setting up cache handler (/cache) I0607 10:44:52.226233 1 server.go:136] Status HTTP port 8081 I0607 10:44:57.431076 1 main.go:78] opts: {{/usr/sbin/dnsmasq [-k --cache-size=1000 --no-negcache --dns-forward-max=1500 --log-facility=- --server=/cluster.local/127.0.0.1#10053 --server=/in-addr.arpa/127.0.0.1#10053 --server=/ip6.arpa/127.0.0.1#10053 --max-ttl=30 --max-cache-ttl=30 --max-tcp-connections=200] true} /etc/k8s/dns/dnsmasq-nanny 10000000000 127.0.0.1:10053} I0607 10:44:57.431225 1 nanny.go:124] Starting dnsmasq [-k --cache-size=1000 --no-negcache --dns-forward-max=1500 --log-facility=- --server=/cluster.local/127.0.0.1#10053 --server=/in-addr.arpa/127.0.0.1#10053 --server=/ip6.arpa/127.0.0.1#10053 --max-ttl=30 --max-cache-ttl=30 --max-tcp-connections=200] I0607 10:44:57.432976 1 nanny.go:149] W0607 10:44:57.433010 1 nanny.go:150] Got EOF from stdout I0607 10:44:57.433026 1 nanny.go:146] dnsmasq[11]: started, version 2.90 cachesize 1000 I0607 10:44:57.433038 1 nanny.go:146] dnsmasq[11]: compile time options: IPv6 GNU-getopt no-DBus no-UBus no-i18n no-IDN DHCP DHCPv6 no-Lua TFTP no-conntrack ipset no-nftset auth no-cryptohash no-DNSSEC loop-detect inotify dumpfile I0607 10:44:57.433049 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain cluster.local I0607 10:44:57.433053 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain in-addr.arpa I0607 10:44:57.433057 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain ip6.arpa I0607 10:44:57.433063 1 nanny.go:146] dnsmasq[11]: reading /etc/resolv.conf I0607 10:44:57.433069 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain cluster.local I0607 10:44:57.433073 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain in-addr.arpa I0607 10:44:57.433076 1 nanny.go:146] dnsmasq[11]: using nameserver 127.0.0.1#10053 for domain ip6.arpa I0607 10:44:57.433079 1 nanny.go:146] dnsmasq[11]: using nameserver 169.254.169.254#53 I0607 10:44:57.433085 1 nanny.go:146] dnsmasq[11]: read /etc/hosts - 9 names Flag --logtostderr has been deprecated, will be removed in a future release, see https://github.com/kubernetes/enhancements/tree/master/keps/sig-instrumentation/2845-deprecate-klog-specific-flags-in-k8s-components I0607 10:45:09.985352 1 flags.go:57] FLAG: --add-dir-header="false" I0607 10:45:09.985957 1 flags.go:57] FLAG: --alsologtostderr="false" I0607 10:45:09.985963 1 flags.go:57] FLAG: --dnsmasq-addr="127.0.0.1" I0607 10:45:09.985968 1 flags.go:57] FLAG: --dnsmasq-poll-interval-ms="5000" I0607 10:45:09.985973 1 flags.go:57] FLAG: --dnsmasq-port="53" I0607 10:45:09.985978 1 flags.go:57] FLAG: --log-backtrace-at=":0" I0607 10:45:09.985994 1 flags.go:57] FLAG: --log-dir="" I0607 10:45:09.986001 1 flags.go:57] FLAG: --log-file="" I0607 10:45:09.986021 1 flags.go:57] FLAG: --log-file-max-size="1800" I0607 10:45:09.986027 1 flags.go:57] FLAG: --log-flush-frequency="5s" I0607 10:45:09.986032 1 flags.go:57] FLAG: --logtostderr="true" I0607 10:45:09.986036 1 flags.go:57] FLAG: --one-output="false" I0607 10:45:09.986042 1 flags.go:57] FLAG: --probe="[{Label:kubedns Server:127.0.0.1:10053 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33} {Label:dnsmasq Server:127.0.0.1:53 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33}]" I0607 10:45:09.986094 1 flags.go:57] FLAG: --prometheus-addr="0.0.0.0" I0607 10:45:09.986104 1 flags.go:57] FLAG: --prometheus-namespace="kubedns" I0607 10:45:09.986109 1 flags.go:57] FLAG: --prometheus-path="/metrics" I0607 10:45:09.986114 1 flags.go:57] FLAG: --prometheus-port="10054" I0607 10:45:09.986120 1 flags.go:57] FLAG: --skip-headers="false" I0607 10:45:09.986123 1 flags.go:57] FLAG: --skip-log-headers="false" I0607 10:45:09.986126 1 flags.go:57] FLAG: --stderrthreshold="2" I0607 10:45:09.986132 1 flags.go:57] FLAG: --v="2" I0607 10:45:09.986136 1 flags.go:57] FLAG: --version="false" I0607 10:45:09.986148 1 flags.go:57] FLAG: --vmodule="" I0607 10:45:09.986162 1 main.go:55] Version v1.23.0-gke.20 I0607 10:45:09.986173 1 server.go:46] Starting server (options {DnsMasqPort:53 DnsMasqAddr:127.0.0.1 DnsMasqPollIntervalMs:5000 Probes:[{Label:kubedns Server:127.0.0.1:10053 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33} {Label:dnsmasq Server:127.0.0.1:53 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33}] PrometheusAddr:0.0.0.0 PrometheusPort:10054 PrometheusPath:/metrics PrometheusNamespace:kubedns}) I0607 10:45:09.986832 1 dnsprobe.go:75] Starting dnsProbe {Label:kubedns Server:127.0.0.1:10053 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33} I0607 10:45:09.986918 1 dnsprobe.go:75] Starting dnsProbe {Label:dnsmasq Server:127.0.0.1:53 Name:kubernetes.default.svc.cluster.local. Interval:5s Type:33}