--Task-- name: revert_environment_variables enabled: True class_name: RevertEnvironmentVariables source_name: controller source_namespace: >default< target_name: controller target_namespace: >default< start: 0.0 stop: None timeout: not yet initialized for this Task as timeout was not explicitly defined, see updates below loop: False interval: None dependencies: [] wait_for: [] preceding_task: None options: {} group_name: None Current dir: /mnt/disk1/xslou/workshop/lodestar-fork/pyrock 2025-09-15 23:53:32 - INFO: Timeout for this Task has changed to 5m (300 seconds) 2025-09-15 23:53:32 - INFO: timeout was set to Task default (1.2x self.expected_duration) or 300 seconds (whatever is higher)), because it was unset 2025-09-15 23:53:32 - INFO: Interval for this Task has changed to 5s (5 seconds) 2025-09-15 23:53:32 - INFO: interval was set to Task default because it was unset, based on self.timeout value because task is allowed to stop by itself ________________________________________________________________________________ [2025-09-15 23:53:32] revert_environment_variables step1 : N/A ________________________________________________________________________________ 2025-09-15 23:53:32,236 INFO Reverting environment variables for am 2025-09-15 23:53:32,681 ERROR [loop_until]: Function failed after 0s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:53:38,061 ERROR [loop_until]: Function failed after 5s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:53:43,412 ERROR [loop_until]: Function failed after 11s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:53:48,769 ERROR [loop_until]: Function failed after 16s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:53:54,126 ERROR [loop_until]: Function failed after 21s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:53:59,477 ERROR [loop_until]: Function failed after 27s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:04,839 ERROR [loop_until]: Function failed after 32s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:10,191 ERROR [loop_until]: Function failed after 37s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:15,543 ERROR [loop_until]: Function failed after 43s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:20,896 ERROR [loop_until]: Function failed after 48s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:26,244 ERROR [loop_until]: Function failed after 54s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:31,597 ERROR [loop_until]: Function failed after 59s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:36,953 ERROR [loop_until]: Function failed after 1m 04s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:42,390 ERROR [loop_until]: Function failed after 1m 10s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:47,746 ERROR [loop_until]: Function failed after 1m 15s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:53,130 ERROR [loop_until]: Function failed after 1m 20s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:54:58,483 ERROR [loop_until]: Function failed after 1m 26s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:03,831 ERROR [loop_until]: Function failed after 1m 31s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:09,184 ERROR [loop_until]: Function failed after 1m 36s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:14,540 ERROR [loop_until]: Function failed after 1m 42s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:19,892 ERROR [loop_until]: Function failed after 1m 47s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:25,245 ERROR [loop_until]: Function failed after 1m 53s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:30,594 ERROR [loop_until]: Function failed after 1m 58s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:35,991 ERROR [loop_until]: Function failed after 2m 03s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:41,344 ERROR [loop_until]: Function failed after 2m 09s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:46,694 ERROR [loop_until]: Function failed after 2m 14s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:52,048 ERROR [loop_until]: Function failed after 2m 19s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:55:57,409 ERROR [loop_until]: Function failed after 2m 25s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:02,764 ERROR [loop_until]: Function failed after 2m 30s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:08,120 ERROR [loop_until]: Function failed after 2m 35s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:13,472 ERROR [loop_until]: Function failed after 2m 41s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:18,820 ERROR [loop_until]: Function failed after 2m 46s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:24,172 ERROR [loop_until]: Function failed after 2m 51s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:29,524 ERROR [loop_until]: Function failed after 2m 57s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:34,882 ERROR [loop_until]: Function failed after 3m 02s (rc=1 - expected to be in [0]) - retry; CMD output was: CMD error was: Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:34,882 ERROR [loop_until]: rc=1, expected [0] 2025-09-15 23:56:34,882 DEBUG --- stdout --- 2025-09-15 23:56:34,882 DEBUG 2025-09-15 23:56:34,882 DEBUG --- stderr --- 2025-09-15 23:56:34,882 DEBUG Error from server (NotFound): namespaces "fr-platform" not found 2025-09-15 23:56:34 - INFO: Traceback (most recent call last): File "/mnt/disk1/xslou/workshop/lodestar-fork/pyrock/lib/scheduler/tasks/Task.py", line 642, in run self._run() File "/mnt/disk1/xslou/workshop/lodestar-fork/pyrock/lib/scheduler/tasks/StepTask.py", line 57, in _run self._run_method(step) File "/mnt/disk1/xslou/workshop/lodestar-fork/pyrock/lib/scheduler/tasks/Task.py", line 683, in _run_method exec("self.%s()" % method) File "", line 1, in File "/mnt/disk1/xslou/workshop/lodestar-fork/pyrock/tasks/deployment/utility_actions.py", line 45, in step1 pyrock_run.deployment.revert_env_vars() File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/multinamespace_deployment.py", line 149, in revert_env_vars deployment.revert_env_vars() File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/deployment_idc.py", line 159, in revert_env_vars component.revert_env_vars() File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/components/component.py", line 1272, in revert_env_vars component = kubectl( ^^^^^^^^ File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/cloud_utils.py", line 161, in kubectl return __kubectl( ^^^^^^^^^^ File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/cloud_utils.py", line 279, in __kubectl return cmd.loop_until( ^^^^^^^^^^^^^^^ File "/mnt/disk1/xslou/workshop/lodestar-fork/shared/lib/utils/cmd/cmd.py", line 664, in loop_until raise FailException(message=exception_message) shared.lib.utils.exception.FailException: [loop_until]: rc=1, expected [0] Setting result to FAIL Task has been successfully stopped